[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:11.519930 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:43047
I20260709 13:07:11.522890 14097 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:11.524245 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:11.549546 14103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:11.549537 14106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:11.550122 14104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:12.881054 14105 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:07:12.881189 14097 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:07:12.887110 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:12.887516 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:12.887794 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602432887756 us; error 0 us; skew 500 ppm
I20260709 13:07:12.888901 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:12.896690 14097 webserver.cc:533] Webserver started at http://127.13.196.126:41555/ using document root <none> and password file <none>
I20260709 13:07:12.897831 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:12.898147 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:12.898730 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:12.907120 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "0e6b2fceffff4b69a3cf18489b916a07"
format_stamp: "Formatted at 2026-07-09 13:07:12 on dist-test-slave-ftjc"
I20260709 13:07:12.918376 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:07:12.925244 14112 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:12.926908 14097 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:07:12.927384 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "0e6b2fceffff4b69a3cf18489b916a07"
format_stamp: "Formatted at 2026-07-09 13:07:12 on dist-test-slave-ftjc"
I20260709 13:07:12.927802 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:12.996165 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:12.998185 14097 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:07:12.998783 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.096007 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:43047
I20260709 13:07:13.096009 14163 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:43047 every 8 connection(s)
I20260709 13:07:13.108552 14164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.138579 14164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07: Bootstrap starting.
I20260709 13:07:13.145704 14164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.147790 14164 log.cc:826] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07: Log is configured to *not* fsync() on all Append() calls
I20260709 13:07:13.154282 14164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07: No bootstrap required, opened a new log
I20260709 13:07:13.182826 14164 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6b2fceffff4b69a3cf18489b916a07" member_type: VOTER }
I20260709 13:07:13.183565 14164 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.183911 14164 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e6b2fceffff4b69a3cf18489b916a07, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.185268 14164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6b2fceffff4b69a3cf18489b916a07" member_type: VOTER }
I20260709 13:07:13.185880 14164 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:13.186208 14164 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:13.186679 14164 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.192199 14164 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6b2fceffff4b69a3cf18489b916a07" member_type: VOTER }
I20260709 13:07:13.193966 14164 leader_election.cc:304] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e6b2fceffff4b69a3cf18489b916a07; no voters: 
I20260709 13:07:13.196657 14164 leader_election.cc:290] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:13.197190 14167 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.200740 14167 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 1 LEADER]: Becoming Leader. State: Replica: 0e6b2fceffff4b69a3cf18489b916a07, State: Running, Role: LEADER
I20260709 13:07:13.201841 14167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6b2fceffff4b69a3cf18489b916a07" member_type: VOTER }
I20260709 13:07:13.203045 14164 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:13.216804 14169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e6b2fceffff4b69a3cf18489b916a07. Latest consensus state: current_term: 1 leader_uuid: "0e6b2fceffff4b69a3cf18489b916a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6b2fceffff4b69a3cf18489b916a07" member_type: VOTER } }
I20260709 13:07:13.217562 14169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:13.217116 14168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e6b2fceffff4b69a3cf18489b916a07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e6b2fceffff4b69a3cf18489b916a07" member_type: VOTER } }
I20260709 13:07:13.218205 14168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:13.221334 14175 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:13.234858 14175 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:13.243278 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:13.260720 14175 catalog_manager.cc:1383] Generated new cluster ID: fcd042a8a8c842a2aa427386c9b1c4df
I20260709 13:07:13.261113 14175 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:13.283063 14175 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:13.285168 14175 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:13.301855 14175 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07: Generated new TSK 0
I20260709 13:07:13.303095 14175 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:13.311872 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:13.323608 14186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:13.325253 14187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.330844 14097 server_base.cc:1061] running on GCE node
W20260709 13:07:13.331508 14189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.332703 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:13.332960 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:13.333160 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602433333139 us; error 0 us; skew 500 ppm
I20260709 13:07:13.333820 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:13.339391 14097 webserver.cc:533] Webserver started at http://127.13.196.65:33383/ using document root <none> and password file <none>
I20260709 13:07:13.340082 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:13.340399 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:13.340771 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:13.342131 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "0a149379ee76471486be2b9ebfecd41c"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-ftjc"
I20260709 13:07:13.350462 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:07:13.356524 14194 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.357865 14097 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:07:13.358461 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "0a149379ee76471486be2b9ebfecd41c"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-ftjc"
I20260709 13:07:13.359015 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:13.386368 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:13.388206 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.392385 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:13.398370 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:13.398739 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.399050 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:13.399268 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.531584 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:40383
I20260709 13:07:13.531693 14256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:40383 every 8 connection(s)
I20260709 13:07:13.541257 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:13.560405 14261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:13.562932 14262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.569865 14097 server_base.cc:1061] running on GCE node
W20260709 13:07:13.571292 14264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.572535 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:13.572825 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:13.573029 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602433573007 us; error 0 us; skew 500 ppm
I20260709 13:07:13.573859 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:13.577853 14097 webserver.cc:533] Webserver started at http://127.13.196.66:41151/ using document root <none> and password file <none>
I20260709 13:07:13.578536 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:13.578840 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:13.579237 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:13.580824 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "805e8170bc1444e9998b86a2cdb8eac2"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-ftjc"
I20260709 13:07:13.583343 14257 heartbeater.cc:344] Connected to a master server at 127.13.196.126:43047
I20260709 13:07:13.583935 14257 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:13.585610 14257 heartbeater.cc:507] Master 127.13.196.126:43047 requested a full tablet report, sending...
I20260709 13:07:13.589525 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:07:13.591135 14129 ts_manager.cc:194] Registered new tserver with Master: 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383)
I20260709 13:07:13.595758 14129 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39788
I20260709 13:07:13.598132 14269 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.599931 14097 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:07:13.600441 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "805e8170bc1444e9998b86a2cdb8eac2"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-ftjc"
I20260709 13:07:13.600842 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:13.625669 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:13.627766 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.630878 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:13.635346 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:13.635703 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.636019 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:13.636241 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.744027 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:34769
I20260709 13:07:13.744163 14331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:34769 every 8 connection(s)
I20260709 13:07:13.752943 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:13.767076 14335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.771462 14332 heartbeater.cc:344] Connected to a master server at 127.13.196.126:43047
I20260709 13:07:13.772120 14332 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:13.773631 14332 heartbeater.cc:507] Master 127.13.196.126:43047 requested a full tablet report, sending...
W20260709 13:07:13.777298 14336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.777374 14129 ts_manager.cc:194] Registered new tserver with Master: 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:13.779700 14129 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39798
W20260709 13:07:13.782261 14338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.783726 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:13.784880 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:13.785140 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:13.785359 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602433785328 us; error 0 us; skew 500 ppm
I20260709 13:07:13.785993 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:13.789305 14097 webserver.cc:533] Webserver started at http://127.13.196.67:39495/ using document root <none> and password file <none>
I20260709 13:07:13.789943 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:13.790176 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:13.790510 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:13.791728 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-ftjc"
I20260709 13:07:13.797363 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:07:13.801915 14343 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.803143 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:07:13.803555 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-ftjc"
I20260709 13:07:13.803997 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:13.817070 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:13.819213 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.821720 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:13.825603 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:13.825971 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.826308 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:13.826534 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.941061 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:40541
I20260709 13:07:13.941156 14405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:40541 every 8 connection(s)
I20260709 13:07:13.966212 14406 heartbeater.cc:344] Connected to a master server at 127.13.196.126:43047
I20260709 13:07:13.966732 14406 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:13.967875 14406 heartbeater.cc:507] Master 127.13.196.126:43047 requested a full tablet report, sending...
I20260709 13:07:13.970561 14129 ts_manager.cc:194] Registered new tserver with Master: 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:13.970911 14097 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022981118s
I20260709 13:07:13.972229 14129 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39812
I20260709 13:07:14.038872 14129 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39814:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:14.043488 14129 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:14.178905 14371 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4f4b29897a42a0829022bd088295fe (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:14.177660 14370 tablet_service.cc:1511] Processing CreateTablet for tablet e56eda67f3ee46b0b9a9835281d0ddae (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:14.186399 14371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4f4b29897a42a0829022bd088295fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.185109 14369 tablet_service.cc:1511] Processing CreateTablet for tablet f93e3995712f43acbdafec6e2b4651cd (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:14.183946 14368 tablet_service.cc:1511] Processing CreateTablet for tablet f862fd002c9c4cf3b325f30fef1c3daa (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:14.195640 14370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56eda67f3ee46b0b9a9835281d0ddae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.196789 14363 tablet_service.cc:1511] Processing CreateTablet for tablet bad0b617b078401a85493f197ea64708 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:14.198885 14363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad0b617b078401a85493f197ea64708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.189433 14366 tablet_service.cc:1511] Processing CreateTablet for tablet e11aaa55d06d4f51b65d851450e26c58 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:14.191802 14364 tablet_service.cc:1511] Processing CreateTablet for tablet 1c49430a4ad749e3a448ac608a7a3a3d (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:14.189368 14367 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbb6b07376c49f9b4e5e04ff1bee16f (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:14.202620 14369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93e3995712f43acbdafec6e2b4651cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.203691 14365 tablet_service.cc:1511] Processing CreateTablet for tablet 46d29b6dd89c4c358d70bab44e5c6681 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:14.209256 14368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f862fd002c9c4cf3b325f30fef1c3daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.223469 14295 tablet_service.cc:1511] Processing CreateTablet for tablet f93e3995712f43acbdafec6e2b4651cd (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:14.233346 14296 tablet_service.cc:1511] Processing CreateTablet for tablet e56eda67f3ee46b0b9a9835281d0ddae (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:14.240177 14297 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4f4b29897a42a0829022bd088295fe (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION VALUES < 238609294
W20260709 13:07:14.243615 14177 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:14.245918 14295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93e3995712f43acbdafec6e2b4651cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.249462 14297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4f4b29897a42a0829022bd088295fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.263553 14296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56eda67f3ee46b0b9a9835281d0ddae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.268198 14364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c49430a4ad749e3a448ac608a7a3a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.271483 14366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e11aaa55d06d4f51b65d851450e26c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.280134 14365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d29b6dd89c4c358d70bab44e5c6681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.297185 14293 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbb6b07376c49f9b4e5e04ff1bee16f (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:14.301931 14367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbb6b07376c49f9b4e5e04ff1bee16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.283232 14294 tablet_service.cc:1511] Processing CreateTablet for tablet f862fd002c9c4cf3b325f30fef1c3daa (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:14.322047 14293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbb6b07376c49f9b4e5e04ff1bee16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.324429 14292 tablet_service.cc:1511] Processing CreateTablet for tablet e11aaa55d06d4f51b65d851450e26c58 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:14.329489 14294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f862fd002c9c4cf3b325f30fef1c3daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.337026 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e11aaa55d06d4f51b65d851450e26c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.332249 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 46d29b6dd89c4c358d70bab44e5c6681 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:14.344668 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d29b6dd89c4c358d70bab44e5c6681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.356514 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 1c49430a4ad749e3a448ac608a7a3a3d (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:14.368026 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c49430a4ad749e3a448ac608a7a3a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.379374 14289 tablet_service.cc:1511] Processing CreateTablet for tablet bad0b617b078401a85493f197ea64708 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:14.389642 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad0b617b078401a85493f197ea64708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.454480 14424 tablet_bootstrap.cc:492] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:14.493680 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbb6b07376c49f9b4e5e04ff1bee16f (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:14.514377 14219 tablet_service.cc:1511] Processing CreateTablet for tablet f862fd002c9c4cf3b325f30fef1c3daa (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:14.517251 14219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f862fd002c9c4cf3b325f30fef1c3daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.505914 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 46d29b6dd89c4c358d70bab44e5c6681 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:14.524251 14215 tablet_service.cc:1511] Processing CreateTablet for tablet 1c49430a4ad749e3a448ac608a7a3a3d (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:14.528975 14222 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4f4b29897a42a0829022bd088295fe (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:14.518694 14220 tablet_service.cc:1511] Processing CreateTablet for tablet f93e3995712f43acbdafec6e2b4651cd (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:14.531538 14425 tablet_bootstrap.cc:492] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:14.532199 14214 tablet_service.cc:1511] Processing CreateTablet for tablet bad0b617b078401a85493f197ea64708 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:14.524569 14217 tablet_service.cc:1511] Processing CreateTablet for tablet e11aaa55d06d4f51b65d851450e26c58 (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:14.526497 14221 tablet_service.cc:1511] Processing CreateTablet for tablet e56eda67f3ee46b0b9a9835281d0ddae (DEFAULT_TABLE table=test-workload [id=2c4fb4ce2f6242d48efa10e191cf0a76]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:14.535948 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbb6b07376c49f9b4e5e04ff1bee16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.544260 14222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4f4b29897a42a0829022bd088295fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.546877 14221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56eda67f3ee46b0b9a9835281d0ddae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.557233 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c49430a4ad749e3a448ac608a7a3a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.563226 14220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93e3995712f43acbdafec6e2b4651cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.564599 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e11aaa55d06d4f51b65d851450e26c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.569016 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d29b6dd89c4c358d70bab44e5c6681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.590984 14424 tablet_bootstrap.cc:654] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.593021 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad0b617b078401a85493f197ea64708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:14.601614 14257 heartbeater.cc:499] Master 127.13.196.126:43047 was elected leader, sending a full tablet report...
I20260709 13:07:14.624177 14424 tablet_bootstrap.cc:492] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:14.626426 14424 ts_tablet_manager.cc:1403] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.173s	user 0.021s	sys 0.010s
I20260709 13:07:14.637697 14424 raft_consensus.cc:359] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.639081 14424 raft_consensus.cc:385] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.639688 14424 raft_consensus.cc:740] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.644078 14424 consensus_queue.cc:260] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.658951 14425 tablet_bootstrap.cc:654] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.685267 14406 heartbeater.cc:499] Master 127.13.196.126:43047 was elected leader, sending a full tablet report...
I20260709 13:07:14.689306 14424 ts_tablet_manager.cc:1434] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.059s	user 0.022s	sys 0.013s
I20260709 13:07:14.690764 14424 tablet_bootstrap.cc:492] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
W20260709 13:07:14.700958 14407 tablet.cc:2406] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:14.700953 14425 tablet_bootstrap.cc:492] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:14.702798 14424 tablet_bootstrap.cc:654] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.704188 14425 ts_tablet_manager.cc:1403] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.206s	user 0.013s	sys 0.012s
I20260709 13:07:14.707719 14429 tablet_bootstrap.cc:492] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:14.718256 14429 tablet_bootstrap.cc:654] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.722321 14425 raft_consensus.cc:359] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:14.723670 14425 raft_consensus.cc:385] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.727844 14424 tablet_bootstrap.cc:492] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:14.732563 14425 raft_consensus.cc:740] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.732916 14424 ts_tablet_manager.cc:1403] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.009s
I20260709 13:07:14.733588 14425 consensus_queue.cc:260] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:14.728722 14429 tablet_bootstrap.cc:492] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:14.735718 14429 ts_tablet_manager.cc:1403] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.012s
I20260709 13:07:14.736554 14332 heartbeater.cc:499] Master 127.13.196.126:43047 was elected leader, sending a full tablet report...
I20260709 13:07:14.740805 14424 raft_consensus.cc:359] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.741750 14424 raft_consensus.cc:385] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.742100 14424 raft_consensus.cc:740] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.743572 14425 ts_tablet_manager.cc:1434] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:07:14.743129 14424 consensus_queue.cc:260] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.745818 14424 ts_tablet_manager.cc:1434] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:14.747052 14424 tablet_bootstrap.cc:492] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:14.747258 14425 tablet_bootstrap.cc:492] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:14.742096 14429 raft_consensus.cc:359] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:14.753378 14429 raft_consensus.cc:385] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.753755 14429 raft_consensus.cc:740] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.755232 14425 tablet_bootstrap.cc:654] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.754665 14429 consensus_queue.cc:260] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:14.765714 14424 tablet_bootstrap.cc:654] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.771245 14429 ts_tablet_manager.cc:1434] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.004s
I20260709 13:07:14.772750 14429 tablet_bootstrap.cc:492] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:14.781381 14429 tablet_bootstrap.cc:654] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.789511 14425 tablet_bootstrap.cc:492] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:14.790346 14425 ts_tablet_manager.cc:1403] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.043s	user 0.032s	sys 0.000s
I20260709 13:07:14.795512 14425 raft_consensus.cc:359] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.796852 14425 raft_consensus.cc:385] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.797212 14425 raft_consensus.cc:740] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.798156 14429 tablet_bootstrap.cc:492] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:14.798780 14429 ts_tablet_manager.cc:1403] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:07:14.798341 14425 consensus_queue.cc:260] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.799964 14424 tablet_bootstrap.cc:492] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:14.800599 14424 ts_tablet_manager.cc:1403] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.015s
I20260709 13:07:14.801702 14425 ts_tablet_manager.cc:1434] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:07:14.802894 14425 tablet_bootstrap.cc:492] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:14.803810 14429 raft_consensus.cc:359] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.804713 14429 raft_consensus.cc:385] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.804194 14424 raft_consensus.cc:359] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.805166 14424 raft_consensus.cc:385] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.805042 14429 raft_consensus.cc:740] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.805531 14424 raft_consensus.cc:740] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.806210 14429 consensus_queue.cc:260] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.806555 14424 consensus_queue.cc:260] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.808903 14429 ts_tablet_manager.cc:1434] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 13:07:14.810003 14429 tablet_bootstrap.cc:492] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:14.811249 14433 raft_consensus.cc:493] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.811875 14425 tablet_bootstrap.cc:654] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.811864 14433 raft_consensus.cc:515] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:14.819676 14429 tablet_bootstrap.cc:654] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.843956 14425 tablet_bootstrap.cc:492] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:14.844610 14425 ts_tablet_manager.cc:1403] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.026s
I20260709 13:07:14.848035 14425 raft_consensus.cc:359] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.849014 14425 raft_consensus.cc:385] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.849363 14425 raft_consensus.cc:740] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.850194 14425 consensus_queue.cc:260] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.851126 14433 leader_election.cc:290] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:14.854571 14425 ts_tablet_manager.cc:1434] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:07:14.855737 14425 tablet_bootstrap.cc:492] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:14.857592 14424 ts_tablet_manager.cc:1434] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:07:14.863831 14425 tablet_bootstrap.cc:654] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.864252 14424 tablet_bootstrap.cc:492] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:14.886123 14429 tablet_bootstrap.cc:492] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:14.888209 14429 ts_tablet_manager.cc:1403] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.017s
I20260709 13:07:14.894799 14432 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.895864 14432 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.921278 14432 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:14.924430 14425 tablet_bootstrap.cc:492] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:14.925371 14429 raft_consensus.cc:359] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.917729 14444 raft_consensus.cc:493] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.928411 14429 raft_consensus.cc:385] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.930568 14433 raft_consensus.cc:493] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.932242 14433 raft_consensus.cc:515] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.929944 14425 ts_tablet_manager.cc:1403] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.024s
I20260709 13:07:14.937662 14433 leader_election.cc:290] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:14.930932 14429 raft_consensus.cc:740] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.943111 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:14.941661 14306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:14.941656 14429 consensus_queue.cc:260] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.949566 14424 tablet_bootstrap.cc:654] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.929428 14444 raft_consensus.cc:515] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:14.966259 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:14.970949 14427 raft_consensus.cc:493] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.971737 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:14.972097 14427 raft_consensus.cc:515] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:14.974399 14429 ts_tablet_manager.cc:1434] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.084s	user 0.013s	sys 0.000s
I20260709 13:07:14.964293 14307 raft_consensus.cc:2468] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 0.
W20260709 13:07:14.989204 14197 leader_election.cc:343] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:14.990373 14197 leader_election.cc:343] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.990520 14427 leader_election.cc:290] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:14.994370 14429 tablet_bootstrap.cc:492] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:14.983820 14425 raft_consensus.cc:359] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.004653 14425 raft_consensus.cc:385] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.007507 14425 raft_consensus.cc:740] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.008594 14425 consensus_queue.cc:260] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.016794 14306 raft_consensus.cc:2468] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 0.
I20260709 13:07:15.013463 14196 leader_election.cc:304] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:15.020375 14433 raft_consensus.cc:2804] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.020920 14433 raft_consensus.cc:493] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.021306 14433 raft_consensus.cc:3060] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.033038 14196 leader_election.cc:304] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:15.053505 14425 ts_tablet_manager.cc:1434] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.006s
I20260709 13:07:15.054389 14444 leader_election.cc:290] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541), 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383)
I20260709 13:07:15.055965 14425 tablet_bootstrap.cc:492] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:15.071189 14424 tablet_bootstrap.cc:492] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:15.072101 14424 ts_tablet_manager.cc:1403] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.208s	user 0.031s	sys 0.019s
I20260709 13:07:15.095808 14433 raft_consensus.cc:515] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:15.103256 14427 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.104647 14427 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.109074 14452 raft_consensus.cc:2804] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:15.109069 14196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:34769, user_credentials={real_user=slave}} blocked reactor thread for 76278.7us
I20260709 13:07:15.113814 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.095952 14424 raft_consensus.cc:359] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.116446 14424 raft_consensus.cc:385] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.116868 14424 raft_consensus.cc:740] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.118189 14427 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.109757 14452 raft_consensus.cc:493] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:15.116786 14197 leader_election.cc:343] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.123628 14433 leader_election.cc:290] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 election: Requested vote from peers 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.121112 14452 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.118180 14424 consensus_queue.cc:260] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.128902 14306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:15.130481 14232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.131803 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.132061 14427 raft_consensus.cc:493] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.132623 14381 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.131174 14306 raft_consensus.cc:3060] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.135403 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
W20260709 13:07:15.135375 14272 leader_election.cc:343] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.135785 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.141400 14231 raft_consensus.cc:2393] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 805e8170bc1444e9998b86a2cdb8eac2 in current term 1: Already voted for candidate 0a149379ee76471486be2b9ebfecd41c in this term.
I20260709 13:07:15.136505 14427 raft_consensus.cc:515] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.144594 14272 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 0a149379ee76471486be2b9ebfecd41c
I20260709 13:07:15.147132 14444 raft_consensus.cc:2804] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.147912 14444 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:15.148011 14272 leader_election.cc:343] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.148377 14444 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.150421 14272 leader_election.cc:304] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 805e8170bc1444e9998b86a2cdb8eac2; no voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:15.154656 14427 leader_election.cc:290] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.164958 14429 tablet_bootstrap.cc:654] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.163826 14424 ts_tablet_manager.cc:1434] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.091s	user 0.012s	sys 0.000s
I20260709 13:07:15.168985 14425 tablet_bootstrap.cc:654] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.167240 14444 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.168790 14427 raft_consensus.cc:493] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.183106 14306 raft_consensus.cc:2468] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 1.
I20260709 13:07:15.183911 14432 raft_consensus.cc:2749] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.182843 14427 raft_consensus.cc:515] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.185901 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.182113 14424 tablet_bootstrap.cc:492] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:15.187383 14432 raft_consensus.cc:493] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.191309 14272 leader_election.cc:343] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.190984 14432 raft_consensus.cc:515] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.191725 14196 leader_election.cc:304] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:15.194304 14444 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.194767 14433 raft_consensus.cc:2804] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.187799 14427 leader_election.cc:290] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.198114 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.198855 14380 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.203151 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.205278 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
W20260709 13:07:15.205652 14272 leader_election.cc:343] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.204070 14432 leader_election.cc:290] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
W20260709 13:07:15.215684 14272 leader_election.cc:343] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.217537 14232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.218752 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:15.218941 14272 leader_election.cc:304] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 805e8170bc1444e9998b86a2cdb8eac2; no voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:15.221256 14305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:15.222445 14305 raft_consensus.cc:2468] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 0.
I20260709 13:07:15.224130 14307 raft_consensus.cc:2393] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b5da3bc4d874b6a9c0577fd3efc216c in current term 1: Already voted for candidate 805e8170bc1444e9998b86a2cdb8eac2 in this term.
I20260709 13:07:15.224256 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.227114 14306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:15.227895 14345 leader_election.cc:304] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.224946 14432 raft_consensus.cc:2749] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.230983 14427 raft_consensus.cc:2804] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.228686 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.233750 14427 raft_consensus.cc:493] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.226476 14433 raft_consensus.cc:697] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:15.229532 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
W20260709 13:07:15.232383 14346 leader_election.cc:343] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:15.239622 14346 leader_election.cc:343] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.239192 14433 consensus_queue.cc:237] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
W20260709 13:07:15.234196 14345 leader_election.cc:343] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.229874 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
W20260709 13:07:15.241724 14346 leader_election.cc:343] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.242993 14346 leader_election.cc:304] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:15.237924 14427 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.242925 14345 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2
W20260709 13:07:15.247445 14345 leader_election.cc:343] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:15.247622 14177 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:15.248055 14345 leader_election.cc:304] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:15.248507 14452 raft_consensus.cc:515] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.253991 14456 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.254884 14456 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.252627 14380 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 1.
I20260709 13:07:15.257297 14230 raft_consensus.cc:2393] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b5da3bc4d874b6a9c0577fd3efc216c in current term 1: Already voted for candidate 0a149379ee76471486be2b9ebfecd41c in this term.
I20260709 13:07:15.259032 14453 raft_consensus.cc:2749] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.263123 14272 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 0a149379ee76471486be2b9ebfecd41c
I20260709 13:07:15.263829 14453 raft_consensus.cc:2749] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.264313 14432 raft_consensus.cc:2804] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.264833 14453 raft_consensus.cc:2749] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.265810 14429 tablet_bootstrap.cc:492] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:15.264878 14432 raft_consensus.cc:697] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:15.266443 14429 ts_tablet_manager.cc:1403] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.278s	user 0.014s	sys 0.017s
I20260709 13:07:15.258598 14424 tablet_bootstrap.cc:654] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.267808 14432 consensus_queue.cc:237] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.274046 14456 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.278045 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
W20260709 13:07:15.280575 14196 leader_election.cc:343] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.284562 14452 leader_election.cc:290] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 election: Requested vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.285674 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:15.285933 14429 raft_consensus.cc:359] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.286540 14429 raft_consensus.cc:385] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.286803 14429 raft_consensus.cc:740] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.286628 14304 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.301146 14429 consensus_queue.cc:260] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
W20260709 13:07:15.302253 14345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:34769, user_credentials={real_user=slave}} blocked reactor thread for 54850.8us
I20260709 13:07:15.312527 14425 tablet_bootstrap.cc:492] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:15.315636 14425 ts_tablet_manager.cc:1403] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.260s	user 0.021s	sys 0.013s
W20260709 13:07:15.305011 14346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:40383, user_credentials={real_user=slave}} blocked reactor thread for 63876.3us
I20260709 13:07:15.318555 14429 ts_tablet_manager.cc:1434] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.001s
I20260709 13:07:15.318485 14427 raft_consensus.cc:515] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.321545 14427 leader_election.cc:290] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.323060 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.323194 14425 raft_consensus.cc:359] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.324086 14425 raft_consensus.cc:385] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.332729 14429 tablet_bootstrap.cc:492] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:15.332230 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
W20260709 13:07:15.335421 14197 leader_election.cc:343] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.326179 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.325112 14129 catalog_manager.cc:5697] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 1 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.329300 14304 raft_consensus.cc:2468] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 1.
I20260709 13:07:15.333721 14425 raft_consensus.cc:740] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.332257 14128 catalog_manager.cc:5697] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.340500 14380 raft_consensus.cc:2393] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a149379ee76471486be2b9ebfecd41c in current term 1: Already voted for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in this term.
I20260709 13:07:15.338843 14197 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c; no voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:15.345543 14452 raft_consensus.cc:2749] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.346730 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.347966 14230 raft_consensus.cc:2393] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b5da3bc4d874b6a9c0577fd3efc216c in current term 1: Already voted for candidate 0a149379ee76471486be2b9ebfecd41c in this term.
I20260709 13:07:15.349593 14346 leader_election.cc:304] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:15.350929 14427 raft_consensus.cc:2749] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.345248 14425 consensus_queue.cc:260] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.362116 14425 ts_tablet_manager.cc:1434] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.002s
I20260709 13:07:15.362098 14196 leader_election.cc:304] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:15.363479 14452 raft_consensus.cc:2804] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.364223 14452 raft_consensus.cc:697] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:15.364861 14429 tablet_bootstrap.cc:654] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.366032 14425 tablet_bootstrap.cc:492] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:15.365455 14452 consensus_queue.cc:237] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.368247 14424 tablet_bootstrap.cc:492] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:15.369048 14424 ts_tablet_manager.cc:1403] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.196s	user 0.017s	sys 0.011s
I20260709 13:07:15.377110 14424 raft_consensus.cc:359] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.379324 14424 raft_consensus.cc:385] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.379768 14424 raft_consensus.cc:740] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.380733 14424 consensus_queue.cc:260] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.382939 14425 tablet_bootstrap.cc:654] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.384184 14424 ts_tablet_manager.cc:1434] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.006s
I20260709 13:07:15.385836 14424 tablet_bootstrap.cc:492] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:15.389860 14429 tablet_bootstrap.cc:492] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:15.402227 14429 ts_tablet_manager.cc:1403] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.005s
I20260709 13:07:15.392094 14425 tablet_bootstrap.cc:492] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:15.406530 14425 ts_tablet_manager.cc:1403] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.012s
I20260709 13:07:15.405997 14429 raft_consensus.cc:359] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.409286 14424 tablet_bootstrap.cc:654] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.409632 14429 raft_consensus.cc:385] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.410089 14429 raft_consensus.cc:740] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.410125 14425 raft_consensus.cc:359] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.411046 14425 raft_consensus.cc:385] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.411405 14425 raft_consensus.cc:740] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.411546 14429 consensus_queue.cc:260] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.412422 14425 consensus_queue.cc:260] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.415580 14425 ts_tablet_manager.cc:1434] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:15.416965 14425 tablet_bootstrap.cc:492] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:15.427260 14429 ts_tablet_manager.cc:1434] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.004s
I20260709 13:07:15.429529 14429 tablet_bootstrap.cc:492] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:15.414891 14127 catalog_manager.cc:5697] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 1 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.440146 14425 tablet_bootstrap.cc:654] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.443023 14429 tablet_bootstrap.cc:654] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.448169 14424 tablet_bootstrap.cc:492] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:15.448832 14424 ts_tablet_manager.cc:1403] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.023s
I20260709 13:07:15.449856 14425 tablet_bootstrap.cc:492] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:15.450505 14425 ts_tablet_manager.cc:1403] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.005s
I20260709 13:07:15.452754 14424 raft_consensus.cc:359] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:15.453677 14424 raft_consensus.cc:385] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.454010 14424 raft_consensus.cc:740] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.453946 14425 raft_consensus.cc:359] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.454936 14424 consensus_queue.cc:260] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:15.455607 14425 raft_consensus.cc:385] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.459638 14425 raft_consensus.cc:740] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.460664 14425 consensus_queue.cc:260] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.464515 14429 tablet_bootstrap.cc:492] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:15.465989 14425 ts_tablet_manager.cc:1434] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:07:15.467031 14425 tablet_bootstrap.cc:492] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:15.467307 14429 ts_tablet_manager.cc:1403] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.009s
I20260709 13:07:15.457641 14424 ts_tablet_manager.cc:1434] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:07:15.468973 14424 tablet_bootstrap.cc:492] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:15.470913 14429 raft_consensus.cc:359] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.471736 14429 raft_consensus.cc:385] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.472054 14429 raft_consensus.cc:740] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.472925 14429 consensus_queue.cc:260] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.475875 14429 ts_tablet_manager.cc:1434] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:07:15.476877 14424 tablet_bootstrap.cc:654] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.477087 14429 tablet_bootstrap.cc:492] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:15.484901 14429 tablet_bootstrap.cc:654] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.485244 14425 tablet_bootstrap.cc:654] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.505450 14424 tablet_bootstrap.cc:492] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:15.506464 14424 ts_tablet_manager.cc:1403] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.005s
I20260709 13:07:15.510565 14429 tablet_bootstrap.cc:492] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:15.511327 14429 ts_tablet_manager.cc:1403] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.011s
I20260709 13:07:15.510638 14424 raft_consensus.cc:359] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.511772 14424 raft_consensus.cc:385] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.512231 14424 raft_consensus.cc:740] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.513202 14424 consensus_queue.cc:260] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.514906 14429 raft_consensus.cc:359] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.517427 14425 tablet_bootstrap.cc:492] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:15.519851 14425 ts_tablet_manager.cc:1403] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.053s	user 0.002s	sys 0.018s
I20260709 13:07:15.520390 14424 ts_tablet_manager.cc:1434] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:07:15.521570 14424 tablet_bootstrap.cc:492] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:15.523092 14425 raft_consensus.cc:359] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.523833 14425 raft_consensus.cc:385] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.524147 14425 raft_consensus.cc:740] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.524876 14425 consensus_queue.cc:260] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.515707 14429 raft_consensus.cc:385] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.527267 14429 raft_consensus.cc:740] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.528160 14429 consensus_queue.cc:260] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.530027 14424 tablet_bootstrap.cc:654] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.531297 14429 ts_tablet_manager.cc:1434] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:07:15.532682 14429 tablet_bootstrap.cc:492] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:15.541010 14425 ts_tablet_manager.cc:1434] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:07:15.542392 14425 tablet_bootstrap.cc:492] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2: Bootstrap starting.
I20260709 13:07:15.557061 14429 tablet_bootstrap.cc:654] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.559087 14424 tablet_bootstrap.cc:492] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:15.560299 14424 ts_tablet_manager.cc:1403] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.007s
I20260709 13:07:15.563081 14425 tablet_bootstrap.cc:654] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.564261 14424 raft_consensus.cc:359] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.565044 14424 raft_consensus.cc:385] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.565352 14424 raft_consensus.cc:740] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.566164 14424 consensus_queue.cc:260] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.568652 14424 ts_tablet_manager.cc:1434] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:07:15.570132 14424 tablet_bootstrap.cc:492] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: Bootstrap starting.
I20260709 13:07:15.577184 14432 raft_consensus.cc:493] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.577824 14432 raft_consensus.cc:515] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.580108 14424 tablet_bootstrap.cc:654] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.581863 14425 tablet_bootstrap.cc:492] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2: No bootstrap required, opened a new log
I20260709 13:07:15.581718 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.582654 14425 ts_tablet_manager.cc:1403] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.017s
I20260709 13:07:15.582782 14230 raft_consensus.cc:2468] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.584967 14272 leader_election.cc:304] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.586447 14454 raft_consensus.cc:2804] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.586311 14425 raft_consensus.cc:359] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.586920 14454 raft_consensus.cc:493] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.587302 14425 raft_consensus.cc:385] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.587350 14454 raft_consensus.cc:3060] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.588423 14432 leader_election.cc:290] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.589951 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.590764 14380 raft_consensus.cc:2468] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.595441 14454 raft_consensus.cc:515] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.587576 14429 tablet_bootstrap.cc:492] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:15.596624 14424 tablet_bootstrap.cc:492] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: No bootstrap required, opened a new log
I20260709 13:07:15.597229 14424 ts_tablet_manager.cc:1403] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.002s
I20260709 13:07:15.596896 14429 ts_tablet_manager.cc:1403] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.009s
I20260709 13:07:15.598613 14425 raft_consensus.cc:740] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.599812 14425 consensus_queue.cc:260] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.601126 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.601774 14230 raft_consensus.cc:3060] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.605041 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.606037 14380 raft_consensus.cc:3060] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.607096 14425 ts_tablet_manager.cc:1434] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:07:15.605841 14424 raft_consensus.cc:359] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.609586 14454 leader_election.cc:290] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.617012 14230 raft_consensus.cc:2468] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 1.
I20260709 13:07:15.609748 14424 raft_consensus.cc:385] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.618095 14424 raft_consensus.cc:740] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.616904 14429 raft_consensus.cc:359] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.618985 14272 leader_election.cc:304] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.620167 14454 raft_consensus.cc:2804] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.619897 14424 consensus_queue.cc:260] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.620785 14454 raft_consensus.cc:697] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:15.621727 14454 consensus_queue.cc:237] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.622586 14424 ts_tablet_manager.cc:1434] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:07:15.625581 14380 raft_consensus.cc:2468] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 1.
I20260709 13:07:15.619324 14429 raft_consensus.cc:385] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.627345 14429 raft_consensus.cc:740] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.628453 14429 consensus_queue.cc:260] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.639863 14432 raft_consensus.cc:493] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.640774 14432 raft_consensus.cc:515] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.642257 14429 ts_tablet_manager.cc:1434] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:07:15.643007 14380 raft_consensus.cc:3060] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.643399 14429 tablet_bootstrap.cc:492] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c: Bootstrap starting.
I20260709 13:07:15.643278 14432 leader_election.cc:290] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.647544 14452 raft_consensus.cc:493] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.648257 14452 raft_consensus.cc:515] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.650440 14429 tablet_bootstrap.cc:654] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.650316 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.651433 14381 raft_consensus.cc:2468] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.657786 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.658653 14272 leader_election.cc:304] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
W20260709 13:07:15.661350 14272 leader_election.cc:343] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.662495 14454 raft_consensus.cc:2804] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.662933 14454 raft_consensus.cc:493] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.663825 14454 raft_consensus.cc:3060] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.664151 14433 consensus_queue.cc:1048] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:15.671236 14452 leader_election.cc:290] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.669364 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:15.674722 14304 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 0.
I20260709 13:07:15.676925 14429 tablet_bootstrap.cc:492] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c: No bootstrap required, opened a new log
I20260709 13:07:15.677548 14429 ts_tablet_manager.cc:1403] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.004s
I20260709 13:07:15.677476 14380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.679874 14196 leader_election.cc:304] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.680621 14380 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 0.
I20260709 13:07:15.682672 14452 raft_consensus.cc:2804] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.683099 14452 raft_consensus.cc:493] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.683436 14452 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.684502 14127 catalog_manager.cc:5697] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.685281 14429 raft_consensus.cc:359] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.686350 14429 raft_consensus.cc:385] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.686734 14429 raft_consensus.cc:740] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.687837 14429 consensus_queue.cc:260] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.700212 14429 ts_tablet_manager.cc:1434] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:07:15.709501 14454 raft_consensus.cc:515] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.713444 14454 leader_election.cc:290] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.713967 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.714797 14230 raft_consensus.cc:3060] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.714988 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.715728 14381 raft_consensus.cc:3060] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.715835 14452 raft_consensus.cc:515] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.730396 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:15.727464 14452 leader_election.cc:290] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 election: Requested vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.732688 14307 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.733587 14433 consensus_queue.cc:1048] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:15.737875 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.738323 14230 raft_consensus.cc:2468] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 1.
I20260709 13:07:15.738997 14379 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.739804 14272 leader_election.cc:304] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.741966 14454 raft_consensus.cc:2804] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.742993 14454 raft_consensus.cc:697] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:15.747757 14452 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.747310 14454 consensus_queue.cc:237] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.748420 14307 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 1.
I20260709 13:07:15.748418 14452 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.750296 14196 leader_election.cc:304] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.752439 14433 raft_consensus.cc:2804] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.753824 14433 raft_consensus.cc:697] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:15.752364 14379 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 1.
I20260709 13:07:15.754948 14433 consensus_queue.cc:237] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.758258 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:15.758755 14452 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.756968 14381 raft_consensus.cc:2468] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 1.
I20260709 13:07:15.771216 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.782892 14381 raft_consensus.cc:2393] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a149379ee76471486be2b9ebfecd41c in current term 1: Already voted for candidate 805e8170bc1444e9998b86a2cdb8eac2 in this term.
I20260709 13:07:15.791504 14197 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c; no voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:15.792799 14433 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.802507 14485 raft_consensus.cc:493] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.803361 14433 raft_consensus.cc:2749] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.803364 14485 raft_consensus.cc:515] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.808072 14485 leader_election.cc:290] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.809688 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d29b6dd89c4c358d70bab44e5c6681" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.810552 14231 raft_consensus.cc:2468] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.810173 14126 catalog_manager.cc:5697] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 1 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.811618 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d29b6dd89c4c358d70bab44e5c6681" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.812398 14381 raft_consensus.cc:2468] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.815223 14272 leader_election.cc:304] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.815035 14485 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:15.816929 14485 raft_consensus.cc:2804] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.817432 14485 raft_consensus.cc:493] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.817899 14485 raft_consensus.cc:3060] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.829726 14485 raft_consensus.cc:515] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.846619 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d29b6dd89c4c358d70bab44e5c6681" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.847482 14231 raft_consensus.cc:3060] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.850270 14427 raft_consensus.cc:493] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.851065 14427 raft_consensus.cc:515] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.854264 14427 leader_election.cc:290] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.855115 14427 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.855599 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.855814 14427 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.856441 14230 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 0.
I20260709 13:07:15.857702 14492 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.858637 14427 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.858515 14346 leader_election.cc:304] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:15.858507 14492 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.860956 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.861068 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d29b6dd89c4c358d70bab44e5c6681" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.862047 14381 raft_consensus.cc:3060] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.862036 14230 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 0.
I20260709 13:07:15.863260 14427 raft_consensus.cc:2804] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.863678 14427 raft_consensus.cc:493] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.863896 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" is_pre_election: true
I20260709 13:07:15.864722 14379 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.864683 14346 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:15.851020 14485 leader_election.cc:290] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.866061 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c" is_pre_election: true
I20260709 13:07:15.866807 14230 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 0.
I20260709 13:07:15.864046 14427 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.869038 14272 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.873776 14454 raft_consensus.cc:2804] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.874264 14454 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.874681 14454 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.859658 14126 catalog_manager.cc:5697] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.862432 14492 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.875440 14381 raft_consensus.cc:2468] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 1.
I20260709 13:07:15.877724 14485 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:15.879999 14272 leader_election.cc:304] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:15.881825 14493 raft_consensus.cc:2804] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.884673 14231 raft_consensus.cc:2468] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 1.
I20260709 13:07:15.899775 14493 raft_consensus.cc:697] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:15.886190 14427 raft_consensus.cc:515] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.900756 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:15.901202 14493 consensus_queue.cc:237] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.892089 14494 raft_consensus.cc:2804] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.895506 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2" is_pre_election: true
I20260709 13:07:15.904253 14304 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 0.
I20260709 13:07:15.904629 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.905385 14494 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.905587 14231 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.905910 14494 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.914898 14427 leader_election.cc:290] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.916158 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:15.916821 14304 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.926060 14494 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.915354 14454 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.928072 14307 raft_consensus.cc:2393] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b5da3bc4d874b6a9c0577fd3efc216c in current term 1: Already voted for candidate 805e8170bc1444e9998b86a2cdb8eac2 in this term.
I20260709 13:07:15.929016 14231 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 1.
I20260709 13:07:15.930557 14346 leader_election.cc:304] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:15.932291 14495 raft_consensus.cc:2804] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.932991 14495 raft_consensus.cc:697] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Becoming Leader. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:15.932293 14494 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:15.933993 14495 consensus_queue.cc:237] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.935753 14230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.937153 14230 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.942780 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:15.943786 14307 raft_consensus.cc:2393] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b5da3bc4d874b6a9c0577fd3efc216c in current term 1: Already voted for candidate 805e8170bc1444e9998b86a2cdb8eac2 in this term.
I20260709 13:07:15.926882 14304 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 1.
I20260709 13:07:15.950131 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:15.952050 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:15.953030 14379 raft_consensus.cc:2393] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 805e8170bc1444e9998b86a2cdb8eac2 in current term 1: Already voted for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in this term.
I20260709 13:07:15.953809 14230 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 1.
I20260709 13:07:15.954203 14454 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:15.954244 14272 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 805e8170bc1444e9998b86a2cdb8eac2; no voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:15.955456 14346 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:15.955950 14454 raft_consensus.cc:2749] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.955122 14126 catalog_manager.cc:5697] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67). New cstate: current_term: 1 leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.958838 14495 raft_consensus.cc:2804] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.959688 14495 raft_consensus.cc:697] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Becoming Leader. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:15.960983 14495 consensus_queue.cc:237] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:15.969183 14452 consensus_queue.cc:1048] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:15.970199 14433 consensus_queue.cc:1048] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.977622 14126 catalog_manager.cc:5697] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.001454 14127 catalog_manager.cc:5697] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67). New cstate: current_term: 1 leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.142783 14493 consensus_queue.cc:1048] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.158257 14432 consensus_queue.cc:1048] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.166455 14493 consensus_queue.cc:1048] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.189601 14493 consensus_queue.cc:1048] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.249629 14433 consensus_queue.cc:1048] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.269973 14433 consensus_queue.cc:1048] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.360989 14495 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.376168 14427 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.384861 14494 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.400151 14493 consensus_queue.cc:1048] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.404506 14427 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.433207 14432 consensus_queue.cc:1048] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.493721 14379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
mode: GRACEFUL
new_leader_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:07:16.494699 14379 raft_consensus.cc:606] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Received request to transfer leadership to TS 0a149379ee76471486be2b9ebfecd41c
I20260709 13:07:16.518944 14307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:07:16.519652 14307 raft_consensus.cc:606] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Received request to transfer leadership to TS 0a149379ee76471486be2b9ebfecd41c
I20260709 13:07:16.544004 14231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
mode: GRACEFUL
new_leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:49174
I20260709 13:07:16.544924 14231 raft_consensus.cc:606] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Received request to transfer leadership to TS 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:16.554795 14379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
mode: GRACEFUL
new_leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:07:16.555840 14379 raft_consensus.cc:606] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Received request to transfer leadership to TS 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:16.571569 14307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bad0b617b078401a85493f197ea64708"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:07:16.572481 14307 raft_consensus.cc:606] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Received request to transfer leadership to TS 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:16.707748 14456 raft_consensus.cc:993] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c: : Instructing follower 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:16.708329 14518 raft_consensus.cc:1081] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Signalling peer 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:16.710660 14307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:56666
I20260709 13:07:16.711304 14307 raft_consensus.cc:493] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.711688 14307 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.718102 14307 raft_consensus.cc:515] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.720420 14307 leader_election.cc:290] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:16.721535 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:16.722249 14231 raft_consensus.cc:3055] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.722630 14231 raft_consensus.cc:740] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:16.722455 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:16.723284 14379 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.723549 14231 consensus_queue.cc:260] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.725179 14231 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.729430 14379 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:16.731338 14272 leader_election.cc:304] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:16.732761 14432 raft_consensus.cc:2804] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:16.733597 14432 raft_consensus.cc:697] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:16.734591 14231 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:16.734490 14432 consensus_queue.cc:237] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.743978 14432 raft_consensus.cc:993] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:16.744714 14492 raft_consensus.cc:993] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:16.744760 14493 raft_consensus.cc:1081] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Signalling peer 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:16.745589 14492 raft_consensus.cc:1081] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Signalling peer 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:16.748548 14379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bad0b617b078401a85493f197ea64708"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:39128
I20260709 13:07:16.750074 14379 raft_consensus.cc:493] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.750581 14379 raft_consensus.cc:3060] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.750290 14127 catalog_manager.cc:5697] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 1 to 2, leader changed from 0a149379ee76471486be2b9ebfecd41c (127.13.196.65) to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.749425 14231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:49158
I20260709 13:07:16.754685 14231 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.755157 14231 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.768224 14231 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.771819 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:16.772632 14307 raft_consensus.cc:3055] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.773015 14307 raft_consensus.cc:740] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:16.773972 14307 consensus_queue.cc:260] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.775007 14307 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.776599 14379 raft_consensus.cc:515] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.780777 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:16.781683 14229 raft_consensus.cc:3060] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.783073 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:16.783746 14381 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.785472 14307 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 2.
I20260709 13:07:16.787237 14196 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:16.788293 14518 raft_consensus.cc:2804] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:16.788800 14518 raft_consensus.cc:697] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:16.789675 14518 consensus_queue.cc:237] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.791939 14231 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 2 election: Requested vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:16.792392 14229 raft_consensus.cc:2468] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 2.
I20260709 13:07:16.794721 14381 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 2.
I20260709 13:07:16.794883 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0b617b078401a85493f197ea64708" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:16.795801 14346 leader_election.cc:304] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:16.794049 14379 leader_election.cc:290] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 2 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:16.797060 14427 raft_consensus.cc:2804] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:16.797700 14427 raft_consensus.cc:697] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 LEADER]: Becoming Leader. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:16.798950 14427 consensus_queue.cc:237] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.801473 14127 catalog_manager.cc:5697] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 1 to 2, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 2 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.795957 14307 raft_consensus.cc:3055] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.808431 14307 raft_consensus.cc:740] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:16.809504 14307 consensus_queue.cc:260] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.810928 14307 raft_consensus.cc:3060] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.813160 14128 catalog_manager.cc:5697] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c reported cstate change: term changed from 1 to 2, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67). New cstate: current_term: 2 leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.820029 14307 raft_consensus.cc:2468] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 2.
I20260709 13:07:16.875154 14494 raft_consensus.cc:993] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: : Instructing follower 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:16.875900 14494 raft_consensus.cc:1081] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Signalling peer 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:16.878026 14307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:56678
I20260709 13:07:16.878728 14307 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.879161 14307 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.887392 14307 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.889837 14307 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:16.891394 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:16.892426 14229 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.892170 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:16.893584 14381 raft_consensus.cc:3055] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.894034 14381 raft_consensus.cc:740] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:16.894955 14381 consensus_queue.cc:260] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.896413 14381 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.898974 14229 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:16.900533 14272 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:16.901880 14432 raft_consensus.cc:2804] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:16.902400 14432 raft_consensus.cc:697] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:16.903584 14432 consensus_queue.cc:237] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.906217 14381 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:16.914269 14128 catalog_manager.cc:5697] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 1 to 2, leader changed from 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67) to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.966807 14495 raft_consensus.cc:993] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c: : Instructing follower 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:16.967348 14427 raft_consensus.cc:1081] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Signalling peer 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:16.969297 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:49172
I20260709 13:07:16.969982 14229 raft_consensus.cc:493] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.970371 14229 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.977922 14229 raft_consensus.cc:515] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.980118 14229 leader_election.cc:290] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 2 election: Requested vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:16.981583 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:16.982079 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:16.982344 14381 raft_consensus.cc:3055] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.982654 14307 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.982705 14381 raft_consensus.cc:740] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:16.983789 14381 consensus_queue.cc:260] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:16.985316 14381 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.991951 14307 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 2.
I20260709 13:07:16.994262 14196 leader_election.cc:304] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:16.994944 14381 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 2.
I20260709 13:07:16.995632 14518 raft_consensus.cc:2804] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:16.996378 14518 raft_consensus.cc:697] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:16.997362 14518 consensus_queue.cc:237] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:17.007555 14128 catalog_manager.cc:5697] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 1 to 2, leader changed from 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67) to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 2 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.207059 14381 raft_consensus.cc:1275] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.209112 14432 consensus_queue.cc:1048] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.212909 14307 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.214977 14518 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.234063 14229 raft_consensus.cc:1275] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.235934 14379 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.237010 14495 consensus_queue.cc:1048] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.238363 14518 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.259280 14305 raft_consensus.cc:1275] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.270020 14494 consensus_queue.cc:1048] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.285583 14229 raft_consensus.cc:1275] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.287974 14432 consensus_queue.cc:1048] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.392513 14379 raft_consensus.cc:1275] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.394345 14485 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.404428 14229 raft_consensus.cc:1275] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.406577 14432 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.412828 14379 raft_consensus.cc:1275] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.415060 14452 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:17.428318 14304 raft_consensus.cc:1275] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.430634 14518 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:19.614687 14097 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:07:19.615856 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.642820 14304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:56692
I20260709 13:07:19.643435 14304 raft_consensus.cc:606] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Received request to transfer leadership to TS 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:19.656739 14231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
mode: GRACEFUL
new_leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:49176
I20260709 13:07:19.657383 14231 raft_consensus.cc:606] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Received request to transfer leadership to TS 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:19.658802 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:19.659428 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:19.740599 14485 raft_consensus.cc:993] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:19.741551 14485 raft_consensus.cc:1081] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Signalling peer 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:19.743821 14379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:39128
I20260709 13:07:19.744412 14379 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.744915 14379 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.751767 14379 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:19.753950 14379 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 3 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:19.754940 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:19.755401 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:19.755685 14231 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.756126 14304 raft_consensus.cc:3055] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:19.756497 14304 raft_consensus.cc:740] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:19.757326 14304 consensus_queue.cc:260] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:19.758430 14304 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.762773 14231 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 3.
I20260709 13:07:19.764107 14304 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 3.
I20260709 13:07:19.764550 14346 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:19.765448 14427 raft_consensus.cc:2804] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.767443 14427 raft_consensus.cc:697] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Becoming Leader. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:19.768718 14427 consensus_queue.cc:237] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:19.776986 14126 catalog_manager.cc:5697] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c reported cstate change: term changed from 2 to 3, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67). New cstate: current_term: 3 leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:19.906682 14518 raft_consensus.cc:993] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c: : Instructing follower 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:19.907451 14537 raft_consensus.cc:1081] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Signalling peer 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:19.909706 14379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:39114
I20260709 13:07:19.910276 14379 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.910553 14379 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.915733 14379 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:19.917678 14379 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 3 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:19.918877 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:19.919059 14304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:19.919585 14231 raft_consensus.cc:3055] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:19.919797 14304 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.920027 14231 raft_consensus.cc:740] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:19.920961 14231 consensus_queue.cc:260] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:19.922262 14231 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.925374 14304 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 3.
I20260709 13:07:19.926990 14345 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:19.928056 14427 raft_consensus.cc:2804] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.928786 14427 raft_consensus.cc:697] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Becoming Leader. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:19.929452 14231 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 3.
I20260709 13:07:19.930111 14427 consensus_queue.cc:237] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:19.938728 14126 catalog_manager.cc:5697] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c reported cstate change: term changed from 2 to 3, leader changed from 0a149379ee76471486be2b9ebfecd41c (127.13.196.65) to 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67). New cstate: current_term: 3 leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:20.213999 14304 raft_consensus.cc:1275] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.215644 14427 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.230361 14231 raft_consensus.cc:1275] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.232306 14427 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:20.406386 14231 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.408092 14543 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.419054 14304 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.421108 14556 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:20.660526 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:20.672592 14231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
mode: GRACEFUL
new_leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:49174
I20260709 13:07:20.673421 14231 raft_consensus.cc:606] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Received request to transfer leadership to TS 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:20.680527 14231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
mode: GRACEFUL
new_leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:49174
I20260709 13:07:20.681125 14231 raft_consensus.cc:606] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Received request to transfer leadership to TS 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:20.686795 14231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
mode: GRACEFUL
new_leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:49174
I20260709 13:07:20.687357 14231 raft_consensus.cc:606] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Received request to transfer leadership to TS 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:20.693840 14379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
mode: GRACEFUL
new_leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:07:20.694528 14379 raft_consensus.cc:606] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Received request to transfer leadership to TS 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:20.704548 14379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
mode: GRACEFUL
new_leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:07:20.705566 14379 raft_consensus.cc:606] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Received request to transfer leadership to TS 805e8170bc1444e9998b86a2cdb8eac2
I20260709 13:07:20.856012 14558 raft_consensus.cc:993] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c: : Instructing follower 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:20.856624 14537 raft_consensus.cc:1081] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Signalling peer 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:20.858556 14304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:56666
I20260709 13:07:20.859345 14304 raft_consensus.cc:493] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.859738 14304 raft_consensus.cc:3060] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.865339 14304 raft_consensus.cc:515] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:20.867172 14304 leader_election.cc:290] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Requested vote from peers 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541), 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383)
I20260709 13:07:20.868462 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:20.868913 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4f4b29897a42a0829022bd088295fe" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:20.869156 14381 raft_consensus.cc:3060] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.869558 14231 raft_consensus.cc:3055] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:20.869846 14231 raft_consensus.cc:740] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:20.870594 14231 consensus_queue.cc:260] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:20.871721 14231 raft_consensus.cc:3060] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.875119 14381 raft_consensus.cc:2468] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:20.876598 14272 leader_election.cc:304] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:20.877463 14485 raft_consensus.cc:2804] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:20.877880 14231 raft_consensus.cc:2468] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:20.878839 14485 raft_consensus.cc:697] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:20.880451 14485 consensus_queue.cc:237] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } }
I20260709 13:07:20.887717 14128 catalog_manager.cc:5697] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 1 to 2, leader changed from 0a149379ee76471486be2b9ebfecd41c (127.13.196.65) to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:20.987861 14543 raft_consensus.cc:993] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: : Instructing follower 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:20.988567 14543 raft_consensus.cc:1081] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Signalling peer 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:20.990540 14304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:56678
I20260709 13:07:20.991256 14304 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.991688 14304 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.998853 14304 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.000810 14304 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 4 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:21.002115 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:21.002481 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:21.002903 14231 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.003139 14381 raft_consensus.cc:3055] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:21.003530 14381 raft_consensus.cc:740] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:21.004843 14381 consensus_queue.cc:260] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.005990 14381 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.010789 14231 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 4.
I20260709 13:07:21.012279 14272 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:21.012287 14381 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 4.
I20260709 13:07:21.013383 14485 raft_consensus.cc:2804] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:21.013940 14485 raft_consensus.cc:697] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:21.014696 14485 consensus_queue.cc:237] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.020956 14128 catalog_manager.cc:5697] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 3 to 4, leader changed from 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67) to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 4 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.069605 14558 raft_consensus.cc:993] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c: : Instructing follower 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:21.070166 14537 raft_consensus.cc:1081] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Signalling peer 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:21.072096 14304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:56666
I20260709 13:07:21.072737 14304 raft_consensus.cc:493] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:21.073226 14304 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:21.082238 14304 raft_consensus.cc:515] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.084156 14304 leader_election.cc:290] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:21.085354 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:21.086012 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:21.086061 14231 raft_consensus.cc:3055] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:21.086658 14231 raft_consensus.cc:740] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:21.086735 14381 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:21.087548 14231 consensus_queue.cc:260] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.089247 14231 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:21.093588 14381 raft_consensus.cc:2468] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:21.094790 14231 raft_consensus.cc:2468] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 2.
I20260709 13:07:21.094990 14272 leader_election.cc:304] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:21.095937 14485 raft_consensus.cc:2804] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:21.096529 14485 raft_consensus.cc:697] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:21.097277 14485 consensus_queue.cc:237] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.105571 14128 catalog_manager.cc:5697] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 1 to 2, leader changed from 0a149379ee76471486be2b9ebfecd41c (127.13.196.65) to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.235798 14556 raft_consensus.cc:993] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: : Instructing follower 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:21.236400 14556 raft_consensus.cc:1081] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Signalling peer 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:21.237753 14558 raft_consensus.cc:993] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c: : Instructing follower 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:21.238206 14558 raft_consensus.cc:1081] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Signalling peer 805e8170bc1444e9998b86a2cdb8eac2 to start an election
I20260709 13:07:21.238340 14304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:56678
I20260709 13:07:21.239003 14304 raft_consensus.cc:493] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:21.239557 14304 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.240240 14307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
 from {username='slave'} at 127.0.0.1:56666
I20260709 13:07:21.241245 14307 raft_consensus.cc:493] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:21.241711 14307 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.245210 14304 raft_consensus.cc:515] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.247284 14304 leader_election.cc:290] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 4 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:21.247087 14307 raft_consensus.cc:515] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.248395 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:21.248704 14381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e11aaa55d06d4f51b65d851450e26c58" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:21.249032 14231 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.249423 14307 leader_election.cc:290] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 3 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:21.249475 14381 raft_consensus.cc:3055] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:21.250042 14381 raft_consensus.cc:740] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:21.250204 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:21.250859 14229 raft_consensus.cc:3055] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:21.251374 14229 raft_consensus.cc:740] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:21.251469 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "805e8170bc1444e9998b86a2cdb8eac2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:21.251034 14381 consensus_queue.cc:260] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.252045 14379 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.252400 14229 consensus_queue.cc:260] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.252835 14381 raft_consensus.cc:3060] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:21.253690 14229 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.259588 14231 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 4.
I20260709 13:07:21.261195 14379 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 3.
I20260709 13:07:21.261412 14272 leader_election.cc:304] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:21.261838 14381 raft_consensus.cc:2468] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 4.
I20260709 13:07:21.262570 14485 raft_consensus.cc:2804] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:21.262679 14272 leader_election.cc:304] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b5da3bc4d874b6a9c0577fd3efc216c, 805e8170bc1444e9998b86a2cdb8eac2; no voters: 
I20260709 13:07:21.263198 14485 raft_consensus.cc:697] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:21.262663 14229 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 805e8170bc1444e9998b86a2cdb8eac2 in term 3.
I20260709 13:07:21.263794 14559 raft_consensus.cc:2804] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:21.264689 14559 raft_consensus.cc:697] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 LEADER]: Becoming Leader. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:21.264761 14485 consensus_queue.cc:237] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.265852 14559 consensus_queue.cc:237] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:21.269860 14229 raft_consensus.cc:1275] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:21.272816 14559 consensus_queue.cc:1048] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:21.275941 14128 catalog_manager.cc:5697] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 3 to 4, leader changed from 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67) to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 4 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.288101 14379 raft_consensus.cc:1275] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:21.290481 14559 consensus_queue.cc:1048] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:21.295624 14128 catalog_manager.cc:5697] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 reported cstate change: term changed from 2 to 3, leader changed from 0a149379ee76471486be2b9ebfecd41c (127.13.196.65) to 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66). New cstate: current_term: 3 leader_uuid: "805e8170bc1444e9998b86a2cdb8eac2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.587713 14231 raft_consensus.cc:1275] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:21.587713 14229 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:21.591922 14485 consensus_queue.cc:1048] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:21.592469 14565 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.596159 14379 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:21.598532 14565 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.640456 14379 raft_consensus.cc:1275] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:21.643229 14565 consensus_queue.cc:1048] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:21.654537 14231 raft_consensus.cc:1275] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:21.656044 14565 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:21.668816 14379 raft_consensus.cc:1275] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:21.673492 14559 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:21.875190 14379 raft_consensus.cc:1275] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:21.877647 14485 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:21.878396 14231 raft_consensus.cc:1275] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Refusing update from remote peer 805e8170bc1444e9998b86a2cdb8eac2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:21.880060 14485 consensus_queue.cc:1048] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:23.718726 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:23.728596 14307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:56692
I20260709 13:07:23.729291 14307 raft_consensus.cc:606] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Received request to transfer leadership to TS 0a149379ee76471486be2b9ebfecd41c
I20260709 13:07:23.733968 14307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:56692
I20260709 13:07:23.734654 14307 raft_consensus.cc:606] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Received request to transfer leadership to TS 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:23.737910 14307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:56692
I20260709 13:07:23.738603 14307 raft_consensus.cc:606] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Received request to transfer leadership to TS 0a149379ee76471486be2b9ebfecd41c
I20260709 13:07:23.742530 14307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:56692
I20260709 13:07:23.743201 14307 raft_consensus.cc:606] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 LEADER]: Received request to transfer leadership to TS 0a149379ee76471486be2b9ebfecd41c
I20260709 13:07:23.746623 14307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd"
dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
mode: GRACEFUL
new_leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:56692
I20260709 13:07:23.747273 14307 raft_consensus.cc:606] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 LEADER]: Received request to transfer leadership to TS 4b5da3bc4d874b6a9c0577fd3efc216c
I20260709 13:07:23.748631 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:23.749110 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:23.793732 14565 raft_consensus.cc:993] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:23.794320 14565 raft_consensus.cc:1081] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 LEADER]: Signalling peer 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:23.796203 14379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:39128
I20260709 13:07:23.796941 14379 raft_consensus.cc:493] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:23.797273 14379 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.804526 14379 raft_consensus.cc:515] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.806828 14379 leader_election.cc:290] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 4 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:23.808576 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:23.808434 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93e3995712f43acbdafec6e2b4651cd" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:23.809508 14307 raft_consensus.cc:3055] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:23.809681 14229 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.810071 14307 raft_consensus.cc:740] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:23.811143 14307 consensus_queue.cc:260] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.812651 14307 raft_consensus.cc:3060] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:23.816623 14229 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 4.
I20260709 13:07:23.818434 14346 leader_election.cc:304] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:23.819576 14307 raft_consensus.cc:2468] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 4.
I20260709 13:07:23.819696 14556 raft_consensus.cc:2804] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:23.821105 14556 raft_consensus.cc:697] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 LEADER]: Becoming Leader. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:23.822225 14556 consensus_queue.cc:237] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.832573 14584 raft_consensus.cc:993] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:23.831614 14126 catalog_manager.cc:5697] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c reported cstate change: term changed from 3 to 4, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67). New cstate: current_term: 4 leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.833283 14565 raft_consensus.cc:1081] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Signalling peer 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:23.835834 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:49158
I20260709 13:07:23.836486 14229 raft_consensus.cc:493] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:23.836858 14229 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.845770 14229 raft_consensus.cc:515] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.848853 14229 leader_election.cc:290] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 3 election: Requested vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:23.850101 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:23.850898 14307 raft_consensus.cc:3055] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:23.851220 14307 raft_consensus.cc:740] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:23.851068 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56eda67f3ee46b0b9a9835281d0ddae" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:23.852061 14379 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.852293 14307 consensus_queue.cc:260] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.854404 14307 raft_consensus.cc:3060] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.858508 14379 raft_consensus.cc:2468] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 3.
I20260709 13:07:23.860256 14197 leader_election.cc:304] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:23.862537 14307 raft_consensus.cc:2468] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 3.
I20260709 13:07:23.863662 14591 raft_consensus.cc:2804] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:23.866207 14591 raft_consensus.cc:697] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 3 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:23.867157 14591 consensus_queue.cc:237] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.877286 14126 catalog_manager.cc:5697] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 2 to 3, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 3 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.888059 14584 raft_consensus.cc:993] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:23.888691 14584 raft_consensus.cc:1081] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Signalling peer 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:23.890793 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:49158
I20260709 13:07:23.891623 14229 raft_consensus.cc:493] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:23.891973 14229 raft_consensus.cc:3060] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.898362 14229 raft_consensus.cc:515] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.900593 14229 leader_election.cc:290] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 2 election: Requested vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:23.901542 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:23.901826 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c49430a4ad749e3a448ac608a7a3a3d" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:23.902175 14307 raft_consensus.cc:3055] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:23.902607 14307 raft_consensus.cc:740] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:23.902772 14379 raft_consensus.cc:3060] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.903820 14307 consensus_queue.cc:260] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.905051 14307 raft_consensus.cc:3060] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.909624 14379 raft_consensus.cc:2468] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 2.
I20260709 13:07:23.910835 14197 leader_election.cc:304] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:23.911804 14591 raft_consensus.cc:2804] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.911882 14307 raft_consensus.cc:2468] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 2.
I20260709 13:07:23.912863 14591 raft_consensus.cc:697] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:23.914002 14591 consensus_queue.cc:237] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.922348 14126 catalog_manager.cc:5697] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 1 to 2, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 2 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.958165 14584 raft_consensus.cc:993] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:23.958731 14565 raft_consensus.cc:1081] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Signalling peer 4b5da3bc4d874b6a9c0577fd3efc216c to start an election
I20260709 13:07:23.960678 14379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f"
dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
 from {username='slave'} at 127.0.0.1:39128
I20260709 13:07:23.961447 14379 raft_consensus.cc:493] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:23.961840 14379 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.967962 14379 raft_consensus.cc:515] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.971225 14379 leader_election.cc:290] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 3 election: Requested vote from peers 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383), 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769)
I20260709 13:07:23.972579 14229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
I20260709 13:07:23.972805 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbb6b07376c49f9b4e5e04ff1bee16f" candidate_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:23.973524 14307 raft_consensus.cc:3055] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:23.973465 14229 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.973986 14307 raft_consensus.cc:740] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:23.974922 14307 consensus_queue.cc:260] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.976432 14307 raft_consensus.cc:3060] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.983369 14229 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 3.
I20260709 13:07:23.986054 14346 leader_election.cc:304] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:23.986675 14307 raft_consensus.cc:2468] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b5da3bc4d874b6a9c0577fd3efc216c in term 3.
I20260709 13:07:23.987432 14556 raft_consensus.cc:2804] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:23.988662 14556 raft_consensus.cc:697] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Becoming Leader. State: Replica: 4b5da3bc4d874b6a9c0577fd3efc216c, State: Running, Role: LEADER
I20260709 13:07:23.989867 14556 consensus_queue.cc:237] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:23.998241 14126 catalog_manager.cc:5697] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c reported cstate change: term changed from 2 to 3, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67). New cstate: current_term: 3 leader_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.047233 14565 raft_consensus.cc:993] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: : Instructing follower 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:24.047780 14584 raft_consensus.cc:1081] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 LEADER]: Signalling peer 0a149379ee76471486be2b9ebfecd41c to start an election
I20260709 13:07:24.049587 14229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa"
dest_uuid: "0a149379ee76471486be2b9ebfecd41c"
 from {username='slave'} at 127.0.0.1:49158
I20260709 13:07:24.050204 14229 raft_consensus.cc:493] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:24.050562 14229 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.056738 14229 raft_consensus.cc:515] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:24.058737 14229 leader_election.cc:290] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 5 election: Requested vote from peers 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769), 4b5da3bc4d874b6a9c0577fd3efc216c (127.13.196.67:40541)
I20260709 13:07:24.060035 14307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "805e8170bc1444e9998b86a2cdb8eac2"
I20260709 13:07:24.060029 14379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f862fd002c9c4cf3b325f30fef1c3daa" candidate_uuid: "0a149379ee76471486be2b9ebfecd41c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c"
I20260709 13:07:24.060967 14307 raft_consensus.cc:3055] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:24.061065 14379 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.061394 14307 raft_consensus.cc:740] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 805e8170bc1444e9998b86a2cdb8eac2, State: Running, Role: LEADER
I20260709 13:07:24.062579 14307 consensus_queue.cc:260] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:24.064007 14307 raft_consensus.cc:3060] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:24.067332 14379 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 5.
I20260709 13:07:24.068805 14197 leader_election.cc:304] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a149379ee76471486be2b9ebfecd41c, 4b5da3bc4d874b6a9c0577fd3efc216c; no voters: 
I20260709 13:07:24.069720 14591 raft_consensus.cc:2804] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:24.070142 14307 raft_consensus.cc:2468] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a149379ee76471486be2b9ebfecd41c in term 5.
I20260709 13:07:24.070641 14591 raft_consensus.cc:697] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 5 LEADER]: Becoming Leader. State: Replica: 0a149379ee76471486be2b9ebfecd41c, State: Running, Role: LEADER
I20260709 13:07:24.071878 14591 consensus_queue.cc:237] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } }
I20260709 13:07:24.083166 14126 catalog_manager.cc:5697] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c reported cstate change: term changed from 4 to 5, leader changed from 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66) to 0a149379ee76471486be2b9ebfecd41c (127.13.196.65). New cstate: current_term: 5 leader_uuid: "0a149379ee76471486be2b9ebfecd41c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.279553 14307 raft_consensus.cc:1275] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:24.281165 14556 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:24.288668 14304 raft_consensus.cc:1275] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:24.290596 14591 consensus_queue.cc:1048] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.297571 14229 raft_consensus.cc:1275] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:24.299903 14585 consensus_queue.cc:1048] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:24.305787 14379 raft_consensus.cc:1275] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:24.308683 14591 consensus_queue.cc:1048] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.423519 14307 raft_consensus.cc:1275] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:24.425042 14591 consensus_queue.cc:1048] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:24.438156 14379 raft_consensus.cc:1275] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:24.439854 14591 consensus_queue.cc:1048] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:24.489094 14307 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 5 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:24.490734 14591 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:24.502540 14379 raft_consensus.cc:1275] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 5 FOLLOWER]: Refusing update from remote peer 0a149379ee76471486be2b9ebfecd41c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:24.504779 14592 consensus_queue.cc:1048] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b5da3bc4d874b6a9c0577fd3efc216c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 40541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:24.506881 14307 raft_consensus.cc:1275] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:24.513557 14601 consensus_queue.cc:1048] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "805e8170bc1444e9998b86a2cdb8eac2" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 34769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.525053 14229 raft_consensus.cc:1275] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Refusing update from remote peer 4b5da3bc4d874b6a9c0577fd3efc216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:24.526793 14556 consensus_queue.cc:1048] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a149379ee76471486be2b9ebfecd41c" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:24.750437 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:24.757608 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
I20260709 13:07:24.804735 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:24.805881 14097 tablet_replica.cc:333] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.807199 14097 raft_consensus.cc:2243] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.807847 14097 raft_consensus.cc:2272] T bad0b617b078401a85493f197ea64708 P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.810786 14097 tablet_replica.cc:333] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.811508 14097 raft_consensus.cc:2243] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.812119 14097 raft_consensus.cc:2272] T 46d29b6dd89c4c358d70bab44e5c6681 P 0a149379ee76471486be2b9ebfecd41c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.814924 14097 tablet_replica.cc:333] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.815768 14097 raft_consensus.cc:2243] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.816579 14097 raft_consensus.cc:2272] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.820544 14097 tablet_replica.cc:333] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.821486 14097 raft_consensus.cc:2243] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.822060 14097 raft_consensus.cc:2272] T f93e3995712f43acbdafec6e2b4651cd P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.824616 14097 tablet_replica.cc:333] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.825217 14097 raft_consensus.cc:2243] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:24.826179 14097 raft_consensus.cc:2272] T 1c49430a4ad749e3a448ac608a7a3a3d P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.828876 14097 tablet_replica.cc:333] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.829507 14097 raft_consensus.cc:2243] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:24.830420 14097 raft_consensus.cc:2272] T f862fd002c9c4cf3b325f30fef1c3daa P 0a149379ee76471486be2b9ebfecd41c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.832779 14097 tablet_replica.cc:333] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.833359 14097 raft_consensus.cc:2243] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.833819 14097 raft_consensus.cc:2272] T e11aaa55d06d4f51b65d851450e26c58 P 0a149379ee76471486be2b9ebfecd41c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.835707 14097 tablet_replica.cc:333] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.836252 14097 raft_consensus.cc:2243] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:24.837204 14097 raft_consensus.cc:2272] T e56eda67f3ee46b0b9a9835281d0ddae P 0a149379ee76471486be2b9ebfecd41c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.839632 14097 tablet_replica.cc:333] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c: stopping tablet replica
I20260709 13:07:24.840154 14097 raft_consensus.cc:2243] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.840649 14097 raft_consensus.cc:2272] T 7c4f4b29897a42a0829022bd088295fe P 0a149379ee76471486be2b9ebfecd41c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:24.847808 14346 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:24.851785 14346 consensus_peers.cc:597] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c -> Peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Couldn't send request to peer 0a149379ee76471486be2b9ebfecd41c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:24.972214 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
W20260709 13:07:24.973956 14272 consensus_peers.cc:597] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 -> Peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Couldn't send request to peer 0a149379ee76471486be2b9ebfecd41c. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:40383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:24.974870 14272 consensus_peers.cc:597] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 -> Peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Couldn't send request to peer 0a149379ee76471486be2b9ebfecd41c. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:40383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:24.996524 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
I20260709 13:07:25.036607 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:25.037597 14097 tablet_replica.cc:333] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.038357 14097 raft_consensus.cc:2243] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.038934 14097 raft_consensus.cc:2272] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.043597 14097 tablet_replica.cc:333] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.044430 14097 raft_consensus.cc:2243] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:25.045331 14097 raft_consensus.cc:2272] T e11aaa55d06d4f51b65d851450e26c58 P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.048161 14097 tablet_replica.cc:333] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.048978 14097 raft_consensus.cc:2243] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.049554 14097 raft_consensus.cc:2272] T bad0b617b078401a85493f197ea64708 P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.051970 14097 tablet_replica.cc:333] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.052923 14097 raft_consensus.cc:2243] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:25.054100 14097 raft_consensus.cc:2272] T 46d29b6dd89c4c358d70bab44e5c6681 P 805e8170bc1444e9998b86a2cdb8eac2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.057687 14097 tablet_replica.cc:333] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.058496 14097 raft_consensus.cc:2243] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.059161 14097 raft_consensus.cc:2272] T 1c49430a4ad749e3a448ac608a7a3a3d P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.068554 14097 tablet_replica.cc:333] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
W20260709 13:07:25.069237 14346 consensus_peers.cc:597] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c -> Peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Couldn't send request to peer 0a149379ee76471486be2b9ebfecd41c. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:40383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:25.069357 14097 raft_consensus.cc:2243] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.070008 14097 raft_consensus.cc:2272] T f93e3995712f43acbdafec6e2b4651cd P 805e8170bc1444e9998b86a2cdb8eac2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.072742 14097 tablet_replica.cc:333] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.073500 14097 raft_consensus.cc:2243] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.074025 14097 raft_consensus.cc:2272] T e56eda67f3ee46b0b9a9835281d0ddae P 805e8170bc1444e9998b86a2cdb8eac2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.076762 14097 tablet_replica.cc:333] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.077718 14097 raft_consensus.cc:2243] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.078367 14097 raft_consensus.cc:2272] T f862fd002c9c4cf3b325f30fef1c3daa P 805e8170bc1444e9998b86a2cdb8eac2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.081741 14097 tablet_replica.cc:333] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2: stopping tablet replica
I20260709 13:07:25.082716 14097 raft_consensus.cc:2243] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:25.084031 14097 raft_consensus.cc:2272] T 7c4f4b29897a42a0829022bd088295fe P 805e8170bc1444e9998b86a2cdb8eac2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:25.084720 14345 consensus_peers.cc:597] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c -> Peer 805e8170bc1444e9998b86a2cdb8eac2 (127.13.196.66:34769): Couldn't send request to peer 805e8170bc1444e9998b86a2cdb8eac2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:25.117115 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
W20260709 13:07:25.140549 14346 consensus_peers.cc:597] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c -> Peer 0a149379ee76471486be2b9ebfecd41c (127.13.196.65:40383): Couldn't send request to peer 0a149379ee76471486be2b9ebfecd41c. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:40383: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:25.142944 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
I20260709 13:07:25.184441 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:25.185340 14097 tablet_replica.cc:333] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.186131 14097 raft_consensus.cc:2243] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.186709 14097 raft_consensus.cc:2272] T e11aaa55d06d4f51b65d851450e26c58 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.188864 14097 tablet_replica.cc:333] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.189481 14097 raft_consensus.cc:2243] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:25.190429 14097 raft_consensus.cc:2272] T f93e3995712f43acbdafec6e2b4651cd P 4b5da3bc4d874b6a9c0577fd3efc216c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.193861 14097 tablet_replica.cc:333] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.194754 14097 raft_consensus.cc:2243] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.195492 14097 raft_consensus.cc:2272] T 1c49430a4ad749e3a448ac608a7a3a3d P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.198868 14097 tablet_replica.cc:333] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.199841 14097 raft_consensus.cc:2243] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.200644 14097 raft_consensus.cc:2272] T 7c4f4b29897a42a0829022bd088295fe P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.202957 14097 tablet_replica.cc:333] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.203651 14097 raft_consensus.cc:2243] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.204174 14097 raft_consensus.cc:2272] T 46d29b6dd89c4c358d70bab44e5c6681 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.206450 14097 tablet_replica.cc:333] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.207125 14097 raft_consensus.cc:2243] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:25.208055 14097 raft_consensus.cc:2272] T bad0b617b078401a85493f197ea64708 P 4b5da3bc4d874b6a9c0577fd3efc216c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.210276 14097 tablet_replica.cc:333] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.210880 14097 raft_consensus.cc:2243] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.211370 14097 raft_consensus.cc:2272] T e56eda67f3ee46b0b9a9835281d0ddae P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.213814 14097 tablet_replica.cc:333] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.214371 14097 raft_consensus.cc:2243] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:25.215435 14097 raft_consensus.cc:2272] T 5bbb6b07376c49f9b4e5e04ff1bee16f P 4b5da3bc4d874b6a9c0577fd3efc216c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.218024 14097 tablet_replica.cc:333] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c: stopping tablet replica
I20260709 13:07:25.218580 14097 raft_consensus.cc:2243] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:25.219069 14097 raft_consensus.cc:2272] T f862fd002c9c4cf3b325f30fef1c3daa P 4b5da3bc4d874b6a9c0577fd3efc216c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.250718 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
I20260709 13:07:25.270819 14097 master.cc:562] Master@127.13.196.126:43047 shutting down...
I20260709 13:07:25.438593 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:25.439603 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:25.440078 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0e6b2fceffff4b69a3cf18489b916a07: stopping tablet replica
I20260709 13:07:25.463667 14097 master.cc:584] Master@127.13.196.126:43047 shutdown complete.
0a149379ee76471486be2b9ebfecd41c  4
4b5da3bc4d874b6a9c0577fd3efc216c  1
805e8170bc1444e9998b86a2cdb8eac2  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13996 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:07:25.513252 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:40215
I20260709 13:07:25.514633 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:25.521703 14617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.521754 14618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.522456 14620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:25.523418 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:25.524556 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:25.524757 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:25.524874 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602445524863 us; error 0 us; skew 500 ppm
I20260709 13:07:25.525372 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:25.528533 14097 webserver.cc:533] Webserver started at http://127.13.196.126:35891/ using document root <none> and password file <none>
I20260709 13:07:25.529125 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:25.529314 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:25.529613 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:25.530967 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "49baf79a82334de49896f790535f61a9"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-ftjc"
I20260709 13:07:25.537181 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:07:25.541724 14625 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.542685 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:07:25.543082 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "49baf79a82334de49896f790535f61a9"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-ftjc"
I20260709 13:07:25.543437 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:25.557547 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:25.559176 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:25.611972 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:40215
I20260709 13:07:25.612097 14676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:40215 every 8 connection(s)
I20260709 13:07:25.617449 14677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.628647 14677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9: Bootstrap starting.
I20260709 13:07:25.635270 14677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.641057 14677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9: No bootstrap required, opened a new log
I20260709 13:07:25.643716 14677 raft_consensus.cc:359] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49baf79a82334de49896f790535f61a9" member_type: VOTER }
I20260709 13:07:25.644521 14677 raft_consensus.cc:385] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.644758 14677 raft_consensus.cc:740] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49baf79a82334de49896f790535f61a9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.645581 14677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49baf79a82334de49896f790535f61a9" member_type: VOTER }
I20260709 13:07:25.646118 14677 raft_consensus.cc:399] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:25.646323 14677 raft_consensus.cc:493] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:25.646557 14677 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.651510 14677 raft_consensus.cc:515] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49baf79a82334de49896f790535f61a9" member_type: VOTER }
I20260709 13:07:25.652473 14677 leader_election.cc:304] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49baf79a82334de49896f790535f61a9; no voters: 
I20260709 13:07:25.653927 14677 leader_election.cc:290] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:25.654412 14680 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.656550 14680 raft_consensus.cc:697] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 1 LEADER]: Becoming Leader. State: Replica: 49baf79a82334de49896f790535f61a9, State: Running, Role: LEADER
I20260709 13:07:25.657470 14680 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49baf79a82334de49896f790535f61a9" member_type: VOTER }
I20260709 13:07:25.658088 14677 sys_catalog.cc:565] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:25.663228 14682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49baf79a82334de49896f790535f61a9. Latest consensus state: current_term: 1 leader_uuid: "49baf79a82334de49896f790535f61a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49baf79a82334de49896f790535f61a9" member_type: VOTER } }
I20260709 13:07:25.665380 14682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:25.664707 14681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49baf79a82334de49896f790535f61a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49baf79a82334de49896f790535f61a9" member_type: VOTER } }
I20260709 13:07:25.666352 14681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:25.668414 14689 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:25.675323 14689 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:25.678495 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:25.687395 14689 catalog_manager.cc:1383] Generated new cluster ID: afb5e07fa1114620bd5e0bf702374f88
I20260709 13:07:25.687781 14689 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:25.711673 14689 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:25.713161 14689 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:25.730633 14689 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9: Generated new TSK 0
I20260709 13:07:25.731396 14689 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:25.747265 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:25.755685 14698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.756443 14699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.758867 14701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:25.759382 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:25.760803 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:25.761058 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:25.761390 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602445761366 us; error 0 us; skew 500 ppm
I20260709 13:07:25.762056 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:25.765480 14097 webserver.cc:533] Webserver started at http://127.13.196.65:36641/ using document root <none> and password file <none>
I20260709 13:07:25.766348 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:25.766691 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:25.767081 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:25.768487 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "006d0e674197426eae7f370303df5cea"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-ftjc"
I20260709 13:07:25.774044 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:25.778535 14706 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.779824 14097 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:25.780499 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "006d0e674197426eae7f370303df5cea"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-ftjc"
I20260709 13:07:25.781028 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:25.802800 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:25.804502 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:25.806571 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:25.809461 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:25.809739 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.809986 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:25.810139 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.864813 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:46065
I20260709 13:07:25.864910 14768 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:46065 every 8 connection(s)
I20260709 13:07:25.870780 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:25.881343 14773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.886130 14774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.887216 14776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:25.887673 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:25.888871 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:25.889148 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:25.889360 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602445889333 us; error 0 us; skew 500 ppm
I20260709 13:07:25.890079 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:25.893863 14097 webserver.cc:533] Webserver started at http://127.13.196.66:37967/ using document root <none> and password file <none>
I20260709 13:07:25.894759 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:25.895083 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:25.895723 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:25.897430 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "b2c52a0b36f3486e8034aff32339c657"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-ftjc"
I20260709 13:07:25.898524 14769 heartbeater.cc:344] Connected to a master server at 127.13.196.126:40215
I20260709 13:07:25.899017 14769 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:25.900537 14769 heartbeater.cc:507] Master 127.13.196.126:40215 requested a full tablet report, sending...
I20260709 13:07:25.903488 14642 ts_manager.cc:194] Registered new tserver with Master: 006d0e674197426eae7f370303df5cea (127.13.196.65:46065)
I20260709 13:07:25.904832 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:07:25.905980 14642 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41426
I20260709 13:07:25.909258 14781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.910434 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:07:25.910799 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "b2c52a0b36f3486e8034aff32339c657"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-ftjc"
I20260709 13:07:25.911164 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:25.928752 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:25.930239 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:25.932586 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:25.935873 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:25.936302 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:07:25.936671 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:25.936863 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.996830 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:39153
I20260709 13:07:25.996920 14843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:39153 every 8 connection(s)
I20260709 13:07:26.005400 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:26.015039 14847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:26.018573 14848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:26.022534 14850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:26.022917 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:26.024057 14844 heartbeater.cc:344] Connected to a master server at 127.13.196.126:40215
I20260709 13:07:26.024505 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:26.024524 14844 heartbeater.cc:461] Registering TS with master...
W20260709 13:07:26.024890 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:26.025198 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602446025175 us; error 0 us; skew 500 ppm
I20260709 13:07:26.025857 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:26.026304 14844 heartbeater.cc:507] Master 127.13.196.126:40215 requested a full tablet report, sending...
I20260709 13:07:26.029568 14642 ts_manager.cc:194] Registered new tserver with Master: b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:26.030220 14097 webserver.cc:533] Webserver started at http://127.13.196.67:33823/ using document root <none> and password file <none>
I20260709 13:07:26.030819 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:26.031044 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:26.031363 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:26.031492 14642 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41434
I20260709 13:07:26.033285 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "c8379b8234e84226a4b14f02781ac248"
format_stamp: "Formatted at 2026-07-09 13:07:26 on dist-test-slave-ftjc"
I20260709 13:07:26.038853 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:07:26.043397 14855 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:26.044663 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:07:26.045163 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "c8379b8234e84226a4b14f02781ac248"
format_stamp: "Formatted at 2026-07-09 13:07:26 on dist-test-slave-ftjc"
I20260709 13:07:26.045619 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:26.068063 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:26.069665 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:26.071682 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:26.074826 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:26.075068 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:26.075438 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:26.075604 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:26.134618 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:42175
I20260709 13:07:26.134753 14917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:42175 every 8 connection(s)
I20260709 13:07:26.152120 14918 heartbeater.cc:344] Connected to a master server at 127.13.196.126:40215
I20260709 13:07:26.152683 14918 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:26.153611 14918 heartbeater.cc:507] Master 127.13.196.126:40215 requested a full tablet report, sending...
I20260709 13:07:26.156724 14642 ts_manager.cc:194] Registered new tserver with Master: c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:26.157539 14097 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018913053s
I20260709 13:07:26.158404 14642 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41450
I20260709 13:07:26.194725 14642 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41458:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:26.198357 14642 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:26.300205 14809 tablet_service.cc:1511] Processing CreateTablet for tablet f162f97bae5d40529d7ab9d954e92930 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:26.300701 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 18af9f65a4a043e0b6a333996fd1bd02 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:26.302085 14809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f162f97bae5d40529d7ab9d954e92930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.302326 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18af9f65a4a043e0b6a333996fd1bd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.301971 14882 tablet_service.cc:1511] Processing CreateTablet for tablet b0e1f9afecbe4bb2a2f1b2b91f66bafa (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:26.303748 14882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e1f9afecbe4bb2a2f1b2b91f66bafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.300701 14883 tablet_service.cc:1511] Processing CreateTablet for tablet f162f97bae5d40529d7ab9d954e92930 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:26.307695 14883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f162f97bae5d40529d7ab9d954e92930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.310799 14808 tablet_service.cc:1511] Processing CreateTablet for tablet b0e1f9afecbe4bb2a2f1b2b91f66bafa (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:26.311180 14880 tablet_service.cc:1511] Processing CreateTablet for tablet d548a418f29644e5805861e4a4b67cf3 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:26.312187 14879 tablet_service.cc:1511] Processing CreateTablet for tablet f73dea2ea0544833b533bca4c50fbaf1 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:26.313263 14808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e1f9afecbe4bb2a2f1b2b91f66bafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.313305 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d548a418f29644e5805861e4a4b67cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.317934 14878 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc52a54d7a14f08b0948b655ebcaefd (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:26.319681 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc52a54d7a14f08b0948b655ebcaefd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.320866 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73dea2ea0544833b533bca4c50fbaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.329963 14877 tablet_service.cc:1511] Processing CreateTablet for tablet 3f98cb0bee9649979976436cf93d6b60 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:26.330704 14876 tablet_service.cc:1511] Processing CreateTablet for tablet 8901f112dfb64e0f9875b4ccbbdc8ebe (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:26.331800 14877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f98cb0bee9649979976436cf93d6b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.332829 14876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8901f112dfb64e0f9875b4ccbbdc8ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.335395 14875 tablet_service.cc:1511] Processing CreateTablet for tablet f14bb0ddaf25448d9eb4fa77be4323f5 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:26.336941 14807 tablet_service.cc:1511] Processing CreateTablet for tablet 18af9f65a4a043e0b6a333996fd1bd02 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:26.338712 14807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18af9f65a4a043e0b6a333996fd1bd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.342373 14874 tablet_service.cc:1511] Processing CreateTablet for tablet dc25b27191f0412285c3a74bed265505 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:26.346678 14806 tablet_service.cc:1511] Processing CreateTablet for tablet d548a418f29644e5805861e4a4b67cf3 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:26.347247 14805 tablet_service.cc:1511] Processing CreateTablet for tablet f73dea2ea0544833b533bca4c50fbaf1 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:26.350003 14804 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc52a54d7a14f08b0948b655ebcaefd (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:26.353332 14803 tablet_service.cc:1511] Processing CreateTablet for tablet 3f98cb0bee9649979976436cf93d6b60 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:26.354797 14800 tablet_service.cc:1511] Processing CreateTablet for tablet dc25b27191f0412285c3a74bed265505 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:26.356206 14802 tablet_service.cc:1511] Processing CreateTablet for tablet 8901f112dfb64e0f9875b4ccbbdc8ebe (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:26.358968 14801 tablet_service.cc:1511] Processing CreateTablet for tablet f14bb0ddaf25448d9eb4fa77be4323f5 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:26.362061 14806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d548a418f29644e5805861e4a4b67cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.362948 14805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73dea2ea0544833b533bca4c50fbaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.366581 14802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8901f112dfb64e0f9875b4ccbbdc8ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.367504 14800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc25b27191f0412285c3a74bed265505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.344830 14875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14bb0ddaf25448d9eb4fa77be4323f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.369128 14874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc25b27191f0412285c3a74bed265505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.368180 14804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc52a54d7a14f08b0948b655ebcaefd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.371388 14803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f98cb0bee9649979976436cf93d6b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.373188 14801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14bb0ddaf25448d9eb4fa77be4323f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.425906 14733 tablet_service.cc:1511] Processing CreateTablet for tablet b0e1f9afecbe4bb2a2f1b2b91f66bafa (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:26.427590 14733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e1f9afecbe4bb2a2f1b2b91f66bafa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.429330 14725 tablet_service.cc:1511] Processing CreateTablet for tablet dc25b27191f0412285c3a74bed265505 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:26.429663 14732 tablet_service.cc:1511] Processing CreateTablet for tablet 18af9f65a4a043e0b6a333996fd1bd02 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:26.431203 14725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc25b27191f0412285c3a74bed265505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.433673 14730 tablet_service.cc:1511] Processing CreateTablet for tablet f73dea2ea0544833b533bca4c50fbaf1 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:26.438674 14728 tablet_service.cc:1511] Processing CreateTablet for tablet 3f98cb0bee9649979976436cf93d6b60 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:26.441540 14727 tablet_service.cc:1511] Processing CreateTablet for tablet 8901f112dfb64e0f9875b4ccbbdc8ebe (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:26.445927 14734 tablet_service.cc:1511] Processing CreateTablet for tablet f162f97bae5d40529d7ab9d954e92930 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:26.444090 14726 tablet_service.cc:1511] Processing CreateTablet for tablet f14bb0ddaf25448d9eb4fa77be4323f5 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:26.431989 14731 tablet_service.cc:1511] Processing CreateTablet for tablet d548a418f29644e5805861e4a4b67cf3 (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:26.436312 14729 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc52a54d7a14f08b0948b655ebcaefd (DEFAULT_TABLE table=test-workload [id=1b095d17d0554c2b8baa51d8ea20ea9e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:26.450269 14730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f73dea2ea0544833b533bca4c50fbaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.459352 14734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f162f97bae5d40529d7ab9d954e92930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.460829 14731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d548a418f29644e5805861e4a4b67cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.461632 14726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14bb0ddaf25448d9eb4fa77be4323f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.463752 14732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18af9f65a4a043e0b6a333996fd1bd02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.468802 14727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8901f112dfb64e0f9875b4ccbbdc8ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.472180 14729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc52a54d7a14f08b0948b655ebcaefd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.476804 14728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f98cb0bee9649979976436cf93d6b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.445930 14933 tablet_bootstrap.cc:492] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:26.512104 14934 tablet_bootstrap.cc:492] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:26.520424 14935 tablet_bootstrap.cc:492] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:26.546172 14933 tablet_bootstrap.cc:654] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.559521 14935 tablet_bootstrap.cc:654] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.569875 14934 tablet_bootstrap.cc:654] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.579641 14935 tablet_bootstrap.cc:492] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:26.580307 14935 ts_tablet_manager.cc:1403] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.000s
I20260709 13:07:26.581418 14933 tablet_bootstrap.cc:492] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:26.584764 14933 ts_tablet_manager.cc:1403] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.139s	user 0.005s	sys 0.020s
I20260709 13:07:26.584156 14935 raft_consensus.cc:359] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.585238 14935 raft_consensus.cc:385] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.585626 14934 tablet_bootstrap.cc:492] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:26.585640 14935 raft_consensus.cc:740] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.586364 14934 ts_tablet_manager.cc:1403] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.003s
I20260709 13:07:26.586768 14935 consensus_queue.cc:260] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.588192 14933 raft_consensus.cc:359] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.589061 14933 raft_consensus.cc:385] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.589380 14933 raft_consensus.cc:740] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.589929 14934 raft_consensus.cc:359] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.590806 14934 raft_consensus.cc:385] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.590435 14933 consensus_queue.cc:260] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.591225 14934 raft_consensus.cc:740] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.592453 14934 consensus_queue.cc:260] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.593663 14918 heartbeater.cc:499] Master 127.13.196.126:40215 was elected leader, sending a full tablet report...
I20260709 13:07:26.594038 14933 ts_tablet_manager.cc:1434] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:07:26.595402 14933 tablet_bootstrap.cc:492] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:26.595449 14844 heartbeater.cc:499] Master 127.13.196.126:40215 was elected leader, sending a full tablet report...
I20260709 13:07:26.596114 14934 ts_tablet_manager.cc:1434] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:07:26.597313 14934 tablet_bootstrap.cc:492] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:26.603468 14933 tablet_bootstrap.cc:654] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.605916 14934 tablet_bootstrap.cc:654] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.613400 14933 tablet_bootstrap.cc:492] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:26.614060 14933 ts_tablet_manager.cc:1403] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.001s
I20260709 13:07:26.614929 14935 ts_tablet_manager.cc:1434] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.011s
I20260709 13:07:26.615880 14769 heartbeater.cc:499] Master 127.13.196.126:40215 was elected leader, sending a full tablet report...
I20260709 13:07:26.616573 14934 tablet_bootstrap.cc:492] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:26.617254 14934 ts_tablet_manager.cc:1403] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:07:26.620901 14934 raft_consensus.cc:359] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:26.621884 14934 raft_consensus.cc:385] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.622320 14934 raft_consensus.cc:740] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.622951 14935 tablet_bootstrap.cc:492] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:26.623514 14934 consensus_queue.cc:260] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:26.625686 14933 raft_consensus.cc:359] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.626565 14933 raft_consensus.cc:385] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.626657 14934 ts_tablet_manager.cc:1434] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:07:26.626971 14933 raft_consensus.cc:740] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.628041 14934 tablet_bootstrap.cc:492] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:26.628077 14933 consensus_queue.cc:260] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.631106 14933 ts_tablet_manager.cc:1434] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.005s
I20260709 13:07:26.631635 14935 tablet_bootstrap.cc:654] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.632216 14933 tablet_bootstrap.cc:492] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:26.636569 14934 tablet_bootstrap.cc:654] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.652014 14933 tablet_bootstrap.cc:654] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.677946 14940 raft_consensus.cc:493] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.683612 14940 raft_consensus.cc:515] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
W20260709 13:07:26.672264 14690 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:26.698016 14940 leader_election.cc:290] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:26.713512 14933 tablet_bootstrap.cc:492] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:26.714210 14933 ts_tablet_manager.cc:1403] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.026s
I20260709 13:07:26.719914 14934 tablet_bootstrap.cc:492] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:26.720742 14934 ts_tablet_manager.cc:1403] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.093s	user 0.031s	sys 0.047s
I20260709 13:07:26.724431 14934 raft_consensus.cc:359] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.725313 14934 raft_consensus.cc:385] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.725704 14934 raft_consensus.cc:740] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.726567 14934 consensus_queue.cc:260] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.727813 14819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:26.728415 14744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:26.729535 14934 ts_tablet_manager.cc:1434] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:26.730050 14933 raft_consensus.cc:359] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
W20260709 13:07:26.731319 14857 leader_election.cc:343] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 006d0e674197426eae7f370303df5cea (127.13.196.65:46065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:26.733542 14856 leader_election.cc:343] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.734231 14856 leader_election.cc:304] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8379b8234e84226a4b14f02781ac248; no voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:26.730854 14933 raft_consensus.cc:385] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.735745 14940 raft_consensus.cc:2749] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:26.734908 14933 raft_consensus.cc:740] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.737057 14935 tablet_bootstrap.cc:492] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:26.738123 14935 ts_tablet_manager.cc:1403] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.115s	user 0.043s	sys 0.033s
I20260709 13:07:26.737557 14933 consensus_queue.cc:260] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.740634 14933 ts_tablet_manager.cc:1434] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:07:26.741042 14934 tablet_bootstrap.cc:492] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:26.741683 14933 tablet_bootstrap.cc:492] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:26.742517 14935 raft_consensus.cc:359] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.743335 14935 raft_consensus.cc:385] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.743690 14935 raft_consensus.cc:740] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.744593 14935 consensus_queue.cc:260] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.747321 14935 ts_tablet_manager.cc:1434] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:07:26.748652 14935 tablet_bootstrap.cc:492] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:26.749891 14933 tablet_bootstrap.cc:654] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.749892 14934 tablet_bootstrap.cc:654] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.765111 14935 tablet_bootstrap.cc:654] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.765488 14941 raft_consensus.cc:493] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.766381 14941 raft_consensus.cc:515] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:26.770295 14941 leader_election.cc:290] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175), 006d0e674197426eae7f370303df5cea (127.13.196.65:46065)
I20260709 13:07:26.770586 14934 tablet_bootstrap.cc:492] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:26.771346 14934 ts_tablet_manager.cc:1403] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.017s
I20260709 13:07:26.778100 14940 raft_consensus.cc:493] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.778843 14940 raft_consensus.cc:515] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.783432 14935 tablet_bootstrap.cc:492] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:26.783246 14744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:26.784471 14744 raft_consensus.cc:2468] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 0.
I20260709 13:07:26.785055 14935 ts_tablet_manager.cc:1403] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.012s
I20260709 13:07:26.786675 14857 leader_election.cc:304] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:26.784606 14939 raft_consensus.cc:493] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.788743 14935 raft_consensus.cc:359] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.789520 14939 raft_consensus.cc:515] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.790570 14940 leader_election.cc:290] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:26.791465 14940 raft_consensus.cc:2804] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.792065 14940 raft_consensus.cc:493] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.792770 14940 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.793092 14933 tablet_bootstrap.cc:492] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:26.793900 14933 ts_tablet_manager.cc:1403] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.008s
I20260709 13:07:26.794682 14939 leader_election.cc:290] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:26.795011 14819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:26.789561 14935 raft_consensus.cc:385] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.795907 14935 raft_consensus.cc:740] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
W20260709 13:07:26.797269 14856 leader_election.cc:343] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.796825 14935 consensus_queue.cc:260] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.798200 14933 raft_consensus.cc:359] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.799013 14933 raft_consensus.cc:385] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.799572 14933 raft_consensus.cc:740] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.803375 14935 ts_tablet_manager.cc:1434] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:07:26.804719 14935 tablet_bootstrap.cc:492] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:26.810909 14933 consensus_queue.cc:260] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.812453 14935 tablet_bootstrap.cc:654] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.813941 14934 raft_consensus.cc:359] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.821538 14934 raft_consensus.cc:385] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.823011 14934 raft_consensus.cc:740] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.824958 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
I20260709 13:07:26.827589 14934 consensus_queue.cc:260] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.831883 14940 raft_consensus.cc:515] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
W20260709 13:07:26.826969 14784 leader_election.cc:343] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.823791 14933 ts_tablet_manager.cc:1434] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.007s
I20260709 13:07:26.837333 14819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:26.845012 14819 raft_consensus.cc:2468] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 0.
I20260709 13:07:26.846520 14707 leader_election.cc:304] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:26.846987 14819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:26.847630 14939 raft_consensus.cc:2804] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.848040 14939 raft_consensus.cc:493] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.848453 14939 raft_consensus.cc:3060] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.850521 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:26.851609 14933 tablet_bootstrap.cc:492] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:26.851328 14743 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.852802 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
W20260709 13:07:26.856787 14856 leader_election.cc:343] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:26.857663 14709 leader_election.cc:343] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.837749 14934 ts_tablet_manager.cc:1434] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.001s
I20260709 13:07:26.833186 14935 tablet_bootstrap.cc:492] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:26.839205 14744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:26.860894 14935 ts_tablet_manager.cc:1403] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.007s
I20260709 13:07:26.860199 14940 leader_election.cc:290] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
W20260709 13:07:26.862293 14783 leader_election.cc:343] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 006d0e674197426eae7f370303df5cea (127.13.196.65:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.862190 14939 raft_consensus.cc:515] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.862833 14783 leader_election.cc:304] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657; no voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248
I20260709 13:07:26.864005 14743 raft_consensus.cc:2468] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 1.
I20260709 13:07:26.864193 14941 raft_consensus.cc:2749] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:26.865386 14934 tablet_bootstrap.cc:492] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:26.865883 14819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:26.866184 14939 leader_election.cc:290] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:26.866621 14819 raft_consensus.cc:3060] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.865417 14857 leader_election.cc:304] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:26.868582 14940 raft_consensus.cc:2804] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:26.868193 14935 raft_consensus.cc:359] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.869171 14935 raft_consensus.cc:385] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.870329 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:26.869549 14935 raft_consensus.cc:740] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.871695 14935 consensus_queue.cc:260] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
W20260709 13:07:26.872766 14709 leader_election.cc:343] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.870376 14940 raft_consensus.cc:697] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:26.875571 14935 ts_tablet_manager.cc:1434] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:07:26.879125 14935 tablet_bootstrap.cc:492] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:26.878820 14940 consensus_queue.cc:237] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.876948 14819 raft_consensus.cc:2468] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 1.
I20260709 13:07:26.877357 14933 tablet_bootstrap.cc:654] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.886554 14707 leader_election.cc:304] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: c8379b8234e84226a4b14f02781ac248
I20260709 13:07:26.888130 14939 raft_consensus.cc:2804] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:26.894183 14639 catalog_manager.cc:5697] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.898136 14934 tablet_bootstrap.cc:654] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.900679 14935 tablet_bootstrap.cc:654] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.904939 14933 tablet_bootstrap.cc:492] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:26.905823 14933 ts_tablet_manager.cc:1403] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.015s
I20260709 13:07:26.911548 14939 raft_consensus.cc:697] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:26.910995 14933 raft_consensus.cc:359] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.912773 14933 raft_consensus.cc:385] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.913144 14933 raft_consensus.cc:740] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.913275 14939 consensus_queue.cc:237] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.916698 14934 tablet_bootstrap.cc:492] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:26.917343 14934 ts_tablet_manager.cc:1403] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.018s
I20260709 13:07:26.918556 14935 tablet_bootstrap.cc:492] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:26.919217 14935 ts_tablet_manager.cc:1403] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 13:07:26.914402 14933 consensus_queue.cc:260] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.920996 14934 raft_consensus.cc:359] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.922570 14935 raft_consensus.cc:359] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.923128 14934 raft_consensus.cc:385] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.925022 14934 raft_consensus.cc:740] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.926072 14934 consensus_queue.cc:260] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.928709 14934 ts_tablet_manager.cc:1434] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:07:26.923560 14935 raft_consensus.cc:385] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.929458 14935 raft_consensus.cc:740] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.930027 14934 tablet_bootstrap.cc:492] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:26.930276 14935 consensus_queue.cc:260] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.932834 14935 ts_tablet_manager.cc:1434] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:26.932442 14640 catalog_manager.cc:5697] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 0 to 1, leader changed from <none> to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 1 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.933738 14933 ts_tablet_manager.cc:1434] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.003s
I20260709 13:07:26.934026 14935 tablet_bootstrap.cc:492] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:26.934870 14933 tablet_bootstrap.cc:492] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:26.942509 14935 tablet_bootstrap.cc:654] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.942520 14933 tablet_bootstrap.cc:654] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.958730 14934 tablet_bootstrap.cc:654] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.959513 14935 tablet_bootstrap.cc:492] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:26.962076 14933 tablet_bootstrap.cc:492] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:26.960141 14935 ts_tablet_manager.cc:1403] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.009s
I20260709 13:07:26.963059 14933 ts_tablet_manager.cc:1403] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.015s
I20260709 13:07:26.965523 14934 tablet_bootstrap.cc:492] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:26.966101 14934 ts_tablet_manager.cc:1403] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.003s
I20260709 13:07:26.966641 14935 raft_consensus.cc:359] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:26.967486 14935 raft_consensus.cc:385] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.967094 14933 raft_consensus.cc:359] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.967828 14935 raft_consensus.cc:740] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.967933 14933 raft_consensus.cc:385] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.968447 14933 raft_consensus.cc:740] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.968848 14935 consensus_queue.cc:260] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:26.969270 14933 consensus_queue.cc:260] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.971820 14933 ts_tablet_manager.cc:1434] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:07:26.971895 14934 raft_consensus.cc:359] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.971777 14935 ts_tablet_manager.cc:1434] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:07:26.972857 14934 raft_consensus.cc:385] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.973201 14934 raft_consensus.cc:740] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.973541 14933 tablet_bootstrap.cc:492] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:26.973730 14935 tablet_bootstrap.cc:492] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:26.974182 14934 consensus_queue.cc:260] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:26.981346 14934 ts_tablet_manager.cc:1434] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:07:26.982583 14935 tablet_bootstrap.cc:654] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.982636 14934 tablet_bootstrap.cc:492] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:26.983796 14933 tablet_bootstrap.cc:654] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.993670 14934 tablet_bootstrap.cc:654] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.001320 14935 tablet_bootstrap.cc:492] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:27.002282 14935 ts_tablet_manager.cc:1403] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 13:07:27.005280 14934 tablet_bootstrap.cc:492] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:27.005419 14933 tablet_bootstrap.cc:492] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:27.005975 14934 ts_tablet_manager.cc:1403] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 13:07:27.006048 14933 ts_tablet_manager.cc:1403] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.011s
I20260709 13:07:27.009624 14934 raft_consensus.cc:359] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.006021 14935 raft_consensus.cc:359] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.010605 14934 raft_consensus.cc:385] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.010803 14935 raft_consensus.cc:385] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.011056 14934 raft_consensus.cc:740] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.011401 14935 raft_consensus.cc:740] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.012526 14935 consensus_queue.cc:260] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.013870 14933 raft_consensus.cc:359] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.014873 14933 raft_consensus.cc:385] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.015280 14933 raft_consensus.cc:740] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.016328 14935 ts_tablet_manager.cc:1434] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:07:27.016528 14933 consensus_queue.cc:260] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.018057 14935 tablet_bootstrap.cc:492] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:27.012241 14934 consensus_queue.cc:260] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.020633 14933 ts_tablet_manager.cc:1434] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:07:27.020596 14940 raft_consensus.cc:493] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.021762 14940 raft_consensus.cc:515] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.025277 14934 ts_tablet_manager.cc:1434] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:07:27.025542 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:27.026414 14743 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 0.
I20260709 13:07:27.026643 14934 tablet_bootstrap.cc:492] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:27.026978 14935 tablet_bootstrap.cc:654] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.028098 14857 leader_election.cc:304] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.029340 14954 raft_consensus.cc:2804] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.029817 14954 raft_consensus.cc:493] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.030213 14954 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.038483 14940 leader_election.cc:290] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.039412 14819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:27.040511 14819 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 0.
I20260709 13:07:27.042373 14941 raft_consensus.cc:493] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.043116 14941 raft_consensus.cc:515] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.045032 14933 tablet_bootstrap.cc:492] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:27.047561 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
W20260709 13:07:27.049836 14783 leader_election.cc:343] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 006d0e674197426eae7f370303df5cea (127.13.196.65:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.053719 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
W20260709 13:07:27.057265 14784 leader_election.cc:343] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.058524 14784 leader_election.cc:304] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657; no voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248
I20260709 13:07:27.059221 14954 raft_consensus.cc:515] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.061372 14941 leader_election.cc:290] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.062975 14954 leader_election.cc:290] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.063230 14934 tablet_bootstrap.cc:654] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.065140 14819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.065189 14933 tablet_bootstrap.cc:654] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.065977 14819 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.069228 14935 tablet_bootstrap.cc:492] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:27.069844 14935 ts_tablet_manager.cc:1403] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.028s
I20260709 13:07:27.070272 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.071098 14743 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.073313 14935 raft_consensus.cc:359] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.074288 14935 raft_consensus.cc:385] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.074664 14935 raft_consensus.cc:740] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.075932 14935 consensus_queue.cc:260] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.075850 14974 raft_consensus.cc:2749] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.084803 14935 ts_tablet_manager.cc:1434] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:07:27.086088 14935 tablet_bootstrap.cc:492] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:27.093214 14935 tablet_bootstrap.cc:654] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.093016 14939 raft_consensus.cc:493] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.097093 14939 raft_consensus.cc:515] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.098441 14933 tablet_bootstrap.cc:492] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:27.099031 14933 ts_tablet_manager.cc:1403] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.014s
I20260709 13:07:27.099874 14939 leader_election.cc:290] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.102180 14934 tablet_bootstrap.cc:492] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:27.102726 14934 ts_tablet_manager.cc:1403] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.007s
I20260709 13:07:27.102664 14933 raft_consensus.cc:359] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:27.103801 14933 raft_consensus.cc:385] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.104034 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:27.104143 14933 raft_consensus.cc:740] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.105288 14818 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 0.
I20260709 13:07:27.105705 14933 consensus_queue.cc:260] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:27.106304 14934 raft_consensus.cc:359] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.106997 14934 raft_consensus.cc:385] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.107278 14934 raft_consensus.cc:740] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.107319 14707 leader_election.cc:304] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:27.108538 14939 raft_consensus.cc:2804] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.108946 14939 raft_consensus.cc:493] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.109344 14939 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.104568 14743 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 1.
I20260709 13:07:27.112162 14857 leader_election.cc:304] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.112844 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
I20260709 13:07:27.113758 14954 raft_consensus.cc:2804] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.114034 14893 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 0.
I20260709 13:07:27.114552 14954 raft_consensus.cc:697] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:27.118345 14933 ts_tablet_manager.cc:1434] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:07:27.118001 14954 consensus_queue.cc:237] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.119653 14933 tablet_bootstrap.cc:492] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:27.123111 14939 raft_consensus.cc:515] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.108228 14934 consensus_queue.cc:260] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.126710 14934 ts_tablet_manager.cc:1434] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:07:27.129674 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.130384 14818 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.136895 14933 tablet_bootstrap.cc:654] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.139338 14819 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 1.
I20260709 13:07:27.139395 14974 raft_consensus.cc:493] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.140465 14974 raft_consensus.cc:515] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.143186 14934 tablet_bootstrap.cc:492] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:27.146088 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
I20260709 13:07:27.146440 14974 leader_election.cc:290] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.146952 14893 raft_consensus.cc:2468] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 0.
I20260709 13:07:27.148904 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:27.149307 14784 leader_election.cc:304] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.150290 14974 raft_consensus.cc:2804] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.150714 14974 raft_consensus.cc:493] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.151149 14974 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:27.151523 14783 leader_election.cc:343] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 006d0e674197426eae7f370303df5cea (127.13.196.65:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.152274 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.153051 14893 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.156163 14818 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 1.
I20260709 13:07:27.158389 14960 raft_consensus.cc:493] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.159988 14935 tablet_bootstrap.cc:492] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:27.159602 14960 raft_consensus.cc:515] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.155061 14939 leader_election.cc:290] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.162617 14707 leader_election.cc:304] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:27.160907 14935 ts_tablet_manager.cc:1403] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.075s	user 0.031s	sys 0.029s
I20260709 13:07:27.165834 14974 raft_consensus.cc:515] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.169159 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.168922 14935 raft_consensus.cc:359] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.170346 14935 raft_consensus.cc:385] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.170522 14893 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 1.
I20260709 13:07:27.170737 14935 raft_consensus.cc:740] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.169132 14640 catalog_manager.cc:5697] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.171744 14935 consensus_queue.cc:260] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.172731 14743 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.172518 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73dea2ea0544833b533bca4c50fbaf1" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
I20260709 13:07:27.173664 14892 raft_consensus.cc:2468] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 0.
I20260709 13:07:27.170001 14960 leader_election.cc:290] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.176488 14709 leader_election.cc:304] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.176721 14939 raft_consensus.cc:2804] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.178333 14960 raft_consensus.cc:2804] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.178821 14960 raft_consensus.cc:493] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.179299 14974 leader_election.cc:290] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.179811 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73dea2ea0544833b533bca4c50fbaf1" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:27.180967 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248"
W20260709 13:07:27.181466 14707 leader_election.cc:343] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.186278 14743 raft_consensus.cc:2468] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 1.
I20260709 13:07:27.183529 14892 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.179195 14960 raft_consensus.cc:3060] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.193570 14783 leader_election.cc:304] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:27.198588 14934 tablet_bootstrap.cc:654] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.192749 14939 raft_consensus.cc:697] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:27.194646 14974 raft_consensus.cc:2804] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.202009 14974 raft_consensus.cc:697] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Becoming Leader. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:27.203029 14974 consensus_queue.cc:237] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.201995 14933 tablet_bootstrap.cc:492] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:27.204946 14933 ts_tablet_manager.cc:1403] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.012s
I20260709 13:07:27.200412 14939 consensus_queue.cc:237] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.210906 14933 raft_consensus.cc:359] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.211831 14933 raft_consensus.cc:385] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.212126 14933 raft_consensus.cc:740] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.214078 14935 ts_tablet_manager.cc:1434] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.048s	user 0.014s	sys 0.010s
I20260709 13:07:27.216034 14935 tablet_bootstrap.cc:492] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea: Bootstrap starting.
I20260709 13:07:27.216908 14892 raft_consensus.cc:2468] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 1.
I20260709 13:07:27.218751 14933 consensus_queue.cc:260] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.220954 14933 ts_tablet_manager.cc:1434] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:07:27.222175 14933 tablet_bootstrap.cc:492] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248: Bootstrap starting.
I20260709 13:07:27.230804 14935 tablet_bootstrap.cc:654] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.233150 14941 raft_consensus.cc:493] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.235888 14941 raft_consensus.cc:515] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.243643 14941 leader_election.cc:290] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.246217 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:27.246883 14933 tablet_bootstrap.cc:654] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.247030 14743 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 0.
I20260709 13:07:27.248700 14783 leader_election.cc:304] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:27.249701 14941 raft_consensus.cc:2804] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.250102 14941 raft_consensus.cc:493] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.250955 14941 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.246765 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
I20260709 13:07:27.253232 14892 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 0.
I20260709 13:07:27.254509 14639 catalog_manager.cc:5697] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2c52a0b36f3486e8034aff32339c657 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "b2c52a0b36f3486e8034aff32339c657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.263283 14941 raft_consensus.cc:515] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.264413 14960 raft_consensus.cc:515] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.266801 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.267731 14743 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.268232 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73dea2ea0544833b533bca4c50fbaf1" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.268769 14935 tablet_bootstrap.cc:492] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea: No bootstrap required, opened a new log
I20260709 13:07:27.269223 14935 ts_tablet_manager.cc:1403] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.007s
W20260709 13:07:27.270045 14707 leader_election.cc:343] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.273169 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73dea2ea0544833b533bca4c50fbaf1" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.273313 14960 leader_election.cc:290] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.273959 14892 raft_consensus.cc:3060] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.273471 14641 catalog_manager.cc:5697] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 0 to 1, leader changed from <none> to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 1 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.274508 14935 raft_consensus.cc:359] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.275262 14935 raft_consensus.cc:385] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.275583 14935 raft_consensus.cc:740] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.276281 14935 consensus_queue.cc:260] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.278618 14933 tablet_bootstrap.cc:492] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248: No bootstrap required, opened a new log
I20260709 13:07:27.278681 14935 ts_tablet_manager.cc:1434] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:27.279276 14933 ts_tablet_manager.cc:1403] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.002s
I20260709 13:07:27.281844 14933 raft_consensus.cc:359] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.282809 14933 raft_consensus.cc:385] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.283252 14933 raft_consensus.cc:740] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.283140 14892 raft_consensus.cc:2468] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 1.
I20260709 13:07:27.284777 14709 leader_election.cc:304] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:27.284801 14933 consensus_queue.cc:260] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.286180 14960 raft_consensus.cc:2804] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.286733 14960 raft_consensus.cc:697] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:27.286908 14954 raft_consensus.cc:493] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.287431 14954 raft_consensus.cc:515] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.287599 14960 consensus_queue.cc:237] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.292092 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:27.292932 14818 raft_consensus.cc:2468] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 0.
I20260709 13:07:27.293979 14939 raft_consensus.cc:493] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.294601 14939 raft_consensus.cc:515] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:27.299952 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:27.300603 14934 tablet_bootstrap.cc:492] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:27.301059 14818 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 0.
I20260709 13:07:27.301326 14934 ts_tablet_manager.cc:1403] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.158s	user 0.018s	sys 0.008s
I20260709 13:07:27.301079 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
I20260709 13:07:27.302385 14892 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 0.
I20260709 13:07:27.303380 14856 leader_election.cc:304] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.304141 14940 raft_consensus.cc:2804] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.304611 14940 raft_consensus.cc:493] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.304438 14709 leader_election.cc:304] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.304992 14940 raft_consensus.cc:3060] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.305943 14980 raft_consensus.cc:2804] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.306380 14980 raft_consensus.cc:493] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.306744 14744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:27.307451 14744 raft_consensus.cc:2468] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 0.
I20260709 13:07:27.306253 14743 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 1.
I20260709 13:07:27.308094 14980 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.309376 14783 leader_election.cc:304] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:27.310345 14974 raft_consensus.cc:2804] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.311414 14934 raft_consensus.cc:359] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.312322 14934 raft_consensus.cc:385] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.312696 14934 raft_consensus.cc:740] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.312934 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.314005 14892 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.315368 14940 raft_consensus.cc:515] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.314503 14934 consensus_queue.cc:260] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.317588 14954 leader_election.cc:290] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.318521 14939 leader_election.cc:290] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.320636 14940 leader_election.cc:290] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.320668 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.322005 14743 raft_consensus.cc:3060] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.322324 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.322929 14818 raft_consensus.cc:3060] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.324687 14933 ts_tablet_manager.cc:1434] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 13:07:27.310352 14941 leader_election.cc:290] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.331084 14818 raft_consensus.cc:2468] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 1.
I20260709 13:07:27.332898 14856 leader_election.cc:304] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.333407 14743 raft_consensus.cc:2468] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 1.
I20260709 13:07:27.334424 14940 raft_consensus.cc:2804] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.335844 14974 raft_consensus.cc:697] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Becoming Leader. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:27.335170 14940 raft_consensus.cc:697] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:27.336966 14974 consensus_queue.cc:237] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.337522 14940 consensus_queue.cc:237] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.332782 14980 raft_consensus.cc:515] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:27.344156 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.345096 14893 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.346237 14980 leader_election.cc:290] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Requested vote from peers c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.330986 14892 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 1.
I20260709 13:07:27.348315 14989 raft_consensus.cc:493] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.348927 14989 raft_consensus.cc:515] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.350294 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.350986 14818 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.352406 14744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73dea2ea0544833b533bca4c50fbaf1" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:27.355012 14980 consensus_queue.cc:1048] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.361263 14989 leader_election.cc:290] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.361543 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f73dea2ea0544833b533bca4c50fbaf1" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8379b8234e84226a4b14f02781ac248" is_pre_election: true
I20260709 13:07:27.362872 14892 raft_consensus.cc:2393] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2c52a0b36f3486e8034aff32339c657 in current term 1: Already voted for candidate 006d0e674197426eae7f370303df5cea in this term.
I20260709 13:07:27.364173 14784 leader_election.cc:304] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657; no voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248
I20260709 13:07:27.365142 14989 raft_consensus.cc:3060] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.344177 14640 catalog_manager.cc:5697] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 0 to 1, leader changed from <none> to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 1 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.369163 14934 ts_tablet_manager.cc:1434] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 13:07:27.370919 14893 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 1.
I20260709 13:07:27.370321 14934 tablet_bootstrap.cc:492] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657: Bootstrap starting.
I20260709 13:07:27.370012 14818 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 1.
I20260709 13:07:27.372530 14709 leader_election.cc:304] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.381569 14960 raft_consensus.cc:2804] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.382200 14960 raft_consensus.cc:697] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:27.375643 14641 catalog_manager.cc:5697] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.383138 14960 consensus_queue.cc:237] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:27.375694 14989 raft_consensus.cc:2749] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.378717 14934 tablet_bootstrap.cc:654] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.400578 14940 raft_consensus.cc:493] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.401499 14940 raft_consensus.cc:515] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.407040 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:27.408140 14743 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 0.
I20260709 13:07:27.410387 14857 leader_election.cc:304] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.413014 14954 raft_consensus.cc:2804] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.413511 14954 raft_consensus.cc:493] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.413929 14954 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.414013 14940 leader_election.cc:290] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.415781 14639 catalog_manager.cc:5697] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2c52a0b36f3486e8034aff32339c657 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "b2c52a0b36f3486e8034aff32339c657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.419996 14640 catalog_manager.cc:5697] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 0 to 1, leader changed from <none> to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 1 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.425275 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
W20260709 13:07:27.426996 14856 leader_election.cc:343] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.429569 14893 raft_consensus.cc:3060] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.429445 14954 raft_consensus.cc:515] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.430760 14934 tablet_bootstrap.cc:492] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657: No bootstrap required, opened a new log
I20260709 13:07:27.431293 14934 ts_tablet_manager.cc:1403] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.007s
I20260709 13:07:27.431870 14954 leader_election.cc:290] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.433636 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.434286 14743 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.434994 14934 raft_consensus.cc:359] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.435770 14934 raft_consensus.cc:385] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.436089 14934 raft_consensus.cc:740] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.437016 14934 consensus_queue.cc:260] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.439683 14934 ts_tablet_manager.cc:1434] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:07:27.433158 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.440687 14818 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.442736 14743 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 1.
I20260709 13:07:27.445963 14857 leader_election.cc:304] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.447999 14940 raft_consensus.cc:2804] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.448619 14940 raft_consensus.cc:697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:27.449553 14940 consensus_queue.cc:237] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.451216 14818 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 1.
I20260709 13:07:27.452662 14819 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.457361 14954 raft_consensus.cc:493] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.458078 14954 raft_consensus.cc:515] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.459004 14980 consensus_queue.cc:1048] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.461519 14954 leader_election.cc:290] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.462159 14954 consensus_queue.cc:1048] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.463923 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2c52a0b36f3486e8034aff32339c657" is_pre_election: true
I20260709 13:07:27.466904 14940 consensus_queue.cc:1048] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.471832 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "006d0e674197426eae7f370303df5cea" is_pre_election: true
I20260709 13:07:27.475822 14857 leader_election.cc:304] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8379b8234e84226a4b14f02781ac248; no voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:27.477113 14640 catalog_manager.cc:5697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.520222 14940 raft_consensus.cc:2749] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:27.560029 14819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
mode: GRACEFUL
new_leader_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:53336
I20260709 13:07:27.560815 14819 raft_consensus.cc:606] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Received request to transfer leadership to TS 006d0e674197426eae7f370303df5cea
I20260709 13:07:27.582899 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
mode: GRACEFUL
new_leader_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:33646
I20260709 13:07:27.583643 14893 raft_consensus.cc:606] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Received request to transfer leadership to TS 006d0e674197426eae7f370303df5cea
I20260709 13:07:27.594089 14980 consensus_queue.cc:1048] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.599388 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
mode: GRACEFUL
new_leader_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:33646
I20260709 13:07:27.600459 14893 raft_consensus.cc:606] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Received request to transfer leadership to TS b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:27.609205 14980 consensus_queue.cc:1048] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.611573 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
mode: GRACEFUL
new_leader_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:33646
I20260709 13:07:27.612421 14893 raft_consensus.cc:606] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Received request to transfer leadership to TS b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:27.624948 14892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
mode: GRACEFUL
new_leader_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:33646
I20260709 13:07:27.625568 14892 raft_consensus.cc:606] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Received request to transfer leadership to TS b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:27.644659 14743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc25b27191f0412285c3a74bed265505"
dest_uuid: "006d0e674197426eae7f370303df5cea"
mode: GRACEFUL
new_leader_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:42028
I20260709 13:07:27.645318 14743 raft_consensus.cc:606] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Received request to transfer leadership to TS c8379b8234e84226a4b14f02781ac248
I20260709 13:07:27.646401 14989 consensus_queue.cc:1048] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.651868 14989 consensus_queue.cc:1048] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.654703 14940 consensus_queue.cc:1048] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.659660 14940 consensus_queue.cc:1048] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.681990 14974 raft_consensus.cc:993] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657: : Instructing follower 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:27.682787 14988 raft_consensus.cc:1081] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Signalling peer 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:27.685536 14743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa"
dest_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:42026
I20260709 13:07:27.686271 14743 raft_consensus.cc:493] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.686697 14743 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.694486 14940 raft_consensus.cc:993] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248: : Instructing follower b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:27.695096 14940 raft_consensus.cc:1081] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Signalling peer b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:27.697456 14817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:53318
I20260709 13:07:27.698294 14817 raft_consensus.cc:493] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.698846 14817 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.708330 14817 raft_consensus.cc:515] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.714560 14744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.715659 14744 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.716892 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.717669 14892 raft_consensus.cc:3055] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.718056 14892 raft_consensus.cc:740] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:27.719041 14892 consensus_queue.cc:260] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.720367 14892 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.720932 14743 raft_consensus.cc:515] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.722389 14742 raft_consensus.cc:1240] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Rejecting Update request from peer b2c52a0b36f3486e8034aff32339c657 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:27.725662 14744 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 2.
I20260709 13:07:27.727371 14783 leader_election.cc:304] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:27.728413 14989 raft_consensus.cc:2804] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.728298 14974 consensus_queue.cc:1059] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.729369 14988 raft_consensus.cc:3055] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.729776 14988 raft_consensus.cc:740] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:27.730198 14989 raft_consensus.cc:697] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Becoming Leader. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:27.730734 14988 consensus_queue.cc:260] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.731212 14989 consensus_queue.cc:237] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.732474 14743 leader_election.cc:290] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 2 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.732897 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.733556 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.733551 14893 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.735829 14817 leader_election.cc:290] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 2 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.732235 14988 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.741302 14892 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 2.
I20260709 13:07:27.742240 14639 catalog_manager.cc:5697] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 reported cstate change: term changed from 1 to 2, leader changed from c8379b8234e84226a4b14f02781ac248 (127.13.196.67) to b2c52a0b36f3486e8034aff32339c657 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "b2c52a0b36f3486e8034aff32339c657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.747934 14893 raft_consensus.cc:2468] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 2.
I20260709 13:07:27.749619 14709 leader_election.cc:304] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.750623 14980 raft_consensus.cc:2804] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.751174 14980 raft_consensus.cc:697] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:27.752117 14980 consensus_queue.cc:237] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.756667 14818 raft_consensus.cc:2468] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 2.
I20260709 13:07:27.761185 14639 catalog_manager.cc:5697] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 1 to 2, leader changed from b2c52a0b36f3486e8034aff32339c657 (127.13.196.66) to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 2 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.800151 14980 consensus_queue.cc:1048] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.812999 14939 consensus_queue.cc:1048] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.816752 14939 consensus_queue.cc:1048] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.812556 14988 consensus_queue.cc:1048] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:27.841624 14974 consensus_queue.cc:1048] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.845566 14939 consensus_queue.cc:1048] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.848415 14940 consensus_queue.cc:1048] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.852840 14940 consensus_queue.cc:1048] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.885458 14954 raft_consensus.cc:993] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248: : Instructing follower b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:27.889663 14954 raft_consensus.cc:1081] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Signalling peer b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:27.891760 14817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:53318
I20260709 13:07:27.892498 14817 raft_consensus.cc:493] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.893002 14817 raft_consensus.cc:3060] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.899545 14954 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.902590 14817 raft_consensus.cc:515] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.905951 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.906595 14817 leader_election.cc:290] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 2 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.906693 14743 raft_consensus.cc:3060] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.906915 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14bb0ddaf25448d9eb4fa77be4323f5" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.907723 14893 raft_consensus.cc:3055] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.908145 14893 raft_consensus.cc:740] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:27.909180 14893 consensus_queue.cc:260] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.910605 14893 raft_consensus.cc:3060] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.916913 14997 raft_consensus.cc:993] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248: : Instructing follower b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:27.917430 14997 raft_consensus.cc:1081] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Signalling peer b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:27.915990 14743 raft_consensus.cc:2468] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 2.
I20260709 13:07:27.919876 14783 leader_election.cc:304] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:27.920965 14893 raft_consensus.cc:2468] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 2.
I20260709 13:07:27.921340 14817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:53318
I20260709 13:07:27.922160 14817 raft_consensus.cc:493] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.922648 14817 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.923096 14988 raft_consensus.cc:2804] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.923653 14988 raft_consensus.cc:697] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Becoming Leader. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:27.924600 14988 consensus_queue.cc:237] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.926038 14940 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.932314 14817 raft_consensus.cc:515] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.937340 14960 raft_consensus.cc:993] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea: : Instructing follower c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:27.937987 14981 raft_consensus.cc:1081] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Signalling peer c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:27.940282 14744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.940622 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc25b27191f0412285c3a74bed265505"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:07:27.941169 14893 raft_consensus.cc:493] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.940347 14640 catalog_manager.cc:5697] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 reported cstate change: term changed from 1 to 2, leader changed from c8379b8234e84226a4b14f02781ac248 (127.13.196.67) to b2c52a0b36f3486e8034aff32339c657 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "b2c52a0b36f3486e8034aff32339c657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.941596 14893 raft_consensus.cc:3060] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.942866 14817 leader_election.cc:290] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 2 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:27.944149 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:27.945024 14892 raft_consensus.cc:3055] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.945389 14892 raft_consensus.cc:740] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:27.946378 14892 consensus_queue.cc:260] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.947641 14892 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.952248 14893 raft_consensus.cc:515] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.955821 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:27.956526 14893 leader_election.cc:290] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:27.955974 14817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc25b27191f0412285c3a74bed265505" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:27.956480 14892 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 2.
I20260709 13:07:27.957247 14817 raft_consensus.cc:3060] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.959225 14784 leader_election.cc:304] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 006d0e674197426eae7f370303df5cea
I20260709 13:07:27.960661 14988 raft_consensus.cc:2804] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.961207 14988 raft_consensus.cc:697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Becoming Leader. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:27.962141 14988 consensus_queue.cc:237] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.957245 14743 raft_consensus.cc:3055] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.964208 14743 raft_consensus.cc:740] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:27.965205 14743 consensus_queue.cc:260] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.965866 14817 raft_consensus.cc:2468] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 2.
I20260709 13:07:27.966794 14743 raft_consensus.cc:3060] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.967461 14856 leader_election.cc:304] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:27.968501 14954 raft_consensus.cc:2804] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.969101 14954 raft_consensus.cc:697] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:27.970047 14954 consensus_queue.cc:237] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:27.972963 14640 catalog_manager.cc:5697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 reported cstate change: term changed from 1 to 2, leader changed from c8379b8234e84226a4b14f02781ac248 (127.13.196.67) to b2c52a0b36f3486e8034aff32339c657 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "b2c52a0b36f3486e8034aff32339c657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.975373 14743 raft_consensus.cc:2468] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 2.
I20260709 13:07:27.979024 14639 catalog_manager.cc:5697] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 1 to 2, leader changed from 006d0e674197426eae7f370303df5cea (127.13.196.65) to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.036002 14997 raft_consensus.cc:993] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248: : Instructing follower 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:28.036715 14954 raft_consensus.cc:1081] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Signalling peer 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:28.038679 14743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3"
dest_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:42010
I20260709 13:07:28.039342 14743 raft_consensus.cc:493] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.039820 14743 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.046160 14743 raft_consensus.cc:515] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:28.048416 14743 leader_election.cc:290] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 2 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:28.049419 14817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:28.049715 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:28.050127 14817 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.050359 14893 raft_consensus.cc:3055] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:28.050726 14893 raft_consensus.cc:740] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:28.051458 14893 consensus_queue.cc:260] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:28.052503 14893 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.056631 14817 raft_consensus.cc:2468] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 2.
I20260709 13:07:28.058022 14893 raft_consensus.cc:2468] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 2.
I20260709 13:07:28.058234 14707 leader_election.cc:304] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:28.059206 14981 raft_consensus.cc:2804] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:28.059705 14981 raft_consensus.cc:697] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:28.060637 14981 consensus_queue.cc:237] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:28.068778 14639 catalog_manager.cc:5697] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 1 to 2, leader changed from c8379b8234e84226a4b14f02781ac248 (127.13.196.67) to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 2 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.173043 14743 raft_consensus.cc:1275] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.174746 14988 consensus_queue.cc:1048] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:28.189169 14893 raft_consensus.cc:1275] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.190816 14974 consensus_queue.cc:1048] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:28.309346 14893 raft_consensus.cc:1275] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.311084 14974 consensus_queue.cc:1048] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.320822 14743 raft_consensus.cc:1275] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.322948 14974 consensus_queue.cc:1048] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:28.369144 14817 raft_consensus.cc:1275] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.371055 14981 consensus_queue.cc:1048] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.371376 14893 raft_consensus.cc:1275] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.373037 14981 consensus_queue.cc:1048] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:28.380716 14892 raft_consensus.cc:1275] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.382782 14989 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:28.398221 14743 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.410993 14743 raft_consensus.cc:1275] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.413532 14988 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:28.485179 14743 raft_consensus.cc:1275] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.487146 14954 consensus_queue.cc:1048] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.487504 14817 raft_consensus.cc:1275] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.489238 14980 consensus_queue.cc:1048] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.503170 14893 raft_consensus.cc:1275] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.509541 14818 raft_consensus.cc:1275] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.510591 14981 consensus_queue.cc:1048] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.513378 14997 consensus_queue.cc:1048] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:30.687312 14097 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:07:30.688158 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:30.708480 14743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02"
dest_uuid: "006d0e674197426eae7f370303df5cea"
mode: GRACEFUL
new_leader_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:42032
I20260709 13:07:30.709190 14743 raft_consensus.cc:606] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Received request to transfer leadership to TS c8379b8234e84226a4b14f02781ac248
I20260709 13:07:30.712487 14743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930"
dest_uuid: "006d0e674197426eae7f370303df5cea"
mode: GRACEFUL
new_leader_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:42032
I20260709 13:07:30.713060 14743 raft_consensus.cc:606] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Received request to transfer leadership to TS c8379b8234e84226a4b14f02781ac248
I20260709 13:07:30.714184 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:30.714799 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:30.931808 15033 raft_consensus.cc:993] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea: : Instructing follower c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:30.932361 15036 raft_consensus.cc:1081] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Signalling peer c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:30.934494 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:07:30.935216 14893 raft_consensus.cc:493] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.935660 14893 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:30.941923 14893 raft_consensus.cc:515] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:30.943966 14893 leader_election.cc:290] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:30.945076 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:30.944996 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:30.945887 14743 raft_consensus.cc:3055] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:30.945822 14818 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:30.946401 14743 raft_consensus.cc:740] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:30.947355 14743 consensus_queue.cc:260] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:30.948726 14743 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:30.955091 14818 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 2.
I20260709 13:07:30.956935 14856 leader_election.cc:304] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:30.957259 14743 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 2.
I20260709 13:07:30.957963 15032 raft_consensus.cc:2804] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:30.959224 15032 raft_consensus.cc:697] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:30.960076 15032 consensus_queue.cc:237] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:30.969764 14642 catalog_manager.cc:5697] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 1 to 2, leader changed from 006d0e674197426eae7f370303df5cea (127.13.196.65) to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.027132 15033 raft_consensus.cc:993] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea: : Instructing follower c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:31.027771 15036 raft_consensus.cc:1081] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Signalling peer c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:31.029500 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:07:31.030170 14893 raft_consensus.cc:493] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.030478 14893 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.037268 14893 raft_consensus.cc:515] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:31.039248 14893 leader_election.cc:290] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), 006d0e674197426eae7f370303df5cea (127.13.196.65:46065)
I20260709 13:07:31.040185 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:31.040539 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:31.040843 14818 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.041258 14743 raft_consensus.cc:3055] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:31.041584 14743 raft_consensus.cc:740] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:31.042320 14743 consensus_queue.cc:260] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:31.043231 14743 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.046986 14818 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 2.
I20260709 13:07:31.048609 14743 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 2.
I20260709 13:07:31.048537 14856 leader_election.cc:304] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:31.049399 15032 raft_consensus.cc:2804] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:31.049845 15032 raft_consensus.cc:697] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:31.050611 15032 consensus_queue.cc:237] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:31.058715 14642 catalog_manager.cc:5697] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 1 to 2, leader changed from 006d0e674197426eae7f370303df5cea (127.13.196.65) to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.405570 14743 raft_consensus.cc:1275] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.407336 15032 consensus_queue.cc:1048] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:31.419265 14818 raft_consensus.cc:1275] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.422246 15032 consensus_queue.cc:1048] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:31.549314 14744 raft_consensus.cc:1275] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.551206 15047 consensus_queue.cc:1048] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:31.563949 14818 raft_consensus.cc:1275] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.567109 15047 consensus_queue.cc:1048] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:31.716998 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:31.734732 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
mode: GRACEFUL
new_leader_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:33646
I20260709 13:07:31.735673 14893 raft_consensus.cc:606] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Received request to transfer leadership to TS 006d0e674197426eae7f370303df5cea
I20260709 13:07:31.750440 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
mode: GRACEFUL
new_leader_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:33646
I20260709 13:07:31.751353 14893 raft_consensus.cc:606] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Received request to transfer leadership to TS 006d0e674197426eae7f370303df5cea
I20260709 13:07:31.767184 14818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
mode: GRACEFUL
new_leader_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:53336
I20260709 13:07:31.768121 14818 raft_consensus.cc:606] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Received request to transfer leadership to TS 006d0e674197426eae7f370303df5cea
I20260709 13:07:31.776911 14818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
mode: GRACEFUL
new_leader_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:53336
I20260709 13:07:31.777609 14818 raft_consensus.cc:606] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Received request to transfer leadership to TS 006d0e674197426eae7f370303df5cea
I20260709 13:07:31.785576 14818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
mode: GRACEFUL
new_leader_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:53336
I20260709 13:07:31.786343 14818 raft_consensus.cc:606] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Received request to transfer leadership to TS 006d0e674197426eae7f370303df5cea
I20260709 13:07:31.951177 15047 raft_consensus.cc:993] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248: : Instructing follower 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:31.952068 15032 raft_consensus.cc:1081] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Signalling peer 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:31.954766 14744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930"
dest_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:42010
I20260709 13:07:31.955538 14744 raft_consensus.cc:493] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.955991 14744 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.965323 14744 raft_consensus.cc:515] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:31.968029 14744 leader_election.cc:290] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Requested vote from peers c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:31.969384 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:31.969803 14817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f162f97bae5d40529d7ab9d954e92930" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:31.970211 14893 raft_consensus.cc:3055] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:31.970602 14817 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.970520 14893 raft_consensus.cc:740] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:31.971781 14893 consensus_queue.cc:260] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:31.973958 14893 raft_consensus.cc:3060] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.978873 15047 raft_consensus.cc:993] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248: : Instructing follower 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:31.979573 15032 raft_consensus.cc:1081] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Signalling peer 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:31.981372 14817 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:31.981638 14744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02"
dest_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:42010
I20260709 13:07:31.982757 14744 raft_consensus.cc:493] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.983618 14744 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.983623 14707 leader_election.cc:304] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:31.984491 14893 raft_consensus.cc:2468] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:31.985244 15036 raft_consensus.cc:2804] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:31.986729 15036 raft_consensus.cc:697] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:31.988183 15036 consensus_queue.cc:237] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } }
I20260709 13:07:31.994777 14744 raft_consensus.cc:515] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:31.998190 14744 leader_election.cc:290] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:31.999475 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:31.999475 14817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18af9f65a4a043e0b6a333996fd1bd02" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:32.000440 14893 raft_consensus.cc:3055] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.000566 14817 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.000844 14893 raft_consensus.cc:740] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:32.001004 14642 catalog_manager.cc:5697] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 2 to 3, leader changed from c8379b8234e84226a4b14f02781ac248 (127.13.196.67) to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 3 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.001865 14893 consensus_queue.cc:260] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.003633 14893 raft_consensus.cc:3060] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.011272 14817 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:32.013376 14707 leader_election.cc:304] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, b2c52a0b36f3486e8034aff32339c657; no voters: 
I20260709 13:07:32.014427 15036 raft_consensus.cc:2804] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.014333 14893 raft_consensus.cc:2468] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:32.016374 15036 raft_consensus.cc:697] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:32.017519 15036 consensus_queue.cc:237] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.030741 14642 catalog_manager.cc:5697] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 2 to 3, leader changed from c8379b8234e84226a4b14f02781ac248 (127.13.196.67) to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 3 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.137624 14988 raft_consensus.cc:993] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657: : Instructing follower 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:32.138264 15044 raft_consensus.cc:1081] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Signalling peer 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:32.140518 14744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe"
dest_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:42026
I20260709 13:07:32.141144 14744 raft_consensus.cc:493] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.141484 14744 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.148459 14744 raft_consensus.cc:515] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.150547 14744 leader_election.cc:290] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:32.151793 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:32.151937 14817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:32.152588 14817 raft_consensus.cc:3055] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.152539 14893 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.153019 14817 raft_consensus.cc:740] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:32.153921 14817 consensus_queue.cc:260] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.155130 14817 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.159075 14893 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:32.160872 14709 leader_election.cc:304] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:32.161648 14817 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:32.161980 15036 raft_consensus.cc:2804] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.162588 15036 raft_consensus.cc:697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:32.163908 15036 consensus_queue.cc:237] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.172742 14642 catalog_manager.cc:5697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 2 to 3, leader changed from b2c52a0b36f3486e8034aff32339c657 (127.13.196.66) to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 3 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.215735 14988 raft_consensus.cc:993] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657: : Instructing follower 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:32.216490 15044 raft_consensus.cc:1081] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Signalling peer 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:32.218621 14744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60"
dest_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:42026
I20260709 13:07:32.219368 14744 raft_consensus.cc:493] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.219770 14744 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.228092 14988 raft_consensus.cc:993] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657: : Instructing follower 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:32.228667 15044 raft_consensus.cc:1081] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Signalling peer 006d0e674197426eae7f370303df5cea to start an election
I20260709 13:07:32.228647 14744 raft_consensus.cc:515] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.230809 14743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd"
dest_uuid: "006d0e674197426eae7f370303df5cea"
 from {username='slave'} at 127.0.0.1:42026
I20260709 13:07:32.231433 14743 raft_consensus.cc:493] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.231796 14743 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.231838 14744 leader_election.cc:290] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:32.232456 14817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:32.233167 14817 raft_consensus.cc:3055] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.232676 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f98cb0bee9649979976436cf93d6b60" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:32.233587 14817 raft_consensus.cc:740] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:32.234021 14893 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.234630 14817 consensus_queue.cc:260] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.236074 14817 raft_consensus.cc:3060] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.239553 14893 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:32.240962 14709 leader_election.cc:304] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:32.241034 14743 raft_consensus.cc:515] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.241896 15036 raft_consensus.cc:2804] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.242542 15036 raft_consensus.cc:697] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:32.243573 15036 consensus_queue.cc:237] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.244745 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:32.244864 14817 raft_consensus.cc:2468] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 3.
I20260709 13:07:32.245247 14743 leader_election.cc:290] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 2 election: Requested vote from peers b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:32.245571 14818 raft_consensus.cc:3055] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:32.245986 14818 raft_consensus.cc:740] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:32.247031 14818 consensus_queue.cc:260] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.247759 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "006d0e674197426eae7f370303df5cea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:32.248469 14893 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.248693 14818 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.253980 14893 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 2.
I20260709 13:07:32.256215 14709 leader_election.cc:304] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 006d0e674197426eae7f370303df5cea, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:32.257539 15036 raft_consensus.cc:2804] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:32.258160 15036 raft_consensus.cc:697] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Becoming Leader. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:32.259137 15036 consensus_queue.cc:237] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:32.260946 14818 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 006d0e674197426eae7f370303df5cea in term 2.
I20260709 13:07:32.261394 14642 catalog_manager.cc:5697] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 2 to 3, leader changed from b2c52a0b36f3486e8034aff32339c657 (127.13.196.66) to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 3 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.277307 14642 catalog_manager.cc:5697] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea reported cstate change: term changed from 1 to 2, leader changed from b2c52a0b36f3486e8034aff32339c657 (127.13.196.66) to 006d0e674197426eae7f370303df5cea (127.13.196.65). New cstate: current_term: 2 leader_uuid: "006d0e674197426eae7f370303df5cea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.516317 14818 raft_consensus.cc:1275] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.518215 15036 consensus_queue.cc:1048] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.531551 14893 raft_consensus.cc:1275] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.533566 15065 consensus_queue.cc:1048] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:32.577306 14893 raft_consensus.cc:1275] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.578858 15065 consensus_queue.cc:1048] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.585770 14818 raft_consensus.cc:1275] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.588130 15057 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:32.591007 14818 raft_consensus.cc:1275] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.594878 14893 raft_consensus.cc:1275] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.594653 15070 consensus_queue.cc:1048] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:32.599026 15070 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.677959 14817 raft_consensus.cc:1275] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.679807 15065 consensus_queue.cc:1048] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.692042 14892 raft_consensus.cc:1275] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.694058 15065 consensus_queue.cc:1048] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:32.832145 14892 raft_consensus.cc:1275] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.833858 15065 consensus_queue.cc:1048] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.846266 14817 raft_consensus.cc:1275] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Refusing update from remote peer 006d0e674197426eae7f370303df5cea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.848603 15057 consensus_queue.cc:1048] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:34.797353 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.808544 14743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd"
dest_uuid: "006d0e674197426eae7f370303df5cea"
mode: GRACEFUL
new_leader_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:42032
I20260709 13:07:34.809439 14743 raft_consensus.cc:606] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Received request to transfer leadership to TS b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:34.812714 14743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe"
dest_uuid: "006d0e674197426eae7f370303df5cea"
mode: GRACEFUL
new_leader_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:42032
I20260709 13:07:34.813772 14743 raft_consensus.cc:606] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Received request to transfer leadership to TS b2c52a0b36f3486e8034aff32339c657
I20260709 13:07:34.816933 14743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa"
dest_uuid: "006d0e674197426eae7f370303df5cea"
mode: GRACEFUL
new_leader_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:42032
I20260709 13:07:34.817556 14743 raft_consensus.cc:606] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Received request to transfer leadership to TS c8379b8234e84226a4b14f02781ac248
I20260709 13:07:34.821291 14743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3"
dest_uuid: "006d0e674197426eae7f370303df5cea"
mode: GRACEFUL
new_leader_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:42032
I20260709 13:07:34.822095 14743 raft_consensus.cc:606] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Received request to transfer leadership to TS c8379b8234e84226a4b14f02781ac248
I20260709 13:07:34.823743 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:34.824262 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:34.880615 15070 raft_consensus.cc:993] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea: : Instructing follower c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:34.881182 15070 raft_consensus.cc:1081] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Signalling peer c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:34.883169 14892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:07:34.883872 14892 raft_consensus.cc:493] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.884284 14892 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.891458 14892 raft_consensus.cc:515] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:34.894137 14892 leader_election.cc:290] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 3 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:34.895467 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:34.895458 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e1f9afecbe4bb2a2f1b2b91f66bafa" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:34.896057 14743 raft_consensus.cc:3055] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:34.896449 14743 raft_consensus.cc:740] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:34.896468 14818 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.897276 14743 consensus_queue.cc:260] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:34.898689 14743 raft_consensus.cc:3060] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.901477 14818 raft_consensus.cc:2468] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 3.
I20260709 13:07:34.903002 14856 leader_election.cc:304] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:34.903983 15076 raft_consensus.cc:2804] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:34.904675 14743 raft_consensus.cc:2468] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 3.
I20260709 13:07:34.905442 15076 raft_consensus.cc:697] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 3 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:34.906572 15076 consensus_queue.cc:237] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:34.915133 14640 catalog_manager.cc:5697] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 2 to 3, leader changed from 006d0e674197426eae7f370303df5cea (127.13.196.65) to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 3 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.960956 15079 raft_consensus.cc:993] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea: : Instructing follower c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:34.961519 15070 raft_consensus.cc:1081] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Signalling peer c8379b8234e84226a4b14f02781ac248 to start an election
I20260709 13:07:34.963551 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3"
dest_uuid: "c8379b8234e84226a4b14f02781ac248"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:07:34.964059 14893 raft_consensus.cc:493] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.964442 14893 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.970708 14893 raft_consensus.cc:515] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:34.972620 14893 leader_election.cc:290] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 3 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), b2c52a0b36f3486e8034aff32339c657 (127.13.196.66:39153)
I20260709 13:07:34.973737 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:34.973766 14818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d548a418f29644e5805861e4a4b67cf3" candidate_uuid: "c8379b8234e84226a4b14f02781ac248" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
I20260709 13:07:34.974550 14818 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.974550 14743 raft_consensus.cc:3055] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:34.975099 14743 raft_consensus.cc:740] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:34.976014 14743 consensus_queue.cc:260] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:34.977433 14743 raft_consensus.cc:3060] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.982941 14818 raft_consensus.cc:2468] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 3.
I20260709 13:07:34.985133 14856 leader_election.cc:304] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:34.985715 14743 raft_consensus.cc:2468] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8379b8234e84226a4b14f02781ac248 in term 3.
I20260709 13:07:34.986176 15076 raft_consensus.cc:2804] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:34.986735 15076 raft_consensus.cc:697] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 3 LEADER]: Becoming Leader. State: Replica: c8379b8234e84226a4b14f02781ac248, State: Running, Role: LEADER
I20260709 13:07:34.987892 15076 consensus_queue.cc:237] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:34.999325 15079 raft_consensus.cc:993] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea: : Instructing follower b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:34.998338 14640 catalog_manager.cc:5697] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 reported cstate change: term changed from 2 to 3, leader changed from 006d0e674197426eae7f370303df5cea (127.13.196.65) to c8379b8234e84226a4b14f02781ac248 (127.13.196.67). New cstate: current_term: 3 leader_uuid: "c8379b8234e84226a4b14f02781ac248" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.999873 15070 raft_consensus.cc:1081] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Signalling peer b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:35.002233 14818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:53326
I20260709 13:07:35.003366 14818 raft_consensus.cc:493] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.003722 14818 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.012213 14818 raft_consensus.cc:515] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:35.014636 14818 leader_election.cc:290] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 3 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:35.015285 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:35.015817 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc52a54d7a14f08b0948b655ebcaefd" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:35.015985 14743 raft_consensus.cc:3055] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:35.016613 14743 raft_consensus.cc:740] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:35.016631 14893 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.017609 14743 consensus_queue.cc:260] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:35.018895 14743 raft_consensus.cc:3060] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.024209 14893 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 3.
I20260709 13:07:35.024559 14743 raft_consensus.cc:2468] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 3.
I20260709 13:07:35.026134 14784 leader_election.cc:304] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:35.027240 15044 raft_consensus.cc:2804] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:35.029047 15044 raft_consensus.cc:697] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 3 LEADER]: Becoming Leader. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:35.029899 15044 consensus_queue.cc:237] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:35.039219 14640 catalog_manager.cc:5697] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 reported cstate change: term changed from 2 to 3, leader changed from 006d0e674197426eae7f370303df5cea (127.13.196.65) to b2c52a0b36f3486e8034aff32339c657 (127.13.196.66). New cstate: current_term: 3 leader_uuid: "b2c52a0b36f3486e8034aff32339c657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.085157 15079 raft_consensus.cc:993] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea: : Instructing follower b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:35.085749 15070 raft_consensus.cc:1081] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Signalling peer b2c52a0b36f3486e8034aff32339c657 to start an election
I20260709 13:07:35.087584 14818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe"
dest_uuid: "b2c52a0b36f3486e8034aff32339c657"
 from {username='slave'} at 127.0.0.1:53326
I20260709 13:07:35.088068 14818 raft_consensus.cc:493] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.088322 14818 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.094731 14818 raft_consensus.cc:515] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:35.096534 14818 leader_election.cc:290] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 4 election: Requested vote from peers 006d0e674197426eae7f370303df5cea (127.13.196.65:46065), c8379b8234e84226a4b14f02781ac248 (127.13.196.67:42175)
I20260709 13:07:35.097710 14743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "006d0e674197426eae7f370303df5cea"
I20260709 13:07:35.097853 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8901f112dfb64e0f9875b4ccbbdc8ebe" candidate_uuid: "b2c52a0b36f3486e8034aff32339c657" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8379b8234e84226a4b14f02781ac248"
I20260709 13:07:35.098281 14743 raft_consensus.cc:3055] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.098515 14893 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.098668 14743 raft_consensus.cc:740] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 006d0e674197426eae7f370303df5cea, State: Running, Role: LEADER
I20260709 13:07:35.099448 14743 consensus_queue.cc:260] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:35.100521 14743 raft_consensus.cc:3060] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.105815 14893 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 4.
I20260709 13:07:35.107717 14784 leader_election.cc:304] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2c52a0b36f3486e8034aff32339c657, c8379b8234e84226a4b14f02781ac248; no voters: 
I20260709 13:07:35.108568 14743 raft_consensus.cc:2468] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2c52a0b36f3486e8034aff32339c657 in term 4.
I20260709 13:07:35.108711 15044 raft_consensus.cc:2804] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:35.109361 15044 raft_consensus.cc:697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 4 LEADER]: Becoming Leader. State: Replica: b2c52a0b36f3486e8034aff32339c657, State: Running, Role: LEADER
I20260709 13:07:35.110281 15044 consensus_queue.cc:237] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } }
I20260709 13:07:35.119014 14640 catalog_manager.cc:5697] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 reported cstate change: term changed from 3 to 4, leader changed from 006d0e674197426eae7f370303df5cea (127.13.196.65) to b2c52a0b36f3486e8034aff32339c657 (127.13.196.66). New cstate: current_term: 4 leader_uuid: "b2c52a0b36f3486e8034aff32339c657" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.337409 14818 raft_consensus.cc:1275] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.338967 15076 consensus_queue.cc:1048] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.353132 14743 raft_consensus.cc:1275] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.355948 15080 consensus_queue.cc:1048] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:35.397576 14743 raft_consensus.cc:1275] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.399155 15080 consensus_queue.cc:1048] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.410363 14818 raft_consensus.cc:1275] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Refusing update from remote peer c8379b8234e84226a4b14f02781ac248: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.413007 15076 consensus_queue.cc:1048] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2c52a0b36f3486e8034aff32339c657" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:35.491372 14743 raft_consensus.cc:1275] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.492988 15044 consensus_queue.cc:1048] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.504772 14893 raft_consensus.cc:1275] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.507651 15099 consensus_queue.cc:1048] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:35.618709 14743 raft_consensus.cc:1275] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 4 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.620406 15099 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "006d0e674197426eae7f370303df5cea" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.632007 14893 raft_consensus.cc:1275] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 4 FOLLOWER]: Refusing update from remote peer b2c52a0b36f3486e8034aff32339c657: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.633836 15099 consensus_queue.cc:1048] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8379b8234e84226a4b14f02781ac248" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 42175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.825515 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.832512 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
W20260709 13:07:35.843456 14857 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:07:35.853727 14857 consensus_peers.cc:597] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 -> Peer 006d0e674197426eae7f370303df5cea (127.13.196.65:46065): Couldn't send request to peer 006d0e674197426eae7f370303df5cea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.890439 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:35.891743 14097 tablet_replica.cc:333] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.892733 14097 raft_consensus.cc:2243] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.893548 14097 raft_consensus.cc:2272] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.897375 14097 tablet_replica.cc:333] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.898180 14097 raft_consensus.cc:2243] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.898784 14097 raft_consensus.cc:2272] T f14bb0ddaf25448d9eb4fa77be4323f5 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.901075 14097 tablet_replica.cc:333] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.901731 14097 raft_consensus.cc:2243] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.902627 14097 raft_consensus.cc:2272] T 18af9f65a4a043e0b6a333996fd1bd02 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.904726 14097 tablet_replica.cc:333] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.905581 14097 raft_consensus.cc:2243] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.906142 14097 raft_consensus.cc:2272] T 8901f112dfb64e0f9875b4ccbbdc8ebe P 006d0e674197426eae7f370303df5cea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.909492 14097 tablet_replica.cc:333] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.910125 14097 raft_consensus.cc:2243] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.911221 14097 raft_consensus.cc:2272] T f162f97bae5d40529d7ab9d954e92930 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.913552 14097 tablet_replica.cc:333] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.914194 14097 raft_consensus.cc:2243] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.914765 14097 raft_consensus.cc:2272] T d548a418f29644e5805861e4a4b67cf3 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.917411 14097 tablet_replica.cc:333] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.918031 14097 raft_consensus.cc:2243] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.919093 14097 raft_consensus.cc:2272] T f73dea2ea0544833b533bca4c50fbaf1 P 006d0e674197426eae7f370303df5cea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.921275 14097 tablet_replica.cc:333] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.922158 14097 raft_consensus.cc:2243] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:35.923220 14097 raft_consensus.cc:2272] T 3f98cb0bee9649979976436cf93d6b60 P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.925912 14097 tablet_replica.cc:333] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.926628 14097 raft_consensus.cc:2243] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.927201 14097 raft_consensus.cc:2272] T 2bc52a54d7a14f08b0948b655ebcaefd P 006d0e674197426eae7f370303df5cea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.929826 14097 tablet_replica.cc:333] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea: stopping tablet replica
I20260709 13:07:35.930368 14097 raft_consensus.cc:2243] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:35.930850 14097 raft_consensus.cc:2272] T dc25b27191f0412285c3a74bed265505 P 006d0e674197426eae7f370303df5cea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:35.957767 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
I20260709 13:07:35.982321 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
I20260709 13:07:36.020144 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.021008 14097 tablet_replica.cc:333] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.021677 14097 raft_consensus.cc:2243] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.022662 14097 raft_consensus.cc:2272] T 8901f112dfb64e0f9875b4ccbbdc8ebe P b2c52a0b36f3486e8034aff32339c657 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.025987 14097 tablet_replica.cc:333] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.026942 14097 raft_consensus.cc:2243] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.027575 14097 raft_consensus.cc:2272] T 3f98cb0bee9649979976436cf93d6b60 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.029928 14097 tablet_replica.cc:333] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.030548 14097 raft_consensus.cc:2243] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.031424 14097 raft_consensus.cc:2272] T 2bc52a54d7a14f08b0948b655ebcaefd P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:36.032140 14857 consensus_peers.cc:597] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 -> Peer 006d0e674197426eae7f370303df5cea (127.13.196.65:46065): Couldn't send request to peer 006d0e674197426eae7f370303df5cea. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:46065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.034042 14097 tablet_replica.cc:333] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.034662 14097 raft_consensus.cc:2243] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.035164 14097 raft_consensus.cc:2272] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.037766 14097 tablet_replica.cc:333] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.038424 14097 raft_consensus.cc:2243] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.039390 14097 raft_consensus.cc:2272] T f14bb0ddaf25448d9eb4fa77be4323f5 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.041702 14097 tablet_replica.cc:333] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.042270 14097 raft_consensus.cc:2243] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.042719 14097 raft_consensus.cc:2272] T 18af9f65a4a043e0b6a333996fd1bd02 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.044984 14097 tablet_replica.cc:333] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.045706 14097 raft_consensus.cc:2243] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.046216 14097 raft_consensus.cc:2272] T dc25b27191f0412285c3a74bed265505 P b2c52a0b36f3486e8034aff32339c657 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.048094 14097 tablet_replica.cc:333] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.048631 14097 raft_consensus.cc:2243] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.049072 14097 raft_consensus.cc:2272] T f73dea2ea0544833b533bca4c50fbaf1 P b2c52a0b36f3486e8034aff32339c657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.050735 14097 tablet_replica.cc:333] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.051221 14097 raft_consensus.cc:2243] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.051621 14097 raft_consensus.cc:2272] T d548a418f29644e5805861e4a4b67cf3 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.055025 14097 tablet_replica.cc:333] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657: stopping tablet replica
I20260709 13:07:36.055739 14097 raft_consensus.cc:2243] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.056321 14097 raft_consensus.cc:2272] T f162f97bae5d40529d7ab9d954e92930 P b2c52a0b36f3486e8034aff32339c657 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.083108 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
I20260709 13:07:36.105825 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
I20260709 13:07:36.141923 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.142867 14097 tablet_replica.cc:333] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.143956 14097 raft_consensus.cc:2243] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.145223 14097 raft_consensus.cc:2272] T dc25b27191f0412285c3a74bed265505 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.147416 14097 tablet_replica.cc:333] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.148092 14097 raft_consensus.cc:2243] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.148670 14097 raft_consensus.cc:2272] T 8901f112dfb64e0f9875b4ccbbdc8ebe P c8379b8234e84226a4b14f02781ac248 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.151579 14097 tablet_replica.cc:333] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.152132 14097 raft_consensus.cc:2243] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.153002 14097 raft_consensus.cc:2272] T b0e1f9afecbe4bb2a2f1b2b91f66bafa P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.155346 14097 tablet_replica.cc:333] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.155889 14097 raft_consensus.cc:2243] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.156423 14097 raft_consensus.cc:2272] T 2bc52a54d7a14f08b0948b655ebcaefd P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.159742 14097 tablet_replica.cc:333] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.160535 14097 raft_consensus.cc:2243] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.161367 14097 raft_consensus.cc:2272] T 3f98cb0bee9649979976436cf93d6b60 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.163298 14097 tablet_replica.cc:333] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.163764 14097 raft_consensus.cc:2243] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.164141 14097 raft_consensus.cc:2272] T f162f97bae5d40529d7ab9d954e92930 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.166450 14097 tablet_replica.cc:333] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.167035 14097 raft_consensus.cc:2243] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.167448 14097 raft_consensus.cc:2272] T f73dea2ea0544833b533bca4c50fbaf1 P c8379b8234e84226a4b14f02781ac248 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.169548 14097 tablet_replica.cc:333] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.170094 14097 raft_consensus.cc:2243] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.170892 14097 raft_consensus.cc:2272] T d548a418f29644e5805861e4a4b67cf3 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.173337 14097 tablet_replica.cc:333] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.173835 14097 raft_consensus.cc:2243] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.174266 14097 raft_consensus.cc:2272] T f14bb0ddaf25448d9eb4fa77be4323f5 P c8379b8234e84226a4b14f02781ac248 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.176137 14097 tablet_replica.cc:333] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248: stopping tablet replica
I20260709 13:07:36.176694 14097 raft_consensus.cc:2243] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.177217 14097 raft_consensus.cc:2272] T 18af9f65a4a043e0b6a333996fd1bd02 P c8379b8234e84226a4b14f02781ac248 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.210042 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
I20260709 13:07:36.236421 14097 master.cc:562] Master@127.13.196.126:40215 shutting down...
I20260709 13:07:36.266780 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.267520 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.267901 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P 49baf79a82334de49896f790535f61a9: stopping tablet replica
I20260709 13:07:36.290257 14097 master.cc:584] Master@127.13.196.126:40215 shutdown complete.
006d0e674197426eae7f370303df5cea  5
b2c52a0b36f3486e8034aff32339c657  4
c8379b8234e84226a4b14f02781ac248  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10831 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:07:36.344419 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:35597
I20260709 13:07:36.345867 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.353602 15107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.355242 15106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.356626 14097 server_base.cc:1061] running on GCE node
W20260709 13:07:36.356266 15109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.358328 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.358572 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.358835 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602456358816 us; error 0 us; skew 500 ppm
I20260709 13:07:36.359536 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.362893 14097 webserver.cc:533] Webserver started at http://127.13.196.126:33041/ using document root <none> and password file <none>
I20260709 13:07:36.363492 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.363701 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.364041 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.365427 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "476e7efc84e541a3bd0f38661ad40403"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.371116 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:07:36.375785 15114 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.377066 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:36.377578 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "476e7efc84e541a3bd0f38661ad40403"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.378036 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.399420 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.401091 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.452121 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:35597
I20260709 13:07:36.452186 15165 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:35597 every 8 connection(s)
I20260709 13:07:36.456971 15166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.468887 15166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Bootstrap starting.
I20260709 13:07:36.474635 15166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.480675 15166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: No bootstrap required, opened a new log
I20260709 13:07:36.483667 15166 raft_consensus.cc:359] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e7efc84e541a3bd0f38661ad40403" member_type: VOTER }
I20260709 13:07:36.484172 15166 raft_consensus.cc:385] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.484526 15166 raft_consensus.cc:740] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 476e7efc84e541a3bd0f38661ad40403, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.485420 15166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e7efc84e541a3bd0f38661ad40403" member_type: VOTER }
I20260709 13:07:36.485981 15166 raft_consensus.cc:399] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:36.486245 15166 raft_consensus.cc:493] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:36.486563 15166 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.491680 15166 raft_consensus.cc:515] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e7efc84e541a3bd0f38661ad40403" member_type: VOTER }
I20260709 13:07:36.492434 15166 leader_election.cc:304] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 476e7efc84e541a3bd0f38661ad40403; no voters: 
I20260709 13:07:36.494338 15166 leader_election.cc:290] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:36.494647 15169 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.496459 15169 raft_consensus.cc:697] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 1 LEADER]: Becoming Leader. State: Replica: 476e7efc84e541a3bd0f38661ad40403, State: Running, Role: LEADER
I20260709 13:07:36.497300 15169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e7efc84e541a3bd0f38661ad40403" member_type: VOTER }
I20260709 13:07:36.498633 15166 sys_catalog.cc:565] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:36.503432 15171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 476e7efc84e541a3bd0f38661ad40403. Latest consensus state: current_term: 1 leader_uuid: "476e7efc84e541a3bd0f38661ad40403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e7efc84e541a3bd0f38661ad40403" member_type: VOTER } }
I20260709 13:07:36.503475 15170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "476e7efc84e541a3bd0f38661ad40403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "476e7efc84e541a3bd0f38661ad40403" member_type: VOTER } }
I20260709 13:07:36.504519 15171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:36.504745 15170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:36.511123 15175 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:36.520426 15175 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:36.521617 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:36.532481 15175 catalog_manager.cc:1383] Generated new cluster ID: d3a4ab8ebd4b400f8583e3695fdb7b5f
I20260709 13:07:36.532776 15175 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:36.572649 15175 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:36.574479 15175 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:36.591287 15175 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Generated new TSK 0
I20260709 13:07:36.592100 15175 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:36.653604 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.660686 15187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.662434 15188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.665053 15190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.669872 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:36.671000 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.671226 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.671360 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602456671347 us; error 0 us; skew 500 ppm
I20260709 13:07:36.671993 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.675068 14097 webserver.cc:533] Webserver started at http://127.13.196.65:43735/ using document root <none> and password file <none>
I20260709 13:07:36.675592 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.675765 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.676002 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.677357 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "b0f9eceec749442cb9a06c87f00f3caf"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.683151 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:36.687434 15195 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.688982 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:36.689337 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "b0f9eceec749442cb9a06c87f00f3caf"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.689740 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.713912 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.716706 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.719554 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.724504 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.724882 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.725237 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.725533 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.797739 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:44011
I20260709 13:07:36.797799 15257 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:44011 every 8 connection(s)
I20260709 13:07:36.804666 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.814793 15262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.816702 15263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.819563 15265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.820557 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:36.822469 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.822822 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.823180 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602456823146 us; error 0 us; skew 500 ppm
I20260709 13:07:36.824198 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.826195 15258 heartbeater.cc:344] Connected to a master server at 127.13.196.126:35597
I20260709 13:07:36.826716 15258 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:36.828025 15258 heartbeater.cc:507] Master 127.13.196.126:35597 requested a full tablet report, sending...
I20260709 13:07:36.828660 14097 webserver.cc:533] Webserver started at http://127.13.196.66:33305/ using document root <none> and password file <none>
I20260709 13:07:36.829443 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.829722 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.830120 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.831589 15131 ts_manager.cc:194] Registered new tserver with Master: b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:07:36.832129 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "841138f50ace4746978e72d7f13878de"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.834564 15131 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36060
I20260709 13:07:36.839298 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:36.843698 15270 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.845116 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:36.845558 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "841138f50ace4746978e72d7f13878de"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.845873 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.871409 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.872963 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.875362 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.878219 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.878456 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.878804 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.878969 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.937565 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:37121
I20260709 13:07:36.937834 15332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:37121 every 8 connection(s)
I20260709 13:07:36.944085 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.953722 15336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.955076 15337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.959043 14097 server_base.cc:1061] running on GCE node
W20260709 13:07:36.960316 15339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.961994 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.962380 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.962852 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602456962815 us; error 0 us; skew 500 ppm
I20260709 13:07:36.963775 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.963835 15333 heartbeater.cc:344] Connected to a master server at 127.13.196.126:35597
I20260709 13:07:36.964516 15333 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:36.965652 15333 heartbeater.cc:507] Master 127.13.196.126:35597 requested a full tablet report, sending...
I20260709 13:07:36.967970 14097 webserver.cc:533] Webserver started at http://127.13.196.67:37375/ using document root <none> and password file <none>
I20260709 13:07:36.968704 15131 ts_manager.cc:194] Registered new tserver with Master: 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:36.969345 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.969651 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.969992 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.970474 15131 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36062
I20260709 13:07:36.971567 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "0ec140f610ed4500ba58208c0e5519bb"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.977965 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:07:36.983271 15344 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.984587 14097 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:07:36.984951 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "0ec140f610ed4500ba58208c0e5519bb"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-ftjc"
I20260709 13:07:36.985224 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:37.005276 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:37.007274 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:37.009892 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:37.013336 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:37.013600 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.013803 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:37.013949 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.070724 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:39043
I20260709 13:07:37.070837 15406 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:39043 every 8 connection(s)
I20260709 13:07:37.100032 15407 heartbeater.cc:344] Connected to a master server at 127.13.196.126:35597
I20260709 13:07:37.100586 15407 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:37.101528 15407 heartbeater.cc:507] Master 127.13.196.126:35597 requested a full tablet report, sending...
I20260709 13:07:37.104053 15131 ts_manager.cc:194] Registered new tserver with Master: 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:37.104949 14097 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.029113552s
I20260709 13:07:37.105803 15131 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36078
I20260709 13:07:37.139943 15131 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36082:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:37.147723 15131 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:37.393633 15371 tablet_service.cc:1511] Processing CreateTablet for tablet 168b77c528554771b17206e0062bd8cc (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:37.395331 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168b77c528554771b17206e0062bd8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.397608 15370 tablet_service.cc:1511] Processing CreateTablet for tablet 0066b5a9791e4a30856433ed14864d2f (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:37.398658 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 0066b5a9791e4a30856433ed14864d2f (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:37.399372 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0066b5a9791e4a30856433ed14864d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.400300 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0066b5a9791e4a30856433ed14864d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.402040 15297 tablet_service.cc:1511] Processing CreateTablet for tablet 168b77c528554771b17206e0062bd8cc (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:37.403004 15295 tablet_service.cc:1511] Processing CreateTablet for tablet 911f84bbbf874ced8f15e93fcf73decd (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:37.404137 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168b77c528554771b17206e0062bd8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.399654 15298 tablet_service.cc:1511] Processing CreateTablet for tablet e879ecfd4de9483e8b42ea01de447fdc (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:37.407409 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e879ecfd4de9483e8b42ea01de447fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.407935 15368 tablet_service.cc:1511] Processing CreateTablet for tablet 7236188a1607470eb04fb303bc4a928b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:37.409628 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7236188a1607470eb04fb303bc4a928b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.411586 15294 tablet_service.cc:1511] Processing CreateTablet for tablet 7236188a1607470eb04fb303bc4a928b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:37.415622 15293 tablet_service.cc:1511] Processing CreateTablet for tablet 10888684198543f19c54c7cbcb094157 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:37.417925 15367 tablet_service.cc:1511] Processing CreateTablet for tablet 10888684198543f19c54c7cbcb094157 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:37.425004 15292 tablet_service.cc:1511] Processing CreateTablet for tablet 2de1580a2d944ae884df67f226c8b71d (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:37.391896 15372 tablet_service.cc:1511] Processing CreateTablet for tablet e879ecfd4de9483e8b42ea01de447fdc (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:37.405766 15369 tablet_service.cc:1511] Processing CreateTablet for tablet 911f84bbbf874ced8f15e93fcf73decd (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:37.426671 15295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911f84bbbf874ced8f15e93fcf73decd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.427743 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10888684198543f19c54c7cbcb094157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.429201 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1580a2d944ae884df67f226c8b71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.433113 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7236188a1607470eb04fb303bc4a928b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.425699 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10888684198543f19c54c7cbcb094157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.435403 15369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911f84bbbf874ced8f15e93fcf73decd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.436733 15372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e879ecfd4de9483e8b42ea01de447fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.438776 15223 tablet_service.cc:1511] Processing CreateTablet for tablet e879ecfd4de9483e8b42ea01de447fdc (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:37.438663 15222 tablet_service.cc:1511] Processing CreateTablet for tablet 168b77c528554771b17206e0062bd8cc (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:37.440744 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168b77c528554771b17206e0062bd8cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.442894 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e879ecfd4de9483e8b42ea01de447fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.453662 15220 tablet_service.cc:1511] Processing CreateTablet for tablet 911f84bbbf874ced8f15e93fcf73decd (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:37.453392 15221 tablet_service.cc:1511] Processing CreateTablet for tablet 0066b5a9791e4a30856433ed14864d2f (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:37.457569 15219 tablet_service.cc:1511] Processing CreateTablet for tablet 7236188a1607470eb04fb303bc4a928b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:37.460706 15218 tablet_service.cc:1511] Processing CreateTablet for tablet 10888684198543f19c54c7cbcb094157 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:37.463635 15217 tablet_service.cc:1511] Processing CreateTablet for tablet 2de1580a2d944ae884df67f226c8b71d (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:37.470144 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0066b5a9791e4a30856433ed14864d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.471097 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911f84bbbf874ced8f15e93fcf73decd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.475494 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10888684198543f19c54c7cbcb094157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.476543 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7236188a1607470eb04fb303bc4a928b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.480643 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1580a2d944ae884df67f226c8b71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.489506 15366 tablet_service.cc:1511] Processing CreateTablet for tablet 2de1580a2d944ae884df67f226c8b71d (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:37.491406 15366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1580a2d944ae884df67f226c8b71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.500053 15425 tablet_bootstrap.cc:492] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
W20260709 13:07:37.515162 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:37.523001 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc5207f2ece48c7ba4d2a23b902610b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:37.526538 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc5207f2ece48c7ba4d2a23b902610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.533864 15365 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc5207f2ece48c7ba4d2a23b902610b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:37.535737 15365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc5207f2ece48c7ba4d2a23b902610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.553002 15215 tablet_service.cc:1511] Processing CreateTablet for tablet 872a48310a1f4a28b75d05f83ce6b20b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:37.555425 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872a48310a1f4a28b75d05f83ce6b20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.557672 15295 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc5207f2ece48c7ba4d2a23b902610b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:37.574199 15295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc5207f2ece48c7ba4d2a23b902610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.576174 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 872a48310a1f4a28b75d05f83ce6b20b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:37.577636 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872a48310a1f4a28b75d05f83ce6b20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.580380 15364 tablet_service.cc:1511] Processing CreateTablet for tablet 872a48310a1f4a28b75d05f83ce6b20b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:37.582384 15364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 872a48310a1f4a28b75d05f83ce6b20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.571218 15425 tablet_bootstrap.cc:654] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.610797 15214 tablet_service.cc:1511] Processing CreateTablet for tablet 8218e039c251425fb97ad83094c709da (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:37.612534 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8218e039c251425fb97ad83094c709da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.617249 15294 tablet_service.cc:1511] Processing CreateTablet for tablet 8218e039c251425fb97ad83094c709da (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:37.618849 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8218e039c251425fb97ad83094c709da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.626823 15426 tablet_bootstrap.cc:492] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:37.637804 15296 tablet_service.cc:1511] Processing CreateTablet for tablet c4dc28ca60664c41a529fde0dc6c28aa (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:37.640007 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dc28ca60664c41a529fde0dc6c28aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.641657 15297 tablet_service.cc:1511] Processing CreateTablet for tablet d55ea5972868497eb17221413640fbea (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:37.643291 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55ea5972868497eb17221413640fbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.646034 15368 tablet_service.cc:1511] Processing CreateTablet for tablet c4dc28ca60664c41a529fde0dc6c28aa (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:37.650501 15371 tablet_service.cc:1511] Processing CreateTablet for tablet d55ea5972868497eb17221413640fbea (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:37.652071 15370 tablet_service.cc:1511] Processing CreateTablet for tablet bb3022274b1549eb806d68dc808a6ceb (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:37.648231 15292 tablet_service.cc:1511] Processing CreateTablet for tablet bb3022274b1549eb806d68dc808a6ceb (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:37.663244 15291 tablet_service.cc:1511] Processing CreateTablet for tablet f5cd793e143d45cf9e32447e33602536 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:37.660032 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3022274b1549eb806d68dc808a6ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.666512 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dc28ca60664c41a529fde0dc6c28aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.666265 15363 tablet_service.cc:1511] Processing CreateTablet for tablet f5cd793e143d45cf9e32447e33602536 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:37.667961 15291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cd793e143d45cf9e32447e33602536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.668002 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55ea5972868497eb17221413640fbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.659750 15367 tablet_service.cc:1511] Processing CreateTablet for tablet 8218e039c251425fb97ad83094c709da (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:37.677050 15290 tablet_service.cc:1511] Processing CreateTablet for tablet f2466cf62f214b16bdaa21d868e54b04 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:37.677917 15363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cd793e143d45cf9e32447e33602536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.679590 15290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2466cf62f214b16bdaa21d868e54b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.686095 15219 tablet_service.cc:1511] Processing CreateTablet for tablet d55ea5972868497eb17221413640fbea (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:37.684531 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8218e039c251425fb97ad83094c709da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.692618 15222 tablet_service.cc:1511] Processing CreateTablet for tablet bb3022274b1549eb806d68dc808a6ceb (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:37.700752 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3022274b1549eb806d68dc808a6ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.705251 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55ea5972868497eb17221413640fbea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.714581 15220 tablet_service.cc:1511] Processing CreateTablet for tablet f2466cf62f214b16bdaa21d868e54b04 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:37.716313 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2466cf62f214b16bdaa21d868e54b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.723764 15223 tablet_service.cc:1511] Processing CreateTablet for tablet f5cd793e143d45cf9e32447e33602536 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:37.734338 15426 tablet_bootstrap.cc:654] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.737267 15365 tablet_service.cc:1511] Processing CreateTablet for tablet f2466cf62f214b16bdaa21d868e54b04 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:37.738821 15365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2466cf62f214b16bdaa21d868e54b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.738978 15425 tablet_bootstrap.cc:492] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:37.739579 15425 ts_tablet_manager.cc:1403] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.007s
I20260709 13:07:37.746158 15425 raft_consensus.cc:359] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:37.747044 15425 raft_consensus.cc:385] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.747336 15425 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.716713 15221 tablet_service.cc:1511] Processing CreateTablet for tablet c4dc28ca60664c41a529fde0dc6c28aa (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:37.763137 15218 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf87f25409d4351a79d5be897b18ddb (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:37.765409 15427 tablet_bootstrap.cc:492] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:37.767164 15364 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf87f25409d4351a79d5be897b18ddb (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:37.768687 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3022274b1549eb806d68dc808a6ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.774845 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dc28ca60664c41a529fde0dc6c28aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.776667 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5cd793e143d45cf9e32447e33602536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.755442 15425 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:37.778301 15364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf87f25409d4351a79d5be897b18ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.779496 15216 tablet_service.cc:1511] Processing CreateTablet for tablet d13483d024d54c9e929c90baefab4d3a (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:37.780973 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf87f25409d4351a79d5be897b18ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.767100 15291 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf87f25409d4351a79d5be897b18ddb (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:37.785957 15291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf87f25409d4351a79d5be897b18ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.796872 15366 tablet_service.cc:1511] Processing CreateTablet for tablet d13483d024d54c9e929c90baefab4d3a (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:37.798439 15366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13483d024d54c9e929c90baefab4d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.798421 15217 tablet_service.cc:1511] Processing CreateTablet for tablet fb1065d4b5964e7f8603f56553ecdb3b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:37.816797 15294 tablet_service.cc:1511] Processing CreateTablet for tablet fb1065d4b5964e7f8603f56553ecdb3b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:37.819777 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13483d024d54c9e929c90baefab4d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.824816 15333 heartbeater.cc:499] Master 127.13.196.126:35597 was elected leader, sending a full tablet report...
I20260709 13:07:37.827108 15426 tablet_bootstrap.cc:492] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:37.827827 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1065d4b5964e7f8603f56553ecdb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.821102 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1065d4b5964e7f8603f56553ecdb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.838433 15258 heartbeater.cc:499] Master 127.13.196.126:35597 was elected leader, sending a full tablet report...
I20260709 13:07:37.840246 15219 tablet_service.cc:1511] Processing CreateTablet for tablet d8ad749c34474d4db0fa33ca64452d80 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:37.842159 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8ad749c34474d4db0fa33ca64452d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.827883 15426 ts_tablet_manager.cc:1403] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.201s	user 0.000s	sys 0.018s
I20260709 13:07:37.843124 15298 tablet_service.cc:1511] Processing CreateTablet for tablet d13483d024d54c9e929c90baefab4d3a (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:37.844785 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d13483d024d54c9e929c90baefab4d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.847189 15426 raft_consensus.cc:359] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:37.848059 15426 raft_consensus.cc:385] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.848882 15368 tablet_service.cc:1511] Processing CreateTablet for tablet fb1065d4b5964e7f8603f56553ecdb3b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:37.888654 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1065d4b5964e7f8603f56553ecdb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.891654 15426 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
W20260709 13:07:37.898425 15115 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63867.7us
I20260709 13:07:37.911003 15426 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:37.920617 15292 tablet_service.cc:1511] Processing CreateTablet for tablet d8ad749c34474d4db0fa33ca64452d80 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:37.922647 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8ad749c34474d4db0fa33ca64452d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.954300 15215 tablet_service.cc:1511] Processing CreateTablet for tablet 9be9d73e985345e39f20d23687e60a85 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:37.956136 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be9d73e985345e39f20d23687e60a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.966375 15407 heartbeater.cc:499] Master 127.13.196.126:35597 was elected leader, sending a full tablet report...
I20260709 13:07:37.967846 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 9be9d73e985345e39f20d23687e60a85 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:37.969504 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be9d73e985345e39f20d23687e60a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.001775 15223 tablet_service.cc:1511] Processing CreateTablet for tablet 58ced12ec3004fab89f76f924edf0925 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:38.003490 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ced12ec3004fab89f76f924edf0925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.008847 15427 tablet_bootstrap.cc:654] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.008136 15290 tablet_service.cc:1511] Processing CreateTablet for tablet 58ced12ec3004fab89f76f924edf0925 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:38.011075 15290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ced12ec3004fab89f76f924edf0925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.973163 15425 ts_tablet_manager.cc:1434] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.225s	user 0.014s	sys 0.016s
I20260709 13:07:38.013396 15425 tablet_bootstrap.cc:492] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:38.021663 15215 tablet_service.cc:1511] Processing CreateTablet for tablet 09794c12bb344a25888d56e55d7e90f8 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:38.023555 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09794c12bb344a25888d56e55d7e90f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.025599 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 09794c12bb344a25888d56e55d7e90f8 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:38.029662 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09794c12bb344a25888d56e55d7e90f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.030067 15426 ts_tablet_manager.cc:1434] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.187s	user 0.017s	sys 0.003s
I20260709 13:07:38.031570 15426 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:38.044100 15426 tablet_bootstrap.cc:654] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.047151 15368 tablet_service.cc:1511] Processing CreateTablet for tablet 9be9d73e985345e39f20d23687e60a85 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:38.049261 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be9d73e985345e39f20d23687e60a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.050458 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 4e535be5fc0f4cf7b8401a4c737a091f (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:38.053505 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e535be5fc0f4cf7b8401a4c737a091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.054035 15367 tablet_service.cc:1511] Processing CreateTablet for tablet 09794c12bb344a25888d56e55d7e90f8 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:38.055467 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09794c12bb344a25888d56e55d7e90f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.059746 15370 tablet_service.cc:1511] Processing CreateTablet for tablet 58ced12ec3004fab89f76f924edf0925 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:38.061925 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ced12ec3004fab89f76f924edf0925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.062610 15430 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.063158 15430 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.063637 15292 tablet_service.cc:1511] Processing CreateTablet for tablet 4e535be5fc0f4cf7b8401a4c737a091f (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:38.065157 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e535be5fc0f4cf7b8401a4c737a091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.066314 15430 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:38.086226 15427 tablet_bootstrap.cc:492] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:38.089736 15426 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:38.094766 15427 ts_tablet_manager.cc:1403] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.330s	user 0.024s	sys 0.000s
I20260709 13:07:38.095409 15364 tablet_service.cc:1511] Processing CreateTablet for tablet d8ad749c34474d4db0fa33ca64452d80 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:38.106181 15215 tablet_service.cc:1511] Processing CreateTablet for tablet 657606da148d404bbcad5ee674c9b9d2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:38.119251 15364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8ad749c34474d4db0fa33ca64452d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.119622 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 657606da148d404bbcad5ee674c9b9d2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:38.121120 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657606da148d404bbcad5ee674c9b9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.125161 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657606da148d404bbcad5ee674c9b9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.126674 15218 tablet_service.cc:1511] Processing CreateTablet for tablet 2578a36ef3a84d208c1736eedfe8f2bf (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:38.129664 15427 raft_consensus.cc:359] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.126711 15426 ts_tablet_manager.cc:1403] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.095s	user 0.028s	sys 0.014s
I20260709 13:07:38.114880 15295 tablet_service.cc:1511] Processing CreateTablet for tablet 2578a36ef3a84d208c1736eedfe8f2bf (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:38.130507 15427 raft_consensus.cc:385] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.130849 15427 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.131466 15295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2578a36ef3a84d208c1736eedfe8f2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.141839 15365 tablet_service.cc:1511] Processing CreateTablet for tablet 4e535be5fc0f4cf7b8401a4c737a091f (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:38.143633 15365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e535be5fc0f4cf7b8401a4c737a091f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.145576 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2578a36ef3a84d208c1736eedfe8f2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.131706 15427 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.165676 15426 raft_consensus.cc:359] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.166734 15426 raft_consensus.cc:385] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.167127 15426 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.168011 15426 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.172756 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:38.188882 15233 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:38.190778 15274 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:38.174388 15425 tablet_bootstrap.cc:654] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.174968 15431 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.178048 15368 tablet_service.cc:1511] Processing CreateTablet for tablet 657606da148d404bbcad5ee674c9b9d2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:38.193650 15430 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.194159 15430 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.193847 15431 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.194597 15430 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.191864 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:38.194621 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657606da148d404bbcad5ee674c9b9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.177924 15427 ts_tablet_manager.cc:1434] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
W20260709 13:07:38.198177 15273 leader_election.cc:343] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.209237 15427 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:38.208762 15294 tablet_service.cc:1511] Processing CreateTablet for tablet e8be1b1f251d4292b0b299f3c0c48c25 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:38.211457 15371 tablet_service.cc:1511] Processing CreateTablet for tablet e8be1b1f251d4292b0b299f3c0c48c25 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:38.217480 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8be1b1f251d4292b0b299f3c0c48c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.211601 15217 tablet_service.cc:1511] Processing CreateTablet for tablet e8be1b1f251d4292b0b299f3c0c48c25 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:38.222401 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8be1b1f251d4292b0b299f3c0c48c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.229218 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8be1b1f251d4292b0b299f3c0c48c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.232003 15431 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:38.251432 15426 ts_tablet_manager.cc:1434] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.111s	user 0.017s	sys 0.017s
I20260709 13:07:38.252975 15426 tablet_bootstrap.cc:492] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:38.261330 15426 tablet_bootstrap.cc:654] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.260248 15427 tablet_bootstrap.cc:654] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.271854 15291 tablet_service.cc:1511] Processing CreateTablet for tablet 362d7a17088a4e86a51428b5ee97346e (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:38.273481 15291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d7a17088a4e86a51428b5ee97346e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.275219 15430 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.282648 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 362d7a17088a4e86a51428b5ee97346e (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:38.300961 15364 tablet_service.cc:1511] Processing CreateTablet for tablet 2578a36ef3a84d208c1736eedfe8f2bf (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:38.302942 15364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2578a36ef3a84d208c1736eedfe8f2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.303556 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d7a17088a4e86a51428b5ee97346e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.318759 15219 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7b07c0f0a5432f94b6b20964332362 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:38.324466 15221 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa83c2832d5495583c7715993a665e2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:38.326511 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa83c2832d5495583c7715993a665e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.324996 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:07:38.328989 15348 leader_election.cc:343] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.350463 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:38.351249 15233 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.350898 15290 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa83c2832d5495583c7715993a665e2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:38.354272 15290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa83c2832d5495583c7715993a665e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.357260 15427 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:38.357909 15427 ts_tablet_manager.cc:1403] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.149s	user 0.012s	sys 0.006s
I20260709 13:07:38.348670 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7b07c0f0a5432f94b6b20964332362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.373492 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7b07c0f0a5432f94b6b20964332362 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:38.376506 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7b07c0f0a5432f94b6b20964332362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.374111 15223 tablet_service.cc:1511] Processing CreateTablet for tablet 20919a13dd564519b54dd5e3c0751736 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:38.365487 15430 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:38.384909 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20919a13dd564519b54dd5e3c0751736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.394287 15292 tablet_service.cc:1511] Processing CreateTablet for tablet 20919a13dd564519b54dd5e3c0751736 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:38.396070 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20919a13dd564519b54dd5e3c0751736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.374573 15427 raft_consensus.cc:359] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.397568 15427 raft_consensus.cc:385] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.397917 15427 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.398032 15365 tablet_service.cc:1511] Processing CreateTablet for tablet 362d7a17088a4e86a51428b5ee97346e (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:38.399705 15365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d7a17088a4e86a51428b5ee97346e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.402238 15368 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7b07c0f0a5432f94b6b20964332362 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:38.404800 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:38.404832 15367 tablet_service.cc:1511] Processing CreateTablet for tablet 4aa83c2832d5495583c7715993a665e2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:38.405754 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:38.407334 15425 tablet_bootstrap.cc:492] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:38.407935 15425 ts_tablet_manager.cc:1403] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.395s	user 0.020s	sys 0.026s
I20260709 13:07:38.402719 15370 tablet_service.cc:1511] Processing CreateTablet for tablet 20919a13dd564519b54dd5e3c0751736 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:38.404109 15363 tablet_service.cc:1511] Processing CreateTablet for tablet 3f803fff1dbc4b87b787f25b1659c2ae (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:38.411427 15425 raft_consensus.cc:359] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.412281 15425 raft_consensus.cc:385] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.413267 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aa83c2832d5495583c7715993a665e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.413988 15363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f803fff1dbc4b87b787f25b1659c2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.398941 15427 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.399039 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 3f803fff1dbc4b87b787f25b1659c2ae (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:38.416797 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7b07c0f0a5432f94b6b20964332362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.417183 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f803fff1dbc4b87b787f25b1659c2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.417728 15427 ts_tablet_manager.cc:1434] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:07:38.418819 15427 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:38.412734 15215 tablet_service.cc:1511] Processing CreateTablet for tablet 3f803fff1dbc4b87b787f25b1659c2ae (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:38.420845 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20919a13dd564519b54dd5e3c0751736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.421520 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f803fff1dbc4b87b787f25b1659c2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.436475 15217 tablet_service.cc:1511] Processing CreateTablet for tablet d3f082f323814ed98886bca799e3d232 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:38.437589 15291 tablet_service.cc:1511] Processing CreateTablet for tablet d3f082f323814ed98886bca799e3d232 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:07:38.438683 15273 leader_election.cc:343] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.412865 15425 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.439733 15291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f082f323814ed98886bca799e3d232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.440176 15425 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:38.441980 15345 leader_election.cc:343] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.442528 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:38.440676 15438 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.446393 15438 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.451392 15438 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:38.459259 15426 tablet_bootstrap.cc:492] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:38.443651 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f082f323814ed98886bca799e3d232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.461591 15440 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.443645 15233 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:38.442737 15425 ts_tablet_manager.cc:1434] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:07:38.465991 15425 tablet_bootstrap.cc:492] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:38.460213 15426 ts_tablet_manager.cc:1403] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.208s	user 0.018s	sys 0.009s
I20260709 13:07:38.469942 15274 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:38.472621 15430 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.489430 15430 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:38.495530 15430 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.511428 15427 tablet_bootstrap.cc:654] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.514245 15364 tablet_service.cc:1511] Processing CreateTablet for tablet d3f082f323814ed98886bca799e3d232 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:38.517692 15425 tablet_bootstrap.cc:654] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.518007 15364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f082f323814ed98886bca799e3d232. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:38.523653 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:38.525915 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:38.527137 15426 raft_consensus.cc:359] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.528023 15426 raft_consensus.cc:385] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.528328 15426 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
W20260709 13:07:38.528484 15196 leader_election.cc:343] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.525914 15295 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56abc7f6c348d58ce156f066549f7d (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:38.533450 15295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56abc7f6c348d58ce156f066549f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.529399 15426 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.546442 15426 ts_tablet_manager.cc:1434] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.004s
I20260709 13:07:38.546047 15371 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56abc7f6c348d58ce156f066549f7d (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:38.547753 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56abc7f6c348d58ce156f066549f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.559499 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:38.559834 15223 tablet_service.cc:1511] Processing CreateTablet for tablet a781ba18f2704d43b5f36e4e55228b71 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:38.560425 15382 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:38.561585 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a781ba18f2704d43b5f36e4e55228b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.562559 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:38.563763 15368 tablet_service.cc:1511] Processing CreateTablet for tablet 0952b977f0484de9aeb6cb7ca74a0580 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:38.564118 15438 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.536706 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56abc7f6c348d58ce156f066549f7d (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:38.564695 15438 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.565109 15438 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.565369 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0952b977f0484de9aeb6cb7ca74a0580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.565372 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56abc7f6c348d58ce156f066549f7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.576700 15290 tablet_service.cc:1511] Processing CreateTablet for tablet a781ba18f2704d43b5f36e4e55228b71 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:38.580286 15290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a781ba18f2704d43b5f36e4e55228b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.577718 15367 tablet_service.cc:1511] Processing CreateTablet for tablet a781ba18f2704d43b5f36e4e55228b71 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:38.582296 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a781ba18f2704d43b5f36e4e55228b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.585570 15221 tablet_service.cc:1511] Processing CreateTablet for tablet 0952b977f0484de9aeb6cb7ca74a0580 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:38.587354 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0952b977f0484de9aeb6cb7ca74a0580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.590662 15218 tablet_service.cc:1511] Processing CreateTablet for tablet 720e51950072462e9d16f75b27995387 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:38.592839 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720e51950072462e9d16f75b27995387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.593174 15440 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.594082 15440 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.601094 15440 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:38.602401 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:38.603547 15233 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:38.603904 15426 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:38.605224 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:38.615549 15297 tablet_service.cc:1511] Processing CreateTablet for tablet 720e51950072462e9d16f75b27995387 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:38.618953 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720e51950072462e9d16f75b27995387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.615764 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:38.580410 15438 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.625669 15440 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.628242 15366 tablet_service.cc:1511] Processing CreateTablet for tablet 720e51950072462e9d16f75b27995387 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:38.629963 15366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720e51950072462e9d16f75b27995387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.631471 15129 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.638844 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:38.642745 15196 leader_election.cc:343] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.606815 15294 tablet_service.cc:1511] Processing CreateTablet for tablet 0952b977f0484de9aeb6cb7ca74a0580 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:38.659940 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0952b977f0484de9aeb6cb7ca74a0580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.679456 15430 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.680130 15430 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.681213 15365 tablet_service.cc:1511] Processing CreateTablet for tablet 389bc861d7d5427b88bae4655d5ef6b8 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:38.684638 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:38.685272 15425 tablet_bootstrap.cc:492] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:38.685940 15425 ts_tablet_manager.cc:1403] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.220s	user 0.008s	sys 0.014s
I20260709 13:07:38.670238 15438 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:38.696527 15215 tablet_service.cc:1511] Processing CreateTablet for tablet 67a795b9e21446b4be65705c76ee1d94 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:38.698669 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a795b9e21446b4be65705c76ee1d94. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:38.699083 15274 leader_election.cc:343] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.696884 15220 tablet_service.cc:1511] Processing CreateTablet for tablet 965cf4b237ec478b978733b437297652 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:38.699481 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:38.689273 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:38.700712 15382 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.701344 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965cf4b237ec478b978733b437297652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.702149 15426 tablet_bootstrap.cc:654] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:38.702064 15273 leader_election.cc:343] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.702682 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:38.705619 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 67a795b9e21446b4be65705c76ee1d94 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:38.706514 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 389bc861d7d5427b88bae4655d5ef6b8 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:38.707304 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a795b9e21446b4be65705c76ee1d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.695931 15219 tablet_service.cc:1511] Processing CreateTablet for tablet 389bc861d7d5427b88bae4655d5ef6b8 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:38.688097 15430 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:38.710665 15448 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.712287 15293 tablet_service.cc:1511] Processing CreateTablet for tablet 965cf4b237ec478b978733b437297652 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:38.712882 15363 tablet_service.cc:1511] Processing CreateTablet for tablet 67a795b9e21446b4be65705c76ee1d94 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:38.714231 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965cf4b237ec478b978733b437297652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.716913 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389bc861d7d5427b88bae4655d5ef6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.724777 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389bc861d7d5427b88bae4655d5ef6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.712249 15425 raft_consensus.cc:359] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:38.731047 15369 tablet_service.cc:1511] Processing CreateTablet for tablet 965cf4b237ec478b978733b437297652 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:38.733575 15382 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:38.735569 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:38.737344 15438 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.746465 15427 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:38.747154 15427 ts_tablet_manager.cc:1403] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.329s	user 0.014s	sys 0.026s
I20260709 13:07:38.755666 15363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a795b9e21446b4be65705c76ee1d94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.756309 15292 tablet_service.cc:1511] Processing CreateTablet for tablet b75da66513484f36a3807f62f4177e56 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:38.757303 15425 raft_consensus.cc:385] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.753650 15223 tablet_service.cc:1511] Processing CreateTablet for tablet b75da66513484f36a3807f62f4177e56 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:38.765071 15438 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:38.765560 15369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965cf4b237ec478b978733b437297652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.777321 15438 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.779211 15222 tablet_service.cc:1511] Processing CreateTablet for tablet fec6e03dbf19483e8e0a5c9d25c73def (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:38.779703 15370 tablet_service.cc:1511] Processing CreateTablet for tablet b75da66513484f36a3807f62f4177e56 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:38.780756 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec6e03dbf19483e8e0a5c9d25c73def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.781215 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75da66513484f36a3807f62f4177e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.797585 15291 tablet_service.cc:1511] Processing CreateTablet for tablet fec6e03dbf19483e8e0a5c9d25c73def (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:38.804622 15291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec6e03dbf19483e8e0a5c9d25c73def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.807509 15426 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:38.808238 15426 ts_tablet_manager.cc:1403] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.205s	user 0.020s	sys 0.015s
I20260709 13:07:38.817345 15214 tablet_service.cc:1511] Processing CreateTablet for tablet bb30c1248aaf4663a734d0eb93201e7b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:38.821606 15368 tablet_service.cc:1511] Processing CreateTablet for tablet bb30c1248aaf4663a734d0eb93201e7b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:38.772107 15425 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.821799 15289 tablet_service.cc:1511] Processing CreateTablet for tablet bb30c1248aaf4663a734d0eb93201e7b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:38.808866 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75da66513484f36a3807f62f4177e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.834949 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 315a39052c3a4aa189e80239d6709f0e (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:38.835975 15289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb30c1248aaf4663a734d0eb93201e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.831365 15440 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.826637 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b75da66513484f36a3807f62f4177e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.825855 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb30c1248aaf4663a734d0eb93201e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.854771 15426 raft_consensus.cc:359] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.855715 15426 raft_consensus.cc:385] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.856046 15426 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.857288 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb30c1248aaf4663a734d0eb93201e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.863324 15425 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:38.866245 15425 ts_tablet_manager.cc:1434] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.180s	user 0.010s	sys 0.000s
I20260709 13:07:38.867794 15427 raft_consensus.cc:359] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.868745 15427 raft_consensus.cc:385] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.873759 15367 tablet_service.cc:1511] Processing CreateTablet for tablet fec6e03dbf19483e8e0a5c9d25c73def (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:38.875559 15427 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.895239 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 315a39052c3a4aa189e80239d6709f0e (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:38.897286 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315a39052c3a4aa189e80239d6709f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.896130 15371 tablet_service.cc:1511] Processing CreateTablet for tablet 315a39052c3a4aa189e80239d6709f0e (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:38.885649 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315a39052c3a4aa189e80239d6709f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.895190 15427 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.908965 15131 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.912175 15430 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.914422 15218 tablet_service.cc:1511] Processing CreateTablet for tablet 439569a190ca4e8fbb5f6ad2dce20957 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:38.919428 15427 ts_tablet_manager.cc:1434] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.172s	user 0.008s	sys 0.004s
I20260709 13:07:38.915825 15365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389bc861d7d5427b88bae4655d5ef6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.922955 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec6e03dbf19483e8e0a5c9d25c73def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.928951 15427 tablet_bootstrap.cc:492] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:38.928951 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315a39052c3a4aa189e80239d6709f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.882176 15426 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:38.936045 15426 ts_tablet_manager.cc:1434] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.127s	user 0.004s	sys 0.005s
I20260709 13:07:38.893884 15425 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:38.951498 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439569a190ca4e8fbb5f6ad2dce20957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.968259 15426 tablet_bootstrap.cc:492] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:38.987946 15427 tablet_bootstrap.cc:654] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.981659 15430 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:07:39.012013 15296 tablet_service.cc:1511] Processing CreateTablet for tablet 439569a190ca4e8fbb5f6ad2dce20957 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:39.014078 15296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439569a190ca4e8fbb5f6ad2dce20957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.015167 15219 tablet_service.cc:1511] Processing CreateTablet for tablet 012aeb5edb4346c8b15a323d6a0a1934 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:39.016729 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012aeb5edb4346c8b15a323d6a0a1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.019330 15366 tablet_service.cc:1511] Processing CreateTablet for tablet 439569a190ca4e8fbb5f6ad2dce20957 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:39.022866 15426 tablet_bootstrap.cc:654] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.023403 15366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439569a190ca4e8fbb5f6ad2dce20957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.037477 15369 tablet_service.cc:1511] Processing CreateTablet for tablet 012aeb5edb4346c8b15a323d6a0a1934 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:39.039129 15369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012aeb5edb4346c8b15a323d6a0a1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.051982 15427 tablet_bootstrap.cc:492] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:39.052675 15427 ts_tablet_manager.cc:1403] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.124s	user 0.019s	sys 0.003s
I20260709 13:07:39.068670 15218 tablet_service.cc:1511] Processing CreateTablet for tablet 8860a3924290420bb9fbf4a44cd89f06 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:39.070574 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8860a3924290420bb9fbf4a44cd89f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.081154 15427 raft_consensus.cc:359] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:39.082093 15427 raft_consensus.cc:385] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.082432 15427 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.083353 15427 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:39.086056 15427 ts_tablet_manager.cc:1434] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:07:39.087476 15427 tablet_bootstrap.cc:492] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:39.087661 15365 tablet_service.cc:1511] Processing CreateTablet for tablet 8860a3924290420bb9fbf4a44cd89f06 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:39.091292 15365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8860a3924290420bb9fbf4a44cd89f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.110244 15368 tablet_service.cc:1511] Processing CreateTablet for tablet 88d57b3730d2404eb078514e05f127c2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:39.110766 15291 tablet_service.cc:1511] Processing CreateTablet for tablet 012aeb5edb4346c8b15a323d6a0a1934 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:39.111971 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d57b3730d2404eb078514e05f127c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.126533 15425 tablet_bootstrap.cc:654] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.133816 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 88d57b3730d2404eb078514e05f127c2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:39.135421 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d57b3730d2404eb078514e05f127c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.131449 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 8860a3924290420bb9fbf4a44cd89f06 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:39.144850 15289 tablet_service.cc:1511] Processing CreateTablet for tablet 88d57b3730d2404eb078514e05f127c2 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:39.135260 15215 tablet_service.cc:1511] Processing CreateTablet for tablet bec569d5083b416380cac661b1b44368 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:39.147490 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec569d5083b416380cac661b1b44368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.148269 15292 tablet_service.cc:1511] Processing CreateTablet for tablet bec569d5083b416380cac661b1b44368 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:39.150895 15371 tablet_service.cc:1511] Processing CreateTablet for tablet bec569d5083b416380cac661b1b44368 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:39.154109 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec569d5083b416380cac661b1b44368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.155197 15427 tablet_bootstrap.cc:654] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.140467 15291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012aeb5edb4346c8b15a323d6a0a1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.157246 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec569d5083b416380cac661b1b44368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.158017 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8860a3924290420bb9fbf4a44cd89f06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.161291 15289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d57b3730d2404eb078514e05f127c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.185848 15297 tablet_service.cc:1511] Processing CreateTablet for tablet ae61ecbf40014ab3bdd48399d0d8a997 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:39.191293 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae61ecbf40014ab3bdd48399d0d8a997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.198678 15438 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.199384 15438 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:39.185855 15219 tablet_service.cc:1511] Processing CreateTablet for tablet ae61ecbf40014ab3bdd48399d0d8a997 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:39.200904 15223 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2d399eb3d45818234b2fb03159dbe (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:39.207700 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae61ecbf40014ab3bdd48399d0d8a997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.208650 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:39.207127 15438 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:39.209547 15308 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:39.207082 15368 tablet_service.cc:1511] Processing CreateTablet for tablet ae61ecbf40014ab3bdd48399d0d8a997 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:39.211337 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae61ecbf40014ab3bdd48399d0d8a997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.211609 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:39.208760 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:39.215325 15198 leader_election.cc:343] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.217573 15438 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:39.218271 15438 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.219206 15438 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.220947 15426 tablet_bootstrap.cc:492] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:39.221570 15426 ts_tablet_manager.cc:1403] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.020s
I20260709 13:07:39.231261 15453 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.231534 15293 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2d399eb3d45818234b2fb03159dbe (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:39.231977 15453 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.236868 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2d399eb3d45818234b2fb03159dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.238682 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:39.240419 15369 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd2d399eb3d45818234b2fb03159dbe (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:39.242543 15369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2d399eb3d45818234b2fb03159dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.243196 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 30992f1a0d1949a7aacbc6cbd114a206 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:07:39.241076 15196 leader_election.cc:343] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.244719 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30992f1a0d1949a7aacbc6cbd114a206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.244485 15294 tablet_service.cc:1511] Processing CreateTablet for tablet 30992f1a0d1949a7aacbc6cbd114a206 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:39.245173 15440 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.245702 15440 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.248814 15294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30992f1a0d1949a7aacbc6cbd114a206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.249557 15367 tablet_service.cc:1511] Processing CreateTablet for tablet 30992f1a0d1949a7aacbc6cbd114a206 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:39.251010 15367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30992f1a0d1949a7aacbc6cbd114a206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.254460 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:39.255749 15232 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:39.258793 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:39.259486 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:39.248121 15440 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:39.260085 15382 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:39.262305 15440 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:39.262831 15440 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.262404 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:39.263355 15440 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.264469 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2d399eb3d45818234b2fb03159dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.264879 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:39.266558 15345 leader_election.cc:343] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.274560 15453 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:39.299950 15427 tablet_bootstrap.cc:492] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:39.300944 15427 ts_tablet_manager.cc:1403] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.214s	user 0.018s	sys 0.002s
I20260709 13:07:39.323693 15425 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:39.324400 15453 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:39.325038 15453 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.325522 15453 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:39.331380 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69095us
I20260709 13:07:39.330127 15425 ts_tablet_manager.cc:1403] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.448s	user 0.030s	sys 0.041s
I20260709 13:07:39.333491 15298 tablet_service.cc:1511] Processing CreateTablet for tablet dc5a1ea32aef45d1b6e1ff8b0718d178 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:39.334980 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5a1ea32aef45d1b6e1ff8b0718d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.346789 15426 raft_consensus.cc:359] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.347724 15426 raft_consensus.cc:385] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.348033 15426 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.351887 15369 tablet_service.cc:1511] Processing CreateTablet for tablet dc5a1ea32aef45d1b6e1ff8b0718d178 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:39.352707 15426 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.353156 15215 tablet_service.cc:1511] Processing CreateTablet for tablet dc5a1ea32aef45d1b6e1ff8b0718d178 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:39.353940 15369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5a1ea32aef45d1b6e1ff8b0718d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.354993 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5a1ea32aef45d1b6e1ff8b0718d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.362012 15468 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:39.315344 15438 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:39.370954 15438 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:39.367878 15289 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbb0d4cfecd47d08011ea23dbbb5965 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:39.372821 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:39.373649 15308 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.376504 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:07:39.379469 15198 leader_election.cc:343] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.335408 15425 raft_consensus.cc:359] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.387553 15425 raft_consensus.cc:385] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.388042 15425 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.373185 15289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbb0d4cfecd47d08011ea23dbbb5965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.413255 15440 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.412202 15425 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.413832 15427 raft_consensus.cc:359] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.414822 15427 raft_consensus.cc:385] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.415201 15427 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.416096 15427 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.416904 15440 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:39.416965 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:39.388180 15219 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbb0d4cfecd47d08011ea23dbbb5965 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:39.419570 15371 tablet_service.cc:1511] Processing CreateTablet for tablet c27cdc2356514f4ea31d68df9ee2fa02 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:39.420265 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbb0d4cfecd47d08011ea23dbbb5965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.427094 15306 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.425526 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:39.429453 15345 leader_election.cc:343] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.421065 15371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27cdc2356514f4ea31d68df9ee2fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.429574 15366 tablet_service.cc:1511] Processing CreateTablet for tablet 3fbb0d4cfecd47d08011ea23dbbb5965 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:39.431197 15366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbb0d4cfecd47d08011ea23dbbb5965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.436067 15298 tablet_service.cc:1511] Processing CreateTablet for tablet c27cdc2356514f4ea31d68df9ee2fa02 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:39.437881 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27cdc2356514f4ea31d68df9ee2fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.442243 15427 ts_tablet_manager.cc:1434] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.004s
I20260709 13:07:39.440689 15426 ts_tablet_manager.cc:1434] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.219s	user 0.008s	sys 0.016s
I20260709 13:07:39.447979 15425 ts_tablet_manager.cc:1434] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.116s	user 0.010s	sys 0.000s
I20260709 13:07:39.433151 15308 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:39.446271 15292 tablet_service.cc:1511] Processing CreateTablet for tablet 66c844c3ac2f40469051bf49c46469c6 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:39.447789 15427 tablet_bootstrap.cc:492] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:39.461277 15425 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:39.467134 15365 tablet_service.cc:1511] Processing CreateTablet for tablet 66c844c3ac2f40469051bf49c46469c6 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:39.469033 15365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c844c3ac2f40469051bf49c46469c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.469322 15292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c844c3ac2f40469051bf49c46469c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.463122 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:39.470887 15438 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:39.471478 15438 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:39.473167 15425 tablet_bootstrap.cc:654] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.474086 15426 tablet_bootstrap.cc:492] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:39.473668 15438 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:39.479288 15223 tablet_service.cc:1511] Processing CreateTablet for tablet 66c844c3ac2f40469051bf49c46469c6 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:39.481532 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c844c3ac2f40469051bf49c46469c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.490968 15297 tablet_service.cc:1511] Processing CreateTablet for tablet 3005d9c450974fc299b5f0c0e92c745a (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:39.492652 15297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3005d9c450974fc299b5f0c0e92c745a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.493593 15440 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.494189 15440 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.498657 15427 tablet_bootstrap.cc:654] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.498778 15368 tablet_service.cc:1511] Processing CreateTablet for tablet 3005d9c450974fc299b5f0c0e92c745a (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:39.499971 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:39.500787 15308 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:39.500823 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:39.501587 15233 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:39.502413 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:39.503628 15469 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:39.504088 15469 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.493891 15215 tablet_service.cc:1511] Processing CreateTablet for tablet c27cdc2356514f4ea31d68df9ee2fa02 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:39.504490 15469 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.504882 15440 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:39.507149 15219 tablet_service.cc:1511] Processing CreateTablet for tablet 3005d9c450974fc299b5f0c0e92c745a (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:39.509594 15368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3005d9c450974fc299b5f0c0e92c745a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.515121 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c27cdc2356514f4ea31d68df9ee2fa02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:39.529312 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:39.532475 15298 tablet_service.cc:1511] Processing CreateTablet for tablet 75432bd549b3481d83070979a305922b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:39.532653 15363 tablet_service.cc:1511] Processing CreateTablet for tablet 75432bd549b3481d83070979a305922b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:39.533176 15370 tablet_service.cc:1511] Processing CreateTablet for tablet 9229ceef9fef4706b1e835456a589647 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:39.534008 15298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75432bd549b3481d83070979a305922b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.534165 15363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75432bd549b3481d83070979a305922b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.534920 15370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9229ceef9fef4706b1e835456a589647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.540839 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3005d9c450974fc299b5f0c0e92c745a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.553270 15293 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca5c0c807fd42129fc4ee147149c313 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:39.540796 15291 tablet_service.cc:1511] Processing CreateTablet for tablet 9229ceef9fef4706b1e835456a589647 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:39.564956 15131 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.568286 15364 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca5c0c807fd42129fc4ee147149c313 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:39.569881 15364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca5c0c807fd42129fc4ee147149c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.577407 15216 tablet_service.cc:1511] Processing CreateTablet for tablet 75432bd549b3481d83070979a305922b (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:39.578954 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75432bd549b3481d83070979a305922b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.582657 15453 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.584489 15232 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:39.589145 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:39.590725 15440 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:39.599203 15426 tablet_bootstrap.cc:654] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.622937 15469 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.626000 15293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca5c0c807fd42129fc4ee147149c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.631536 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:39.633665 15196 leader_election.cc:343] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.634730 15453 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:39.648698 15223 tablet_service.cc:1511] Processing CreateTablet for tablet 9229ceef9fef4706b1e835456a589647 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:39.650311 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9229ceef9fef4706b1e835456a589647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.650643 15291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9229ceef9fef4706b1e835456a589647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.652402 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:39.653469 15232 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.636854 15430 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.656877 15430 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.663210 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:39.664245 15306 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.665047 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:39.668085 15430 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:39.669127 15469 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:39.674002 15215 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca5c0c807fd42129fc4ee147149c313 (DEFAULT_TABLE table=test-workload [id=8fa6196893d945378030cba17992850a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:39.675495 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca5c0c807fd42129fc4ee147149c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.698217 15232 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:39.704701 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:39.705789 15469 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:39.706343 15425 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:39.706972 15425 ts_tablet_manager.cc:1403] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.246s	user 0.019s	sys 0.034s
I20260709 13:07:39.706380 15469 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:39.712718 15469 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.710796 15425 raft_consensus.cc:359] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.713749 15425 raft_consensus.cc:385] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.714078 15425 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.717139 15425 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.636523 15453 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
I20260709 13:07:39.723205 15425 ts_tablet_manager.cc:1434] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:07:39.725162 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:39.727366 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:39.728762 15430 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:39.730069 15425 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:39.732236 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:39.708721 15306 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:39.734988 15380 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 1: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:39.739778 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:39.741456 15468 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:39.762661 15426 tablet_bootstrap.cc:492] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:39.763475 15426 ts_tablet_manager.cc:1403] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.290s	user 0.006s	sys 0.012s
I20260709 13:07:39.767071 15426 raft_consensus.cc:359] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:39.757817 15425 tablet_bootstrap.cc:654] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.767967 15426 raft_consensus.cc:385] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.783905 15129 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.778066 15426 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.787210 15427 tablet_bootstrap.cc:492] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:39.790589 15427 ts_tablet_manager.cc:1403] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.343s	user 0.012s	sys 0.050s
I20260709 13:07:39.796877 15426 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:07:39.795781 15427 raft_consensus.cc:359] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.805112 15425 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:39.805765 15427 raft_consensus.cc:385] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.806133 15425 ts_tablet_manager.cc:1403] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.012s
I20260709 13:07:39.806265 15427 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.807219 15427 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.805259 15426 ts_tablet_manager.cc:1434] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.004s
I20260709 13:07:39.809769 15427 ts_tablet_manager.cc:1434] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:07:39.810175 15426 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:39.810967 15427 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:39.812566 15425 raft_consensus.cc:359] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.813611 15425 raft_consensus.cc:385] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.814088 15425 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.815423 15425 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.819546 15427 tablet_bootstrap.cc:654] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.825695 15426 tablet_bootstrap.cc:654] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.826193 15425 ts_tablet_manager.cc:1434] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:07:39.827426 15425 tablet_bootstrap.cc:492] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:39.827426 15427 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:39.828327 15427 ts_tablet_manager.cc:1403] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.006s
I20260709 13:07:39.832870 15427 raft_consensus.cc:359] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.834630 15427 raft_consensus.cc:385] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.835125 15427 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.836289 15425 tablet_bootstrap.cc:654] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.836280 15427 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.840466 15427 ts_tablet_manager.cc:1434] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:07:39.842464 15427 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:39.850198 15425 tablet_bootstrap.cc:492] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:39.850879 15425 ts_tablet_manager.cc:1403] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:07:39.853405 15427 tablet_bootstrap.cc:654] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.855444 15425 raft_consensus.cc:359] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.856601 15425 raft_consensus.cc:385] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.856956 15425 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.858323 15425 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.861575 15425 ts_tablet_manager.cc:1434] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:07:39.862844 15425 tablet_bootstrap.cc:492] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:39.870682 15425 tablet_bootstrap.cc:654] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.878954 15427 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:39.879788 15427 ts_tablet_manager.cc:1403] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.012s
I20260709 13:07:39.880923 15425 tablet_bootstrap.cc:492] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:39.881472 15425 ts_tablet_manager.cc:1403] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:07:39.884104 15427 raft_consensus.cc:359] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.885349 15427 raft_consensus.cc:385] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.885165 15425 raft_consensus.cc:359] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.885851 15427 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.886102 15425 raft_consensus.cc:385] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.886441 15425 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.887266 15425 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.887143 15427 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.890105 15425 ts_tablet_manager.cc:1434] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:07:39.890579 15427 ts_tablet_manager.cc:1434] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:39.891330 15425 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:39.892746 15427 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:39.899056 15425 tablet_bootstrap.cc:654] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.904450 15427 tablet_bootstrap.cc:654] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.912384 15425 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:39.913175 15425 ts_tablet_manager.cc:1403] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:07:39.919715 15453 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.917039 15425 raft_consensus.cc:359] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.925700 15425 raft_consensus.cc:385] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.926064 15427 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:39.926867 15427 ts_tablet_manager.cc:1403] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.007s
I20260709 13:07:39.926105 15425 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.928089 15425 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.930891 15425 ts_tablet_manager.cc:1434] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:07:39.931588 15426 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:39.932098 15425 tablet_bootstrap.cc:492] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:39.930895 15427 raft_consensus.cc:359] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.932294 15426 ts_tablet_manager.cc:1403] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.122s	user 0.046s	sys 0.065s
I20260709 13:07:39.932562 15427 raft_consensus.cc:385] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.933548 15427 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.935266 15427 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.937760 15426 raft_consensus.cc:359] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.939033 15426 raft_consensus.cc:385] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.939465 15426 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.941134 15425 tablet_bootstrap.cc:654] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.940845 15426 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.950240 15427 ts_tablet_manager.cc:1434] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:07:39.953544 15427 tablet_bootstrap.cc:492] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:39.953989 15426 ts_tablet_manager.cc:1434] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 13:07:39.955564 15426 tablet_bootstrap.cc:492] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:39.963625 15426 tablet_bootstrap.cc:654] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.965621 15427 tablet_bootstrap.cc:654] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.983268 15427 tablet_bootstrap.cc:492] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:39.983924 15427 ts_tablet_manager.cc:1403] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:07:39.984647 15381 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.987679 15427 raft_consensus.cc:359] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.988561 15427 raft_consensus.cc:385] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.988843 15427 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.989753 15427 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:39.994340 15427 ts_tablet_manager.cc:1434] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:07:39.999086 15425 tablet_bootstrap.cc:492] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:39.999616 15425 ts_tablet_manager.cc:1403] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.009s
I20260709 13:07:40.002327 15427 tablet_bootstrap.cc:492] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.006443 15426 tablet_bootstrap.cc:492] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.007105 15426 ts_tablet_manager.cc:1403] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.022s
I20260709 13:07:40.006958 15473 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.009646 15425 raft_consensus.cc:359] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.010505 15425 raft_consensus.cc:385] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.010455 15426 raft_consensus.cc:359] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.011377 15426 raft_consensus.cc:385] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.011721 15426 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.012696 15426 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.014716 15427 tablet_bootstrap.cc:654] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.016878 15426 ts_tablet_manager.cc:1434] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 13:07:40.011000 15425 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.019716 15425 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.022274 15425 ts_tablet_manager.cc:1434] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:07:40.023041 15430 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.023438 15425 tablet_bootstrap.cc:492] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.023698 15430 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.026916 15430 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.018801 15426 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.028088 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.028962 15232 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.029520 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.030257 15381 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.030527 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.034457 15430 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.034977 15430 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.035378 15430 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.036095 15426 tablet_bootstrap.cc:654] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.040966 15425 tablet_bootstrap.cc:654] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.046020 15430 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.050976 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.051923 15430 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.052140 15232 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.051162 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.053140 15381 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.066674 15381 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.068825 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:40.070420 15430 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.071133 15430 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:40.072415 15430 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.088658 15469 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.089395 15469 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.092152 15469 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:40.093724 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.094928 15233 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:40.099709 15427 tablet_bootstrap.cc:492] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.099308 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:40.099913 15232 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.100306 15427 ts_tablet_manager.cc:1403] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.030s
I20260709 13:07:40.103957 15427 raft_consensus.cc:359] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.104815 15427 raft_consensus.cc:385] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:40.104771 15345 leader_election.cc:343] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.105474 15427 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.106410 15427 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.107213 15425 tablet_bootstrap.cc:492] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:40.107720 15425 ts_tablet_manager.cc:1403] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.015s
I20260709 13:07:40.109087 15427 ts_tablet_manager.cc:1434] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:07:40.109522 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:40.110430 15427 tablet_bootstrap.cc:492] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.110644 15469 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.111065 15469 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.111514 15469 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.112385 15425 raft_consensus.cc:359] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.113237 15425 raft_consensus.cc:385] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.113530 15425 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.114547 15425 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.117830 15425 ts_tablet_manager.cc:1434] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:40.118305 15427 tablet_bootstrap.cc:654] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.119197 15425 tablet_bootstrap.cc:492] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.117897 15129 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.128857 15425 tablet_bootstrap.cc:654] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.122123 15426 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.129863 15426 ts_tablet_manager.cc:1403] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.111s	user 0.030s	sys 0.046s
I20260709 13:07:40.133599 15426 raft_consensus.cc:359] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.134418 15426 raft_consensus.cc:385] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.134737 15426 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.135219 15427 tablet_bootstrap.cc:492] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.123173 15469 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.136229 15430 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.135762 15426 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.136845 15430 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.137562 15469 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:40.138381 15427 ts_tablet_manager.cc:1403] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.006s
I20260709 13:07:40.138468 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.139197 15232 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.139387 15430 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.142827 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:40.142495 15427 raft_consensus.cc:359] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.143540 15308 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.143611 15427 raft_consensus.cc:385] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.144117 15427 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.145630 15427 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.148455 15232 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:40.151186 15426 ts_tablet_manager.cc:1434] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:07:40.152431 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.153244 15426 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.153447 15440 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.153967 15440 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:40.155118 15440 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.157253 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.152062 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.160585 15425 tablet_bootstrap.cc:492] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
W20260709 13:07:40.160962 15273 leader_election.cc:343] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.161163 15425 ts_tablet_manager.cc:1403] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.011s
I20260709 13:07:40.161656 15430 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.161969 15426 tablet_bootstrap.cc:654] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:40.162024 15274 leader_election.cc:343] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.162281 15430 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.162573 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:40.164052 15448 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:40.164760 15430 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.155987 15427 ts_tablet_manager.cc:1434] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:07:40.166560 15427 tablet_bootstrap.cc:492] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.168383 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.170761 15430 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.179942 15427 tablet_bootstrap.cc:654] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.179744 15430 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.180586 15308 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:40.172580 15473 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.174499 15426 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.182636 15430 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.182416 15473 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.176570 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.184930 15233 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:40.178440 15469 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.186246 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:40.187294 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.182673 15426 ts_tablet_manager.cc:1403] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
W20260709 13:07:40.190045 15196 leader_election.cc:343] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:40.190738 15198 leader_election.cc:343] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.191284 15198 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:40.191969 15381 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:40.192289 15438 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:40.194033 15427 tablet_bootstrap.cc:492] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.194125 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:40.194496 15473 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.194686 15427 ts_tablet_manager.cc:1403] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.002s
I20260709 13:07:40.195045 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.195902 15233 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.196045 15430 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.191341 15426 raft_consensus.cc:359] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.197417 15426 raft_consensus.cc:385] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.197777 15426 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.198103 15440 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:40.198647 15426 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.178707 15425 raft_consensus.cc:359] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.200942 15473 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.201505 15425 raft_consensus.cc:385] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.199244 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.201340 15426 ts_tablet_manager.cc:1434] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:40.202886 15425 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.202706 15473 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.203116 15427 raft_consensus.cc:359] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.203824 15427 raft_consensus.cc:385] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.206903 15473 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.207088 15427 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.203912 15425 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.206153 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:40.207789 15430 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:40.207944 15448 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.208271 15306 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:40.207923 15427 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.208673 15448 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.209082 15448 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.200124 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.210594 15427 ts_tablet_manager.cc:1434] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
W20260709 13:07:40.211354 15273 leader_election.cc:343] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.211706 15427 tablet_bootstrap.cc:492] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.206409 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.212922 15380 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:40.214903 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.219815 15426 tablet_bootstrap.cc:492] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.220623 15427 tablet_bootstrap.cc:654] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.224539 15473 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.227262 15425 ts_tablet_manager.cc:1434] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:07:40.228471 15425 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.227800 15129 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.228616 15448 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.232764 15509 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.233525 15509 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.231630 15473 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.239677 15473 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.235199 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.244362 15448 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.247812 15232 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.248045 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:07:40.250414 15273 leader_election.cc:343] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.255110 15509 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.255985 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.257489 15231 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.259426 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.260829 15426 tablet_bootstrap.cc:654] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.263195 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.264243 15380 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.267151 15509 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.268015 15509 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.268603 15509 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.278264 15473 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.283656 15232 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.284462 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.286243 15380 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.289619 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:40.291306 15510 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.291960 15510 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:40.292979 15510 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.293608 15509 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.288669 15473 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.303421 15425 tablet_bootstrap.cc:654] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.304029 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:40.309446 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.310259 15232 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.311995 15427 tablet_bootstrap.cc:492] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.314074 15427 ts_tablet_manager.cc:1403] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.019s
I20260709 13:07:40.310518 15509 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.316557 15308 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.327606 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.329672 15381 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.332697 15473 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.337682 15473 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.342998 15473 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.344631 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:40.339648 15232 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.344631 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.341668 15380 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:40.352571 15510 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.353176 15510 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.354357 15381 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.355872 15273 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:07:40.356447 15196 leader_election.cc:343] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.356616 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.356935 15509 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:40.357164 15198 leader_election.cc:343] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.357327 15233 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.357491 15509 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:40.357609 15427 raft_consensus.cc:359] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.358392 15427 raft_consensus.cc:385] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.358733 15427 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.357128 15425 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:40.358194 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:40.359747 15425 ts_tablet_manager.cc:1403] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.132s	user 0.027s	sys 0.005s
I20260709 13:07:40.361497 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.361233 15427 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.362380 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.362624 15448 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.363241 15448 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.363610 15448 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.365192 15509 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.366215 15426 tablet_bootstrap.cc:492] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.366744 15426 ts_tablet_manager.cc:1403] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.009s
I20260709 13:07:40.367642 15473 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:40.369040 15427 ts_tablet_manager.cc:1434] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.006s
I20260709 13:07:40.360416 15510 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.371093 15427 tablet_bootstrap.cc:492] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.374038 15425 raft_consensus.cc:359] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.374827 15425 raft_consensus.cc:385] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.375349 15425 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.380887 15473 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.390425 15473 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:40.391867 15473 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.396518 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.375238 15448 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:40.401777 15273 leader_election.cc:343] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.407805 15308 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:40.417094 15425 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.396260 15129 catalog_manager.cc:5697] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:40.447649 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45965.5us
I20260709 13:07:40.449493 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.450424 15232 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.451494 15425 ts_tablet_manager.cc:1434] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.008s
I20260709 13:07:40.449565 15426 raft_consensus.cc:359] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.452432 15426 raft_consensus.cc:385] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.452793 15426 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.453826 15426 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.457762 15426 ts_tablet_manager.cc:1434] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.091s	user 0.014s	sys 0.004s
I20260709 13:07:40.459960 15426 tablet_bootstrap.cc:492] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.463814 15232 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.465145 15425 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.455338 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.453171 15448 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.478087 15427 tablet_bootstrap.cc:654] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.478204 15513 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.472604 15273 leader_election.cc:343] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.478874 15513 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.484009 15513 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:40.484678 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.485843 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:40.486292 15348 leader_election.cc:343] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:40.487731 15345 leader_election.cc:343] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.488433 15345 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:40.488821 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:40.489251 15513 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:40.489900 15448 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.490479 15448 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:40.491168 15510 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.491490 15448 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.495864 15129 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.499743 15473 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.500379 15473 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.504225 15426 tablet_bootstrap.cc:654] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.504410 15473 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.506429 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:40.507418 15308 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:40.510232 15425 tablet_bootstrap.cc:654] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.514226 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.515543 15473 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.516278 15473 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.516892 15425 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:40.517247 15473 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.517668 15425 ts_tablet_manager.cc:1403] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 13:07:40.524176 15425 raft_consensus.cc:359] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.524829 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.525375 15425 raft_consensus.cc:385] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.525864 15425 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
W20260709 13:07:40.526636 15198 leader_election.cc:343] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.526882 15425 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.528923 15473 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.531584 15426 tablet_bootstrap.cc:492] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.532446 15426 ts_tablet_manager.cc:1403] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.015s
I20260709 13:07:40.533571 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:40.534250 15308 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.535732 15426 raft_consensus.cc:359] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.536589 15426 raft_consensus.cc:385] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.536916 15426 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.537734 15426 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.540235 15426 ts_tablet_manager.cc:1434] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:40.540544 15425 ts_tablet_manager.cc:1434] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:07:40.541393 15426 tablet_bootstrap.cc:492] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.541580 15425 tablet_bootstrap.cc:492] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.543592 15308 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:40.545213 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.546223 15438 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.546710 15438 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:40.547617 15438 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.548449 15425 tablet_bootstrap.cc:654] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:40.550120 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:40.548449 15426 tablet_bootstrap.cc:654] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.552847 15128 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.556143 15427 tablet_bootstrap.cc:492] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.557050 15427 ts_tablet_manager.cc:1403] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.002s
I20260709 13:07:40.560766 15427 raft_consensus.cc:359] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.561596 15427 raft_consensus.cc:385] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.562424 15427 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.563438 15427 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.566013 15427 ts_tablet_manager.cc:1434] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:40.571089 15427 tablet_bootstrap.cc:492] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.556074 15128 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.586158 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.587208 15381 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.591993 15430 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.593935 15426 tablet_bootstrap.cc:492] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.594550 15426 ts_tablet_manager.cc:1403] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.003s
I20260709 13:07:40.599169 15473 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.600817 15426 raft_consensus.cc:359] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.601682 15426 raft_consensus.cc:385] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.601982 15426 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.603351 15425 tablet_bootstrap.cc:492] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:40.603214 15426 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.603941 15425 ts_tablet_manager.cc:1403] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.063s	user 0.048s	sys 0.008s
I20260709 13:07:40.605856 15426 ts_tablet_manager.cc:1434] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:07:40.607048 15426 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.607122 15425 raft_consensus.cc:359] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.614010 15425 raft_consensus.cc:385] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.614516 15425 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.615790 15426 tablet_bootstrap.cc:654] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.616225 15425 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.619302 15427 tablet_bootstrap.cc:654] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.620537 15425 ts_tablet_manager.cc:1434] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 13:07:40.621578 15425 tablet_bootstrap.cc:492] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.620807 15131 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.626893 15381 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:40.633922 15425 tablet_bootstrap.cc:654] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.635882 15427 tablet_bootstrap.cc:492] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.636523 15427 ts_tablet_manager.cc:1403] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.004s
I20260709 13:07:40.639621 15427 raft_consensus.cc:359] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.640456 15427 raft_consensus.cc:385] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.640744 15427 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.641645 15427 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.644912 15427 ts_tablet_manager.cc:1434] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:40.646001 15427 tablet_bootstrap.cc:492] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.652048 15513 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.653084 15427 tablet_bootstrap.cc:654] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.653018 15513 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.660830 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.661656 15513 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:07:40.665199 15348 leader_election.cc:343] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.666036 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:40.666385 15513 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:40.667858 15345 leader_election.cc:343] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.668107 15425 tablet_bootstrap.cc:492] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:40.668443 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:40.668761 15425 ts_tablet_manager.cc:1403] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.010s
I20260709 13:07:40.669801 15513 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:40.671919 15425 raft_consensus.cc:359] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.672803 15425 raft_consensus.cc:385] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.673264 15425 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.674391 15425 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.677260 15426 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.677845 15426 ts_tablet_manager.cc:1403] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.071s	user 0.021s	sys 0.020s
I20260709 13:07:40.678392 15425 ts_tablet_manager.cc:1434] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:07:40.680086 15427 tablet_bootstrap.cc:492] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.680450 15425 tablet_bootstrap.cc:492] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.687369 15427 ts_tablet_manager.cc:1403] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.004s
I20260709 13:07:40.690115 15426 raft_consensus.cc:359] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.691756 15425 tablet_bootstrap.cc:654] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.691025 15426 raft_consensus.cc:385] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.691967 15427 raft_consensus.cc:359] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.692731 15426 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.693105 15427 raft_consensus.cc:385] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.693506 15427 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.693948 15426 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.694317 15427 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.697593 15426 ts_tablet_manager.cc:1434] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 13:07:40.699416 15427 ts_tablet_manager.cc:1434] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:07:40.700870 15427 tablet_bootstrap.cc:492] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.701267 15440 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.702237 15426 tablet_bootstrap.cc:492] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.708178 15427 tablet_bootstrap.cc:654] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.714746 15426 tablet_bootstrap.cc:654] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.730960 15430 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.733099 15430 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.735855 15430 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.737241 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.738044 15232 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.738607 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.739310 15381 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.739893 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.741321 15430 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.741809 15430 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.742383 15430 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.746573 15427 tablet_bootstrap.cc:492] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.747308 15427 ts_tablet_manager.cc:1403] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.007s
I20260709 13:07:40.748469 15425 tablet_bootstrap.cc:492] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:40.748986 15425 ts_tablet_manager.cc:1403] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.010s
I20260709 13:07:40.750398 15427 raft_consensus.cc:359] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.751184 15427 raft_consensus.cc:385] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.751470 15427 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.751905 15425 raft_consensus.cc:359] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.752714 15425 raft_consensus.cc:385] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.752254 15427 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.753037 15425 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.753830 15425 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.754705 15509 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.755456 15509 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.758853 15425 ts_tablet_manager.cc:1434] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:40.760169 15427 ts_tablet_manager.cc:1434] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:07:40.760689 15425 tablet_bootstrap.cc:492] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.761265 15427 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.763509 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.765195 15509 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:07:40.765878 15273 leader_election.cc:343] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.767660 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:07:40.769543 15274 leader_election.cc:343] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:40.770260 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:40.772622 15509 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:40.789400 15430 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.792430 15425 tablet_bootstrap.cc:654] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.792986 15509 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.793555 15509 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.794080 15426 tablet_bootstrap.cc:492] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:40.794662 15426 ts_tablet_manager.cc:1403] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.093s	user 0.035s	sys 0.029s
I20260709 13:07:40.796150 15427 tablet_bootstrap.cc:654] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.796010 15509 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.796756 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.797552 15381 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.798484 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.798251 15426 raft_consensus.cc:359] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.799042 15426 raft_consensus.cc:385] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.799095 15232 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.799458 15426 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.800237 15426 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.800328 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.801901 15380 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.804601 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:40.805233 15380 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.805780 15509 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.806180 15509 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.806540 15509 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.810117 15426 ts_tablet_manager.cc:1434] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:07:40.811391 15426 tablet_bootstrap.cc:492] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:40.808568 15430 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.823069 15232 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.824457 15381 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.826164 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:40.827492 15510 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.828215 15510 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:40.829211 15510 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.832679 15430 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.833688 15448 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:40.828168 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.836323 15232 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.842206 15425 tablet_bootstrap.cc:492] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:40.842849 15425 ts_tablet_manager.cc:1403] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.020s
I20260709 13:07:40.833637 15509 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.849807 15427 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:40.850402 15427 ts_tablet_manager.cc:1403] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.005s
I20260709 13:07:40.850600 15425 raft_consensus.cc:359] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.851593 15425 raft_consensus.cc:385] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.851864 15425 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.852643 15425 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.855576 15425 ts_tablet_manager.cc:1434] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:40.856830 15425 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:40.857762 15427 raft_consensus.cc:359] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.858536 15427 raft_consensus.cc:385] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.858814 15427 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.859581 15427 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.862874 15509 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.866237 15427 ts_tablet_manager.cc:1434] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:07:40.866561 15510 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.866811 15509 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:40.867139 15510 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.864866 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.867638 15427 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:40.865078 15129 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.869861 15381 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.881790 15426 tablet_bootstrap.cc:654] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.884610 15510 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.887125 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.888123 15231 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.903867 15510 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.904680 15381 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.909605 15425 tablet_bootstrap.cc:654] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.911640 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:40.912132 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:40.913079 15380 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.913179 15230 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:40.915830 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:40.920811 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:40.922034 15510 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.926992 15438 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.919281 15473 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:40.935065 15510 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:40.938323 15430 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.939054 15430 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.934978 15438 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.939616 15430 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.939682 15231 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:40.941464 15438 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.944780 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:40.945590 15308 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:40.949199 15510 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.952943 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:40.954437 15473 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:40.955632 15473 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.956179 15473 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.964253 15430 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.967190 15430 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:40.988662 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:40.989535 15231 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.994503 15473 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:40.969579 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:40.996755 15381 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.007376 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:41.029706 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:41.030685 15306 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.032825 15473 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.035001 15509 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.008517 15231 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:41.037781 15509 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.048794 15509 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.049803 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:41.051553 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:41.061767 15382 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:41.052603 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:41.065713 15509 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.053102 15473 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:41.066468 15509 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:41.055135 15544 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:41.067703 15510 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.056983 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:41.067801 15509 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.063731 15273 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:41.070786 15430 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.071233 15430 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.071621 15430 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.077667 15306 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:41.063678 15427 tablet_bootstrap.cc:654] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.086128 15131 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.091159 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:41.092252 15544 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:41.094848 15198 leader_election.cc:343] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.103436 15544 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:07:41.102946 15274 leader_election.cc:343] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.110670 15473 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.117298 15473 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.120116 15473 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.116063 15425 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
W20260709 13:07:41.129865 15198 leader_election.cc:343] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.132138 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:41.135231 15425 ts_tablet_manager.cc:1403] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.279s	user 0.018s	sys 0.007s
I20260709 13:07:41.133457 15544 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.144732 15426 tablet_bootstrap.cc:492] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:41.145884 15426 ts_tablet_manager.cc:1403] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.335s	user 0.047s	sys 0.034s
I20260709 13:07:41.164110 15425 raft_consensus.cc:359] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.168226 15425 raft_consensus.cc:385] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:41.147461 15196 leader_election.cc:343] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.168651 15425 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.171703 15425 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.165750 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:41.183204 15426 raft_consensus.cc:359] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.184514 15426 raft_consensus.cc:385] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.184944 15426 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.188318 15426 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.191548 15425 ts_tablet_manager.cc:1434] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 13:07:41.194273 15425 tablet_bootstrap.cc:492] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:41.176754 15381 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:41.200876 15426 ts_tablet_manager.cc:1434] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.055s	user 0.012s	sys 0.000s
I20260709 13:07:41.201325 15473 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:41.233426 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51785.2us
I20260709 13:07:41.241575 15438 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.242645 15438 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.247247 15430 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.268863 15512 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.269829 15512 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.276520 15430 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.288612 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:41.289537 15232 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:41.290637 15426 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:41.290447 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:07:41.280900 15273 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.292306 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46778.2us
W20260709 13:07:41.295351 15274 leader_election.cc:343] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.294256 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:41.300819 15440 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:41.301270 15440 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.301618 15440 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.293829 15559 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.309494 15512 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:41.309736 15559 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.314179 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:41.315022 15306 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:41.316767 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:41.316874 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:41.317934 15379 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.318066 15473 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.318678 15473 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.319118 15473 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.320623 15559 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.321245 15438 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.322185 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:41.323909 15196 leader_election.cc:343] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.343389 15425 tablet_bootstrap.cc:654] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.326177 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:41.351590 15131 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.360462 15427 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:41.361274 15427 ts_tablet_manager.cc:1403] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.494s	user 0.033s	sys 0.050s
W20260709 13:07:41.344731 15198 leader_election.cc:343] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.369621 15427 raft_consensus.cc:359] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.370761 15427 raft_consensus.cc:385] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.371192 15427 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.372164 15427 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.375618 15306 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:41.377811 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:41.377648 15427 ts_tablet_manager.cc:1434] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 13:07:41.382320 15561 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.383424 15427 tablet_bootstrap.cc:492] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
W20260709 13:07:41.385236 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46415.2us
I20260709 13:07:41.388797 15554 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:41.391186 15128 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.383852 15440 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.397881 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:41.397997 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:41.403450 15440 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:41.404155 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:41.405015 15308 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.408077 15379 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:41.408818 15425 tablet_bootstrap.cc:492] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:41.409696 15273 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:41.409394 15425 ts_tablet_manager.cc:1403] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.216s	user 0.030s	sys 0.016s
I20260709 13:07:41.415745 15430 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.410140 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:41.413298 15473 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.422014 15430 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:41.422752 15233 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.429244 15430 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:41.420053 15198 leader_election.cc:343] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.425966 15426 tablet_bootstrap.cc:654] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.427074 15427 tablet_bootstrap.cc:654] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.430537 15308 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:07:41.432615 15552 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.438694 15554 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.460263 15425 raft_consensus.cc:359] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.461624 15425 raft_consensus.cc:385] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.462000 15425 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.462903 15425 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.464939 15425 ts_tablet_manager.cc:1434] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.005s
I20260709 13:07:41.466013 15425 tablet_bootstrap.cc:492] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:41.473956 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:41.483879 15563 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:41.476987 15198 leader_election.cc:343] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.487102 15440 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.489064 15440 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.486518 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:41.487968 15563 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:41.494825 15563 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.497463 15544 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.498371 15440 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:41.498808 15233 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:07:41.498826 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:41.491864 15473 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.501770 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:41.504243 15308 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:41.504303 15348 leader_election.cc:343] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.508312 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:41.509414 15426 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:41.510254 15426 ts_tablet_manager.cc:1403] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.220s	user 0.017s	sys 0.006s
I20260709 13:07:41.514197 15426 raft_consensus.cc:359] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.515089 15426 raft_consensus.cc:385] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.515691 15426 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.516623 15426 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.513384 15131 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.517936 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:41.518746 15306 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:41.519616 15426 ts_tablet_manager.cc:1434] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:41.520175 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:41.520937 15426 tablet_bootstrap.cc:492] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:41.521539 15440 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.521950 15440 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.522315 15440 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:41.518676 15198 leader_election.cc:343] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.539242 15554 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.547042 15440 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.552902 15512 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.553599 15512 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.557438 15308 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:41.556237 15512 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:41.557757 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:41.567020 15232 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:41.572911 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:41.576578 15544 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.577837 15544 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:41.579152 15544 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.581485 15425 tablet_bootstrap.cc:654] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:41.590802 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:41.636130 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:07:41.642868 15348 leader_election.cc:343] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.643172 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:41.646529 15308 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:41.649567 15427 tablet_bootstrap.cc:492] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:41.651594 15131 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 2, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 2 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.653471 15427 ts_tablet_manager.cc:1403] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.271s	user 0.021s	sys 0.009s
I20260709 13:07:41.657967 15426 tablet_bootstrap.cc:654] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.664626 15345 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:41.665767 15512 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.670215 15440 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:41.675661 15427 raft_consensus.cc:359] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.676749 15427 raft_consensus.cc:385] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.677136 15427 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.678119 15427 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.678905 15509 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:41.686050 15427 ts_tablet_manager.cc:1434] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 13:07:41.689635 15427 tablet_bootstrap.cc:492] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:41.697614 15128 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.702476 15473 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.705253 15509 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.714360 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:41.715179 15306 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.719491 15512 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.738911 15425 tablet_bootstrap.cc:492] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:41.739523 15425 ts_tablet_manager.cc:1403] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.274s	user 0.046s	sys 0.029s
I20260709 13:07:41.744606 15426 tablet_bootstrap.cc:492] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:41.745652 15426 ts_tablet_manager.cc:1403] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.225s	user 0.019s	sys 0.014s
I20260709 13:07:41.750362 15426 raft_consensus.cc:359] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.751530 15426 raft_consensus.cc:385] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.751925 15426 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.744695 15427 tablet_bootstrap.cc:654] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.752445 15473 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.753106 15473 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.754308 15426 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.757906 15473 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:41.758641 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:41.760722 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:41.761610 15380 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:41.766458 15198 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:41.766763 15306 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:41.773649 15473 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.774606 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:41.776046 15440 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.776633 15440 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:41.777557 15440 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.780534 15425 raft_consensus.cc:359] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.782389 15425 raft_consensus.cc:385] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.782820 15425 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.790796 15425 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.798039 15425 ts_tablet_manager.cc:1434] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.002s
I20260709 13:07:41.799574 15425 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:41.799238 15473 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.800876 15426 ts_tablet_manager.cc:1434] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:07:41.802717 15426 tablet_bootstrap.cc:492] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
W20260709 13:07:41.848299 15198 consensus_peers.cc:597] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.849751 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54401.9us
I20260709 13:07:41.858232 15440 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.878505 15554 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:41.859988 15440 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.895023 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:41.906112 15426 tablet_bootstrap.cc:654] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.910512 15128 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.913702 15440 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:41.915884 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:41.919238 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:41.925277 15427 tablet_bootstrap.cc:492] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:41.928277 15427 ts_tablet_manager.cc:1403] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.239s	user 0.006s	sys 0.028s
I20260709 13:07:41.930272 15440 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.936774 15427 raft_consensus.cc:359] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.937835 15554 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.940907 15425 tablet_bootstrap.cc:654] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.937865 15427 raft_consensus.cc:385] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.944798 15427 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.945832 15427 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:41.950767 15427 ts_tablet_manager.cc:1434] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:07:41.969203 15427 tablet_bootstrap.cc:492] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:41.999727 15544 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.003739 15427 tablet_bootstrap.cc:654] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.008193 15426 tablet_bootstrap.cc:492] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.009269 15426 ts_tablet_manager.cc:1403] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.024s
I20260709 13:07:42.014554 15426 raft_consensus.cc:359] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.015127 15549 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.015919 15549 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.017715 15425 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:42.018595 15425 ts_tablet_manager.cc:1403] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.028s
I20260709 13:07:42.021800 15425 raft_consensus.cc:359] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.021862 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:42.022593 15425 raft_consensus.cc:385] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.022970 15425 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.023118 15230 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:42.023871 15425 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.025514 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:42.027237 15430 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.027786 15430 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.028264 15430 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.028836 15425 ts_tablet_manager.cc:1434] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:07:42.030020 15544 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.030766 15544 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.036194 15549 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.036852 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:42.044970 15426 raft_consensus.cc:385] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.045614 15426 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.037827 15544 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.038482 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.047289 15308 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 1: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:42.039541 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:42.040146 15425 tablet_bootstrap.cc:492] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:42.047086 15426 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.050375 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:07:42.050376 15273 leader_election.cc:343] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.052551 15544 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.053045 15426 ts_tablet_manager.cc:1434] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.006s
I20260709 13:07:42.065872 15426 tablet_bootstrap.cc:492] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.068257 15427 tablet_bootstrap.cc:492] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.055146 15430 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.073524 15427 ts_tablet_manager.cc:1403] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.017s
I20260709 13:07:42.075644 15430 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.070508 15544 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.076669 15559 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.074479 15425 tablet_bootstrap.cc:654] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.077244 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:42.077977 15230 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.081784 15426 tablet_bootstrap.cc:654] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.082437 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:42.081939 15427 raft_consensus.cc:359] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:42.084124 15273 leader_election.cc:343] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.084575 15427 raft_consensus.cc:385] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.084934 15427 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.085857 15427 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.089828 15427 ts_tablet_manager.cc:1434] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:07:42.094610 15427 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:42.099314 15306 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:42.101548 15440 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.111550 15230 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:42.116019 15425 tablet_bootstrap.cc:492] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:42.116729 15425 ts_tablet_manager.cc:1403] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.006s
I20260709 13:07:42.120071 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:42.120237 15425 raft_consensus.cc:359] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.121030 15425 raft_consensus.cc:385] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.121181 15430 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.121363 15425 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.121861 15430 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:42.123353 15430 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.127051 15378 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.127795 15559 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.128396 15559 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.131006 15559 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.133005 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:42.135679 15198 leader_election.cc:343] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.142122 15426 tablet_bootstrap.cc:492] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.142680 15426 ts_tablet_manager.cc:1403] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.077s	user 0.026s	sys 0.002s
I20260709 13:07:42.145917 15427 tablet_bootstrap.cc:654] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.133072 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.146543 15426 raft_consensus.cc:359] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.147432 15426 raft_consensus.cc:385] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.147773 15426 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.148939 15426 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:42.149961 15196 leader_election.cc:343] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.150489 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:42.151257 15559 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.151536 15426 ts_tablet_manager.cc:1434] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:07:42.156996 15426 tablet_bootstrap.cc:492] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.157198 15230 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:42.168897 15512 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.173629 15426 tablet_bootstrap.cc:654] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.122808 15425 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.184558 15427 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.188230 15427 ts_tablet_manager.cc:1403] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.007s
I20260709 13:07:42.189992 15425 ts_tablet_manager.cc:1434] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 13:07:42.192278 15427 raft_consensus.cc:359] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.193650 15427 raft_consensus.cc:385] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.194001 15427 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.195508 15427 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.197263 15425 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:42.198318 15427 ts_tablet_manager.cc:1434] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:07:42.199566 15427 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:42.205678 15430 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.206440 15430 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.207904 15128 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.211724 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:42.215231 15273 leader_election.cc:343] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.219265 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:07:42.226145 15274 leader_election.cc:343] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.226755 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:42.227720 15549 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.228579 15440 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.229843 15426 tablet_bootstrap.cc:492] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.230342 15426 ts_tablet_manager.cc:1403] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.022s
I20260709 13:07:42.232474 15430 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.233472 15426 raft_consensus.cc:359] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.234337 15426 raft_consensus.cc:385] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.234664 15426 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.235483 15426 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.237233 15425 tablet_bootstrap.cc:654] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.241755 15426 ts_tablet_manager.cc:1434] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 13:07:42.244624 15427 tablet_bootstrap.cc:654] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.252125 15426 tablet_bootstrap.cc:492] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.257594 15549 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.258395 15549 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.261018 15549 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.263288 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:42.265086 15273 leader_election.cc:343] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.269438 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:42.270294 15232 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:42.271633 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:42.272540 15430 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.272943 15430 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.273288 15430 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.261061 15426 tablet_bootstrap.cc:654] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.289786 15430 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.293633 15425 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:42.294275 15425 ts_tablet_manager.cc:1403] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.007s
I20260709 13:07:42.295354 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:42.296428 15232 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.300575 15427 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.301162 15427 ts_tablet_manager.cc:1403] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.011s
I20260709 13:07:42.298195 15425 raft_consensus.cc:359] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.302932 15430 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.303170 15425 raft_consensus.cc:385] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.303529 15425 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.304369 15425 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.304750 15559 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.305375 15559 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.306927 15425 ts_tablet_manager.cc:1434] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 13:07:42.308100 15425 tablet_bootstrap.cc:492] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:42.309736 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.310510 15306 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:42.315958 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:42.316818 15378 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:42.308102 15559 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.323577 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:42.326459 15430 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.327039 15430 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.329479 15426 tablet_bootstrap.cc:492] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.330263 15426 ts_tablet_manager.cc:1403] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.003s
I20260709 13:07:42.331176 15430 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.332059 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:42.332401 15559 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.332803 15559 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.334167 15559 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.337680 15427 raft_consensus.cc:359] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:42.339696 15273 leader_election.cc:343] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.342538 15427 raft_consensus.cc:385] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.342904 15427 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.333632 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:42.343627 15427 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:42.344729 15273 leader_election.cc:343] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.345194 15512 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.346134 15427 ts_tablet_manager.cc:1434] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:07:42.348322 15427 tablet_bootstrap.cc:492] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:42.350064 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:07:42.355418 15274 leader_election.cc:343] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.363077 15602 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.367648 15602 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.368690 15426 raft_consensus.cc:359] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.369511 15426 raft_consensus.cc:385] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.369838 15426 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.355970 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:42.370664 15426 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.380996 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:42.370414 15602 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:42.382321 15509 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.383586 15232 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:42.386199 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.389393 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:42.392994 15426 ts_tablet_manager.cc:1434] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.062s	user 0.013s	sys 0.005s
I20260709 13:07:42.392413 15559 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.393533 15427 tablet_bootstrap.cc:654] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.395274 15426 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.398458 15603 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.405563 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:42.406301 15308 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.413480 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:42.413262 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:42.414289 15378 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.417281 15557 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.418277 15557 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:42.422745 15378 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:42.422950 15425 tablet_bootstrap.cc:654] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.424978 15379 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.419845 15557 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.431245 15308 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:42.432935 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:42.403697 15559 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.434306 15438 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.435339 15438 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:42.436558 15438 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.441387 15426 tablet_bootstrap.cc:654] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.445736 15427 tablet_bootstrap.cc:492] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.446401 15427 ts_tablet_manager.cc:1403] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.099s	user 0.037s	sys 0.009s
I20260709 13:07:42.454160 15427 raft_consensus.cc:359] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.455013 15427 raft_consensus.cc:385] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.455336 15427 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.456099 15427 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.465858 15427 ts_tablet_manager.cc:1434] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:07:42.467707 15427 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:42.498529 15130 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.501204 15131 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.506129 15425 tablet_bootstrap.cc:492] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:42.506687 15425 ts_tablet_manager.cc:1403] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.199s	user 0.012s	sys 0.020s
I20260709 13:07:42.508946 15427 tablet_bootstrap.cc:654] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.510754 15425 raft_consensus.cc:359] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.511595 15425 raft_consensus.cc:385] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.511945 15425 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.513249 15425 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.515775 15425 ts_tablet_manager.cc:1434] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:07:42.517225 15425 tablet_bootstrap.cc:492] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:42.520000 15426 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.521010 15426 ts_tablet_manager.cc:1403] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.003s
I20260709 13:07:42.524870 15426 raft_consensus.cc:359] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.525732 15426 raft_consensus.cc:385] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.526015 15426 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.526795 15426 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.529394 15426 ts_tablet_manager.cc:1434] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:42.531198 15426 tablet_bootstrap.cc:492] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.539474 15426 tablet_bootstrap.cc:654] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.551482 15426 tablet_bootstrap.cc:492] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.552022 15426 ts_tablet_manager.cc:1403] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.009s
I20260709 13:07:42.555709 15426 raft_consensus.cc:359] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.556551 15426 raft_consensus.cc:385] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.556839 15426 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.557667 15426 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.560881 15426 ts_tablet_manager.cc:1434] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:07:42.562323 15426 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.563787 15425 tablet_bootstrap.cc:654] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.572259 15427 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.572268 15426 tablet_bootstrap.cc:654] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.573050 15427 ts_tablet_manager.cc:1403] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.106s	user 0.039s	sys 0.023s
I20260709 13:07:42.576231 15427 raft_consensus.cc:359] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.577234 15427 raft_consensus.cc:385] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.577570 15427 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.579206 15427 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.580639 15438 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.581602 15427 ts_tablet_manager.cc:1434] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:07:42.581326 15438 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.590656 15427 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:42.593061 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.593981 15308 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:42.594172 15559 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.594784 15559 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.597024 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:42.598028 15559 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.598701 15559 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.599115 15559 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.599301 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.599572 15559 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.605486 15602 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.606135 15602 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.606788 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:42.608530 15196 leader_election.cc:343] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.608656 15602 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:42.609047 15382 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.610539 15438 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.610919 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:07:42.611303 15198 leader_election.cc:343] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.611795 15232 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:42.612780 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:42.613809 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:42.614503 15544 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.614897 15602 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.615319 15602 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.615715 15602 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.618129 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:42.620056 15345 leader_election.cc:343] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.621644 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:42.623900 15198 leader_election.cc:343] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.626338 15425 tablet_bootstrap.cc:492] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:42.626945 15425 ts_tablet_manager.cc:1403] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.014s
I20260709 13:07:42.630235 15425 raft_consensus.cc:359] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.631035 15425 raft_consensus.cc:385] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.631325 15425 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.632829 15557 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:42.639204 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:42.642508 15602 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.644647 15426 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.645856 15426 ts_tablet_manager.cc:1403] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.009s
I20260709 13:07:42.645802 15559 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.644802 15427 tablet_bootstrap.cc:654] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.648931 15425 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.649449 15426 raft_consensus.cc:359] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.652382 15426 raft_consensus.cc:385] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.650754 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:42.652719 15426 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.653265 15308 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.654223 15425 ts_tablet_manager.cc:1434] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:07:42.655810 15425 tablet_bootstrap.cc:492] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:42.659708 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:42.657191 15602 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:42.660493 15306 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.653743 15426 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.661129 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:42.665952 15232 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.668383 15426 ts_tablet_manager.cc:1434] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:07:42.669664 15426 tablet_bootstrap.cc:492] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.664988 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:42.662107 15559 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:07:42.676270 15198 leader_election.cc:343] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.680743 15426 tablet_bootstrap.cc:654] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.681963 15308 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:42.687382 15602 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.688020 15602 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.691403 15602 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:42.692198 15425 tablet_bootstrap.cc:654] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.692250 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:42.699155 15430 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.699929 15427 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.700387 15427 ts_tablet_manager.cc:1403] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.004s
I20260709 13:07:42.703616 15544 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.704447 15544 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:42.705626 15232 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:42.694149 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:42.707644 15233 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:42.694905 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.708745 15308 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:42.705370 15544 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.712822 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:42.713124 15427 raft_consensus.cc:359] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.714152 15427 raft_consensus.cc:385] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.714955 15427 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.714033 15440 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.715494 15440 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.715924 15440 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.716975 15427 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.717689 15426 tablet_bootstrap.cc:492] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.718211 15426 ts_tablet_manager.cc:1403] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.021s
I20260709 13:07:42.718851 15427 ts_tablet_manager.cc:1434] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:07:42.719484 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:42.720542 15427 tablet_bootstrap.cc:492] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:42.693076 15306 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:42.723927 15426 raft_consensus.cc:359] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.724716 15426 raft_consensus.cc:385] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.724977 15426 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.725709 15426 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.731470 15603 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.732187 15603 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:42.733390 15603 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.742151 15427 tablet_bootstrap.cc:654] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.745831 15426 ts_tablet_manager.cc:1434] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:07:42.747531 15426 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.781930 15559 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.782567 15440 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.783135 15559 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.799003 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:42.799784 15233 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.808820 15559 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.809398 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.810252 15306 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:42.811353 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:42.812100 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:07:42.813364 15198 leader_election.cc:343] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.815231 15559 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.815848 15559 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.816443 15559 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.818092 15602 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.819041 15602 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.825316 15602 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:42.825443 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:42.826293 15306 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.829403 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:42.830401 15232 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:42.831221 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.833720 15348 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:42.828130 15440 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:42.835971 15512 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.845580 15425 tablet_bootstrap.cc:492] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:42.846765 15233 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:42.848661 15426 tablet_bootstrap.cc:654] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.846194 15425 ts_tablet_manager.cc:1403] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.191s	user 0.031s	sys 0.025s
I20260709 13:07:42.848922 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:42.850113 15427 tablet_bootstrap.cc:492] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.850234 15603 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.850718 15427 ts_tablet_manager.cc:1403] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.131s	user 0.019s	sys 0.059s
I20260709 13:07:42.851301 15603 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:42.852296 15603 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.854732 15131 catalog_manager.cc:5697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.856317 15559 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.858433 15512 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.861775 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:42.862839 15427 raft_consensus.cc:359] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.863701 15427 raft_consensus.cc:385] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.863554 15306 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
W20260709 13:07:42.864091 15198 leader_election.cc:343] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.858867 15559 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:42.859829 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:42.866124 15308 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.864073 15427 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.867120 15427 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.869319 15427 ts_tablet_manager.cc:1434] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:07:42.870373 15427 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:42.872788 15128 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.877094 15544 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.877640 15544 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.879362 15426 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.879441 15427 tablet_bootstrap.cc:654] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.880127 15426 ts_tablet_manager.cc:1403] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.012s
I20260709 13:07:42.881989 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:42.883469 15544 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:07:42.884670 15198 leader_election.cc:343] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.889470 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:42.889936 15308 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:42.890753 15425 raft_consensus.cc:359] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.891496 15425 raft_consensus.cc:385] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.891892 15425 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
W20260709 13:07:42.891850 15196 leader_election.cc:343] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.892812 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:42.893093 15425 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.894004 15544 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.894871 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:42.901430 15544 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.902127 15544 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:42.901897 15128 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.903110 15544 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.905108 15426 raft_consensus.cc:359] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.905913 15426 raft_consensus.cc:385] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.906188 15426 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.908742 15426 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.911239 15426 ts_tablet_manager.cc:1434] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 13:07:42.912448 15426 tablet_bootstrap.cc:492] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:42.921891 15425 ts_tablet_manager.cc:1434] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.002s
I20260709 13:07:42.921934 15557 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.935751 15557 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.944758 15425 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:42.963372 15426 tablet_bootstrap.cc:654] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.968600 15427 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:42.969324 15427 ts_tablet_manager.cc:1403] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.099s	user 0.042s	sys 0.036s
I20260709 13:07:42.975844 15426 tablet_bootstrap.cc:492] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:42.976511 15426 ts_tablet_manager.cc:1403] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.005s
I20260709 13:07:42.979877 15426 raft_consensus.cc:359] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:42.981127 15426 raft_consensus.cc:385] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.981436 15426 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.991822 15426 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:42.997267 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59117.4us
I20260709 13:07:43.002579 15559 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.003489 15559 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.006224 15559 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.007730 15427 raft_consensus.cc:359] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.008630 15427 raft_consensus.cc:385] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.988037 15131 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.008949 15427 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.012650 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.013928 15425 tablet_bootstrap.cc:654] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:43.014866 15196 leader_election.cc:343] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.015552 15426 ts_tablet_manager.cc:1434] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.039s	user 0.001s	sys 0.008s
I20260709 13:07:43.016624 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.017091 15427 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.018383 15603 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.018967 15603 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.019570 15427 ts_tablet_manager.cc:1434] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:07:43.025565 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:43.026754 15198 leader_election.cc:343] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.027297 15198 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:07:43.028378 15345 leader_election.cc:343] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.028446 15629 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.028914 15427 tablet_bootstrap.cc:492] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:43.030088 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.030821 15230 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:43.024039 15603 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.036137 15512 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.036816 15512 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.039336 15426 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:43.039256 15512 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.040795 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.041739 15233 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:43.043306 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:43.040829 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.046659 15427 tablet_bootstrap.cc:654] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.046959 15438 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.048148 15603 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:43.048627 15603 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.048993 15603 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.049762 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:43.051131 15602 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:43.051566 15602 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.051925 15602 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.053591 15426 tablet_bootstrap.cc:654] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:43.056783 15345 leader_election.cc:343] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.064760 15427 tablet_bootstrap.cc:492] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:43.064939 15425 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:43.065364 15427 ts_tablet_manager.cc:1403] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.007s
I20260709 13:07:43.065531 15425 ts_tablet_manager.cc:1403] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.006s
I20260709 13:07:43.070298 15629 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.070111 15427 raft_consensus.cc:359] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.071234 15427 raft_consensus.cc:385] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.071664 15427 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.072661 15427 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.075894 15427 ts_tablet_manager.cc:1434] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:43.077837 15427 tablet_bootstrap.cc:492] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:43.090130 15602 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.085317 15425 raft_consensus.cc:359] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.098165 15425 raft_consensus.cc:385] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.098593 15425 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.101322 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:43.102092 15233 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.102484 15603 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.128106 15426 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:43.128949 15426 ts_tablet_manager.cc:1403] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.005s
I20260709 13:07:43.133376 15427 tablet_bootstrap.cc:654] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.140926 15440 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.141610 15440 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.150368 15426 raft_consensus.cc:359] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.151240 15426 raft_consensus.cc:385] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.151582 15426 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.163856 15603 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.165987 15440 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.169047 15426 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.171306 15426 ts_tablet_manager.cc:1434] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.004s
I20260709 13:07:43.172571 15426 tablet_bootstrap.cc:492] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:43.173100 15381 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.176261 15544 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.176610 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:43.176836 15233 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:43.176934 15544 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.177452 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:43.178486 15345 leader_election.cc:343] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.178872 15602 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.180723 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.181552 15307 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:43.183553 15544 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.183848 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:43.185781 15198 leader_election.cc:343] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.185710 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.190241 15426 tablet_bootstrap.cc:654] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:43.192939 15196 leader_election.cc:343] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.189571 15425 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.193614 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:43.194523 15306 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.183153 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:43.194808 15544 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.199632 15427 tablet_bootstrap.cc:492] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:43.200186 15427 ts_tablet_manager.cc:1403] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.002s
I20260709 13:07:43.200455 15440 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:43.200911 15440 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.201287 15440 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.203540 15602 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.204074 15602 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.204929 15628 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.207974 15602 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.203315 15427 raft_consensus.cc:359] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.209208 15427 raft_consensus.cc:385] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.209403 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:43.209921 15427 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.210261 15233 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.210729 15427 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.213521 15427 ts_tablet_manager.cc:1434] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:43.219331 15544 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.222916 15427 tablet_bootstrap.cc:492] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:43.229401 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.230151 15427 tablet_bootstrap.cc:654] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.230254 15230 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:43.231580 15306 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:43.232858 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.233556 15307 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:43.236145 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.239868 15426 tablet_bootstrap.cc:492] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:43.240797 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:43.243300 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:43.245563 15425 ts_tablet_manager.cc:1434] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.180s	user 0.021s	sys 0.021s
I20260709 13:07:43.246827 15425 tablet_bootstrap.cc:492] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:43.232558 15440 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.249610 15637 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:43.255669 15637 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:43.251411 15603 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:43.257324 15440 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.257030 15637 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.258788 15602 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:43.259388 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:43.251892 15233 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:43.260259 15307 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.262140 15426 ts_tablet_manager.cc:1403] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.006s
I20260709 13:07:43.265475 15426 raft_consensus.cc:359] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.266284 15426 raft_consensus.cc:385] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.266623 15426 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.267637 15425 tablet_bootstrap.cc:654] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.267436 15426 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.274276 15602 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:07:43.274946 15602 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.275422 15307 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:43.279206 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:43.281771 15233 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.294929 15427 tablet_bootstrap.cc:492] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:43.295655 15427 ts_tablet_manager.cc:1403] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.007s
I20260709 13:07:43.296195 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:43.299575 15427 raft_consensus.cc:359] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.301587 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:43.302958 15603 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.306272 15512 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:43.306706 15603 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:43.306882 15512 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:43.308028 15512 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.310696 15648 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.312492 15603 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:43.315541 15438 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.316143 15438 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.316395 15603 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.318084 15602 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.320452 15438 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.321027 15427 raft_consensus.cc:385] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.320897 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.320394 15440 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:43.304747 15426 ts_tablet_manager.cc:1434] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:07:43.323911 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.324826 15426 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:43.326222 15648 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.321362 15427 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
W20260709 13:07:43.323079 15198 leader_election.cc:343] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.329694 15427 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:43.332446 15196 leader_election.cc:343] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.343410 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:43.332751 15648 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.332283 15427 ts_tablet_manager.cc:1434] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.036s	user 0.000s	sys 0.008s
I20260709 13:07:43.344801 15438 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.346221 15427 tablet_bootstrap.cc:492] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:43.350064 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.351243 15306 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:43.361539 15544 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.362430 15544 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.364629 15602 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.365247 15544 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.367843 15426 tablet_bootstrap.cc:654] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.369053 15425 tablet_bootstrap.cc:492] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:43.369426 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.370396 15425 ts_tablet_manager.cc:1403] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.124s	user 0.039s	sys 0.033s
I20260709 13:07:43.371258 15427 tablet_bootstrap.cc:654] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:43.371151 15198 leader_election.cc:343] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.374692 15425 raft_consensus.cc:359] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.375065 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.378113 15544 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.378854 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:43.382009 15196 leader_election.cc:343] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.382537 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:43.383424 15544 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.387779 15426 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:43.389056 15426 ts_tablet_manager.cc:1403] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.003s
I20260709 13:07:43.382745 15425 raft_consensus.cc:385] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.393419 15425 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.395345 15425 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.312776 15646 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.401165 15425 ts_tablet_manager.cc:1434] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.004s
I20260709 13:07:43.403311 15425 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
W20260709 13:07:43.404541 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 97490.6us
I20260709 13:07:43.407188 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.409554 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:43.410656 15603 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.418905 15233 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:43.423954 15509 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.422129 15425 tablet_bootstrap.cc:654] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.424557 15509 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.425107 15603 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.420640 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:43.428963 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.429688 15378 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:43.431890 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:43.433079 15549 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:43.433488 15549 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.433866 15549 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.440515 15509 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.441838 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.443193 15232 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:43.444954 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:43.475823 15603 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:43.449759 15427 tablet_bootstrap.cc:492] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:43.478660 15427 ts_tablet_manager.cc:1403] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.003s
I20260709 13:07:43.454995 15426 raft_consensus.cc:359] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.470306 15628 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.480966 15426 raft_consensus.cc:385] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.471663 15128 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.481694 15426 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.483764 15128 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.485879 15426 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.487680 15549 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.491314 15549 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.499045 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:43.500479 15232 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.503461 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:43.504509 15378 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.488463 15128 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.562793 15426 ts_tablet_manager.cc:1434] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.173s	user 0.009s	sys 0.014s
I20260709 13:07:43.564272 15426 tablet_bootstrap.cc:492] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:43.571110 15232 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:43.570186 15427 raft_consensus.cc:359] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.572969 15427 raft_consensus.cc:385] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.572883 15274 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:43.574127 15430 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:43.574394 15427 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.574644 15430 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:43.575608 15430 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.576310 15378 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:43.577731 15427 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.579969 15425 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:43.580578 15425 ts_tablet_manager.cc:1403] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.178s	user 0.036s	sys 0.052s
I20260709 13:07:43.583669 15425 raft_consensus.cc:359] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.585589 15425 raft_consensus.cc:385] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.585896 15427 ts_tablet_manager.cc:1434] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.003s
I20260709 13:07:43.585991 15425 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.587455 15427 tablet_bootstrap.cc:492] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:43.587278 15425 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.595762 15425 ts_tablet_manager.cc:1434] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:07:43.597590 15425 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:43.598773 15426 tablet_bootstrap.cc:654] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.599226 15427 tablet_bootstrap.cc:654] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.605435 15425 tablet_bootstrap.cc:654] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.626422 15426 tablet_bootstrap.cc:492] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:43.626542 15425 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:43.627117 15425 ts_tablet_manager.cc:1403] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.008s
I20260709 13:07:43.628823 15427 tablet_bootstrap.cc:492] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:43.629384 15427 ts_tablet_manager.cc:1403] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.020s
I20260709 13:07:43.630141 15425 raft_consensus.cc:359] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.630920 15425 raft_consensus.cc:385] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.631194 15425 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.632026 15425 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.632448 15427 raft_consensus.cc:359] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.633198 15427 raft_consensus.cc:385] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.633489 15427 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.634218 15427 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.634697 15425 ts_tablet_manager.cc:1434] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:43.630620 15426 ts_tablet_manager.cc:1403] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.067s	user 0.004s	sys 0.023s
I20260709 13:07:43.636507 15425 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:43.637054 15427 ts_tablet_manager.cc:1434] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:43.638871 15426 raft_consensus.cc:359] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.639761 15426 raft_consensus.cc:385] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.640151 15426 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.641252 15426 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.644752 15426 ts_tablet_manager.cc:1434] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:07:43.645049 15425 tablet_bootstrap.cc:654] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.646664 15426 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:43.654215 15426 tablet_bootstrap.cc:654] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.657562 15427 tablet_bootstrap.cc:492] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:43.663619 15425 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:43.664251 15425 ts_tablet_manager.cc:1403] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.000s
I20260709 13:07:43.667338 15425 raft_consensus.cc:359] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.668100 15425 raft_consensus.cc:385] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.668466 15425 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.669425 15425 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.671701 15427 tablet_bootstrap.cc:654] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.672266 15425 ts_tablet_manager.cc:1434] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:43.673655 15425 tablet_bootstrap.cc:492] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:43.673694 15131 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.681504 15425 tablet_bootstrap.cc:654] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.689184 15381 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:43.702363 15628 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:43.705809 15628 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.706388 15628 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:43.707281 15628 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.712064 15628 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.714146 15426 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:43.718305 15426 ts_tablet_manager.cc:1403] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.006s
I20260709 13:07:43.721822 15426 raft_consensus.cc:359] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.723193 15426 raft_consensus.cc:385] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.723553 15426 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.728775 15427 tablet_bootstrap.cc:492] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:43.729578 15427 ts_tablet_manager.cc:1403] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.016s
I20260709 13:07:43.724326 15426 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.736797 15426 ts_tablet_manager.cc:1434] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 13:07:43.738848 15440 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:43.745407 15427 raft_consensus.cc:359] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.746543 15427 raft_consensus.cc:385] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.746894 15427 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.748025 15645 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.748591 15645 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.763810 15426 tablet_bootstrap.cc:492] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:43.767228 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.768164 15232 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:43.772990 15427 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.780718 15427 ts_tablet_manager.cc:1434] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:07:43.782415 15427 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:43.798834 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:07:43.799042 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:43.800204 15440 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:43.800854 15440 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.801769 15440 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.802309 15426 tablet_bootstrap.cc:654] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.805524 15645 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.807964 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.804054 15544 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.810022 15544 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:43.813216 15345 leader_election.cc:343] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.814982 15645 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.815640 15645 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.818055 15544 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.818769 15645 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.819284 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.819723 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.820439 15549 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.821973 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.823830 15603 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.817960 15440 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.830478 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.836400 15628 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.838739 15198 leader_election.cc:343] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.837642 15549 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.841971 15306 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.842231 15425 tablet_bootstrap.cc:492] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:43.843133 15425 ts_tablet_manager.cc:1403] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.170s	user 0.026s	sys 0.036s
I20260709 13:07:43.843041 15549 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.839542 15305 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
W20260709 13:07:43.863157 15196 leader_election.cc:343] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.863878 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:43.846593 15628 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.867130 15440 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.870707 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.871201 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.873051 15509 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.873301 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:43.873800 15509 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.874384 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:43.874677 15645 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:43.878712 15645 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.879184 15645 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.887970 15426 tablet_bootstrap.cc:492] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:43.888659 15426 ts_tablet_manager.cc:1403] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.012s
I20260709 13:07:43.867475 15544 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.888639 15425 raft_consensus.cc:359] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.893839 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:43.881320 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:43.894919 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:43.896283 15427 tablet_bootstrap.cc:654] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:43.896677 15425 raft_consensus.cc:385] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.897543 15425 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
W20260709 13:07:43.899036 15196 leader_election.cc:343] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:43.899160 15348 leader_election.cc:343] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.899492 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:43.900534 15230 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:43.902267 15345 leader_election.cc:343] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.904934 15440 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:43.908198 15426 raft_consensus.cc:359] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.909524 15549 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.909233 15426 raft_consensus.cc:385] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:43.900480 15231 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:43.910447 15426 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.902449 15425 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.911705 15426 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:43.921315 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:43.927903 15549 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:43.929201 15549 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.910995 15628 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.929248 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.930236 15645 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:43.933964 15198 leader_election.cc:343] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:43.934640 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:43.909559 15509 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:43.945331 15425 ts_tablet_manager.cc:1434] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.001s
I20260709 13:07:43.946455 15426 ts_tablet_manager.cc:1434] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:07:43.930351 15549 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:43.949692 15646 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:43.949795 15628 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:43.938179 15648 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:07:43.944140 15637 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:07:43.942780 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:43.955164 15378 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:43.958721 15425 tablet_bootstrap.cc:492] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:43.960171 15426 tablet_bootstrap.cc:492] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:43.935128 15645 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:43.942770 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:43.977982 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:43.969002 15307 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.006568 15230 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:44.078608 15307 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
W20260709 13:07:44.080250 15348 leader_election.cc:343] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.084620 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:44.086935 15646 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:44.087532 15646 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:44.088804 15646 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.118793 15427 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:44.119566 15427 ts_tablet_manager.cc:1403] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.338s	user 0.021s	sys 0.032s
I20260709 13:07:44.125444 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:44.148224 15425 tablet_bootstrap.cc:654] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.133055 15645 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:44.176816 15675 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:44.184355 15427 raft_consensus.cc:359] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.185469 15427 raft_consensus.cc:385] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.185853 15427 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.198660 15427 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.193287 15645 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:44.208146 15427 ts_tablet_manager.cc:1434] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.088s	user 0.013s	sys 0.000s
I20260709 13:07:44.222576 15645 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.223935 15427 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:44.211211 15673 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.239251 15426 tablet_bootstrap.cc:654] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.247334 15427 tablet_bootstrap.cc:654] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.215983 15549 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.235072 15673 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.290277 15549 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:07:44.293074 15677 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.003s
I20260709 13:07:44.299787 15673 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.303078 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:44.303838 15379 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.309046 15549 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:44.309059 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:44.327442 15196 leader_election.cc:343] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.328658 15509 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.329313 15509 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.331684 15509 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.334985 15425 tablet_bootstrap.cc:492] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:44.335613 15425 ts_tablet_manager.cc:1403] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.386s	user 0.030s	sys 0.011s
I20260709 13:07:44.338539 15427 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:44.339773 15427 ts_tablet_manager.cc:1403] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.012s
I20260709 13:07:44.340945 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:44.352008 15425 raft_consensus.cc:359] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.356681 15425 raft_consensus.cc:385] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.357362 15425 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.358894 15425 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.358981 15130 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.361445 15425 ts_tablet_manager.cc:1434] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:07:44.363427 15425 tablet_bootstrap.cc:492] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:44.363119 15130 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:44.365082 15198 leader_election.cc:343] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.418473 15637 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.424114 15426 tablet_bootstrap.cc:492] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:44.426218 15426 ts_tablet_manager.cc:1403] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.468s	user 0.029s	sys 0.033s
W20260709 13:07:44.432147 15686 log.cc:927] Time spent T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:44.366423 15198 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:07:44.439802 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74760.1us
I20260709 13:07:44.441524 15544 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:44.421826 15379 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:44.448407 15427 raft_consensus.cc:359] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.449254 15427 raft_consensus.cc:385] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.449553 15427 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.443626 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:44.450600 15228 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.450474 15427 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.425249 15637 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.452291 15427 ts_tablet_manager.cc:1434] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 13:07:44.455330 15637 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:44.455833 15427 tablet_bootstrap.cc:492] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:44.456714 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:44.461325 15229 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:44.503635 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:44.505012 15232 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:44.504400 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:44.505829 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:44.510939 15426 raft_consensus.cc:359] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.511818 15426 raft_consensus.cc:385] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.512065 15688 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:44.512192 15426 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.516446 15688 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.516510 15426 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.519481 15378 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:44.522609 15425 tablet_bootstrap.cc:654] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.517042 15688 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.526110 15427 tablet_bootstrap.cc:654] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.527016 15426 ts_tablet_manager.cc:1434] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.002s
I20260709 13:07:44.558218 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:44.559798 15637 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:44.560424 15637 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.560895 15637 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.589792 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:44.588016 15307 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.593055 15426 tablet_bootstrap.cc:492] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:44.604773 15427 tablet_bootstrap.cc:492] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:44.605544 15427 ts_tablet_manager.cc:1403] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.150s	user 0.026s	sys 0.017s
I20260709 13:07:44.606407 15228 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:44.611478 15273 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:07:44.614547 15345 leader_election.cc:343] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.613202 15688 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.616478 15549 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:44.622478 15549 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:44.623466 15549 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.629737 15688 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.630693 15637 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.633539 15427 raft_consensus.cc:359] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.634408 15427 raft_consensus.cc:385] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.639135 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:44.640223 15378 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.640969 15426 tablet_bootstrap.cc:654] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.641044 15637 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:44.642696 15440 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:44.634723 15427 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.645253 15440 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:44.646037 15427 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.639451 15425 tablet_bootstrap.cc:492] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:44.648411 15425 ts_tablet_manager.cc:1403] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.285s	user 0.018s	sys 0.003s
I20260709 13:07:44.653982 15438 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.654707 15438 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.656303 15427 ts_tablet_manager.cc:1434] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.004s
I20260709 13:07:44.658114 15427 tablet_bootstrap.cc:492] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:44.658352 15438 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.660976 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:44.661188 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:44.662181 15228 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.662894 15426 tablet_bootstrap.cc:492] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:44.663457 15426 ts_tablet_manager.cc:1403] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.001s
I20260709 13:07:44.664422 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:44.665308 15307 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 1: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:44.666757 15196 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:44.668100 15559 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.666813 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:44.672665 15229 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.667111 15426 raft_consensus.cc:359] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.674206 15426 raft_consensus.cc:385] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.674705 15426 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.680891 15426 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.684408 15559 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:44.684790 15426 ts_tablet_manager.cc:1434] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.006s
I20260709 13:07:44.687331 15229 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:44.688422 15427 tablet_bootstrap.cc:654] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.690233 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:44.686480 15426 tablet_bootstrap.cc:492] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:44.692469 15425 raft_consensus.cc:359] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.693212 15430 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:44.693843 15430 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:44.694696 15430 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.693302 15425 raft_consensus.cc:385] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.696131 15425 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.696944 15425 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.700091 15425 ts_tablet_manager.cc:1434] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.003s
I20260709 13:07:44.701635 15425 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:44.703301 15426 tablet_bootstrap.cc:654] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.710382 15425 tablet_bootstrap.cc:654] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.735873 15427 tablet_bootstrap.cc:492] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:44.736693 15427 ts_tablet_manager.cc:1403] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.008s
I20260709 13:07:44.744050 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:44.746596 15427 raft_consensus.cc:359] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:44.747267 15345 leader_election.cc:343] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.747517 15427 raft_consensus.cc:385] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.747865 15427 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.753053 15427 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.763475 15427 ts_tablet_manager.cc:1434] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:07:44.769428 15426 tablet_bootstrap.cc:492] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:44.753773 15378 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:44.770051 15426 ts_tablet_manager.cc:1403] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.022s
I20260709 13:07:44.772087 15690 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.773149 15425 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:44.773717 15425 ts_tablet_manager.cc:1403] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.009s
I20260709 13:07:44.761307 15549 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:07:44.772773 15690 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.777151 15549 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.787596 15427 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:44.791937 15228 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:44.791785 15648 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:44.794569 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:44.794981 15549 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.795492 15229 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:07:44.796396 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:44.798162 15259 tablet.cc:2406] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:44.799764 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:44.800308 15690 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.800997 15690 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:44.800877 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:44.801393 15690 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:07:44.804739 15382 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:44.804912 15690 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:44.810527 15273 leader_election.cc:343] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.806042 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:44.813211 15229 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:44.814888 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:44.820490 15549 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:44.820999 15549 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.821350 15549 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.820158 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:44.823412 15440 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:44.824548 15440 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:44.825477 15440 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.796793 15426 raft_consensus.cc:359] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.830370 15426 raft_consensus.cc:385] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.831136 15426 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.831847 15426 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.858353 15425 raft_consensus.cc:359] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.859169 15425 raft_consensus.cc:385] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.859454 15425 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.864002 15425 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.868674 15427 tablet_bootstrap.cc:654] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.869724 15426 ts_tablet_manager.cc:1434] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.000s
I20260709 13:07:44.870129 15648 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:44.886118 15425 ts_tablet_manager.cc:1434] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.000s
I20260709 13:07:44.893388 15544 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.894073 15544 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.899953 15544 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.905221 15426 tablet_bootstrap.cc:492] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:44.912890 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:44.914891 15198 leader_election.cc:343] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.925746 15425 tablet_bootstrap.cc:492] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:44.933075 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:44.937913 15304 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:44.946357 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:44.947767 15544 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:44.948436 15544 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.951228 15690 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.953351 15544 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.961123 15131 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.956240 15549 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.963945 15131 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.966712 15549 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.967509 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:44.968232 15232 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.969271 15427 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:44.969691 15427 ts_tablet_manager.cc:1403] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.019s
I20260709 13:07:44.968528 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:07:44.971735 15273 leader_election.cc:343] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.973132 15425 tablet_bootstrap.cc:654] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.976594 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:44.977043 15628 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.977583 15628 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.979135 15426 tablet_bootstrap.cc:654] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.981006 15628 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.976300 15690 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.981964 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:44.982801 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:44.983922 15378 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:44.984433 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:44.985110 15128 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:44.983929 15196 leader_election.cc:343] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:44.987005 15198 leader_election.cc:343] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.987413 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:44.987543 15544 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.988674 15628 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:44.990248 15544 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:44.989106 15232 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:44.992421 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:44.992760 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:44.993594 15690 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:44.994504 15690 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:07:44.994566 15198 leader_election.cc:343] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:44.991179 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:44.995960 15304 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.995543 15690 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:44.991192 15229 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:07:44.998212 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:44.999444 15549 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:44.999172 15427 raft_consensus.cc:359] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.000011 15427 raft_consensus.cc:385] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.000159 15549 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:45.000392 15427 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.001158 15427 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.001289 15549 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.003679 15427 ts_tablet_manager.cc:1434] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:07:45.005084 15427 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
W20260709 13:07:45.022178 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:45.027082 15427 tablet_bootstrap.cc:654] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.027257 15688 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:45.053876 15430 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:45.106662 15425 tablet_bootstrap.cc:492] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:45.107162 15425 ts_tablet_manager.cc:1403] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.009s
I20260709 13:07:45.099576 15637 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.094800 15304 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:45.115413 15637 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.119511 15637 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:45.119297 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:45.121892 15559 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:45.122449 15559 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:45.122865 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:45.135210 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.136422 15427 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:45.136979 15427 ts_tablet_manager.cc:1403] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.011s
I20260709 13:07:45.138095 15425 raft_consensus.cc:359] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.138835 15425 raft_consensus.cc:385] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.139081 15425 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.139895 15425 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:45.140952 15345 leader_election.cc:343] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.143565 15427 raft_consensus.cc:359] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.145185 15427 raft_consensus.cc:385] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.145537 15427 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.147519 15427 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.151912 15426 tablet_bootstrap.cc:492] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:45.153095 15426 ts_tablet_manager.cc:1403] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.248s	user 0.026s	sys 0.027s
W20260709 13:07:45.156349 15348 leader_election.cc:343] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.156991 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:45.158581 15637 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:45.165623 15425 ts_tablet_manager.cc:1434] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:07:45.155606 15559 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.167160 15427 ts_tablet_manager.cc:1434] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:07:45.164520 15637 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.168660 15637 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.168990 15426 raft_consensus.cc:359] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.169732 15426 raft_consensus.cc:385] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.170011 15426 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.170894 15637 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:45.170753 15426 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.172951 15425 tablet_bootstrap.cc:492] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:45.166109 15128 catalog_manager.cc:5697] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.171219 15427 tablet_bootstrap.cc:492] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:45.175824 15128 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 2, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.180893 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.181888 15426 ts_tablet_manager.cc:1434] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:07:45.254277 15426 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
W20260709 13:07:45.190424 15345 leader_election.cc:343] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:45.255611 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65276.4us
I20260709 13:07:45.257858 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:45.266460 15229 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:45.228104 15438 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.282248 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:45.283285 15694 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.283718 15694 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.284094 15694 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.276698 15307 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.276598 15438 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.302165 15430 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:45.306504 15425 tablet_bootstrap.cc:654] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.306407 15130 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.319031 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.320716 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:45.325809 15196 leader_election.cc:343] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.311074 15438 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:45.324421 15549 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:45.326957 15198 leader_election.cc:343] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.324083 15646 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:07:45.351313 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:45.352377 15438 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:45.353786 15427 tablet_bootstrap.cc:654] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.353700 15425 tablet_bootstrap.cc:492] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:45.354667 15425 ts_tablet_manager.cc:1403] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.182s	user 0.019s	sys 0.001s
I20260709 13:07:45.358556 15425 raft_consensus.cc:359] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.359421 15425 raft_consensus.cc:385] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.359735 15425 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.358389 15646 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:45.327893 15694 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.364909 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:45.365783 15229 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.345705 15426 tablet_bootstrap.cc:654] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.370411 15694 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:07:45.383176 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56269us
I20260709 13:07:45.383435 15425 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.397679 15425 ts_tablet_manager.cc:1434] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:07:45.399266 15425 tablet_bootstrap.cc:492] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:45.402837 15426 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:45.403337 15426 ts_tablet_manager.cc:1403] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.008s
I20260709 13:07:45.411166 15228 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:45.411901 15426 raft_consensus.cc:359] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.413133 15690 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:45.412756 15426 raft_consensus.cc:385] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.415211 15426 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.419689 15425 tablet_bootstrap.cc:654] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.415978 15426 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.422680 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:45.422721 15426 ts_tablet_manager.cc:1434] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:07:45.430986 15425 tablet_bootstrap.cc:492] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:45.433933 15425 ts_tablet_manager.cc:1403] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 13:07:45.441665 15426 tablet_bootstrap.cc:492] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:45.446085 15694 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.446825 15694 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.450213 15426 tablet_bootstrap.cc:654] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.456557 15427 tablet_bootstrap.cc:492] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:45.456775 15694 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:45.457142 15427 ts_tablet_manager.cc:1403] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.289s	user 0.018s	sys 0.018s
W20260709 13:07:45.457690 15345 leader_election.cc:343] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.440395 15425 raft_consensus.cc:359] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.458091 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:45.458323 15425 raft_consensus.cc:385] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.460481 15232 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:45.460774 15380 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:45.462633 15427 raft_consensus.cc:359] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.463585 15427 raft_consensus.cc:385] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.463881 15427 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.464432 15425 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.465274 15425 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.467283 15425 ts_tablet_manager.cc:1434] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:07:45.469062 15427 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.473321 15425 tablet_bootstrap.cc:492] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:45.478067 15229 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:45.479305 15426 tablet_bootstrap.cc:492] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:45.479921 15426 ts_tablet_manager.cc:1403] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.003s
I20260709 13:07:45.479633 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:45.480692 15694 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:45.482167 15694 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:45.483148 15426 raft_consensus.cc:359] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.483103 15694 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.485345 15427 ts_tablet_manager.cc:1434] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:07:45.486605 15427 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:45.484083 15426 raft_consensus.cc:385] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.492641 15426 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.502102 15430 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:45.500689 15426 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.511296 15426 ts_tablet_manager.cc:1434] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:07:45.512578 15426 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:45.517997 15425 tablet_bootstrap.cc:654] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.509450 15427 tablet_bootstrap.cc:654] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.528203 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.529598 15426 tablet_bootstrap.cc:654] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.543183 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:45.544878 15646 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.552529 15131 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.563416 15646 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:45.565032 15425 tablet_bootstrap.cc:492] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:45.565652 15425 ts_tablet_manager.cc:1403] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.003s
I20260709 13:07:45.566746 15427 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:45.567252 15427 ts_tablet_manager.cc:1403] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.005s
I20260709 13:07:45.568699 15425 raft_consensus.cc:359] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.569518 15425 raft_consensus.cc:385] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.569813 15425 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.570118 15427 raft_consensus.cc:359] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.571064 15426 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:45.571595 15426 ts_tablet_manager.cc:1403] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.008s
I20260709 13:07:45.571002 15427 raft_consensus.cc:385] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.573812 15427 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.575098 15426 raft_consensus.cc:359] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.575031 15427 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.575881 15426 raft_consensus.cc:385] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.576516 15426 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.577484 15426 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.578009 15427 ts_tablet_manager.cc:1434] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:07:45.580466 15426 ts_tablet_manager.cc:1434] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:07:45.581681 15427 tablet_bootstrap.cc:492] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:45.581887 15426 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:45.582616 15425 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.586023 15425 ts_tablet_manager.cc:1434] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:07:45.587607 15425 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:45.597229 15438 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.598021 15438 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.603144 15380 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.607805 15559 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.617350 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:45.618458 15382 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:45.624435 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:45.631323 15544 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.632000 15544 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.632517 15544 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.633657 15646 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.634218 15646 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.639182 15628 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:07:45.654479 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:45.655306 15233 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:45.655525 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.656445 15307 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:45.604727 15438 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:45.659899 15549 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:45.710067 15646 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:45.712877 15427 tablet_bootstrap.cc:654] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.712776 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:45.713220 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.608559 15559 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.715111 15425 tablet_bootstrap.cc:654] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.720631 15688 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:45.715215 15426 tablet_bootstrap.cc:654] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.718319 15646 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.744603 15637 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.745348 15637 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:45.747900 15345 leader_election.cc:343] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.740023 15646 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.746248 15559 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:45.785116 15430 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.785822 15430 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.774675 15646 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.790825 15425 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:45.792830 15637 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:45.794513 15430 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:45.795046 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.795090 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:45.803210 15232 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:45.797099 15425 ts_tablet_manager.cc:1403] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.210s	user 0.026s	sys 0.043s
I20260709 13:07:45.805449 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:45.809616 15688 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.815202 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:45.810098 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:45.829289 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 65097.2us
I20260709 13:07:45.829474 15430 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.830600 15430 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.836066 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:45.836962 15229 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:45.810113 15688 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.840826 15688 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.839764 15544 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.844887 15377 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:45.850026 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:45.851470 15440 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.851886 15440 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.852234 15440 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.824204 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:45.860196 15427 tablet_bootstrap.cc:492] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:45.860845 15427 ts_tablet_manager.cc:1403] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.279s	user 0.042s	sys 0.058s
W20260709 13:07:45.858851 15196 leader_election.cc:343] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.876657 15430 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:45.915340 15440 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.918741 15694 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.919397 15694 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:45.906090 15737 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:45.871965 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:45.958647 15440 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:07:45.976594 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 101915us
I20260709 13:07:45.979311 15734 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.981879 15734 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.982275 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:45.979547 15198 leader_election.cc:343] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.984784 15198 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:45.984865 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:45.985625 15229 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.974944 15427 raft_consensus.cc:359] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:45.991113 15427 raft_consensus.cc:385] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.991458 15427 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.987542 15228 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:45.984216 15734 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:45.989996 15735 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.006701 15544 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:46.041749 15427 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:46.035553 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54516.9us
I20260709 13:07:46.051828 15425 raft_consensus.cc:359] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.052714 15425 raft_consensus.cc:385] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.053002 15425 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.036487 15646 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.053826 15425 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.057453 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:46.058672 15430 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.063162 15427 ts_tablet_manager.cc:1434] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.202s	user 0.006s	sys 0.004s
I20260709 13:07:46.068202 15425 ts_tablet_manager.cc:1434] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.263s	user 0.012s	sys 0.002s
I20260709 13:07:46.060106 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:46.087699 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:46.088312 15308 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:46.090931 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:46.092618 15426 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:46.093226 15426 ts_tablet_manager.cc:1403] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.512s	user 0.029s	sys 0.032s
I20260709 13:07:46.094336 15425 tablet_bootstrap.cc:492] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:46.102061 15427 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:46.099568 15637 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:07:46.109205 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:46.112386 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:46.113869 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:46.114480 15646 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.114683 15377 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:46.117605 15196 leader_election.cc:343] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.118302 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:46.119000 15227 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.178690 15308 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:46.183285 15430 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.156762 15688 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.181526 15426 raft_consensus.cc:359] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.184556 15426 raft_consensus.cc:385] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.185141 15426 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.185870 15426 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.198191 15426 ts_tablet_manager.cc:1434] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.105s	user 0.011s	sys 0.000s
I20260709 13:07:46.184214 15229 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:46.202397 15688 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:46.202966 15305 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:46.203462 15427 tablet_bootstrap.cc:654] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.211906 15426 tablet_bootstrap.cc:492] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:46.224536 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:46.227666 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:46.228144 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:46.228498 15307 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.229004 15378 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:46.231603 15425 tablet_bootstrap.cc:654] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.211476 15628 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:07:46.241379 15694 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.246013 15747 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:46.251269 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 143137us
W20260709 13:07:46.251952 15198 leader_election.cc:343] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.254765 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:46.237157 15227 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:46.250674 15747 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:46.271237 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:46.272324 15232 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:46.259824 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:46.262408 15559 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.262737 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:46.294492 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:46.274766 15377 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:46.304937 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:46.305840 15440 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:46.302887 15741 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.298645 15307 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:46.297786 15637 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:07:46.317843 15628 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.317843 15747 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.329420 15628 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.331743 15628 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:46.340850 15426 tablet_bootstrap.cc:654] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.343590 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:46.328749 15741 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:46.346581 15544 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.383131 15425 tablet_bootstrap.cc:492] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:46.384248 15425 ts_tablet_manager.cc:1403] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.295s	user 0.022s	sys 0.018s
I20260709 13:07:46.381830 15741 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.382800 15544 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:07:46.394357 15755 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:46.398134 15427 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:46.399168 15427 ts_tablet_manager.cc:1403] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.313s	user 0.014s	sys 0.024s
I20260709 13:07:46.395568 15425 raft_consensus.cc:359] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.399799 15425 raft_consensus.cc:385] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.400254 15425 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.405444 15425 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:46.410871 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 138316us
I20260709 13:07:46.415726 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:46.406955 15544 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.432533 15427 raft_consensus.cc:359] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.433730 15427 raft_consensus.cc:385] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.434109 15427 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.435194 15427 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.439599 15426 tablet_bootstrap.cc:492] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:46.442396 15426 ts_tablet_manager.cc:1403] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.237s	user 0.013s	sys 0.014s
I20260709 13:07:46.460683 15425 ts_tablet_manager.cc:1434] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 13:07:46.467869 15425 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:46.470569 15763 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.480819 15427 ts_tablet_manager.cc:1434] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.003s
I20260709 13:07:46.480124 15426 raft_consensus.cc:359] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.498426 15426 raft_consensus.cc:385] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.498821 15426 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.499684 15426 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.546376 15425 tablet_bootstrap.cc:654] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.551709 15426 ts_tablet_manager.cc:1434] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.005s
W20260709 13:07:46.557221 15759 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:46.590428 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:46.592957 15426 tablet_bootstrap.cc:492] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:46.598918 15425 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:46.600059 15425 ts_tablet_manager.cc:1403] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.136s	user 0.022s	sys 0.008s
I20260709 13:07:46.600405 15426 tablet_bootstrap.cc:654] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.604636 15425 raft_consensus.cc:359] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.605934 15425 raft_consensus.cc:385] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.606560 15425 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.607820 15425 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.611230 15425 ts_tablet_manager.cc:1434] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:07:46.613503 15425 tablet_bootstrap.cc:492] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:46.614851 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:46.627662 15425 tablet_bootstrap.cc:654] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.634466 15739 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.635140 15739 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.638723 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:46.639496 15227 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:46.642082 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:46.644418 15646 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.645159 15646 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.645666 15646 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.655440 15637 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.657230 15198 leader_election.cc:343] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.656414 15637 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.665654 15637 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.667001 15130 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.669471 15427 tablet_bootstrap.cc:492] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:46.677625 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:46.667042 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:46.678448 15305 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:46.678823 15232 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:46.673964 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:46.680320 15306 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:46.678366 15130 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.687781 15427 tablet_bootstrap.cc:654] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.644512 15739 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.692195 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:46.698137 15741 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.699474 15741 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.700803 15741 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:46.705192 15196 leader_election.cc:343] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.705983 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:46.707304 15628 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.691141 15646 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.724244 15646 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.724417 15427 tablet_bootstrap.cc:492] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:46.729350 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:46.734598 15427 ts_tablet_manager.cc:1403] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 13:07:46.734774 15306 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.735992 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:46.736706 15232 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.737957 15427 raft_consensus.cc:359] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.737883 15741 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.738824 15427 raft_consensus.cc:385] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.739147 15427 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.730177 15425 tablet_bootstrap.cc:492] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:46.740761 15425 ts_tablet_manager.cc:1403] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.128s	user 0.036s	sys 0.058s
I20260709 13:07:46.740700 15741 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.743455 15425 raft_consensus.cc:359] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.744109 15425 raft_consensus.cc:385] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.739952 15427 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.744297 15306 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:46.744472 15425 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.755398 15425 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.756912 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:46.757644 15229 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.758080 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:46.746994 15427 ts_tablet_manager.cc:1434] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:46.760462 15427 tablet_bootstrap.cc:492] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:46.761488 15426 tablet_bootstrap.cc:492] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:46.762034 15426 ts_tablet_manager.cc:1403] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.039s
I20260709 13:07:46.762212 15646 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.765193 15426 raft_consensus.cc:359] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.766002 15426 raft_consensus.cc:385] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.766290 15426 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.746783 15232 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:46.767170 15427 tablet_bootstrap.cc:654] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.751247 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:46.766968 15426 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.767714 15305 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.769364 15426 ts_tablet_manager.cc:1434] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:46.770753 15426 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:46.758800 15425 ts_tablet_manager.cc:1434] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:07:46.773869 15425 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:46.779945 15426 tablet_bootstrap.cc:654] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.786036 15305 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:46.790776 15345 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:46.794003 15425 tablet_bootstrap.cc:654] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.791319 15646 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.793373 15637 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.799791 15628 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.805668 15646 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:46.806900 15628 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.813910 15229 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:46.816701 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:46.819258 15196 leader_election.cc:343] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.807292 15637 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:46.827212 15427 tablet_bootstrap.cc:492] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:46.827785 15427 ts_tablet_manager.cc:1403] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.003s
I20260709 13:07:46.830174 15427 raft_consensus.cc:359] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.830829 15427 raft_consensus.cc:385] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.831138 15427 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.845232 15427 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.847790 15628 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:07:46.859133 15774 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:46.861351 15646 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.863034 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:46.863117 15637 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:46.865849 15198 leader_election.cc:343] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.866360 15198 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:46.868315 15628 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.869182 15426 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:46.869921 15426 ts_tablet_manager.cc:1403] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.100s	user 0.021s	sys 0.009s
I20260709 13:07:46.891860 15741 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.900455 15748 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.901145 15748 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.904250 15748 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:46.906227 15425 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:46.913442 15425 ts_tablet_manager.cc:1403] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.034s
I20260709 13:07:46.912361 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:46.906829 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:46.915320 15227 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:46.916785 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:46.917733 15743 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.918169 15743 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.918540 15743 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.919559 15425 raft_consensus.cc:359] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.922761 15425 raft_consensus.cc:385] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.923646 15425 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.924707 15425 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.901268 15426 raft_consensus.cc:359] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.925733 15426 raft_consensus.cc:385] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.926091 15426 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.926898 15426 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.927538 15743 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.923300 15427 ts_tablet_manager.cc:1434] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.022s
I20260709 13:07:46.929458 15427 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:46.930859 15743 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:46.930291 15426 ts_tablet_manager.cc:1434] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:07:46.932298 15426 tablet_bootstrap.cc:492] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
W20260709 13:07:46.936597 15273 leader_election.cc:343] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.939762 15637 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.957124 15646 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.958012 15646 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.961007 15741 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.961694 15741 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:46.964800 15131 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.963096 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:46.971293 15741 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.963021 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:46.972551 15229 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.976830 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:46.977720 15232 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:46.964010 15782 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:07:46.984084 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:46.984916 15232 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:46.987664 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:46.988636 15741 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.989045 15741 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.989404 15741 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.990162 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:46.990971 15305 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:46.968415 15425 ts_tablet_manager.cc:1434] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.002s
I20260709 13:07:46.997537 15425 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:46.997833 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:46.992726 15426 tablet_bootstrap.cc:654] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.961187 15646 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:46.995960 15427 tablet_bootstrap.cc:654] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.004733 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:47.006848 15747 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.007414 15747 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.007798 15747 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.009832 15229 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
W20260709 13:07:47.014307 15345 leader_election.cc:343] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.019313 15425 tablet_bootstrap.cc:654] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.023941 15781 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.024789 15781 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:47.027020 15273 leader_election.cc:343] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.027632 15781 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:47.028332 15646 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.028285 15781 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:47.036705 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:47.038268 15749 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.027010 15741 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.041285 15749 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:47.042268 15749 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.044580 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:47.045253 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:47.046182 15307 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.045524 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:47.053068 15741 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:47.055089 15426 tablet_bootstrap.cc:492] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:47.055297 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:47.045390 15232 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.057569 15426 ts_tablet_manager.cc:1403] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.007s
W20260709 13:07:47.057936 15196 leader_election.cc:343] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:47.071739 15198 leader_election.cc:343] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.075227 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:47.084733 15232 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:47.084998 15782 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:47.087190 15307 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:47.069728 15131 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.096045 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:47.097649 15637 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.098253 15637 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:47.095585 15131 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.103111 15747 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.060501 15427 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:47.099399 15637 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.107731 15427 ts_tablet_manager.cc:1403] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.179s	user 0.019s	sys 0.001s
I20260709 13:07:47.111793 15747 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:47.091468 15426 raft_consensus.cc:359] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.113904 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:47.107241 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:47.118011 15426 raft_consensus.cc:385] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.120972 15233 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:47.126180 15345 leader_election.cc:343] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.126112 15426 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.129102 15426 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.130846 15427 raft_consensus.cc:359] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.139107 15427 raft_consensus.cc:385] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.139402 15427 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.140733 15427 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.141934 15233 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:47.142473 15427 ts_tablet_manager.cc:1434] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:07:47.146004 15426 ts_tablet_manager.cc:1434] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.002s
I20260709 13:07:47.164197 15426 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:47.166970 15427 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:47.152014 15425 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:47.170395 15425 ts_tablet_manager.cc:1403] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.008s
I20260709 13:07:47.171339 15426 tablet_bootstrap.cc:654] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.174010 15425 raft_consensus.cc:359] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.176820 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:47.180245 15425 raft_consensus.cc:385] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.180749 15739 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.181438 15739 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:47.182711 15739 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.180788 15425 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.187690 15425 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.194437 15128 catalog_manager.cc:5697] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.204257 15425 ts_tablet_manager.cc:1434] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 13:07:47.205925 15425 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:47.210861 15427 tablet_bootstrap.cc:654] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:47.227633 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:47.234330 15426 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:47.235037 15426 ts_tablet_manager.cc:1403] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.007s
I20260709 13:07:47.248091 15741 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.254069 15741 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.258469 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:47.258340 15741 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:47.265062 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:47.265934 15233 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
W20260709 13:07:47.262400 15345 leader_election.cc:343] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.269207 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:47.273505 15646 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.273978 15646 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.274350 15646 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.278407 15130 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.283735 15425 tablet_bootstrap.cc:654] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.297683 15741 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.300832 15426 raft_consensus.cc:359] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.301775 15426 raft_consensus.cc:385] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.302084 15426 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.303668 15426 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.310819 15646 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.314122 15426 ts_tablet_manager.cc:1434] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.001s
I20260709 13:07:47.315052 15427 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:47.320052 15427 ts_tablet_manager.cc:1403] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.008s
I20260709 13:07:47.320128 15741 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.317024 15425 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:47.324095 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:47.325899 15426 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:47.323920 15739 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.326808 15646 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:47.334290 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:47.340586 15131 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.365306 15747 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.324745 15232 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.324860 15425 ts_tablet_manager.cc:1403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.004s
W20260709 13:07:47.369760 15345 leader_election.cc:343] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.373332 15425 raft_consensus.cc:359] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.374271 15425 raft_consensus.cc:385] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.374607 15425 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.324306 15427 raft_consensus.cc:359] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.379140 15427 raft_consensus.cc:385] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.379505 15427 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.381439 15427 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.383956 15427 ts_tablet_manager.cc:1434] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.016s
I20260709 13:07:47.375792 15425 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.386586 15425 ts_tablet_manager.cc:1434] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:07:47.387697 15425 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:47.396006 15425 tablet_bootstrap.cc:654] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.400274 15427 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:47.414953 15427 tablet_bootstrap.cc:654] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.419018 15426 tablet_bootstrap.cc:654] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.424463 15749 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.425129 15749 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.427748 15749 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:47.433409 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:47.435491 15273 leader_election.cc:343] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.442790 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:07:47.444446 15274 leader_election.cc:343] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.445036 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:47.445910 15749 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:47.455626 15232 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:47.473208 15427 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:47.473784 15427 ts_tablet_manager.cc:1403] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.010s
I20260709 13:07:47.474067 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:47.475090 15742 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.478298 15427 raft_consensus.cc:359] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.479179 15427 raft_consensus.cc:385] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.479483 15427 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.480134 15780 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.480594 15742 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:47.480679 15780 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.481760 15742 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.484722 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:47.485741 15378 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:47.485962 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:47.487537 15425 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:47.487486 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:47.488158 15425 ts_tablet_manager.cc:1403] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.028s
I20260709 13:07:47.488512 15735 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.481992 15426 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:47.489048 15735 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.489447 15735 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.489473 15426 ts_tablet_manager.cc:1403] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.002s
W20260709 13:07:47.490097 15196 leader_election.cc:343] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.490422 15427 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.494136 15427 ts_tablet_manager.cc:1434] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:07:47.491066 15780 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:07:47.498165 15273 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:47.498198 15425 raft_consensus.cc:359] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.505015 15425 raft_consensus.cc:385] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.505761 15425 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.499197 15427 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:47.506448 15426 raft_consensus.cc:359] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.507215 15426 raft_consensus.cc:385] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.507508 15426 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.508220 15426 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.508735 15425 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.511756 15425 ts_tablet_manager.cc:1434] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.005s
I20260709 13:07:47.513332 15426 ts_tablet_manager.cc:1434] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:07:47.515803 15426 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:47.517463 15427 tablet_bootstrap.cc:654] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.518255 15425 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:47.530229 15425 tablet_bootstrap.cc:654] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.529546 15735 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.536973 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:47.539556 15196 leader_election.cc:343] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.541134 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:47.542595 15378 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.546033 15427 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:47.546603 15427 ts_tablet_manager.cc:1403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.005s
I20260709 13:07:47.546877 15749 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.549674 15780 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.550311 15780 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.554728 15780 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:47.555526 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:47.558130 15304 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:47.559669 15196 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:47.557152 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:47.561777 15198 leader_election.cc:343] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.562825 15780 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.564049 15780 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.564535 15780 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.567097 15426 tablet_bootstrap.cc:654] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.573096 15427 raft_consensus.cc:359] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.574141 15427 raft_consensus.cc:385] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.574561 15427 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.574254 15741 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.575525 15427 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.577123 15780 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.582599 15741 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.584352 15427 ts_tablet_manager.cc:1434] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:07:47.595747 15427 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:47.589272 15130 catalog_manager.cc:5697] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.590806 15735 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:47.608254 15780 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:47.609599 15378 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
W20260709 13:07:47.612766 15345 consensus_peers.cc:597] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:47.613190 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:47.614594 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:07:47.616503 15198 leader_election.cc:343] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.621101 15304 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.653497 15427 tablet_bootstrap.cc:654] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.666649 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:47.677362 15782 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.677965 15782 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:47.679298 15782 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.674408 15304 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:47.708925 15425 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:47.709605 15425 ts_tablet_manager.cc:1403] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.193s	user 0.008s	sys 0.035s
I20260709 13:07:47.725296 15426 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:47.726253 15426 ts_tablet_manager.cc:1403] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.211s	user 0.020s	sys 0.016s
I20260709 13:07:47.731714 15196 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:47.743754 15780 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.765125 15426 raft_consensus.cc:359] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.766233 15427 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:47.766834 15427 ts_tablet_manager.cc:1403] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.171s	user 0.028s	sys 0.011s
I20260709 13:07:47.766814 15780 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:47.769598 15780 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.771994 15425 raft_consensus.cc:359] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.772883 15425 raft_consensus.cc:385] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.773200 15425 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.773953 15425 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.779315 15427 raft_consensus.cc:359] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.780717 15427 raft_consensus.cc:385] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.781054 15427 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.781940 15427 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.783601 15427 ts_tablet_manager.cc:1434] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:07:47.785231 15427 tablet_bootstrap.cc:492] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:47.787572 15425 ts_tablet_manager.cc:1434] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.078s	user 0.016s	sys 0.016s
I20260709 13:07:47.789535 15425 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:47.795007 15427 tablet_bootstrap.cc:654] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.796384 15425 tablet_bootstrap.cc:654] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.808493 15748 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.809294 15748 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.766230 15426 raft_consensus.cc:385] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.821169 15426 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.823938 15811 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.832038 15811 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.825661 15426 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.846694 15748 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:47.841076 15810 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.850414 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:47.838126 15742 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:07:47.873111 15229 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:47.875202 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:47.877799 15750 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.878261 15750 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.878628 15750 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.870635 15426 ts_tablet_manager.cc:1434] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.144s	user 0.019s	sys 0.017s
I20260709 13:07:47.869750 15810 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.881994 15425 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:47.882966 15425 ts_tablet_manager.cc:1403] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.005s
W20260709 13:07:47.890657 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53247.4us
I20260709 13:07:47.894970 15426 tablet_bootstrap.cc:492] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:47.901005 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:47.901782 15378 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:47.955368 15646 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.980834 15427 tablet_bootstrap.cc:492] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:47.981547 15427 ts_tablet_manager.cc:1403] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.197s	user 0.028s	sys 0.020s
I20260709 13:07:47.983385 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:47.984186 15377 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:47.985014 15427 raft_consensus.cc:359] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:47.986120 15427 raft_consensus.cc:385] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.986418 15427 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.986493 15198 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:47.988060 15735 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.988493 15735 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.988893 15735 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.985517 15810 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:47.992549 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:47.993500 15381 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:47.995214 15198 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:47.996130 15782 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.996587 15782 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.996984 15782 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.998457 15128 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.000095 15427 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.003705 15425 raft_consensus.cc:359] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.004520 15425 raft_consensus.cc:385] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.004817 15425 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.005586 15425 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.001740 15128 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.999404 15811 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.012845 15425 ts_tablet_manager.cc:1434] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.009s
I20260709 13:07:48.014966 15735 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.020121 15743 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.020857 15743 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.023213 15743 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.024504 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:48.024868 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:48.026708 15304 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:48.028138 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:48.030876 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:48.033002 15426 tablet_bootstrap.cc:654] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.034024 15810 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.035190 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:48.035358 15810 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.035907 15381 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:48.036603 15425 tablet_bootstrap.cc:492] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:48.038232 15810 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.038923 15780 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.024427 15750 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.039541 15780 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.044293 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:48.043098 15780 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.089668 15427 ts_tablet_manager.cc:1434] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.002s
I20260709 13:07:48.047044 15306 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:48.049052 15273 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:07:48.096619 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47723us
I20260709 13:07:48.052870 15750 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.060052 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:48.102051 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:48.102661 15381 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.110278 15427 tablet_bootstrap.cc:492] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
W20260709 13:07:48.110517 15198 leader_election.cc:343] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.039598 15735 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.104378 15230 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:48.054836 15782 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.115535 15782 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.105526 15749 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.116519 15229 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:48.116568 15749 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.117524 15749 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.047461 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:48.060286 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:48.045818 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:48.058313 15823 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.139868 15381 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:48.141024 15307 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:48.140877 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:48.202505 15377 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:48.149113 15823 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.210888 15823 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:07:48.218413 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 107306us
I20260709 13:07:48.247529 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:48.258121 15749 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.229591 15780 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.280665 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:48.290591 15749 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.294221 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:48.295625 15230 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:48.303541 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:48.304809 15304 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:48.301246 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:07:48.310096 15198 leader_election.cc:343] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.311004 15198 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:48.312539 15375 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.313383 15817 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.286499 15780 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.318782 15427 tablet_bootstrap.cc:654] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.325722 15196 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:48.325793 15811 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:48.328634 15307 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.330574 15425 tablet_bootstrap.cc:654] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:48.332060 15198 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:48.333889 15196 leader_election.cc:343] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.334394 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:48.337357 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:48.338980 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:48.345616 15273 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:48.341075 15781 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.344295 15750 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.367398 15828 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.367719 15780 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.389617 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:48.346601 15817 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.354823 15781 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.397810 15426 tablet_bootstrap.cc:492] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:48.398825 15378 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:48.400277 15426 ts_tablet_manager.cc:1403] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.506s	user 0.019s	sys 0.016s
I20260709 13:07:48.402794 15781 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.427989 15750 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:48.483352 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:48.508529 15196 leader_election.cc:343] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.493230 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:48.525545 15750 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.542140 15426 raft_consensus.cc:359] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.543305 15426 raft_consensus.cc:385] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.543687 15426 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.544648 15426 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.547472 15781 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.549885 15781 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:48.550103 15825 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:48.552191 15273 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:48.552776 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:48.553915 15345 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.554601 15302 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.561638 15427 tablet_bootstrap.cc:492] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:48.562335 15427 ts_tablet_manager.cc:1403] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.458s	user 0.013s	sys 0.019s
I20260709 13:07:48.564388 15833 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.564839 15426 ts_tablet_manager.cc:1434] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.164s	user 0.004s	sys 0.004s
I20260709 13:07:48.566009 15426 tablet_bootstrap.cc:492] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:48.565723 15825 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:48.571077 15375 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:48.573477 15425 tablet_bootstrap.cc:492] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:48.651167 15425 ts_tablet_manager.cc:1403] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.615s	user 0.024s	sys 0.003s
I20260709 13:07:48.655153 15425 raft_consensus.cc:359] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.578310 15302 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:48.657814 15196 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:48.659130 15811 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.659713 15811 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:48.600034 15426 tablet_bootstrap.cc:654] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.606793 15380 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.610239 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:07:48.608211 15198 leader_election.cc:343] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.578364 15427 raft_consensus.cc:359] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.661520 15427 raft_consensus.cc:385] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.661290 15198 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:48.661834 15427 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.662448 15427 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.628960 15131 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.656149 15425 raft_consensus.cc:385] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.667114 15425 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.667943 15425 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:48.671972 15427 ts_tablet_manager.cc:1434] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.109s	user 0.003s	sys 0.005s
I20260709 13:07:48.673702 15427 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
W20260709 13:07:48.678452 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70269.6us
I20260709 13:07:48.691506 15425 ts_tablet_manager.cc:1434] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:07:48.688957 15782 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.810757 15425 tablet_bootstrap.cc:492] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
W20260709 13:07:48.813301 15837 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:07:48.829944 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 138206us
W20260709 13:07:48.839754 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 91798.5us
I20260709 13:07:48.688069 15811 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:48.865497 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 172830us
I20260709 13:07:48.867558 15198 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:07:48.893340 15198 leader_election.cc:343] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.985553 15810 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.986382 15810 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:48.987635 15810 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.092542 15856 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.093593 15856 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.072372 15825 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.169857 15427 tablet_bootstrap.cc:654] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.161952 15825 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:49.384758 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 364767us
I20260709 13:07:49.259737 15825 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:49.454373 15425 tablet_bootstrap.cc:654] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.438709 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:49.491111 15821 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:07:49.492053 15821 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.503150 15856 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:49.523406 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:49.530699 15426 tablet_bootstrap.cc:492] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:49.531415 15426 ts_tablet_manager.cc:1403] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.966s	user 0.029s	sys 0.079s
W20260709 13:07:49.540431 15196 leader_election.cc:343] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.553928 15811 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:07:49.561378 15811 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.564229 15811 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:49.568584 15426 raft_consensus.cc:359] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.571349 15426 raft_consensus.cc:385] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.571698 15426 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.572671 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:07:49.576700 15869 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:07:49.575119 15426 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.582758 15426 ts_tablet_manager.cc:1434] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:07:49.585095 15427 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:49.587041 15427 ts_tablet_manager.cc:1403] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.914s	user 0.024s	sys 0.008s
W20260709 13:07:49.588603 15198 leader_election.cc:343] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.589186 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:49.593703 15426 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:49.595562 15861 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.597882 15427 raft_consensus.cc:359] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.599591 15427 raft_consensus.cc:385] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.599908 15427 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.600839 15427 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.610415 15301 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.612818 15427 ts_tablet_manager.cc:1434] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:07:49.613255 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:49.615324 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:49.620410 15864 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.217s	user 0.001s	sys 0.002s
I20260709 13:07:49.629464 15427 tablet_bootstrap.cc:492] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:49.635680 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:49.638652 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:49.643527 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:49.648844 15855 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:49.625583 15832 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:07:49.654387 15859 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:49.673646 15821 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:49.674952 15425 tablet_bootstrap.cc:492] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:49.675575 15425 ts_tablet_manager.cc:1403] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.922s	user 0.032s	sys 0.066s
I20260709 13:07:49.664059 15855 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:49.684672 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:49.675422 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:49.697175 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:49.703315 15857 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:49.722421 15425 raft_consensus.cc:359] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.726456 15425 raft_consensus.cc:385] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.726831 15425 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.727713 15425 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:49.729425 15198 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:49.732834 15427 tablet_bootstrap.cc:654] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.736056 15128 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.745369 15425 ts_tablet_manager.cc:1434] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.002s
I20260709 13:07:49.747366 15426 tablet_bootstrap.cc:654] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.757541 15425 tablet_bootstrap.cc:492] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
W20260709 13:07:49.781705 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:49.820817 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 97) took 1227 ms. Trace:
I20260709 13:07:49.821467 15131 rpcz_store.cc:276] 0709 13:07:48.593160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.593357 (+   197us) service_pool.cc:224] Handling call
0709 13:07:49.820697 (+1227340us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:48.992104 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:48.993040 (+   936us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:48.993093 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:07:48.993134 (+    41us) tablet.cc:662] Decoding operations
0709 13:07:48.993682 (+   548us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:48.993773 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:48.993817 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:48.994081 (+   264us) tablet.cc:701] Row locks acquired
0709 13:07:48.994109 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:07:48.994333 (+   224us) write_op.cc:270] Start()
0709 13:07:48.994485 (+   152us) write_op.cc:276] Timestamp: P: 1783602468994265 usec, L: 0
0709 13:07:48.994517 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:07:48.995491 (+   974us) log.cc:844] Serialized 540 byte log entry
0709 13:07:49.399179 (+403688us) op_driver.cc:464] REPLICATION: finished
0709 13:07:49.657536 (+258357us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f5755cef0
0709 13:07:49.787371 (+129835us) write_op.cc:301] APPLY: starting
0709 13:07:49.794975 (+  7604us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:49.805778 (+ 10803us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:49.809502 (+  3724us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:49.812718 (+  3216us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:49.812975 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:49.813051 (+    76us) write_op.cc:312] APPLY: finished
0709 13:07:49.814510 (+  1459us) log.cc:844] Serialized 22 byte log entry
0709 13:07:49.814771 (+   261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:49.814865 (+    94us) write_op.cc:454] Released schema lock
0709 13:07:49.814912 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:49.815340 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:49.815371 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":370908,"apply.run_cpu_time_us":2785,"apply.run_wall_time_us":38785,"num_ops":1,"prepare.queue_time_us":322988,"prepare.run_cpu_time_us":3925,"prepare.run_wall_time_us":10587,"replication_time_us":404451,"spinlock_wait_cycles":44471552,"thread_start_us":421752,"threads_started":2}]]}
I20260709 13:07:49.849532 15879 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.850587 15879 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:49.903607 15425 tablet_bootstrap.cc:654] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.010454 15427 tablet_bootstrap.cc:492] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:50.011126 15427 ts_tablet_manager.cc:1403] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.382s	user 0.012s	sys 0.017s
I20260709 13:07:50.054242 15426 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:50.054890 15426 ts_tablet_manager.cc:1403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.461s	user 0.032s	sys 0.015s
I20260709 13:07:50.058454 15833 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.062973 15821 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.063247 15427 raft_consensus.cc:359] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.064015 15821 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.054598 15743 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.066547 15743 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.068357 15821 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:50.064206 15427 raft_consensus.cc:385] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.071898 15427 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.073483 15427 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:50.084956 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72752.6us
I20260709 13:07:50.097378 15427 ts_tablet_manager.cc:1434] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:07:50.090380 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:50.100462 15227 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:50.105504 15743 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:50.123878 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:50.166005 15427 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:50.169752 15426 raft_consensus.cc:359] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.170645 15426 raft_consensus.cc:385] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.171031 15426 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.171952 15426 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.133850 15845 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.183647 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:50.225378 15426 ts_tablet_manager.cc:1434] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.170s	user 0.009s	sys 0.000s
I20260709 13:07:50.144740 15855 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:07:50.193732 15845 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.286847 15845 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:50.292140 15425 tablet_bootstrap.cc:492] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:50.292201 15879 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:50.292935 15425 ts_tablet_manager.cc:1403] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.536s	user 0.045s	sys 0.029s
I20260709 13:07:50.294790 15426 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:50.301138 15425 raft_consensus.cc:359] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.302450 15425 raft_consensus.cc:385] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.302772 15425 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.303462 15425 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.306176 15425 ts_tablet_manager.cc:1434] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:50.316160 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:50.326702 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:50.339464 15128 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.362936 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:50.364320 15748 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.375335 15427 tablet_bootstrap.cc:654] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.378334 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:50.381042 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:50.383752 15299 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:50.385798 15425 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:50.396997 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:50.400754 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:50.413043 15866 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.413568 15866 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.413833 15303 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.413964 15866 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.420828 15376 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.423421 15879 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.424182 15879 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:50.417999 15198 leader_election.cc:343] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.437367 15879 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:50.442454 15425 tablet_bootstrap.cc:654] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.452996 15345 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:07:50.455267 15345 leader_election.cc:343] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.459221 15845 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:50.460702 15845 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:07:50.461282 15845 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.480803 15426 tablet_bootstrap.cc:654] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.492328 15866 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.494457 15829 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.494823 15866 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:07:50.502616 15196 leader_election.cc:343] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.495149 15829 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.504815 15196 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:50.512753 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:50.514066 15829 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:50.504479 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:50.516418 15198 leader_election.cc:343] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.523401 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:50.524387 15228 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:50.510943 15879 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.505086 15855 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 13:07:50.537377 15196 leader_election.cc:343] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.537783 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:50.538630 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:50.543457 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:50.544394 15233 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.548518 15749 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.549072 15749 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.549476 15749 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.562688 15233 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:50.592418 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:50.569634 15825 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.579376 15845 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.613471 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:50.605073 15742 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.621930 15826 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:07:50.622663 15826 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.629313 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:07:50.629824 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57727.6us
I20260709 13:07:50.630827 15845 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:50.634876 15425 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:50.635577 15425 ts_tablet_manager.cc:1403] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.250s	user 0.020s	sys 0.010s
I20260709 13:07:50.624830 15742 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:07:50.642189 15427 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:50.642859 15427 ts_tablet_manager.cc:1403] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.493s	user 0.023s	sys 0.008s
I20260709 13:07:50.659502 15375 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:50.659669 15427 raft_consensus.cc:359] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.666249 15427 raft_consensus.cc:385] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.666990 15427 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.667748 15426 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:50.668622 15426 ts_tablet_manager.cc:1403] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.374s	user 0.008s	sys 0.019s
I20260709 13:07:50.668138 15427 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.664490 15904 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:07:50.662603 15742 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.679387 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:07:50.680052 15273 leader_election.cc:343] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.679818 15749 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.682765 15749 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:50.675784 15426 raft_consensus.cc:359] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.686971 15426 raft_consensus.cc:385] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.687374 15426 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.689684 15426 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.696754 15427 ts_tablet_manager.cc:1434] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.002s
I20260709 13:07:50.720607 15847 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:50.721519 15847 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:50.723766 15847 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.729844 15847 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.735556 15826 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:50.739080 15425 raft_consensus.cc:359] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.739995 15425 raft_consensus.cc:385] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.740294 15425 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.742022 15426 ts_tablet_manager.cc:1434] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 13:07:50.743186 15426 tablet_bootstrap.cc:492] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
W20260709 13:07:50.744907 15345 leader_election.cc:343] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.750880 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:50.757916 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:50.758713 15231 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.764264 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:50.769626 15858 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.770272 15858 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.773768 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:50.775521 15858 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:50.778757 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:50.778209 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:07:50.783648 15198 leader_election.cc:343] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.784611 15425 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.786823 15425 ts_tablet_manager.cc:1434] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.151s	user 0.008s	sys 0.000s
I20260709 13:07:50.787943 15425 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:50.788264 15301 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:50.794572 15426 tablet_bootstrap.cc:654] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.801801 15826 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.802520 15826 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.806604 15826 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:50.816257 15345 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:07:50.825592 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 79841.6us
I20260709 13:07:50.828011 15427 tablet_bootstrap.cc:492] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Bootstrap starting.
I20260709 13:07:50.828521 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:50.819254 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:50.829293 15232 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 0.
I20260709 13:07:50.839742 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:50.842396 15231 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:50.821782 15742 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:50.851943 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:50.853684 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:50.855093 15829 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.855682 15829 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:07:50.861699 15273 leader_election.cc:343] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.830857 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:50.856705 15829 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:50.864651 15345 leader_election.cc:343] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.860543 15847 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.868451 15866 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:50.869349 15847 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.899194 15131 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.893913 15847 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.913749 15425 tablet_bootstrap.cc:654] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.919181 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:50.923161 15427 tablet_bootstrap.cc:654] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.931130 15826 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.931699 15826 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.932061 15826 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:50.932482 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:50.977926 15426 tablet_bootstrap.cc:492] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:50.984752 15426 ts_tablet_manager.cc:1403] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.242s	user 0.024s	sys 0.015s
I20260709 13:07:50.978302 15425 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:50.978612 15826 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.991222 15847 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:50.996393 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:50.997373 15305 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.986749 15425 ts_tablet_manager.cc:1403] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.199s	user 0.016s	sys 0.012s
I20260709 13:07:51.001561 15425 raft_consensus.cc:359] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.002123 15427 tablet_bootstrap.cc:492] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: No bootstrap required, opened a new log
I20260709 13:07:51.002388 15425 raft_consensus.cc:385] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.002499 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:51.002733 15425 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.002746 15427 ts_tablet_manager.cc:1403] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.014s
I20260709 13:07:51.003669 15425 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:07:51.004300 15198 leader_election.cc:343] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.985160 15128 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.006459 15426 raft_consensus.cc:359] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.007269 15426 raft_consensus.cc:385] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.007544 15426 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.007712 15847 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.010571 15425 ts_tablet_manager.cc:1434] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:07:51.008361 15426 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.011632 15427 raft_consensus.cc:359] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.012902 15427 raft_consensus.cc:385] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.013247 15427 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.013744 15425 tablet_bootstrap.cc:492] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:51.014838 15426 ts_tablet_manager.cc:1434] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:07:51.014101 15427 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.021503 15426 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:51.021296 15826 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:51.023257 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:51.023999 15228 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.030273 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:51.053460 15427 ts_tablet_manager.cc:1434] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
W20260709 13:07:51.107849 15345 leader_election.cc:343] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.112416 15829 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.118582 15829 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.120568 15305 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:51.147697 15425 tablet_bootstrap.cc:654] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.150321 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:51.139180 15847 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.159632 15904 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.160256 15904 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:51.161268 15904 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.157362 15847 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.166250 15829 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.163355 15228 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:07:51.169929 15847 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.171799 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:51.175423 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:07:51.173887 15198 leader_election.cc:343] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.180434 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:51.180474 15742 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.181658 15742 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:07:51.184417 15273 leader_election.cc:343] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:51.185359 15345 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:51.182605 15742 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.188541 15426 tablet_bootstrap.cc:654] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.195860 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:51.197302 15303 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 0.
I20260709 13:07:51.202528 15196 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:51.208256 15917 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.210958 15917 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.195736 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:51.225519 15909 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.226405 15909 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.228783 15909 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:51.231256 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:51.233888 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:51.241605 15226 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:07:51.244511 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:51.246479 15425 tablet_bootstrap.cc:492] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:51.246618 15909 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.247188 15425 ts_tablet_manager.cc:1403] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.235s	user 0.028s	sys 0.028s
I20260709 13:07:51.224691 15917 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.253291 15130 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.259053 15909 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.272787 15128 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.275080 15425 raft_consensus.cc:359] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.276165 15425 raft_consensus.cc:385] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.276517 15425 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.277441 15425 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.278757 15426 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:51.279356 15426 ts_tablet_manager.cc:1403] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.259s	user 0.013s	sys 0.025s
I20260709 13:07:51.281064 15425 ts_tablet_manager.cc:1434] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:07:51.282723 15425 tablet_bootstrap.cc:492] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:51.283190 15426 raft_consensus.cc:359] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.283977 15426 raft_consensus.cc:385] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.284302 15426 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.285271 15426 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.287513 15426 ts_tablet_manager.cc:1434] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:51.288651 15426 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:51.287709 15917 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.292892 15228 raft_consensus.cc:2393] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:51.295050 15917 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.297324 15425 tablet_bootstrap.cc:654] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.300570 15894 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.300717 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:51.296375 15274 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:51.301930 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:51.302556 15303 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.313336 15426 tablet_bootstrap.cc:654] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.314823 15845 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.329362 15375 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:51.333310 15198 leader_election.cc:343] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.357110 15904 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.357679 15904 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.359495 15426 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:51.360147 15426 ts_tablet_manager.cc:1403] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.033s
I20260709 13:07:51.364893 15426 raft_consensus.cc:359] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.367228 15426 raft_consensus.cc:385] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.367612 15426 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.373198 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:51.360042 15904 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.374159 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:07:51.382114 15196 leader_election.cc:343] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:51.385824 15198 leader_election.cc:343] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.386431 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:07:51.388424 15917 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.382925 15426 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.398634 15426 ts_tablet_manager.cc:1434] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:07:51.408632 15426 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:51.392584 15303 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:07:51.412412 15873 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.415856 15196 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:07:51.417071 15917 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.417675 15917 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:51.419335 15894 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.419519 15917 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.437254 15425 tablet_bootstrap.cc:492] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:51.437916 15425 ts_tablet_manager.cc:1403] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.007s
I20260709 13:07:51.452946 15426 tablet_bootstrap.cc:654] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.454638 15425 raft_consensus.cc:359] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.459885 15425 raft_consensus.cc:385] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.460255 15425 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.468184 15425 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.472857 15742 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.473471 15742 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.473903 15425 ts_tablet_manager.cc:1434] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:07:51.475965 15425 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:51.476866 15742 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:51.478081 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:51.480401 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:51.481734 15303 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 1: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:07:51.487366 15345 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:51.488279 15845 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.494228 15426 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:51.494869 15426 ts_tablet_manager.cc:1403] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.003s
I20260709 13:07:51.498692 15426 raft_consensus.cc:359] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.499502 15426 raft_consensus.cc:385] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.499811 15426 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.484898 15130 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 0 to 1, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.508178 15426 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.515035 15425 tablet_bootstrap.cc:654] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.517910 15845 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.522939 15426 ts_tablet_manager.cc:1434] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 13:07:51.524250 15426 tablet_bootstrap.cc:492] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:51.561444 15426 tablet_bootstrap.cc:654] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.585147 15425 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:51.585987 15425 ts_tablet_manager.cc:1403] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.017s
I20260709 13:07:51.590067 15425 raft_consensus.cc:359] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.591194 15425 raft_consensus.cc:385] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.591589 15425 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.593909 15425 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.596805 15909 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.596803 15425 ts_tablet_manager.cc:1434] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:07:51.599896 15425 tablet_bootstrap.cc:492] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Bootstrap starting.
I20260709 13:07:51.608086 15425 tablet_bootstrap.cc:654] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.627076 15426 tablet_bootstrap.cc:492] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:51.627646 15426 ts_tablet_manager.cc:1403] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.006s
I20260709 13:07:51.631306 15426 raft_consensus.cc:359] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.632223 15426 raft_consensus.cc:385] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.632747 15426 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.633646 15426 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.634502 15425 tablet_bootstrap.cc:492] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: No bootstrap required, opened a new log
I20260709 13:07:51.635136 15425 ts_tablet_manager.cc:1403] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.010s
I20260709 13:07:51.636596 15426 ts_tablet_manager.cc:1434] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:07:51.638681 15425 raft_consensus.cc:359] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.639588 15425 raft_consensus.cc:385] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.639917 15425 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.640532 15426 tablet_bootstrap.cc:492] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Bootstrap starting.
I20260709 13:07:51.640760 15425 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.644972 15425 ts_tablet_manager.cc:1434] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:07:51.640552 15811 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:07:51.664824 15873 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.665472 15873 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.668763 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:51.669145 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:51.669656 15426 tablet_bootstrap.cc:654] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.672961 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:51.673905 15894 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.678326 15303 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.678581 15426 tablet_bootstrap.cc:492] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: No bootstrap required, opened a new log
I20260709 13:07:51.679315 15426 ts_tablet_manager.cc:1403] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.000s
I20260709 13:07:51.680744 15873 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.689381 15894 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.689608 15845 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.690014 15894 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.692160 15894 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.693039 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:51.694128 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:51.699222 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:07:51.701143 15894 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.705328 15426 raft_consensus.cc:359] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.706521 15426 raft_consensus.cc:385] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.706915 15426 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.708276 15426 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.710500 15301 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.711740 15426 ts_tablet_manager.cc:1434] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:07:51.746626 15847 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.798748 15829 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.799378 15829 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.802122 15829 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.802978 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:51.803683 15225 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:51.803767 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:51.804755 15376 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:51.806277 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:51.808365 15829 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.808687 15376 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.808792 15829 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.811187 15829 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.819082 15847 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.824568 15847 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.844466 15829 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.861271 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:51.861889 15225 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.865586 15829 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.873135 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:51.875612 15376 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.876773 15225 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:51.878278 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:51.880306 15829 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.881654 15829 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:51.882521 15829 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.889055 15829 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.889652 15829 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.890466 15376 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:51.892130 15829 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.893247 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:51.894061 15225 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:51.894816 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:51.895401 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:51.895711 15376 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 0.
I20260709 13:07:51.901368 15894 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.901830 15894 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.902246 15894 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.899997 15130 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.923005 15894 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:51.925963 15894 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:51.927755 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:51.928498 15376 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.930241 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:07:51.930935 15225 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.936545 15376 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:51.937960 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:07:51.938944 15829 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.939301 15225 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:07:51.939479 15829 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:07:51.940652 15829 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:52.035068 15847 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.037487 15847 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:52.101071 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:07:52.109171 15847 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:52.111285 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:52.115916 15381 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:07:52.118516 15198 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:07:52.122254 15811 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:52.122934 15811 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.123458 15811 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:52.138477 15748 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:07:52.139688 15748 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:52.148828 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:07:52.151743 15375 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:07:52.143149 15748 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:52.157083 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:07:52.188162 15811 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:52.193112 15228 raft_consensus.cc:2368] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:07:52.198235 15274 leader_election.cc:400] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:07:52.198688 15274 leader_election.cc:403] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.204576 15748 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:52.207877 15811 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:52.209183 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:07:52.214497 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:07:52.215620 15375 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:52.242252 15179 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:52.243270 15748 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:07:52.244799 15375 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:07:52.243575 15130 catalog_manager.cc:5697] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 0 to 1, leader changed from <none> to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.253516 15304 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:07:52.259685 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:07:52.262965 15811 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:52.266112 15811 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:07:52.267398 15811 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:07:52.275082 15748 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.308876 15748 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.327814 15748 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.355253 15748 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.349689 15130 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.822999 15304 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:52.824765 15811 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.839612 15376 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:52.841689 15958 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.801589 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:53.835491 15965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:53.835705 15963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:53.841095 15962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.868033 14097 server_base.cc:1061] running on GCE node
I20260709 13:07:53.871217 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:53.871613 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:53.871860 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602473871834 us; error 0 us; skew 500 ppm
I20260709 13:07:53.872784 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:53.877954 14097 webserver.cc:533] Webserver started at http://127.13.196.68:44731/ using document root <none> and password file <none>
I20260709 13:07:53.878847 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:53.879187 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:53.879722 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:53.882027 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-3-root/instance:
uuid: "5c70ddb5aae14b059dc90fd40125b034"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ftjc"
I20260709 13:07:53.895325 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.012s	user 0.003s	sys 0.008s
I20260709 13:07:53.905419 15970 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.906461 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:07:53.906836 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-3-root
uuid: "5c70ddb5aae14b059dc90fd40125b034"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ftjc"
I20260709 13:07:53.907217 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:53.965967 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:53.968325 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:53.974408 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:53.983078 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:53.983971 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:07:53.984491 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:53.984836 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:54.055265 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.68:44351
I20260709 13:07:54.055635 16032 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.68:44351 every 8 connection(s)
I20260709 13:07:54.069092 14097 auto_leader_rebalancer-test.cc:384] add a tserver: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:54.100481 16033 heartbeater.cc:344] Connected to a master server at 127.13.196.126:35597
I20260709 13:07:54.101029 16033 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:54.101899 16033 heartbeater.cc:507] Master 127.13.196.126:35597 requested a full tablet report, sending...
I20260709 13:07:54.104503 15130 ts_manager.cc:194] Registered new tserver with Master: 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:07:54.106207 15130 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35768
I20260709 13:07:54.413713 15228 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:54.426203 15375 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.428082 15301 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.428215 15949 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:54.430763 15961 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:54.458536 15961 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.463516 15305 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.484679 15380 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:07:54.507205 15199 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bf87f25409d4351a79d5be897b18ddb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.518956 15130 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.548422 15376 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:54.563271 15305 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.566172 15232 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.567457 15956 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:54.569161 15739 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:54.588749 15348 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb30c1248aaf4663a734d0eb93201e7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.591815 15956 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.597929 15305 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.600600 15232 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.617991 15376 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:54.628254 15128 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:54.632200 15348 consensus_peers.cc:597] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e7b07c0f0a5432f94b6b20964332362. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.634177 15304 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.636591 15232 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.639905 15739 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:54.644745 15742 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:54.668546 15956 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.680935 15301 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.751320 15225 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.765175 15130 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.788188 15232 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:07:54.814177 15199 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bec569d5083b416380cac661b1b44368. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.817581 15304 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.817698 15376 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:54.819931 15961 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:54.822223 16046 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:54.849226 16045 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.856794 15376 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.858496 15305 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.890868 15131 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:54.960433 16067 ts_tablet_manager.cc:933] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:07:54.964602 16067 tablet_copy_client.cc:323] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:07:54.982780 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 6bf87f25409d4351a79d5be897b18ddb from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:07:54.983714 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 6bf87f25409d4351a79d5be897b18ddb from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-6bf87f25409d4351a79d5be897b18ddb
I20260709 13:07:55.008069 15243 tablet_copy_source_session.cc:215] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:55.022619 16067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf87f25409d4351a79d5be897b18ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:55.030809 16071 ts_tablet_manager.cc:933] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:55.043962 16071 tablet_copy_client.cc:323] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:07:55.049443 16067 tablet_copy_client.cc:806] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:55.052266 16067 tablet_copy_client.cc:670] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:55.077309 15392 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet 2e7b07c0f0a5432f94b6b20964332362 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:07:55.078325 15392 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet 2e7b07c0f0a5432f94b6b20964332362 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-2e7b07c0f0a5432f94b6b20964332362
I20260709 13:07:55.091454 15392 tablet_copy_source_session.cc:215] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:55.093891 16067 tablet_copy_client.cc:538] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:55.104586 16071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7b07c0f0a5432f94b6b20964332362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:55.106191 16067 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:07:55.109607 16033 heartbeater.cc:499] Master 127.13.196.126:35597 was elected leader, sending a full tablet report...
I20260709 13:07:55.135671 16071 tablet_copy_client.cc:806] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:55.136444 16071 tablet_copy_client.cc:670] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:55.143304 16067 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:55.144788 16067 tablet_bootstrap.cc:492] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:07:55.145637 16067 ts_tablet_manager.cc:1403] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.013s
I20260709 13:07:55.145782 16071 tablet_copy_client.cc:538] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:55.149470 16067 raft_consensus.cc:359] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.150584 16067 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:07:55.151324 16067 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.170882 16071 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:07:55.178345 16067 ts_tablet_manager.cc:1434] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.032s	user 0.018s	sys 0.006s
I20260709 13:07:55.186621 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-6bf87f25409d4351a79d5be897b18ddb received from {username='slave'} at 127.0.0.1:46420
I20260709 13:07:55.187441 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-6bf87f25409d4351a79d5be897b18ddb on tablet 6bf87f25409d4351a79d5be897b18ddb with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:55.192723 16076 ts_tablet_manager.cc:933] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:55.207872 16076 tablet_copy_client.cc:323] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:07:55.210487 15392 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet bb30c1248aaf4663a734d0eb93201e7b from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:07:55.211138 15392 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet bb30c1248aaf4663a734d0eb93201e7b from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-bb30c1248aaf4663a734d0eb93201e7b
I20260709 13:07:55.230938 15392 tablet_copy_source_session.cc:215] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:55.235827 16076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb30c1248aaf4663a734d0eb93201e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:55.238183 16071 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:55.240002 16071 tablet_bootstrap.cc:492] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:07:55.243942 16071 ts_tablet_manager.cc:1403] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.008s
I20260709 13:07:55.248948 16071 raft_consensus.cc:359] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.249795 16071 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:07:55.250447 16071 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.253013 16071 ts_tablet_manager.cc:1434] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:55.255268 15392 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-2e7b07c0f0a5432f94b6b20964332362 received from {username='slave'} at 127.0.0.1:52412
I20260709 13:07:55.255817 15392 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-2e7b07c0f0a5432f94b6b20964332362 on tablet 2e7b07c0f0a5432f94b6b20964332362 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:55.272295 16076 tablet_copy_client.cc:806] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:55.273073 16076 tablet_copy_client.cc:670] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:55.279080 16076 tablet_copy_client.cc:538] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:55.284525 16071 ts_tablet_manager.cc:933] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:07:55.286641 16071 tablet_copy_client.cc:323] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:07:55.288578 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet bec569d5083b416380cac661b1b44368 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:07:55.289134 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet bec569d5083b416380cac661b1b44368 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-bec569d5083b416380cac661b1b44368
I20260709 13:07:55.291647 16076 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:07:55.305414 15243 tablet_copy_source_session.cc:215] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:55.310117 16071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec569d5083b416380cac661b1b44368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:55.335350 16071 tablet_copy_client.cc:806] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:55.336239 16071 tablet_copy_client.cc:670] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:55.343189 16071 tablet_copy_client.cc:538] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:55.346525 16076 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:55.347716 16076 tablet_bootstrap.cc:492] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:07:55.348533 16076 ts_tablet_manager.cc:1403] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.018s
I20260709 13:07:55.352234 16076 raft_consensus.cc:359] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.353466 16076 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:07:55.354278 16076 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.359746 16071 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:07:55.365289 16076 ts_tablet_manager.cc:1434] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 13:07:55.373875 15392 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-bb30c1248aaf4663a734d0eb93201e7b received from {username='slave'} at 127.0.0.1:52412
I20260709 13:07:55.374436 15392 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-bb30c1248aaf4663a734d0eb93201e7b on tablet bb30c1248aaf4663a734d0eb93201e7b with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:55.437058 16071 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:55.438259 16071 tablet_bootstrap.cc:492] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:07:55.439049 16071 ts_tablet_manager.cc:1403] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.080s	user 0.043s	sys 0.022s
I20260709 13:07:55.442945 16071 raft_consensus.cc:359] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.443895 16071 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:07:55.444594 16071 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:55.447703 16008 raft_consensus.cc:1217] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:55.454340 16071 ts_tablet_manager.cc:1434] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:07:55.459648 16008 raft_consensus.cc:1217] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:55.463703 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-bec569d5083b416380cac661b1b44368 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:07:55.464381 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-bec569d5083b416380cac661b1b44368 on tablet bec569d5083b416380cac661b1b44368 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:55.618578 16008 raft_consensus.cc:1217] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:07:56.241472 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 434883us
I20260709 13:07:56.363256 16007 raft_consensus.cc:1217] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:56.455070 16088 raft_consensus.cc:1064] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:07:56.457787 16059 raft_consensus.cc:1064] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
W20260709 13:07:56.520684 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 154147us
W20260709 13:07:56.528101 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 107441us
W20260709 13:07:56.561355 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 168833us
I20260709 13:07:56.607503 16059 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:07:56.619940 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 123537us
W20260709 13:07:56.624708 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 48354.8us
I20260709 13:07:56.650765 16104 raft_consensus.cc:1064] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:07:56.657948 16104 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:07:56.717739 16088 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:07:56.741088 16007 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:56.744719 16059 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:56.748809 15225 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:56.762029 16008 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:56.763454 15375 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:56.764389 16101 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:56.766222 15307 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:56.769763 16101 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:56.772326 16089 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:56.781461 16006 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:56.784828 16090 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:56.882366 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 98781.8us
W20260709 13:07:56.886538 16113 log.cc:927] Time spent T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.104s	user 0.008s	sys 0.006s
W20260709 13:07:56.904999 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.923130 16101 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:56.941021 16061 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:56.953095 15232 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:07:56.959507 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75395.8us
I20260709 13:07:56.984884 15375 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:56.990320 16109 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.013382 16092 raft_consensus.cc:1064] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:07:57.016780 16092 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:07:57.051324 15299 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.053580 15130 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.075114 16008 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.093293 15303 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.100973 15307 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.146780 16108 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.150992 16007 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.153266 16088 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.155112 15299 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.157200 16107 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.166254 15374 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.168704 16088 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.173074 16108 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.182165 16061 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.194151 15299 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.192929 16092 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:07:57.212095 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002db060 after lost signal to thread 14100
W20260709 13:07:57.213511 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002db740 after lost signal to thread 15165
W20260709 13:07:57.215123 16029 debug-util.cc:398] Leaking SignalData structure 0x7b080021fbc0 after lost signal to thread 15257
W20260709 13:07:57.216789 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002584c0 after lost signal to thread 15332
W20260709 13:07:57.218376 16029 debug-util.cc:398] Leaking SignalData structure 0x7b0800289540 after lost signal to thread 15406
W20260709 13:07:57.220088 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9a40 after lost signal to thread 16032
I20260709 13:07:57.211098 16007 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.239828 15226 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.242612 16008 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.259276 15374 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.277189 16085 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.284871 15232 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.355072 15228 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:07:57.361181 15131 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.365307 16007 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.365569 15300 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.368187 16097 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:57.371145 16088 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:57.375559 16008 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.383471 16097 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.393965 15304 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.397356 15130 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.399302 15130 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.403004 16007 raft_consensus.cc:2955] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:07:57.427568 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 123554us
I20260709 13:07:57.429702 15228 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:07:57.452854 16006 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.454995 16088 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:57.452857 15375 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.459195 16107 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:57.463474 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bf87f25409d4351a79d5be897b18ddb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:57.478204 16005 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.474025 16097 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.505990 15130 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.522295 15306 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.533802 15299 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.538640 15376 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:07:57.557358 15374 raft_consensus.cc:2955] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.566296 15228 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.569989 16085 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:07:57.596462 16008 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.616022 15364 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bf87f25409d4351a79d5be897b18ddb with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54632
I20260709 13:07:57.618363 15375 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:07:57.624577 16109 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:57.628305 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bec569d5083b416380cac661b1b44368 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:57.625101 15130 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.637990 16099 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.638505 16007 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.641242 16005 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.642876 15956 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:57.641986 15226 raft_consensus.cc:2955] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.655135 16061 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.663022 16008 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.669718 16134 tablet_replica.cc:333] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:07:57.670882 15300 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.671231 16134 raft_consensus.cc:2243] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.682885 15956 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:57.698285 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e7b07c0f0a5432f94b6b20964332362 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:57.699640 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb30c1248aaf4663a734d0eb93201e7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:57.724231 15128 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.672257 16134 raft_consensus.cc:2272] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.736671 15129 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.743003 15291 tablet_service.cc:1558] Processing DeleteTablet for tablet bec569d5083b416380cac661b1b44368 with delete_type TABLET_DATA_TOMBSTONED (TS 841138f50ace4746978e72d7f13878de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50758
I20260709 13:07:57.746726 16134 ts_tablet_manager.cc:1916] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:57.751936 15215 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e7b07c0f0a5432f94b6b20964332362 with delete_type TABLET_DATA_TOMBSTONED (TS b0f9eceec749442cb9a06c87f00f3caf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47386
I20260709 13:07:57.760332 15297 tablet_service.cc:1558] Processing DeleteTablet for tablet bb30c1248aaf4663a734d0eb93201e7b with delete_type TABLET_DATA_TOMBSTONED (TS 841138f50ace4746978e72d7f13878de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50758
I20260709 13:07:57.751237 15303 raft_consensus.cc:2955] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:07:57.842378 16135 tablet_replica.cc:333] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:07:57.845786 16135 raft_consensus.cc:2243] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.844007 16136 tablet_replica.cc:333] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:07:57.846750 16135 raft_consensus.cc:2272] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.853765 16134 ts_tablet_manager.cc:1929] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:57.854317 16134 log.cc:1199] T 6bf87f25409d4351a79d5be897b18ddb P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/6bf87f25409d4351a79d5be897b18ddb
I20260709 13:07:57.854635 16136 raft_consensus.cc:2243] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.856491 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 6bf87f25409d4351a79d5be897b18ddb (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:07:57.858532 16135 ts_tablet_manager.cc:1916] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:57.861462 16136 raft_consensus.cc:2272] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.866637 16136 ts_tablet_manager.cc:1916] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:57.886197 16135 ts_tablet_manager.cc:1929] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:57.886797 16135 log.cc:1199] T bec569d5083b416380cac661b1b44368 P 841138f50ace4746978e72d7f13878de: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/wals/bec569d5083b416380cac661b1b44368
I20260709 13:07:57.888954 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet bec569d5083b416380cac661b1b44368 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:07:57.889371 16135 tablet_replica.cc:333] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:07:57.890748 16135 raft_consensus.cc:2243] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.891635 16135 raft_consensus.cc:2272] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.899186 16135 ts_tablet_manager.cc:1916] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:57.906805 16136 ts_tablet_manager.cc:1929] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:57.907497 16136 log.cc:1199] T 2e7b07c0f0a5432f94b6b20964332362 P b0f9eceec749442cb9a06c87f00f3caf: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/wals/2e7b07c0f0a5432f94b6b20964332362
I20260709 13:07:57.911906 15118 catalog_manager.cc:5028] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): tablet 2e7b07c0f0a5432f94b6b20964332362 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:07:57.929468 16135 ts_tablet_manager.cc:1929] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:57.930159 16135 log.cc:1199] T bb30c1248aaf4663a734d0eb93201e7b P 841138f50ace4746978e72d7f13878de: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/wals/bb30c1248aaf4663a734d0eb93201e7b
I20260709 13:07:57.932121 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet bb30c1248aaf4663a734d0eb93201e7b (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:07:58.906574 15232 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:07:58.919394 15199 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 439569a190ca4e8fbb5f6ad2dce20957. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.925324 15374 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:58.927891 15299 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:58.928063 16140 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:58.930234 16097 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.945695 16107 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:58.952525 15376 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:58.986332 15128 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 3, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:58.992274 15303 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.081966 15303 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.094551 15374 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.096495 16122 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.140836 15232 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.160989 16122 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.172051 15376 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.187141 16037 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.215513 15228 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.208681 15232 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:07:59.225003 15274 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fd2d399eb3d45818234b2fb03159dbe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.230749 15129 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:07:59.260555 15199 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75432bd549b3481d83070979a305922b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.264300 15376 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.266608 15300 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.267846 16143 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.281374 16143 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.339649 16160 ts_tablet_manager.cc:933] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:07:59.341837 16107 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.348012 15300 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.346438 15376 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.369071 15375 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.376595 15127 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:07:59.436949 15348 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3f082f323814ed98886bca799e3d232. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.440217 15228 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.440320 15303 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.442117 16147 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.446332 16061 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.469457 16160 tablet_copy_client.cc:323] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:07:59.470332 16061 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.472440 15300 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.483976 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 439569a190ca4e8fbb5f6ad2dce20957 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:07:59.484787 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 439569a190ca4e8fbb5f6ad2dce20957 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-439569a190ca4e8fbb5f6ad2dce20957
I20260709 13:07:59.493640 15243 tablet_copy_source_session.cc:215] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.494051 15227 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.497253 16165 ts_tablet_manager.cc:933] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:07:59.498116 16160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 439569a190ca4e8fbb5f6ad2dce20957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.506201 16165 tablet_copy_client.cc:323] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.66:37121
I20260709 13:07:59.519944 15127 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:07:59.566138 15318 tablet_copy_service.cc:140] P 841138f50ace4746978e72d7f13878de: Received BeginTabletCopySession request for tablet 5fd2d399eb3d45818234b2fb03159dbe from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:49780)
I20260709 13:07:59.566834 15318 tablet_copy_service.cc:161] P 841138f50ace4746978e72d7f13878de: Beginning new tablet copy session on tablet 5fd2d399eb3d45818234b2fb03159dbe from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:49780: session id = 5c70ddb5aae14b059dc90fd40125b034-5fd2d399eb3d45818234b2fb03159dbe
I20260709 13:07:59.575980 15318 tablet_copy_source_session.cc:215] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.587631 16165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd2d399eb3d45818234b2fb03159dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.599049 16160 tablet_copy_client.cc:806] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.599825 16160 tablet_copy_client.cc:670] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.608805 16160 tablet_copy_client.cc:538] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.630321 16160 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:07:59.643314 16165 tablet_copy_client.cc:806] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.645093 16165 tablet_copy_client.cc:670] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.650050 16165 tablet_copy_client.cc:538] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.671419 16165 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:07:59.693531 16160 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:59.695119 16160 tablet_bootstrap.cc:492] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:07:59.696157 16160 ts_tablet_manager.cc:1403] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.066s	user 0.031s	sys 0.010s
I20260709 13:07:59.699726 16160 raft_consensus.cc:359] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.701426 16160 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:07:59.702255 16160 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.703354 16169 ts_tablet_manager.cc:933] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:07:59.717106 16169 tablet_copy_client.cc:323] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:07:59.724578 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 75432bd549b3481d83070979a305922b from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:07:59.725299 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 75432bd549b3481d83070979a305922b from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-75432bd549b3481d83070979a305922b
I20260709 13:07:59.744269 15243 tablet_copy_source_session.cc:215] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.752544 16165 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:59.755254 16160 ts_tablet_manager.cc:1434] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.008s
I20260709 13:07:59.758841 15242 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-439569a190ca4e8fbb5f6ad2dce20957 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:07:59.757107 16165 tablet_bootstrap.cc:492] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:07:59.760564 16165 ts_tablet_manager.cc:1403] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.089s	user 0.018s	sys 0.016s
I20260709 13:07:59.764215 16165 raft_consensus.cc:359] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.759356 15242 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-439569a190ca4e8fbb5f6ad2dce20957 on tablet 439569a190ca4e8fbb5f6ad2dce20957 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:59.768921 16165 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:07:59.769025 16169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75432bd549b3481d83070979a305922b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.772213 16165 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.775324 16165 ts_tablet_manager.cc:1434] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:07:59.777534 16007 raft_consensus.cc:1217] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:07:59.779407 15318 tablet_copy_service.cc:342] P 841138f50ace4746978e72d7f13878de: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-5fd2d399eb3d45818234b2fb03159dbe received from {username='slave'} at 127.0.0.1:49780
I20260709 13:07:59.779963 15318 tablet_copy_service.cc:434] P 841138f50ace4746978e72d7f13878de: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-5fd2d399eb3d45818234b2fb03159dbe on tablet 5fd2d399eb3d45818234b2fb03159dbe with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:59.804491 16169 tablet_copy_client.cc:806] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.805253 16169 tablet_copy_client.cc:670] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.810966 16169 tablet_copy_client.cc:538] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.827299 16169 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:07:59.863585 16169 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:59.873932 16165 ts_tablet_manager.cc:933] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:07:59.881487 16169 tablet_bootstrap.cc:492] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:07:59.882833 16165 tablet_copy_client.cc:323] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:07:59.885764 16169 ts_tablet_manager.cc:1403] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.017s
I20260709 13:07:59.886065 15392 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet d3f082f323814ed98886bca799e3d232 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:07:59.887844 15392 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet d3f082f323814ed98886bca799e3d232 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-d3f082f323814ed98886bca799e3d232
I20260709 13:07:59.907537 16169 raft_consensus.cc:359] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.909755 16169 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:07:59.910734 15392 tablet_copy_source_session.cc:215] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.910550 16169 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:07:59.914474 16165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f082f323814ed98886bca799e3d232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.915455 16169 ts_tablet_manager.cc:1434] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:07:59.917558 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-75432bd549b3481d83070979a305922b received from {username='slave'} at 127.0.0.1:46420
I20260709 13:07:59.918035 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-75432bd549b3481d83070979a305922b on tablet 75432bd549b3481d83070979a305922b with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:07:59.958374 16165 tablet_copy_client.cc:806] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.959220 16165 tablet_copy_client.cc:670] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.963965 16165 tablet_copy_client.cc:538] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.992455 16165 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:00.058429 16165 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:00.060360 16165 tablet_bootstrap.cc:492] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:00.061256 16165 ts_tablet_manager.cc:1403] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.069s	user 0.032s	sys 0.010s
I20260709 13:08:00.065574 16165 raft_consensus.cc:359] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:00.066505 16165 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:00.073586 16165 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:00.092370 16165 ts_tablet_manager.cc:1434] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.001s
I20260709 13:08:00.094728 15392 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-d3f082f323814ed98886bca799e3d232 received from {username='slave'} at 127.0.0.1:52412
I20260709 13:08:00.095283 15392 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-d3f082f323814ed98886bca799e3d232 on tablet d3f082f323814ed98886bca799e3d232 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:00.098412 16007 raft_consensus.cc:1217] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.111857 16007 raft_consensus.cc:1217] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.392753 16107 raft_consensus.cc:1064] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:00.395784 16107 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:00.422533 16007 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:00.425319 16178 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:00.466601 15300 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:00.467600 15377 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:00.468693 16143 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:00.469659 16097 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:00.500252 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46777.2us
I20260709 13:08:00.504130 16097 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.509380 16007 raft_consensus.cc:1217] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.524857 15300 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.545324 16007 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.546773 15373 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.608454 15128 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index 3 to 4, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.669921 15228 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:00.688115 16007 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:00.691202 15303 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:00.692402 16143 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:00.693929 16097 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:00.707515 16143 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.711529 16179 raft_consensus.cc:1064] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:00.714594 16179 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:00.716254 15303 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.720611 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 439569a190ca4e8fbb5f6ad2dce20957 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:00.730883 16097 raft_consensus.cc:1064] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:00.733306 16007 raft_consensus.cc:2955] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.735530 16097 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:00.744853 15377 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.747174 16179 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:00.753530 15227 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.755417 16008 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.761009 16177 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:00.763526 16177 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:00.816710 15131 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 4 to 5, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.823498 16037 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.833418 15364 tablet_service.cc:1558] Processing DeleteTablet for tablet 439569a190ca4e8fbb5f6ad2dce20957 with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54632
I20260709 13:08:00.846875 15375 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.887032 15131 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:00.930584 16193 tablet_replica.cc:333] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:08:00.946980 16005 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.948997 16107 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.959842 15377 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.961731 16178 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.034169 15303 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.036273 16097 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:01.057678 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57831.7us
I20260709 13:08:01.046087 16007 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.096804 16061 raft_consensus.cc:1064] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:01.099617 16061 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:01.108762 15300 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:01.116297 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56027.4us
I20260709 13:08:01.120837 16005 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.123148 16201 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:01.145020 16097 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.153323 15377 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.175623 15307 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.180491 15374 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.184619 15227 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.189597 16193 raft_consensus.cc:2243] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.191097 16006 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.197757 15303 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.199326 16193 raft_consensus.cc:2272] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.191365 15131 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.211375 16193 ts_tablet_manager.cc:1916] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.230831 15227 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.232895 16202 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:01.252982 16008 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:08:01.264398 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54254us
I20260709 13:08:01.267618 16061 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.272686 16199 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.279104 16179 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.286726 16061 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.314769 16179 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.314476 15227 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.321318 16008 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.327082 15381 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.333084 16193 ts_tablet_manager.cc:1929] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:08:01.333665 16193 log.cc:1199] T 439569a190ca4e8fbb5f6ad2dce20957 P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/439569a190ca4e8fbb5f6ad2dce20957
I20260709 13:08:01.335788 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 439569a190ca4e8fbb5f6ad2dce20957 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:01.334879 15131 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.354633 15115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5fd2d399eb3d45818234b2fb03159dbe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.359550 15303 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.371196 16007 raft_consensus.cc:2955] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.386456 15227 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:01.400674 16006 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.403656 16178 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.407112 15381 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.409021 16097 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.418533 16143 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.420782 15131 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.429191 15381 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.451129 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75432bd549b3481d83070979a305922b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.467295 15215 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd2d399eb3d45818234b2fb03159dbe with delete_type TABLET_DATA_TOMBSTONED (TS b0f9eceec749442cb9a06c87f00f3caf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47386
I20260709 13:08:01.459221 16007 raft_consensus.cc:2955] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.472307 15374 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:01.487967 16006 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.490023 16085 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.468940 15129 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.497495 15303 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.513178 16202 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.525960 16085 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.531710 16008 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.550761 15291 tablet_service.cc:1558] Processing DeleteTablet for tablet 75432bd549b3481d83070979a305922b with delete_type TABLET_DATA_TOMBSTONED (TS 841138f50ace4746978e72d7f13878de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50758
I20260709 13:08:01.560438 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3f082f323814ed98886bca799e3d232 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.576273 16209 tablet_replica.cc:333] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:08:01.589253 15129 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.612798 16207 tablet_replica.cc:333] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:08:01.614732 16209 raft_consensus.cc:2243] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.624680 16209 raft_consensus.cc:2272] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.617105 15303 raft_consensus.cc:2955] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:01.635640 16209 ts_tablet_manager.cc:1916] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.644381 15215 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f082f323814ed98886bca799e3d232 with delete_type TABLET_DATA_TOMBSTONED (TS b0f9eceec749442cb9a06c87f00f3caf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47386
I20260709 13:08:01.650537 16207 raft_consensus.cc:2243] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.651619 16207 raft_consensus.cc:2272] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.655620 16207 ts_tablet_manager.cc:1916] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.665235 16209 ts_tablet_manager.cc:1929] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.665885 16209 log.cc:1199] T 75432bd549b3481d83070979a305922b P 841138f50ace4746978e72d7f13878de: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/wals/75432bd549b3481d83070979a305922b
I20260709 13:08:01.667845 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet 75432bd549b3481d83070979a305922b (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:01.679021 16207 ts_tablet_manager.cc:1929] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.679822 16207 log.cc:1199] T 5fd2d399eb3d45818234b2fb03159dbe P b0f9eceec749442cb9a06c87f00f3caf: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/wals/5fd2d399eb3d45818234b2fb03159dbe
I20260709 13:08:01.682207 16207 tablet_replica.cc:333] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:08:01.682144 15118 catalog_manager.cc:5028] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): tablet 5fd2d399eb3d45818234b2fb03159dbe (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:01.683533 16207 raft_consensus.cc:2243] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.684279 16207 raft_consensus.cc:2272] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.688460 16207 ts_tablet_manager.cc:1916] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.708390 16207 ts_tablet_manager.cc:1929] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.709110 16207 log.cc:1199] T d3f082f323814ed98886bca799e3d232 P b0f9eceec749442cb9a06c87f00f3caf: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/wals/d3f082f323814ed98886bca799e3d232
I20260709 13:08:01.711251 15118 catalog_manager.cc:5028] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): tablet d3f082f323814ed98886bca799e3d232 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:02.925309 15227 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:02.937943 15374 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.937942 15300 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:02.938661 15199 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fbb0d4cfecd47d08011ea23dbbb5965. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.941228 16216 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:02.943733 16212 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:02.960511 16097 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:02.962663 15303 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:02.962484 15374 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:02.990445 15131 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.034560 15374 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:08:03.058557 15348 consensus_peers.cc:597] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88d57b3730d2404eb078514e05f127c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.066365 15227 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:03.066218 15303 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:03.068595 16219 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.070849 16210 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.112886 16085 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.117334 15307 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.154773 15374 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:03.152900 15227 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.157564 15128 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.243402 15307 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:03.247882 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 315a39052c3a4aa189e80239d6709f0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.249696 15225 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:03.251924 16210 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.254046 16085 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.279033 16210 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.283577 15232 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.292124 15307 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.328810 15131 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.330014 15303 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:03.358357 15374 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:03.358548 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20919a13dd564519b54dd5e3c0751736. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.360975 15232 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:03.362943 16179 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.368568 16196 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.383484 16179 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.395300 15381 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.432533 15131 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.435396 15232 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:03.554978 16236 ts_tablet_manager.cc:933] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:03.575415 16236 tablet_copy_client.cc:323] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:08:03.577382 16238 ts_tablet_manager.cc:933] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:03.579015 15392 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet 88d57b3730d2404eb078514e05f127c2 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:08:03.579876 15392 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet 88d57b3730d2404eb078514e05f127c2 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-88d57b3730d2404eb078514e05f127c2
I20260709 13:08:03.588809 16238 tablet_copy_client.cc:323] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:08:03.591831 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 3fbb0d4cfecd47d08011ea23dbbb5965 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:03.592479 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 3fbb0d4cfecd47d08011ea23dbbb5965 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-3fbb0d4cfecd47d08011ea23dbbb5965
I20260709 13:08:03.598860 15392 tablet_copy_source_session.cc:215] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.603448 16236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d57b3730d2404eb078514e05f127c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.617031 15243 tablet_copy_source_session.cc:215] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.627995 16238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fbb0d4cfecd47d08011ea23dbbb5965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.661882 16238 tablet_copy_client.cc:806] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.669727 16238 tablet_copy_client.cc:670] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.672112 16236 tablet_copy_client.cc:806] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.672796 16236 tablet_copy_client.cc:670] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.682770 16238 tablet_copy_client.cc:538] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.685304 16236 tablet_copy_client.cc:538] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.703266 16238 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:03.703644 16236 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:03.754271 16238 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.755684 16238 tablet_bootstrap.cc:492] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:03.757030 16238 ts_tablet_manager.cc:1403] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.020s
I20260709 13:08:03.761420 16238 raft_consensus.cc:359] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:03.762388 16238 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:03.763149 16238 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:03.780085 16238 ts_tablet_manager.cc:1434] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.005s
I20260709 13:08:03.796365 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-3fbb0d4cfecd47d08011ea23dbbb5965 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:03.796979 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-3fbb0d4cfecd47d08011ea23dbbb5965 on tablet 3fbb0d4cfecd47d08011ea23dbbb5965 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:03.845150 16236 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.846560 16236 tablet_bootstrap.cc:492] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:03.847433 16236 ts_tablet_manager.cc:1403] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.144s	user 0.033s	sys 0.000s
I20260709 13:08:03.851214 16236 raft_consensus.cc:359] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:03.852224 16236 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:03.852973 16236 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:03.860831 16236 ts_tablet_manager.cc:1434] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:08:03.866714 15392 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-88d57b3730d2404eb078514e05f127c2 received from {username='slave'} at 127.0.0.1:52412
I20260709 13:08:03.867247 15392 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-88d57b3730d2404eb078514e05f127c2 on tablet 88d57b3730d2404eb078514e05f127c2 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:03.890460 16236 ts_tablet_manager.cc:933] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:03.913563 16236 tablet_copy_client.cc:323] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:08:03.915761 15392 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet 315a39052c3a4aa189e80239d6709f0e from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:08:03.916522 15392 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet 315a39052c3a4aa189e80239d6709f0e from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-315a39052c3a4aa189e80239d6709f0e
W20260709 13:08:03.916729 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62757.4us
I20260709 13:08:03.936625 15392 tablet_copy_source_session.cc:215] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.938256 16238 ts_tablet_manager.cc:933] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:03.972474 16236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 315a39052c3a4aa189e80239d6709f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.973532 16238 tablet_copy_client.cc:323] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.66:37121
I20260709 13:08:03.977265 15318 tablet_copy_service.cc:140] P 841138f50ace4746978e72d7f13878de: Received BeginTabletCopySession request for tablet 20919a13dd564519b54dd5e3c0751736 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:49780)
I20260709 13:08:03.978091 15318 tablet_copy_service.cc:161] P 841138f50ace4746978e72d7f13878de: Beginning new tablet copy session on tablet 20919a13dd564519b54dd5e3c0751736 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:49780: session id = 5c70ddb5aae14b059dc90fd40125b034-20919a13dd564519b54dd5e3c0751736
I20260709 13:08:03.991313 15318 tablet_copy_source_session.cc:215] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:04.016956 16236 tablet_copy_client.cc:806] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:04.018302 16236 tablet_copy_client.cc:670] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:04.026849 16236 tablet_copy_client.cc:538] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:04.035346 16238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20919a13dd564519b54dd5e3c0751736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:04.051286 16008 raft_consensus.cc:1217] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:04.064888 16008 raft_consensus.cc:1217] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:04.080295 16236 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:04.151131 16236 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:04.152420 16236 tablet_bootstrap.cc:492] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:04.154518 16236 ts_tablet_manager.cc:1403] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.016s
I20260709 13:08:04.169322 16236 raft_consensus.cc:359] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:04.170526 16236 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:04.171391 16236 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:04.175889 16236 ts_tablet_manager.cc:1434] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:08:04.178368 15392 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-315a39052c3a4aa189e80239d6709f0e received from {username='slave'} at 127.0.0.1:52412
I20260709 13:08:04.178869 15392 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-315a39052c3a4aa189e80239d6709f0e on tablet 315a39052c3a4aa189e80239d6709f0e with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:04.198688 16238 tablet_copy_client.cc:806] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:04.199648 16238 tablet_copy_client.cc:670] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:04.207784 16238 tablet_copy_client.cc:538] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:04.219362 16238 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:04.265066 16238 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:04.266135 16238 tablet_bootstrap.cc:492] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:04.266868 16238 ts_tablet_manager.cc:1403] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.012s
I20260709 13:08:04.270179 16238 raft_consensus.cc:359] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:04.271246 16238 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:04.272037 16238 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:04.274914 16238 ts_tablet_manager.cc:1434] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:08:04.276800 15318 tablet_copy_service.cc:342] P 841138f50ace4746978e72d7f13878de: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-20919a13dd564519b54dd5e3c0751736 received from {username='slave'} at 127.0.0.1:49780
I20260709 13:08:04.277274 15318 tablet_copy_service.cc:434] P 841138f50ace4746978e72d7f13878de: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-20919a13dd564519b54dd5e3c0751736 on tablet 20919a13dd564519b54dd5e3c0751736 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:04.313874 16008 raft_consensus.cc:1217] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:04.350975 16008 raft_consensus.cc:1217] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:04.605434 16061 raft_consensus.cc:1064] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:04.607946 16061 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:04.619185 16243 raft_consensus.cc:1064] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:04.630080 16243 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:04.631867 15306 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.633529 16061 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.639250 16008 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.646334 15227 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.649940 16208 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.670337 16208 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:04.682322 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65728.7us
I20260709 13:08:04.708433 16008 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.710888 16251 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.713068 15374 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.718936 15307 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.720448 16251 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.728478 16097 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.731600 16208 raft_consensus.cc:1064] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:04.734251 16208 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:04.737592 16179 raft_consensus.cc:1064] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:04.739866 16179 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:04.756858 15307 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.758170 16208 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.760922 16006 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.763233 15232 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.773895 16208 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.778537 16208 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.832329 16005 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.834517 16208 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.839363 16196 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.838714 15227 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.845404 16085 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.847267 16251 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.851737 16004 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.865557 15227 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.866523 15129 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.883884 15307 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.900455 16008 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.912223 15306 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.918612 15381 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.932521 15307 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.946120 16007 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:04.955753 15227 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.959820 15374 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.960901 16179 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.962590 16265 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:08:05.010959 16265 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.012629 15127 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.015666 15374 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.016527 15232 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.014355 15127 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.043177 16004 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.065131 15232 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:05.072361 15303 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.078650 15128 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.080368 16005 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.087246 16243 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.088900 16097 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.105931 16245 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.112010 16005 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.112010 15303 raft_consensus.cc:2955] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.121131 15307 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:05.136574 16004 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.147565 15381 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:05.137532 15227 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.142808 15374 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:05.149317 16265 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.153004 16008 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.156855 16007 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.157226 16219 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.155891 15307 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.159009 16179 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.161342 16219 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.165529 16219 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.168020 15131 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.170704 16085 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.174045 16208 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.180932 15303 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.185715 16007 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.190687 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88d57b3730d2404eb078514e05f127c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.194536 16247 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:05.198761 15227 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.200994 15232 raft_consensus.cc:2955] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.201984 16008 raft_consensus.cc:2955] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.203171 15115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20919a13dd564519b54dd5e3c0751736 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.206316 16219 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.205977 16006 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.210474 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fbb0d4cfecd47d08011ea23dbbb5965 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.217455 15227 raft_consensus.cc:2955] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.223824 15127 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.229120 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 315a39052c3a4aa189e80239d6709f0e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.250769 15215 tablet_service.cc:1558] Processing DeleteTablet for tablet 88d57b3730d2404eb078514e05f127c2 with delete_type TABLET_DATA_TOMBSTONED (TS b0f9eceec749442cb9a06c87f00f3caf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47386
I20260709 13:08:05.250259 15128 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.253608 15128 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:05.262012 16275 tablet_replica.cc:333] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:08:05.263322 16275 raft_consensus.cc:2243] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.264088 16275 raft_consensus.cc:2272] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.268177 16275 ts_tablet_manager.cc:1916] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.273696 15291 tablet_service.cc:1558] Processing DeleteTablet for tablet 315a39052c3a4aa189e80239d6709f0e with delete_type TABLET_DATA_TOMBSTONED (TS 841138f50ace4746978e72d7f13878de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50758
I20260709 13:08:05.274601 15363 tablet_service.cc:1558] Processing DeleteTablet for tablet 20919a13dd564519b54dd5e3c0751736 with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54632
I20260709 13:08:05.276173 15364 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fbb0d4cfecd47d08011ea23dbbb5965 with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54632
I20260709 13:08:05.283030 16276 tablet_replica.cc:333] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:08:05.284297 16276 raft_consensus.cc:2243] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.285269 16276 raft_consensus.cc:2272] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.291335 16275 ts_tablet_manager.cc:1929] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.291971 16275 log.cc:1199] T 88d57b3730d2404eb078514e05f127c2 P b0f9eceec749442cb9a06c87f00f3caf: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/wals/88d57b3730d2404eb078514e05f127c2
I20260709 13:08:05.298390 16276 ts_tablet_manager.cc:1916] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.299342 16277 tablet_replica.cc:333] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:08:05.300221 16277 raft_consensus.cc:2243] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.294013 15118 catalog_manager.cc:5028] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): tablet 88d57b3730d2404eb078514e05f127c2 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:05.300969 16277 raft_consensus.cc:2272] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.303869 16277 ts_tablet_manager.cc:1916] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.315048 16276 ts_tablet_manager.cc:1929] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.315548 16276 log.cc:1199] T 315a39052c3a4aa189e80239d6709f0e P 841138f50ace4746978e72d7f13878de: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/wals/315a39052c3a4aa189e80239d6709f0e
I20260709 13:08:05.316978 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet 315a39052c3a4aa189e80239d6709f0e (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:05.321185 16277 ts_tablet_manager.cc:1929] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.321712 16277 log.cc:1199] T 20919a13dd564519b54dd5e3c0751736 P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/20919a13dd564519b54dd5e3c0751736
I20260709 13:08:05.323393 16277 tablet_replica.cc:333] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:08:05.323330 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 20919a13dd564519b54dd5e3c0751736 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:05.324153 16277 raft_consensus.cc:2243] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.324815 16277 raft_consensus.cc:2272] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.327280 16277 ts_tablet_manager.cc:1916] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.347769 16277 ts_tablet_manager.cc:1929] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.348181 16277 log.cc:1199] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/3fbb0d4cfecd47d08011ea23dbbb5965
I20260709 13:08:05.349766 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 3fbb0d4cfecd47d08011ea23dbbb5965 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:06.382400 15227 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:08:06.395265 15199 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fc5207f2ece48c7ba4d2a23b902610b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.396911 15307 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.398090 15374 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.403003 16243 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.412743 16245 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.439590 16278 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.442482 15307 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.444550 15381 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.465553 15131 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.478837 15303 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:08:06.504262 15274 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4dc28ca60664c41a529fde0dc6c28aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.507496 15227 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.508868 15381 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.511070 16247 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.512583 16265 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.554808 16265 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.558743 15381 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.563001 15227 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.578822 15303 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:06.593160 15129 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:06.601909 15274 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8218e039c251425fb97ad83094c709da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.602989 15225 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.604233 15381 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.604933 16265 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.609362 16265 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.663694 15225 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.660794 16265 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.668205 15381 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.687501 15306 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:06.687881 15127 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.724169 15225 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.724493 15381 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:06.724675 15274 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2de1580a2d944ae884df67f226c8b71d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.726559 16265 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.727605 16290 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.740916 16265 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.750913 15225 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.748487 15381 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.774298 15127 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:06.805895 16297 ts_tablet_manager.cc:933] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:06.822733 16297 tablet_copy_client.cc:323] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:08:06.825317 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 3fc5207f2ece48c7ba4d2a23b902610b from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:06.826054 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 3fc5207f2ece48c7ba4d2a23b902610b from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-3fc5207f2ece48c7ba4d2a23b902610b
I20260709 13:08:06.833250 15243 tablet_copy_source_session.cc:215] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.837787 16297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc5207f2ece48c7ba4d2a23b902610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.862543 16297 tablet_copy_client.cc:806] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.863445 16297 tablet_copy_client.cc:670] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.879994 16297 tablet_copy_client.cc:538] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.896117 16297 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:06.930995 16297 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.932502 16297 tablet_bootstrap.cc:492] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:06.933180 16297 ts_tablet_manager.cc:1403] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.018s
I20260709 13:08:06.935717 16297 raft_consensus.cc:359] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:06.936759 16297 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:06.937464 16297 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:06.941277 16297 ts_tablet_manager.cc:1434] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:08:06.947620 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-3fc5207f2ece48c7ba4d2a23b902610b received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:06.949083 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-3fc5207f2ece48c7ba4d2a23b902610b on tablet 3fc5207f2ece48c7ba4d2a23b902610b with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:07.117875 16297 ts_tablet_manager.cc:933] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:07.124670 16297 tablet_copy_client.cc:323] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.66:37121
I20260709 13:08:07.128579 15318 tablet_copy_service.cc:140] P 841138f50ace4746978e72d7f13878de: Received BeginTabletCopySession request for tablet c4dc28ca60664c41a529fde0dc6c28aa from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:49780)
I20260709 13:08:07.129220 15318 tablet_copy_service.cc:161] P 841138f50ace4746978e72d7f13878de: Beginning new tablet copy session on tablet c4dc28ca60664c41a529fde0dc6c28aa from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:49780: session id = 5c70ddb5aae14b059dc90fd40125b034-c4dc28ca60664c41a529fde0dc6c28aa
I20260709 13:08:07.138120 15318 tablet_copy_source_session.cc:215] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:07.141789 16297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4dc28ca60664c41a529fde0dc6c28aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:07.161538 16303 ts_tablet_manager.cc:933] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:07.162259 16297 tablet_copy_client.cc:806] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:07.165169 16297 tablet_copy_client.cc:670] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:07.168298 16303 tablet_copy_client.cc:323] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.66:37121
I20260709 13:08:07.172235 15317 tablet_copy_service.cc:140] P 841138f50ace4746978e72d7f13878de: Received BeginTabletCopySession request for tablet 8218e039c251425fb97ad83094c709da from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:49780)
I20260709 13:08:07.172946 15317 tablet_copy_service.cc:161] P 841138f50ace4746978e72d7f13878de: Beginning new tablet copy session on tablet 8218e039c251425fb97ad83094c709da from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:49780: session id = 5c70ddb5aae14b059dc90fd40125b034-8218e039c251425fb97ad83094c709da
I20260709 13:08:07.188429 16297 tablet_copy_client.cc:538] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:07.202864 15317 tablet_copy_source_session.cc:215] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:07.205217 16297 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:07.213828 16303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8218e039c251425fb97ad83094c709da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:07.247414 16303 tablet_copy_client.cc:806] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:07.248481 16303 tablet_copy_client.cc:670] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:07.259258 16303 tablet_copy_client.cc:538] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:07.267275 16297 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:07.276589 16297 tablet_bootstrap.cc:492] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:07.279654 16297 ts_tablet_manager.cc:1403] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.007s
I20260709 13:08:07.272253 16303 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:07.319036 16297 raft_consensus.cc:359] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:07.320525 16297 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:07.321323 16297 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:07.323967 16297 ts_tablet_manager.cc:1434] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.003s
I20260709 13:08:07.340400 15317 tablet_copy_service.cc:342] P 841138f50ace4746978e72d7f13878de: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-c4dc28ca60664c41a529fde0dc6c28aa received from {username='slave'} at 127.0.0.1:49780
I20260709 13:08:07.341006 15317 tablet_copy_service.cc:434] P 841138f50ace4746978e72d7f13878de: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-c4dc28ca60664c41a529fde0dc6c28aa on tablet c4dc28ca60664c41a529fde0dc6c28aa with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:07.344301 16006 raft_consensus.cc:1217] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.345149 16303 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:07.346185 16303 tablet_bootstrap.cc:492] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:07.349668 16297 ts_tablet_manager.cc:933] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:07.368742 16303 ts_tablet_manager.cc:1403] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.097s	user 0.026s	sys 0.007s
I20260709 13:08:07.373458 16303 raft_consensus.cc:359] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:07.374595 16303 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:07.375453 16303 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:07.377530 16297 tablet_copy_client.cc:323] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.66:37121
I20260709 13:08:07.378342 16303 ts_tablet_manager.cc:1434] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:08:07.381561 15317 tablet_copy_service.cc:140] P 841138f50ace4746978e72d7f13878de: Received BeginTabletCopySession request for tablet 2de1580a2d944ae884df67f226c8b71d from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:49780)
I20260709 13:08:07.382189 15317 tablet_copy_service.cc:161] P 841138f50ace4746978e72d7f13878de: Beginning new tablet copy session on tablet 2de1580a2d944ae884df67f226c8b71d from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:49780: session id = 5c70ddb5aae14b059dc90fd40125b034-2de1580a2d944ae884df67f226c8b71d
I20260709 13:08:07.384578 15318 tablet_copy_service.cc:342] P 841138f50ace4746978e72d7f13878de: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-8218e039c251425fb97ad83094c709da received from {username='slave'} at 127.0.0.1:49780
I20260709 13:08:07.385195 15318 tablet_copy_service.cc:434] P 841138f50ace4746978e72d7f13878de: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-8218e039c251425fb97ad83094c709da on tablet 8218e039c251425fb97ad83094c709da with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:07.398595 15317 tablet_copy_source_session.cc:215] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:07.406366 16297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de1580a2d944ae884df67f226c8b71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:07.429059 16297 tablet_copy_client.cc:806] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:07.429726 16297 tablet_copy_client.cc:670] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:07.434252 16297 tablet_copy_client.cc:538] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:07.446211 16297 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:07.509068 16297 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:07.510159 16297 tablet_bootstrap.cc:492] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:07.510921 16297 ts_tablet_manager.cc:1403] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.031s
I20260709 13:08:07.514066 16297 raft_consensus.cc:359] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:07.514998 16297 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:07.515718 16297 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:07.518065 16297 ts_tablet_manager.cc:1434] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:07.524199 15317 tablet_copy_service.cc:342] P 841138f50ace4746978e72d7f13878de: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-2de1580a2d944ae884df67f226c8b71d received from {username='slave'} at 127.0.0.1:49780
I20260709 13:08:07.524902 15317 tablet_copy_service.cc:434] P 841138f50ace4746978e72d7f13878de: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-2de1580a2d944ae884df67f226c8b71d on tablet 2de1580a2d944ae884df67f226c8b71d with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:07.550664 16008 raft_consensus.cc:1217] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.583022 16008 raft_consensus.cc:1217] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.893654 16008 raft_consensus.cc:1217] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.949098 16310 raft_consensus.cc:1064] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:07.952680 16310 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:07.964712 16008 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.968933 16245 raft_consensus.cc:1064] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:07.972054 15227 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.972362 16245 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:07.973155 16312 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.976522 15374 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.979095 16265 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.980587 16310 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.002388 16312 raft_consensus.cc:1064] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:08.006429 16312 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:08.012095 16006 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.014400 16243 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.016609 16265 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.025592 15374 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.029980 15307 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.036264 15374 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.027978 16245 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:08:08.041466 16278 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.043342 16310 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.067076 15227 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.066148 16008 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.073216 15225 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:08:08.136888 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52648.5us
I20260709 13:08:08.139048 15377 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.105039 16006 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.160233 15129 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.099192 16320 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:08:08.194177 16265 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:08.204303 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47819.1us
W20260709 13:08:08.217268 16324 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:08:08.236605 16243 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.239876 15374 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:08:08.289445 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48258.9us
I20260709 13:08:08.295771 16007 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.296783 16328 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.307797 15227 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.328186 15306 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.333475 16326 raft_consensus.cc:1064] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:08.337248 16326 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:08.340530 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 84194.9us
I20260709 13:08:08.342595 15374 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.338418 16008 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.356297 16007 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.359210 16327 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.360965 15377 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.360520 15233 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.365053 16327 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.373174 16327 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.402387 16326 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.415084 16007 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.424618 15374 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.449997 15233 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.452118 15306 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:08.465929 15128 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.467644 16007 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.472759 16311 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.468029 15128 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.483033 15128 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.470724 15374 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.493497 16311 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.495563 16007 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.498950 16312 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.504202 15377 raft_consensus.cc:2955] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.526614 15130 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.540550 15306 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:08.545086 15215 tablet_service.cc:1558] Processing DeleteTablet for tablet 8218e039c251425fb97ad83094c709da with delete_type TABLET_DATA_TOMBSTONED (TS b0f9eceec749442cb9a06c87f00f3caf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47386
I20260709 13:08:08.553975 15233 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.553975 16007 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.555989 16328 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.571871 16311 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.573117 15233 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:08.573901 16196 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.578068 16342 tablet_replica.cc:333] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:08:08.578959 15115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8218e039c251425fb97ad83094c709da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:08.582858 16007 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.583524 15377 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.585390 16243 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.587518 16243 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.578486 15306 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:08.607472 16342 raft_consensus.cc:2243] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.608203 15115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4dc28ca60664c41a529fde0dc6c28aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:08.608551 16342 raft_consensus.cc:2272] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.611438 15233 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.616725 15227 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.616935 16004 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.618335 16332 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.621505 16342 ts_tablet_manager.cc:1916] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:08.619099 16007 raft_consensus.cc:2955] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.634933 15374 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.655889 16327 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.659473 16196 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.673372 16008 raft_consensus.cc:2955] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.667259 15131 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.729533 16342 ts_tablet_manager.cc:1929] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:08.730324 16342 log.cc:1199] T 8218e039c251425fb97ad83094c709da P b0f9eceec749442cb9a06c87f00f3caf: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/wals/8218e039c251425fb97ad83094c709da
I20260709 13:08:08.729763 15129 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.732549 15118 catalog_manager.cc:5028] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): tablet 8218e039c251425fb97ad83094c709da (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:08.729733 16312 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.740235 16007 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.767493 15291 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fc5207f2ece48c7ba4d2a23b902610b with delete_type TABLET_DATA_TOMBSTONED (TS 841138f50ace4746978e72d7f13878de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50758
I20260709 13:08:08.795689 15115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2de1580a2d944ae884df67f226c8b71d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:08.800136 15363 tablet_service.cc:1558] Processing DeleteTablet for tablet c4dc28ca60664c41a529fde0dc6c28aa with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54632
I20260709 13:08:08.807590 16346 tablet_replica.cc:333] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:08:08.811228 15225 raft_consensus.cc:2955] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.817106 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fc5207f2ece48c7ba4d2a23b902610b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:08.826835 15127 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 4, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 1 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:08.854713 15363 tablet_service.cc:1558] Processing DeleteTablet for tablet 2de1580a2d944ae884df67f226c8b71d with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54632
I20260709 13:08:08.896044 16345 tablet_replica.cc:333] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:08:08.906262 16346 raft_consensus.cc:2243] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.907291 16346 raft_consensus.cc:2272] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.911132 16345 raft_consensus.cc:2243] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.912101 16345 raft_consensus.cc:2272] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.911131 16346 ts_tablet_manager.cc:1916] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:08.916752 16345 ts_tablet_manager.cc:1916] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:08.935194 16346 ts_tablet_manager.cc:1929] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:08.935784 16346 log.cc:1199] T c4dc28ca60664c41a529fde0dc6c28aa P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/c4dc28ca60664c41a529fde0dc6c28aa
I20260709 13:08:08.937794 16346 tablet_replica.cc:333] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:08:08.937894 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet c4dc28ca60664c41a529fde0dc6c28aa (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:08.938810 16346 raft_consensus.cc:2243] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.939664 16346 raft_consensus.cc:2272] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.943110 16346 ts_tablet_manager.cc:1916] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:08.943131 16345 ts_tablet_manager.cc:1929] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:08.943889 16345 log.cc:1199] T 3fc5207f2ece48c7ba4d2a23b902610b P 841138f50ace4746978e72d7f13878de: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/wals/3fc5207f2ece48c7ba4d2a23b902610b
I20260709 13:08:08.946769 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet 3fc5207f2ece48c7ba4d2a23b902610b (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:08.958961 16346 ts_tablet_manager.cc:1929] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:08.959513 16346 log.cc:1199] T 2de1580a2d944ae884df67f226c8b71d P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/2de1580a2d944ae884df67f226c8b71d
I20260709 13:08:08.961522 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 2de1580a2d944ae884df67f226c8b71d (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
W20260709 13:08:09.389112 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 109730us
I20260709 13:08:10.544715 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1093) took 1148 ms. Trace:
I20260709 13:08:10.551745 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1096) took 1154 ms. Trace:
I20260709 13:08:10.550894 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1094) took 1145 ms. Trace:
I20260709 13:08:10.540526 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1092) took 1144 ms. Trace:
I20260709 13:08:10.543701 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1095) took 1146 ms. Trace:
I20260709 13:08:10.546844 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1091) took 1151 ms. Trace:
I20260709 13:08:10.551985 15227 rpcz_store.cc:276] 0709 13:08:09.396389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.741862 (+345473us) service_pool.cc:224] Handling call
0709 13:08:10.543955 (+802093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.544197 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.544240 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.544298 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:10.544408 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.544485 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.544637 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.556746 15233 rpcz_store.cc:276] 0709 13:08:09.395603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.683149 (+287546us) service_pool.cc:224] Handling call
0709 13:08:10.546465 (+863316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.546608 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.546622 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.546647 (+    25us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:10.546665 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.546700 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.546793 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.552721 15228 rpcz_store.cc:276] 0709 13:08:09.396724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.743616 (+346892us) service_pool.cc:224] Handling call
0709 13:08:10.541618 (+798002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.541876 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.541914 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.541970 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:10.542013 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.542087 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.542390 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.552476 15226 rpcz_store.cc:276] 0709 13:08:09.397542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.783841 (+386299us) service_pool.cc:224] Handling call
0709 13:08:10.550775 (+766934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.551064 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.551106 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.551173 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:10.551220 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.551305 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.551504 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.556484 15225 rpcz_store.cc:276] 0709 13:08:09.396017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.773205 (+377188us) service_pool.cc:224] Handling call
0709 13:08:10.539967 (+766762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.540151 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.540168 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.540203 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:10.540222 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.540267 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.540448 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.559754 16332 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.563972 16332 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.567927 16332 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.568766 16332 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.569337 16332 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.556440 15232 rpcz_store.cc:276] 0709 13:08:09.397089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.769432 (+372343us) service_pool.cc:224] Handling call
0709 13:08:10.542867 (+773435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.543157 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.543244 (+    87us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.543309 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:10.543368 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.543450 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.543618 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.600800 16347 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.601498 16347 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.602659 16353 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.603293 16353 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.603792 16347 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.606375 16353 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:10.607540 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 987680us
I20260709 13:08:10.615626 16354 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.616575 16354 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.619746 16354 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.632215 16354 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.633153 16354 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.637583 16354 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.652034 16355 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.653787 16355 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.657112 16355 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.657665 16356 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.658586 16355 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.658339 16356 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.659277 16355 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.661231 16356 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.661350 16357 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.662139 16355 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.662279 16357 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.664911 16355 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.665014 16357 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.666163 16355 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.666694 16357 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.667546 16357 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.668556 16355 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.665499 16356 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.669842 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.670217 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.671669 16357 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:10.671793 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63464.8us
I20260709 13:08:10.671944 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.675268 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.670256 16356 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.682577 16356 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.684949 16353 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.686039 16353 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.691309 16353 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.695645 16353 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:10.696542 16353 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.712643 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.714659 16363 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.715435 16363 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.716612 16353 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.738467 16363 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.730190 16362 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.741021 16362 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.744287 16219 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.746820 16351 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.748457 16358 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.752513 16350 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.754630 16354 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.755138 16363 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.755251 16354 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.759990 16360 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.747723 16351 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.770881 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.771391 16332 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.771763 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.761207 16363 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.771147 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.756232 16353 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.773061 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.749929 16358 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.753141 16350 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.776715 16353 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.772663 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.774391 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.774549 16361 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.762140 16362 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:10.757954 16347 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.775074 16359 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.745412 16219 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.783205 16219 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.788815 16219 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.783092 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.794715 15378 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:10.796622 16219 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.782497 16362 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.804728 16365 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.764494 16360 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.797188 16363 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.807529 16363 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.807900 16367 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.808177 16363 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.810672 16363 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.811300 16363 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.812561 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.805256 16219 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:10.813500 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.782981 16359 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.814980 16219 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.817095 16219 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.783747 16361 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.818048 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.818286 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.819442 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.819871 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.784109 16347 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.818912 15232 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:10.823729 16358 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.824671 16351 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.805444 16362 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.826558 16353 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.803912 16350 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.827324 16347 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:10.811803 16363 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.828908 16362 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:10.829854 16359 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.832638 16363 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.830310 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.838519 16354 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.838970 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:10.843071 16219 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.844996 16360 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.815654 16365 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.809002 16367 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.843308 16358 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.849184 16365 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.849159 16367 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.849742 16358 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.854163 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.855250 16361 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.858323 16358 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.873521 15374 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:10.880241 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:10.882009 16360 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:10.882632 16360 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.883190 16360 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:10.885057 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66422.8us
I20260709 13:08:10.895121 16360 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:10.896390 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 1.22482e+06us
I20260709 13:08:10.897771 16360 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:10.896692 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:10.902747 16365 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:10.903527 16365 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.903946 16365 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.913348 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.914113 16361 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.914798 16361 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.915236 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.916020 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.916380 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.916924 15233 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:10.917973 16361 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.917932 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.918370 15229 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:10.919694 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.920714 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.916766 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.927731 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.928026 16361 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:10.931347 15224 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:10.933279 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.933399 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.934130 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.934764 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.935031 15381 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:10.935501 15377 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:10.936605 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.937368 16361 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.938030 16367 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.937970 16361 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.938779 16367 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.939857 16358 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.940661 16358 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:10.942143 16365 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.943279 16358 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.941324 16367 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.944818 16368 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:10.934209 15374 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:10.945569 16368 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:10.948570 16368 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.951050 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.951244 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.952906 16361 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.954246 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.955813 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:10.957250 15225 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:10.945315 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.958568 16365 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:10.959190 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.959794 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.960592 15378 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:10.960988 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.961938 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:10.962297 15381 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:10.962603 15374 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:10.965394 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:10.968043 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:10.969070 16365 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:11.101390 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.970521 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 1.3004e+06us
I20260709 13:08:11.143297 15225 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.145035 16352 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.145215 16328 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.116006 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:11.145860 16328 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.096393 16356 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.100538 16354 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.103842 16357 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.181427 16196 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:10.967588 16358 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.029776 16360 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.103971 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 818) took 1431 ms. Trace:
I20260709 13:08:11.182163 16196 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.142549 16327 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.145804 16352 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.194046 15225 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:11.172574 16355 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.192448 16196 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.142269 16365 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.189006 16354 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.197520 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:11.199373 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:11.200274 16008 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:11.133459 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.185506 16357 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.212093 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:11.212971 16005 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:11.213294 16354 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.213958 16357 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.220880 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:11.204087 16365 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.183429 16356 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.213968 16354 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.205884 16355 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.189047 15373 rpcz_store.cc:276] 0709 13:08:09.672719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.029909 (+1357190us) service_pool.cc:224] Handling call
0709 13:08:11.030374 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.030613 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.030663 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.062930 (+ 32267us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:11.063001 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.063131 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.103707 (+ 40576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.235880 16350 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.236259 16351 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.236629 16350 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.236929 16351 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.237383 16355 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.238014 16355 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.191402 16360 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.201579 16327 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.189306 16358 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.251088 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.227512 16367 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:11.224035 16357 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:11.231227 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 104212us
I20260709 13:08:11.268381 16328 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.272809 16350 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:11.272861 16352 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.238374 16355 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.281509 16351 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:11.282382 16358 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:11.286868 16196 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.293857 16196 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.288223 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.300776 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.251151 16354 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.278314 16367 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:11.294291 16355 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.307997 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.292171 16312 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:11.304972 16372 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:08:11.309796 16367 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.310506 16356 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.298240 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.310678 16196 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.276167 16357 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.339779 16373 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:11.340277 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48421.3us
I20260709 13:08:11.340438 16373 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.341391 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.342808 16358 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.343562 16358 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.343634 16373 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.312114 16327 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.344062 16358 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.317530 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.321105 16328 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.321959 16354 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.337212 16312 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.339057 16377 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.337920 16381 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.314206 16376 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.313606 16360 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.342248 16357 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.346321 15348 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:11.346961 16196 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.355468 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.354024 16369 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:11.346073 16328 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.345939 16379 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:11.355178 16196 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:11.361445 15348 consensus_peers.cc:597] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3005d9c450974fc299b5f0c0e92c745a. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:11.356645 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 102598us
I20260709 13:08:11.349507 16381 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.369035 16196 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.347368 15973 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:11.375950 16328 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.376716 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.376941 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.367453 16301 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.377799 16301 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.377947 16379 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.378309 16301 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.378458 16379 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.379022 16379 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.374048 16375 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.374861 16312 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.377091 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.349244 16327 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.356943 16377 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.358656 16373 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.363801 16368 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.390112 16196 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.390484 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.392391 16357 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.399158 15232 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:11.401846 16196 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.371927 16374 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.391269 16328 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.415800 16196 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.425238 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.405026 16357 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.431584 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.432385 15376 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:11.431824 16357 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.416756 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.442234 16196 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:11.403941 16368 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.449150 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.395727 16375 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.430953 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.451866 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.452692 15378 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:11.459089 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.404106 16373 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.454957 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:11.462659 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:11.460920 16378 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.403313 16327 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.443066 16356 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:08:11.464869 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55733.7us
I20260709 13:08:11.449301 16368 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.414027 16365 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.468452 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.361603 16376 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.453763 16312 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:11.471704 16371 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.446028 16328 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.468096 16360 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:11.456009 15299 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:11.478123 15300 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:11.492066 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.470088 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.485011 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.488421 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.463615 16378 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:11.496788 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.473026 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.452678 16374 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.567123 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.575892 15301 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:11.540169 15127 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 2 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.567122 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.537020 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:11.583225 15254 debug-util.cc:398] Leaking SignalData structure 0x7b0800115780 after lost signal to thread 14100
W20260709 13:08:11.584856 15254 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0860 after lost signal to thread 15165
W20260709 13:08:11.586627 15254 debug-util.cc:398] Leaking SignalData structure 0x7b08003403e0 after lost signal to thread 15257
W20260709 13:08:11.587877 15254 debug-util.cc:398] Leaking SignalData structure 0x7b0800322d00 after lost signal to thread 15332
I20260709 13:08:11.589351 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:11.477698 16312 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:11.596580 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.597950 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.598527 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.599152 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.588733 16385 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.529696 15224 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:11.530349 15373 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:11.605334 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.606060 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.492552 16360 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.499194 16371 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.609405 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:11.602733 16376 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.473160 16356 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.579021 16388 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:11.613068 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.615417 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:11.624612 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.564301 16383 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.630962 16328 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.624653 16327 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.626956 16366 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.614637 16385 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.596909 16301 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.639770 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.529846 16358 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.645274 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:11.633249 15254 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb980 after lost signal to thread 15406
I20260709 13:08:11.500885 16382 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.642769 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.670931 16374 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.627400 16378 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:11.673656 15301 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:11.529661 16355 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.616685 16360 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.660470 16368 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.621186 16379 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:11.677624 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 213156us
I20260709 13:08:11.681466 16394 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:11.710723 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.583300 16361 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:11.627729 16388 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.716610 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.690428 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.690735 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.626005 16365 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:11.694540 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:11.698954 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.694864 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.698884 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:11.701996 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 231487us
I20260709 13:08:11.706526 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.623288 16357 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.695888 16366 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.622022 16371 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.665048 16383 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.714354 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.714581 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.715480 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.715631 16381 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.719060 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.719486 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.720386 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.699443 16382 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:11.725318 15254 debug-util.cc:398] Leaking SignalData structure 0x7b0800328180 after lost signal to thread 16032
I20260709 13:08:11.725119 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.726475 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.725558 15131 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:11.627086 16312 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.745636 16358 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.746117 16312 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.746434 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.725035 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.748922 16373 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.749212 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:11.749388 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.738811 16390 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:11.721313 16375 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.744426 16355 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.743606 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.757431 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:11.758245 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.759406 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.739674 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.742465 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.760867 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:11.753302 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.754381 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:11.746327 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.736135 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.756734 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.756637 16385 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.761520 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.731998 16368 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.732542 16004 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:11.730585 16356 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:11.731261 16003 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:11.743489 15254 debug-util.cc:398] Leaking SignalData structure 0x7b0800337680 after lost signal to thread 16319
I20260709 13:08:11.762468 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.768954 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:11.769063 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.743191 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.783092 16332 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:11.783568 16332 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:11.783923 16332 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.749239 16377 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.774919 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.778230 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.779377 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.780611 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:11.726768 16394 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:11.779055 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.792763 15299 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
W20260709 13:08:11.779816 15254 debug-util.cc:398] Leaking SignalData structure 0x7b08003375e0 after lost signal to thread 16324
I20260709 13:08:11.743263 16383 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.796064 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.779095 16388 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.799059 16390 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:11.802289 16379 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.770387 16375 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:08:11.818809 16366 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.788517 16301 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.820812 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:11.797851 15254 debug-util.cc:398] Leaking SignalData structure 0x7b0800337860 after lost signal to thread 16336
W20260709 13:08:11.828022 15254 debug-util.cc:398] Leaking SignalData structure 0x7b0800337740 after lost signal to thread 16338
W20260709 13:08:11.830432 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67035.7us
I20260709 13:08:11.832988 15301 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.831157 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:11.839217 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.864295 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.865449 16379 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:11.867199 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:11.871423 16391 ts_tablet_manager.cc:933] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:11.873781 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.876024 16379 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:11.877694 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48488us
I20260709 13:08:11.879452 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.883001 16332 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.887923 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.888732 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.889147 16379 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:11.890560 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:11.890777 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:11.888875 16366 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:11.892460 16388 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:11.892918 16388 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:11.893858 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.895875 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.896646 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.900003 15307 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:11.901041 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.903138 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.897095 16388 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.914992 16394 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:11.902729 16373 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:11.916731 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:11.919370 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.918350 15224 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:11.926474 16357 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:11.928205 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.928725 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:11.931201 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:11.933375 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.934667 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:11.935664 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:11.936070 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:11.937005 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:11.937338 16008 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:11.943954 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:11.918638 16360 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:11.917371 16377 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:11.930704 16373 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:11.930493 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:11.982944 16388 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.998153 15233 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:11.965162 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.046056 15225 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:12.008630 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:11.964574 16371 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.064003 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:12.062222 16357 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:12.070680 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 302672us
I20260709 13:08:12.049947 16366 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:12.074544 15228 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.068737 16347 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:12.119117 15198 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:12.139302 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56962.2us
I20260709 13:08:12.128108 16005 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:12.139418 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 152049us
I20260709 13:08:12.132304 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:08:12.072758 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 150442us
I20260709 13:08:12.144646 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:12.146852 15381 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.118537 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.145732 16386 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.081239 16366 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:12.164079 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65522.2us
I20260709 13:08:12.152724 16332 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.175237 16353 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.175813 16353 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.142088 16347 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.176234 16353 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.157529 16382 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.158826 16397 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.185503 16397 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:12.168716 16357 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:12.179198 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 101278us
I20260709 13:08:12.187554 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.186118 16378 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:12.179280 16360 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.182611 15273 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.196455 16388 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.197074 16347 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.173830 16386 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:12.198278 16386 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.190732 16332 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:08:12.201395 16354 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.201893 16354 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:12.202920 16354 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.183554 16391 tablet_copy_client.cc:323] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:08:12.205744 16371 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.186136 16397 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.199195 16347 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.211953 15308 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:12.162782 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.162794 16395 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.216s
I20260709 13:08:12.233680 15392 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet 3005d9c450974fc299b5f0c0e92c745a from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:08:12.234555 15392 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet 3005d9c450974fc299b5f0c0e92c745a from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-3005d9c450974fc299b5f0c0e92c745a
I20260709 13:08:12.235877 16395 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.236443 16395 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:12.200259 16386 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.245489 16357 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:12.249529 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93810.3us
I20260709 13:08:12.246902 16366 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:12.289388 15230 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.252590 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:12.299091 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.301304 15392 tablet_copy_source_session.cc:215] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.315353 16391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3005d9c450974fc299b5f0c0e92c745a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:12.316900 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65291.2us
I20260709 13:08:12.319386 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.320573 16379 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.321461 16379 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.325135 16389 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:12.325620 16389 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:12.326889 16389 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.331988 16389 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.252501 16395 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.340086 16395 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:12.365209 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 64221.6us
W20260709 13:08:12.367377 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.398468 16029 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 13:08:12.368696 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.402701 16379 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.403589 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.406996 16379 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.415505 16353 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.419989 16397 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.422060 16353 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.425920 16397 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:12.459929 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 295597us
W20260709 13:08:12.461335 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 304616us
W20260709 13:08:12.463516 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 275805us
I20260709 13:08:12.468282 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:12.472975 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 103952us
W20260709 13:08:12.476173 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 320833us
I20260709 13:08:12.420655 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:12.483753 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:12.485456 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65871.2us
I20260709 13:08:12.486114 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:12.486723 15380 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:12.487426 15374 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.487336 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.489356 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:12.489471 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:12.501912 16389 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:12.504508 16392 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:12.503681 16363 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.511548 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.516021 16357 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.517450 15376 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:12.517593 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.519126 16003 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:12.521560 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:12.528389 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.528824 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:12.530444 16379 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.537283 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:12.542737 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63146.6us
I20260709 13:08:12.547104 15374 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:12.543284 16379 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.549237 16379 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.549315 16368 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:12.550882 16357 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.553198 16363 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.554524 16392 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:12.555914 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 82606.5us
I20260709 13:08:12.558238 16392 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.559403 16401 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:12.562100 15345 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.562402 16401 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.562935 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:12.563114 16401 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:12.564997 16354 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.567646 16395 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.566118 16401 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.568116 16386 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.568769 16386 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.569329 16386 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.576220 15224 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.569307 16401 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:12.581859 15199 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30992f1a0d1949a7aacbc6cbd114a206. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:12.585225 16361 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.587556 16361 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:12.587612 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.588215 16361 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.589028 16373 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.596634 16373 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:12.598644 16373 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.609301 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.609683 16373 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.610747 16380 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.611296 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.612800 16364 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.613370 16364 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:12.613933 16364 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.606230 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:12.619030 16332 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.629179 15127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 180) took 1157 ms. Trace:
I20260709 13:08:12.637143 16332 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.637782 16332 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:12.638401 16332 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:12.639729 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 53746.1us
I20260709 13:08:12.640296 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.641451 16366 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.645473 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.646919 16403 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.648692 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:12.649224 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.650236 16403 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.650475 16366 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.650873 16403 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:12.651525 16403 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.655172 16379 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.658564 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 188) took 1054 ms. Trace:
W20260709 13:08:12.658859 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47695.5us
I20260709 13:08:12.661031 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:12.630010 15127 rpcz_store.cc:276] 0709 13:08:11.454096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.454349 (+   253us) service_pool.cc:224] Handling call
0709 13:08:12.611706 (+1157357us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:11.794663 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:11.873584 (+ 78921us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:11.873627 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:08:11.873663 (+    36us) tablet.cc:662] Decoding operations
0709 13:08:11.874248 (+   585us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:11.874337 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:11.874373 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:11.897154 (+ 22781us) tablet.cc:701] Row locks acquired
0709 13:08:11.897180 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:08:11.897458 (+   278us) write_op.cc:270] Start()
0709 13:08:11.897585 (+   127us) write_op.cc:276] Timestamp: P: 1783602491897410 usec, L: 0
0709 13:08:11.897609 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:11.967464 (+ 69855us) log.cc:844] Serialized 540 byte log entry
0709 13:08:12.429397 (+461933us) op_driver.cc:464] REPLICATION: finished
0709 13:08:12.432040 (+  2643us) write_op.cc:301] APPLY: starting
0709 13:08:12.432147 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:12.432264 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:12.432465 (+   201us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.534981 (+102516us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.535347 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:12.535423 (+    76us) write_op.cc:312] APPLY: finished
0709 13:08:12.585949 (+ 50526us) log.cc:844] Serialized 22 byte log entry
0709 13:08:12.592365 (+  6416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.592530 (+   165us) write_op.cc:454] Released schema lock
0709 13:08:12.592605 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.617311 (+ 24706us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.618356 (+  1045us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":2381,"apply.run_cpu_time_us":4137,"apply.run_wall_time_us":175173,"num_ops":1,"prepare.queue_time_us":156544,"prepare.run_cpu_time_us":39166,"prepare.run_wall_time_us":486589,"raft.queue_time_us":47471,"raft.run_cpu_time_us":4314,"raft.run_wall_time_us":86143,"replication_time_us":530325,"thread_start_us":441429,"threads_started":4,"wal-append.queue_time_us":405641}]]}
I20260709 13:08:12.668731 16380 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:12.659476 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 142223us
I20260709 13:08:12.660987 15131 rpcz_store.cc:276] 0709 13:08:11.604061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.604847 (+   786us) service_pool.cc:224] Handling call
0709 13:08:12.658259 (+1053412us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:12.288992 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:12.289629 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:12.289668 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:08:12.289687 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:12.290052 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:12.290105 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:12.290135 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:12.290323 (+   188us) tablet.cc:701] Row locks acquired
0709 13:08:12.290344 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:12.290536 (+   192us) write_op.cc:270] Start()
0709 13:08:12.290668 (+   132us) write_op.cc:276] Timestamp: P: 1783602492290492 usec, L: 0
0709 13:08:12.290691 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:12.291408 (+   717us) log.cc:844] Serialized 598 byte log entry
0709 13:08:12.432112 (+140704us) op_driver.cc:464] REPLICATION: finished
0709 13:08:12.539737 (+107625us) write_op.cc:301] APPLY: starting
0709 13:08:12.579483 (+ 39746us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:12.579698 (+   215us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:12.580745 (+  1047us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:12.581637 (+   892us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:12.586647 (+  5010us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:12.604246 (+ 17599us) write_op.cc:312] APPLY: finished
0709 13:08:12.628611 (+ 24365us) log.cc:844] Serialized 22 byte log entry
0709 13:08:12.652786 (+ 24175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.655529 (+  2743us) write_op.cc:454] Released schema lock
0709 13:08:12.655594 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:12.656004 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:12.656038 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":82506,"apply.run_cpu_time_us":4231,"apply.run_wall_time_us":140997,"mutex_wait_us":11620,"num_ops":1,"prepare.queue_time_us":524737,"prepare.run_cpu_time_us":2721,"prepare.run_wall_time_us":6442,"replication_time_us":141301,"thread_start_us":81360,"threads_started":1}]]}
I20260709 13:08:12.670708 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.684903 16008 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.659403 16379 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.671864 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:12.672909 16391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46148 (request call id 138) took 1143 ms. Trace:
I20260709 13:08:12.672816 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.675288 16361 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.687529 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:12.692186 16366 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.688265 16380 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.688783 16391 rpcz_store.cc:276] 0709 13:08:11.528099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.536610 (+  8511us) service_pool.cc:224] Handling call
0709 13:08:11.871898 (+335288us) ts_tablet_manager.cc:934] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
0709 13:08:12.313270 (+441372us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:12.426938 (+113668us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:12.427565 (+   627us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:12.670169 (+242604us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:12.670855 (+   686us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:12.671303 (+   448us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:12.671448 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":29718,"tablet-copy.queue_time_us":177547,"thread_start_us":365082,"threads_started":2}
I20260709 13:08:12.695590 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.697249 16366 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.695933 16391 tablet_copy_client.cc:806] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.698536 16391 tablet_copy_client.cc:670] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.700582 15378 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.696554 16354 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:12.704423 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:12.707782 16361 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:12.703086 16354 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:12.718082 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.721114 16389 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.734813 16354 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:12.731771 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61345us
I20260709 13:08:12.735529 16332 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.738114 16401 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:12.738466 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.740626 16389 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:12.750449 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52654.9us
I20260709 13:08:12.751045 16388 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.751567 16388 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:12.752244 16389 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:12.753386 16388 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.753937 16389 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.757910 16380 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.745884 16361 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:12.751559 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.757269 16391 tablet_copy_client.cc:538] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.762662 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.755227 16388 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.766482 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:12.762025 16361 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.760737 16389 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.770920 16359 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.771808 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.771874 15229 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.770941 16392 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:12.774101 16361 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:12.775287 16359 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.780794 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.782884 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.783730 16359 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.783354 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.785363 16379 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.791249 16380 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:12.792310 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:12.798687 16395 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:12.799805 16395 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:12.799875 15233 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.803471 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.795365 16392 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.805172 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.800844 16359 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.809012 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.813503 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.817746 16359 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.788985 16364 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.819268 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.819734 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:12.821353 16364 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:12.821375 15381 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.802591 16403 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.824852 16392 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:12.826709 16396 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.827162 16396 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:12.828395 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:12.828614 16396 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.831176 16396 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.838567 16359 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:12.838791 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44492.9us
I20260709 13:08:12.834970 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.839799 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.841010 16380 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.842830 16361 consensus_queue.cc:1059] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.844821 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.846544 16361 raft_consensus.cc:3055] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.852372 16361 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:12.850960 16403 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.854015 16361 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.855515 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:12.857106 16361 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.857174 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:12.858203 15381 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.813707 16395 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.866205 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.870168 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:12.871094 15303 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:12.874300 15308 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:12.879357 15305 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:12.896042 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:12.899358 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:12.901993 15299 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.854619 16359 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:08:12.906644 16364 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.906721 16413 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:12.907529 16413 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:12.848659 16391 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:12.854159 16332 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:12.818928 16386 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.919966 16401 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.932720 16401 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.923036 16312 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.923338 16382 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.937806 16382 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.939610 15302 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:12.924249 16389 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.941116 16389 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.943737 16389 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.925091 16383 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.945252 15345 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.946579 16359 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.923069 16352 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:08:12.931743 15229 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.928529 16384 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.948902 16384 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.948518 15373 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:12.950170 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.950805 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:12.951900 16384 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.946126 16383 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.961936 15381 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:12.964802 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:12.965263 16382 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.965330 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:12.966836 16395 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:08:12.970573 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.967434 16395 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:12.971205 16389 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:12.933970 16332 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:12.998401 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:12.984772 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:12.973389 15224 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.981140 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:12.982767 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:12.973114 16312 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:12.990643 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:12.991499 16384 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:12.972966 15127 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.003790 16388 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.004310 16388 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:13.003852 16312 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.005657 16388 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:12.974844 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:13.007001 16363 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:13.010792 16380 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.011139 16354 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.011283 16363 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.012130 16363 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:13.014227 16384 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.014791 16384 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:13.014493 16363 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.016938 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.015993 16384 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.020470 16384 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.020687 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:12.996649 16389 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.026487 16363 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.027531 16388 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.979884 16386 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:12.985324 16401 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.035341 15233 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:12.951999 16413 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:13.042938 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52398.3us
W20260709 13:08:13.063532 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44596.1us
I20260709 13:08:13.065917 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:13.030638 16383 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:13.069404 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.051852 16368 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:13.074602 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:13.088763 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.076810 16354 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.104393 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:13.081054 16413 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.104964 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:13.110816 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52925us
W20260709 13:08:13.118454 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.124032 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:13.108853 16368 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.124954 16364 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.073145 16395 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.132771 16368 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:13.120774 16354 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:13.137790 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.148672 16396 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:13.160559 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.165544 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:13.168527 16403 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.170166 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:13.171123 16403 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.171835 16403 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:13.173099 16403 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.173096 16389 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.180235 16354 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.183758 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:13.184484 16406 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:08:13.164551 16386 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:08:13.186401 15381 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.164701 16396 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:13.188278 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.188716 16396 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.193013 16368 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.196583 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.158703 16364 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.198597 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:13.200875 16392 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.201416 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.204862 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.206698 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:13.208225 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.209043 15378 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:13.224529 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.224720 16332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46416 (request call id 6) took 1276 ms. Trace:
I20260709 13:08:13.266340 16332 rpcz_store.cc:276] 0709 13:08:11.889092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.892175 (+  3083us) service_pool.cc:224] Handling call
0709 13:08:12.178433 (+286258us) log.cc:844] Serialized 506 byte log entry
0709 13:08:12.529066 (+350633us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b1800324dc0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa6b26 00007f2f53aa049a 00007f2f53a9f714
0709 13:08:13.163312 (+634246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19093,"raft.queue_time_us":107395,"raft.run_cpu_time_us":7211,"raft.run_wall_time_us":46057,"spinlock_wait_cycles":9909504,"thread_start_us":289943,"threads_started":1,"wal-append.queue_time_us":234895}
I20260709 13:08:13.269672 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.285475 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.286566 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.304833 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.309680 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:13.319475 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.320608 16392 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.333428 15301 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.334458 15302 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:13.339862 15232 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:13.346791 16382 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.352912 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:13.357815 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.370653 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.371075 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.371454 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.372066 16386 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.372812 15380 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.372628 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.374756 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.347520 16382 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:13.360212 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78384us
I20260709 13:08:13.387435 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.387751 16382 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.390791 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.394055 15378 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:13.408468 15380 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.408468 16391 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:13.408697 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.417225 15378 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.417446 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.430527 15378 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.433383 16391 tablet_bootstrap.cc:492] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:13.434689 16391 ts_tablet_manager.cc:1403] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.597s	user 0.033s	sys 0.033s
I20260709 13:08:13.442356 16433 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:13.443324 16433 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.445591 16386 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.446827 16396 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.449707 16442 ts_tablet_manager.cc:933] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:13.453747 15301 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.428960 15373 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:13.463852 15380 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.468776 16433 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.471220 16382 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:13.471089 16413 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:13.478098 16413 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.480682 15373 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.472085 16382 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:13.482709 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:13.482951 15199 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc5a1ea32aef45d1b6e1ff8b0718d178. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:13.490039 16391 raft_consensus.cc:359] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:13.491112 16391 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:13.488727 16442 tablet_copy_client.cc:323] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:08:13.462941 16437 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:13.492885 16437 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.497601 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 30992f1a0d1949a7aacbc6cbd114a206 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:13.498139 16413 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:13.498495 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 30992f1a0d1949a7aacbc6cbd114a206 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-30992f1a0d1949a7aacbc6cbd114a206
I20260709 13:08:13.491925 16391 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:13.500970 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.502154 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:13.508967 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.582s (SENT) [suppressed 1 similar messages]
I20260709 13:08:13.513928 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.517493 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.509858 16437 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.525244 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.527503 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.530074 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:13.532562 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.533139 16437 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.537489 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.539245 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.541075 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.554447 15243 tablet_copy_source_session.cc:215] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:13.560009 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.563527 16442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30992f1a0d1949a7aacbc6cbd114a206. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:13.564700 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 103404us
I20260709 13:08:13.566701 16437 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.567481 16437 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.568763 16395 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.563861 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.575281 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.576555 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:13.577381 15302 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:13.579470 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.580273 15230 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:13.582787 16437 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.584674 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:13.586289 16437 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.586807 16437 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.586838 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:13.587427 16437 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.587743 16332 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:13.584666 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.588459 16332 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.591645 16332 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:13.593231 16332 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:13.593676 16332 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:13.594087 16332 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.594581 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:13.595345 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:13.597760 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:13.595026 15382 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.598683 16366 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:13.599418 16366 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:13.599861 16366 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.601660 15230 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.603790 16368 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:13.610653 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.619632 15373 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.629992 16434 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.631337 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.632879 15300 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:13.633875 15305 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:13.641572 16354 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.642513 16437 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.644299 16354 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:13.650177 16442 tablet_copy_client.cc:806] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:13.651803 16442 tablet_copy_client.cc:670] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:13.651860 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.653813 16413 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:13.654525 16413 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.656908 16413 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:13.657779 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:13.658527 15230 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.660681 16434 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:13.660894 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.662168 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:13.665268 16413 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:13.662253 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:13.672554 16442 tablet_copy_client.cc:538] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:13.682106 16413 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.682865 16436 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.683288 16436 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:13.682168 16008 raft_consensus.cc:2368] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:13.682168 15373 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.685982 16413 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:13.692474 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 183577us
W20260709 13:08:13.693621 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53610.3us
I20260709 13:08:13.687773 15375 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:13.696805 15348 leader_election.cc:400] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:13.697161 15348 leader_election.cc:403] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.698451 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:13.699391 16008 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:13.686784 15127 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:13.674474 16437 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.704674 16395 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:13.706409 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.707150 15373 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:13.707945 15224 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:13.707875 16363 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:13.709340 16382 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.713162 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:13.716609 16437 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.703315 15127 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:13.718209 16363 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:13.719298 16363 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:13.719831 16363 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.718160 16437 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.742436 16437 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.743121 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.745504 15374 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:13.745319 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.744418 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:13.748651 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:13.749364 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.752149 15225 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:13.751888 16437 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.759166 16437 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:13.724982 16436 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:13.767027 16436 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.764506 16437 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.775735 15230 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:13.801801 16363 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.847555 16363 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:13.848831 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:13.852073 16442 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:13.859071 16366 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.860479 15229 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.861613 16366 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:13.863581 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:13.879530 15230 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:13.883105 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:13.884699 16380 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.817798 16332 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:13.877645 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 129107us
I20260709 13:08:13.892199 16380 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:13.906872 15231 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.910261 16448 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.928431 15305 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.928223 16459 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.935281 16459 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.938155 16459 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.943390 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:13.944590 15230 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:13.944849 16380 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:13.928929 16448 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.949630 15301 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.956447 15382 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.953677 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.964556 16332 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:13.948254 16448 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.972611 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:13.973708 16459 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.974234 16459 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.974778 16459 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.975725 16391 ts_tablet_manager.cc:1434] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.541s	user 0.012s	sys 0.019s
W20260709 13:08:13.976156 16391 ts_tablet_manager.cc:1467] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Tablet startup took 541ms
I20260709 13:08:13.983871 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:13.974152 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:13.989156 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:13.992017 15129 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.994356 15129 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.996425 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:14.000227 16413 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.001595 16413 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.002023 16413 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:14.003198 16413 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.007642 16413 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.009408 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:14.010224 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:13.996214 15129 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.011566 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:13.984233 15382 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.022809 16404 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:14.025257 16368 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.025599 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:14.026610 15307 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:14.031953 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.025801 16368 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:14.039549 15308 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:14.042706 15129 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 3, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:14.047156 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.031386 16459 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:14.051900 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62391.5us
I20260709 13:08:14.067248 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:14.077610 16366 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.078505 16366 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.081554 16008 raft_consensus.cc:2368] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:14.085179 15299 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.089828 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:14.087837 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 280065us
I20260709 13:08:14.094067 15303 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.094823 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.095384 16354 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.085220 16434 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:14.105679 16433 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:14.096499 16467 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:14.043073 16368 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:14.108768 16464 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:14.115196 16389 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.122011 15303 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:13.976572 16391 ts_tablet_manager.cc:1469] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Trace:
0709 13:08:11.528099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.536610 (+  8511us) service_pool.cc:224] Handling call
0709 13:08:11.871898 (+335288us) ts_tablet_manager.cc:934] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
0709 13:08:12.313270 (+441372us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:12.426938 (+113668us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:12.427565 (+   627us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:12.670169 (+242604us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:12.670855 (+   686us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:12.671303 (+   448us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:12.671448 (+   145us) inbound_call.cc:177] Queueing success response
0709 13:08:12.837752 (+166304us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:13.435153 (+597401us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:13.457490 (+ 22337us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:13.458198 (+   708us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":29718,"raft.queue_time_us":18307,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":151,"tablet-copy.queue_time_us":177547,"tablet-download-pool.queue_time_us":305,"tablet-download-pool.run_cpu_time_us":2447,"tablet-download-pool.run_wall_time_us":57406,"thread_start_us":730841,"threads_started":3}
I20260709 13:08:14.138300 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:14.139122 15375 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.149417 15382 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
W20260709 13:08:14.149912 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.151407 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 100154us
W20260709 13:08:14.154861 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61426.2us
I20260709 13:08:14.155150 15348 leader_election.cc:400] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:14.154740 16008 raft_consensus.cc:1217] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:14.174242 15375 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.178227 16368 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:14.182682 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.173988 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:14.189428 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.187768 15231 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.204566 15198 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:14.205847 16392 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.206768 16392 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:14.210476 16386 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.213636 15225 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:14.172777 16448 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.220021 16459 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.223862 16459 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:14.207816 16392 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.203276 16465 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.232643 15392 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-3005d9c450974fc299b5f0c0e92c745a received from {username='slave'} at 127.0.0.1:52412
I20260709 13:08:14.245481 15392 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-3005d9c450974fc299b5f0c0e92c745a on tablet 3005d9c450974fc299b5f0c0e92c745a with peer 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:14.245960 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.237931 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:14.237651 15130 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.241298 15131 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 1 to 2, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 2 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.241339 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.269569 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:14.270434 15224 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.271375 15231 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:14.284230 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.241391 16448 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.255847 16465 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.261417 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:14.292984 16466 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.296208 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:14.297704 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.299750 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.304663 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:14.305612 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.303339 15379 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.308665 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.309691 16388 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.308111 16448 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:14.312954 16448 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:14.314136 16448 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.316356 16465 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.306721 16382 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.311983 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.319597 16442 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:14.357932 15378 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:14.321152 16384 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.319367 16466 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.365645 16459 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.367117 16384 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:14.396481 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84656.8us
I20260709 13:08:14.398518 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:14.403712 16442 tablet_bootstrap.cc:492] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:14.396245 16459 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.404982 16442 ts_tablet_manager.cc:1403] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.553s	user 0.029s	sys 0.013s
I20260709 13:08:14.379925 16389 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.405378 16384 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:14.410624 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.369472 16463 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:08:14.439062 16008 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:14.412822 16466 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:14.442060 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43688.4us
I20260709 13:08:14.416939 15224 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:14.469076 15230 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:14.462826 16413 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:14.495105 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:14.517624 16477 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:14.546510 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:14.547725 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 86924.2us
I20260709 13:08:14.548702 15273 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.550679 16388 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.551038 16312 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.553714 15379 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:14.560011 16459 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.560755 16459 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.561352 16459 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.563228 16413 consensus_queue.cc:1243] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer 5c70ddb5aae14b059dc90fd40125b034 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:14.566453 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:14.563745 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 92600.5us
I20260709 13:08:14.591326 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:14.592425 15382 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:14.598177 16404 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:14.598737 16413 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:14.598984 16404 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.602135 16442 raft_consensus.cc:359] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:14.598273 16388 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.603266 16442 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:14.569051 16363 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:14.617486 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67280.3us
W20260709 13:08:14.564276 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 70812.1us
W20260709 13:08:14.624217 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.625061 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.625187 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:14.626143 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.608585 16388 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:14.615603 16466 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.616518 16459 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.617306 16363 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:14.631117 15303 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:14.635313 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:14.630200 16312 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.635074 16442 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:14.636786 16459 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:14.642849 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:14.644474 16465 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.644956 16465 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:14.645438 16465 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.645967 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:14.646775 15302 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:14.628556 16388 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.648702 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:14.657027 16404 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:14.631100 16466 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.661020 16363 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.636250 16483 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:14.663010 16363 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.663522 16483 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.666532 16484 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:14.667102 16484 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.667454 16484 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.673348 16388 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.673974 16466 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:14.675001 16384 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.677433 16388 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.678429 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:14.686028 15374 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:14.687927 16483 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:14.689353 16483 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:14.689963 16483 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.690555 16483 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.692541 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:14.689424 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:14.695353 15230 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:14.696018 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.697183 16389 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.697959 16469 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:14.703923 15127 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.708873 16469 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.709373 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.712011 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:14.713618 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.715631 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.717483 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.718696 15233 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:14.724237 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:14.725304 15230 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:14.726241 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:14.717077 16466 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.717463 16312 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.717372 16382 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.750999 15302 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.724187 16388 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:14.742944 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 64663.1us
I20260709 13:08:14.735850 16459 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:08:14.773979 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 125391us
I20260709 13:08:14.779275 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:14.780151 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:14.784602 16008 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:14.780134 15303 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:14.789549 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:14.790666 16484 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.790946 16382 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:14.791723 16382 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.792152 16382 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.792748 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.794109 16488 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.794701 16488 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:14.795279 16488 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.796305 16469 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:14.800647 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83245.2us
I20260709 13:08:14.801661 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.806783 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:14.807312 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.809278 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.810787 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.813705 16389 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:14.821877 16312 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.822268 16442 ts_tablet_manager.cc:1434] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.412s	user 0.025s	sys 0.014s
I20260709 13:08:14.837541 16005 raft_consensus.cc:1217] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:14.840381 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-30992f1a0d1949a7aacbc6cbd114a206 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:14.841310 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-30992f1a0d1949a7aacbc6cbd114a206 on tablet 30992f1a0d1949a7aacbc6cbd114a206 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:14.842564 16489 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:14.843237 16489 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.844949 16384 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.812260 16466 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.846338 16459 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.831314 15131 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.807415 16388 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.778151 16483 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.855540 15375 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:14.864207 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53506.7us
I20260709 13:08:14.865430 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.874125 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:14.876835 15233 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:14.878417 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62890.8us
I20260709 13:08:14.889101 16347 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:08:14.895089 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:14.887198 16384 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.904856 15374 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:08:14.905521 15374 pending_rounds.cc:85] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:08:14.902161 16368 raft_consensus.cc:1064] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:14.909683 16489 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:14.910518 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:14.912791 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:14.913738 15379 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:14.913604 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:14.915127 16484 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.935652 16488 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.938958 16488 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:14.940795 16382 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.940018 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:14.944937 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:14.968175 15224 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:14.969861 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:14.970237 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:14.972550 16382 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:14.916692 16483 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:14.906332 15374 pending_rounds.cc:107] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:14.979990 15374 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.980376 16470 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:14.980885 16470 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.947572 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:14.983804 16470 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:14.984040 15379 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.951469 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:14.952764 16368 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:14.989619 16386 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:14.990268 16483 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:14.990376 16386 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:14.953994 15302 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.956159 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:14.993765 15373 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.958344 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:14.995234 15230 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:14.995641 15305 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.960759 15345 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.962213 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:14.997522 15303 raft_consensus.cc:2368] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3.
I20260709 13:08:15.000735 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.964747 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:14.961489 16469 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:15.004452 16483 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.005862 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:15.006630 16005 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.978039 16465 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.008824 16465 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:15.009122 15299 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.004297 16469 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.011327 16469 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:15.014608 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:15.015395 15225 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.002151 15971 leader_election.cc:400] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3.
I20260709 13:08:15.017388 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:15.006246 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:15.006162 16495 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:15.026744 16363 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.027539 16386 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.029626 15379 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:15.031574 16483 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:15.025061 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64391.5us
I20260709 13:08:15.033073 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.035386 16470 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.052060 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.017457 15971 leader_election.cc:403] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.061182 16363 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.060708 16465 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.061043 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.080153 15225 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:15.056754 15973 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:15.085341 16483 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:15.067162 15299 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:15.068095 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:15.086651 15379 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
W20260709 13:08:15.087222 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85187.9us
I20260709 13:08:15.087703 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:15.088531 16466 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:15.089077 16466 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:15.089872 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:15.090065 16466 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.100914 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:15.102545 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 137883us
I20260709 13:08:15.103464 15273 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.072806 15305 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:15.086025 16483 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:15.097151 15131 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.112613 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:15.114221 16484 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:15.114789 16484 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:15.062407 16347 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:08:15.118299 16489 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:15.108840 16433 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:15.119841 16433 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:15.120242 16433 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.118920 16489 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.121505 16413 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:15.115759 16484 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.127099 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:15.127900 15375 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:15.130306 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:15.131237 15225 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:15.132037 16005 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:15.132761 16459 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3.
I20260709 13:08:15.133438 16465 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.122488 16489 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.116139 16483 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.144069 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.146553 16488 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:15.147119 16488 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:15.147589 16488 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.137722 15373 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:15.156062 15224 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.122272 16413 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.167469 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:15.193791 16486 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:15.197445 16005 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.199709 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.200704 16486 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.202219 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.221326 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.222455 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.227713 16465 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.210707 16386 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.181984 16469 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:08:15.231161 16488 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.211746 16413 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:15.226265 16486 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.235596 16466 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:15.242945 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 141857us
I20260709 13:08:15.253110 16395 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.253769 16395 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.264012 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.265056 15300 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:15.270175 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.256160 16395 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.242123 16380 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:08:15.272995 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.277103 15302 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.278535 16403 raft_consensus.cc:1064] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:15.284518 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:15.238840 16386 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:15.311532 16488 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.316018 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:15.317468 16386 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.318616 15225 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:15.317495 15229 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:15.282271 16403 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.329459 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.330348 15301 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:15.300993 16395 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:15.333315 16395 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.333845 16395 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.334837 16483 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.307956 16494 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:15.336179 16494 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.337142 15131 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.329396 16363 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:15.341504 16363 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.341338 15127 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.342237 16494 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:15.343963 16363 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:15.339572 15131 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:15.351604 15196 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:15.360730 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:15.347885 16433 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.356563 16470 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:15.363832 16461 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:15.380028 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:15.391805 16461 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.389626 16494 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:15.397269 16470 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:15.413626 16494 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.426421 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:15.431798 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:15.442178 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:15.408213 16461 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.479310 16433 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.425552 16470 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:15.485198 16494 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:15.479027 16395 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.503713 16395 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.515724 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:15.524948 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:15.526183 15299 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.530493 15224 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:15.530807 15307 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:15.533089 16466 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.533361 16483 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.549521 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:15.552052 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 128175us
I20260709 13:08:15.574677 15233 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:15.576553 16466 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:15.578450 16493 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:15.579089 16493 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:15.580083 16493 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.581636 16493 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.589581 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:15.590881 15375 raft_consensus.cc:2368] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
W20260709 13:08:15.632809 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 63991.1us
I20260709 13:08:15.642154 16008 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.642437 15299 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:15.645534 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.649262 15382 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:15.644002 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:15.650964 15378 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:15.653738 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:15.727622 16366 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:15.654937 16392 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:15.741559 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.740577 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 79579.5us
I20260709 13:08:15.749188 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:15.743867 15375 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:15.759881 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.744808 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:15.790163 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:15.812973 16005 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:15.783842 15379 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:15.791327 16363 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.846046 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:15.847817 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:15.856249 15375 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:15.848186 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:15.829517 16380 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.866520 16392 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:15.787155 16461 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:08:15.832923 16512 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:08:15.886019 15378 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:15.832122 16433 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.891985 15379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:15.927001 16461 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:15.901285 16433 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.940399 15379 raft_consensus.cc:606] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:15.949616 15373 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:15.867830 16392 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:15.958590 16483 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.961534 16521 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.970840 15378 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:15.936244 16433 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:15.974419 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 182548us
I20260709 13:08:15.975708 15273 leader_election.cc:400] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:15.976171 15273 leader_election.cc:403] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.998843 16465 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
W20260709 13:08:16.016283 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 125373us
W20260709 13:08:16.008076 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 218035us
I20260709 13:08:16.000680 16492 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:16.027154 15378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:16.022683 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.028211 15378 raft_consensus.cc:606] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
W20260709 13:08:16.031586 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 135572us
I20260709 13:08:16.030823 16469 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.048914 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:16.045261 16486 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:08:16.077605 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 128193us
I20260709 13:08:16.082471 16526 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:16.027004 16380 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:16.084118 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.084288 16395 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.038163 16492 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.129468 16504 raft_consensus.cc:993] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:16.130124 16504 raft_consensus.cc:1081] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:16.134577 16519 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:16.125231 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.136896 16505 raft_consensus.cc:993] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:16.138890 16521 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.139549 16521 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:16.139842 16532 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:16.147428 16492 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:16.150231 16003 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:16.119918 16469 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.168906 16521 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:16.178861 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:16.179834 15378 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.180799 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:16.181627 15373 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
W20260709 13:08:16.182531 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67182.6us
I20260709 13:08:16.201834 15378 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:16.211018 15225 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:16.206681 15129 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.221989 16505 raft_consensus.cc:1081] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:08:16.283882 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 291021us
I20260709 13:08:16.323231 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.323472 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:16.324568 15307 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.325202 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.328405 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:16.329865 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:16.348055 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 366493us
I20260709 13:08:16.321583 16466 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:16.362371 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:16.358309 16538 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.364825 16537 raft_consensus.cc:2764] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:08:16.415926 15300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50774
I20260709 13:08:16.425963 15300 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.426523 15300 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.419837 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:16.421095 16534 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:16.421522 16523 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.422612 15307 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:16.376030 16466 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:16.431668 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:16.434290 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.455642 15380 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.564294 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:16.599710 16493 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.592456 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 192459us
I20260709 13:08:16.600713 16493 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:16.605861 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 156747us
I20260709 13:08:16.608006 16493 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:16.610419 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.616200 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:16.606158 15308 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:16.457263 16505 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.631601 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:16.542897 16529 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:16.504624 16520 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:16.561906 16466 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:16.625946 16404 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.661188 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:16.656715 15300 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.640012 16538 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:16.695307 15300 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:16.663697 16520 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.666507 16359 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.449276 16523 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:16.709343 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93232.1us
I20260709 13:08:16.684134 16529 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:16.711110 15299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50774
I20260709 13:08:16.695161 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:16.713711 15299 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.699852 16520 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.715221 15299 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:16.719226 16549 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.005s
I20260709 13:08:16.719606 15304 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:16.720992 16527 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:16.721835 16527 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.733825 15299 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.731099 16524 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:08:16.721069 16529 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:16.747193 15229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:16.747937 15229 raft_consensus.cc:606] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:16.749341 16527 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:16.758280 15229 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:16.758734 15299 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:16.760125 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.763967 16523 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:16.765638 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:16.765887 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:16.766458 15378 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.766814 15378 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:16.744295 16538 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.767820 15378 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.770376 15378 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.776487 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:16.777796 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 70793.8us
I20260709 13:08:16.779985 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:16.780792 15229 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.783710 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:16.785209 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:16.785913 15377 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.787210 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:16.781801 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:16.787936 15233 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.786379 15377 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:16.789597 15377 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.794497 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:16.779901 16488 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:08:16.778690 16527 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.810513 15380 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:16.812260 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:16.812628 15307 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.813771 15377 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.821117 16520 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.824858 15229 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:16.841249 15303 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.846671 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:16.847263 15274 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:16.852905 16492 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.853904 16492 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:16.856528 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:16.858700 15378 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:16.873751 15377 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:16.875299 15233 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:16.877700 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:16.901628 16520 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:16.887192 16527 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.926225 15378 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:16.939976 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62432.4us
I20260709 13:08:16.855446 16492 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:16.948794 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:16.949839 15305 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:16.955720 15229 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.989087 16528 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:16.994572 15224 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.948405 16526 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.949415 16558 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:17.011576 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60838.3us
I20260709 13:08:17.031800 15378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "5c70ddb5aae14b059dc90fd40125b034"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:17.032975 15378 raft_consensus.cc:606] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Received request to transfer leadership to TS 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:17.038949 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 66932.3us
I20260709 13:08:17.022615 16380 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:17.022132 16526 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:17.027500 16465 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:17.063262 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:17.064004 15381 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:17.069908 16465 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:17.100209 16526 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.108129 16494 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:17.110126 16525 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:08:17.112391 16494 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.113292 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:17.114081 15379 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.068876 16380 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.101513 16465 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:17.116719 16366 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:08:17.108163 16461 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:17.180549 16380 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:17.166512 16494 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:17.177659 16522 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:17.228996 15378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:17.232378 15378 raft_consensus.cc:606] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
W20260709 13:08:17.318115 16562 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:08:17.319713 16554 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.052s	sys 0.110s
I20260709 13:08:17.311825 16470 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:17.322708 16470 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:17.320274 16554 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.052s	sys 0.110s
I20260709 13:08:17.334035 16008 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:08:17.341953 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 305905us
W20260709 13:08:17.352072 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 348246us
I20260709 13:08:17.377868 15375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:17.379158 15375 raft_consensus.cc:606] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:17.384073 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:17.385151 15233 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:17.393625 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:17.401643 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 286206us
I20260709 13:08:17.402824 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:17.376258 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 388226us
I20260709 13:08:17.414252 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:17.414888 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:17.422526 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:17.413205 16519 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:17.455528 16520 raft_consensus.cc:993] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:08:17.402590 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 248082us
I20260709 13:08:17.479265 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:17.478739 15374 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:17.447100 16519 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:17.472183 16537 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:17.477936 16395 raft_consensus.cc:1081] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:17.484428 16553 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.512324 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:17.513585 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:17.493482 16519 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.538497 16528 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:17.531978 16553 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:17.629447 16577 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:08:17.591758 15379 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:17.632614 16566 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:08:17.640789 16576 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:08:17.645125 15308 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
W20260709 13:08:17.671871 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 120526us
I20260709 13:08:17.620508 16528 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:17.695217 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 78239us
I20260709 13:08:17.700630 15230 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:17.703210 15232 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.695693 16368 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:17.714735 16382 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:17.717728 16589 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:17.719336 16368 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:17.740787 16368 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:17.751844 16553 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:17.757721 15300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:08:17.758534 15300 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.766302 15300 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.769897 16470 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:17.780215 16528 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:17.719647 16466 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:17.784770 16466 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:17.786032 16466 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.790426 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:17.787060 16519 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:17.795769 15300 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.788010 16466 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.812805 15300 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:17.821820 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:08:17.829913 16583 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.272s	user 0.010s	sys 0.000s
I20260709 13:08:17.836575 16586 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.837411 16586 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.838490 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:17.836825 16582 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.275s	user 0.002s	sys 0.000s
I20260709 13:08:17.843503 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:17.845351 15232 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.845752 15232 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:17.845822 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:17.850138 15232 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.852973 16586 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:17.861263 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:17.866927 15231 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:17.869546 16519 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:17.873708 16575 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:17.874879 16575 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:17.883145 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:17.885586 16551 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:17.886137 16551 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.886649 16551 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.892416 16382 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:17.898839 16382 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:17.901654 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:17.902691 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:17.927378 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:17.928391 15377 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:17.929699 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:17.930150 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:17.931219 16461 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:17.931703 16461 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.932061 16461 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.876313 16575 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.931279 16588 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:17.939231 16526 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:17.953395 16537 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:17.956486 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:17.957197 16537 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.958621 16526 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:17.993475 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:17.955616 16504 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.037477 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.992436 15305 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:08:18.038736 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45232.4us
W20260709 13:08:18.039234 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47265.8us
I20260709 13:08:17.971073 16526 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:17.960144 16537 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.100625 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.074822 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:17.959347 16382 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:18.109858 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:18.113402 16368 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.115139 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.116900 16470 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.069295 16354 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.164548 15229 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.167007 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.162675 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:18.080832 16504 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.221621 16551 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.235232 16551 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.236286 16505 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:18.246194 15308 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:18.245606 16505 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:18.246537 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.248332 16505 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:18.255899 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 185236us
W20260709 13:08:18.258453 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 157926us
I20260709 13:08:18.264186 16504 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:18.266678 15232 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.271193 15131 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 2 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.281371 15129 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 194) took 2100 ms. Trace:
I20260709 13:08:18.284298 15130 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.289250 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.296119 16470 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:18.297022 16470 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:18.297439 16470 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.287297 16404 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:18.302313 16404 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.290563 16505 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:18.304877 16505 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.307284 16505 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:18.309840 16380 raft_consensus.cc:993] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:18.310626 16380 raft_consensus.cc:1081] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:18.315331 16347 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:18.315500 16553 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.316113 16347 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:18.319133 16404 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:18.281841 15129 rpcz_store.cc:276] 0709 13:08:16.171235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.171439 (+   204us) service_pool.cc:224] Handling call
0709 13:08:18.271907 (+2100468us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:16.490830 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:16.503668 (+ 12838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:16.503718 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:08:16.503730 (+    12us) tablet.cc:662] Decoding operations
0709 13:08:16.504119 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:16.504176 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:16.504202 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:16.532560 (+ 28358us) tablet.cc:701] Row locks acquired
0709 13:08:16.532603 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:08:16.535317 (+  2714us) write_op.cc:270] Start()
0709 13:08:16.535517 (+   200us) write_op.cc:276] Timestamp: P: 1783602496532782 usec, L: 0
0709 13:08:16.540429 (+  4912us) op_driver.cc:348] REPLICATION: starting
0709 13:08:16.554682 (+ 14253us) log.cc:844] Serialized 540 byte log entry
0709 13:08:17.320705 (+766023us) op_driver.cc:464] REPLICATION: finished
0709 13:08:17.552733 (+232028us) write_op.cc:301] APPLY: starting
0709 13:08:17.559897 (+  7164us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:17.591904 (+ 32007us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:17.621907 (+ 30003us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:17.640307 (+ 18400us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:17.650794 (+ 10487us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:17.650861 (+    67us) write_op.cc:312] APPLY: finished
0709 13:08:17.666375 (+ 15514us) log.cc:844] Serialized 22 byte log entry
0709 13:08:17.675336 (+  8961us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:17.679590 (+  4254us) write_op.cc:454] Released schema lock
0709 13:08:17.680098 (+   508us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:17.706914 (+ 26816us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:17.710300 (+  3386us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":891,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":193026,"apply.run_cpu_time_us":9528,"apply.run_wall_time_us":168655,"num_ops":1,"prepare.queue_time_us":250818,"prepare.run_cpu_time_us":45035,"prepare.run_wall_time_us":171248,"raft.queue_time_us":536230,"raft.run_cpu_time_us":58097,"raft.run_wall_time_us":176341,"replication_time_us":779894,"thread_start_us":925608,"threads_started":4,"wal-append.queue_time_us":153728}]]}
I20260709 13:08:18.332453 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.340097 15374 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.344767 15374 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:18.345453 16465 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:18.324219 16461 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.354332 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.365799 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.367769 16466 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:18.370225 16494 raft_consensus.cc:993] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: : Instructing follower 5c70ddb5aae14b059dc90fd40125b034 to start an election
I20260709 13:08:18.370828 16494 raft_consensus.cc:1081] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Signalling peer 5c70ddb5aae14b059dc90fd40125b034 to start an election
W20260709 13:08:18.359334 16603 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:08:18.359563 16465 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.395177 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.395901 16347 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:18.397092 16465 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.345513 16486 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.400970 16466 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.407117 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:18.408032 16466 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.361104 16470 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:18.411424 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47122.7us
I20260709 13:08:18.412781 15232 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:18.409310 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:18.414968 15377 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.415439 15379 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.417151 16461 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.419600 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.421110 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.429962 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:18.431006 15230 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:18.433012 15374 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:18.433789 16470 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:18.435177 16504 raft_consensus.cc:993] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:18.435776 16504 raft_consensus.cc:1081] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:18.440153 16539 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:18.441484 15305 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.443849 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.444813 16539 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:18.452330 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:18.454069 15305 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:18.439544 15127 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.470070 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:18.470583 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.471660 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:18.472831 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:18.473119 15301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50774
I20260709 13:08:18.472719 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.476466 15301 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.476969 15301 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.477272 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:18.478883 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.480589 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:18.481307 15374 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.446416 16002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
 from {username='slave'} at 127.0.0.1:46148
I20260709 13:08:18.485344 16002 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.496858 16002 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.498163 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.489634 16584 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:18.501559 16584 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.504287 16584 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.509362 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:18.510402 15231 raft_consensus.cc:2368] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
W20260709 13:08:18.490202 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76622.1us
I20260709 13:08:18.513016 16539 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:18.506861 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.507614 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.513073 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:18.519745 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66303.7us
I20260709 13:08:18.521415 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:18.521934 16551 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:18.522938 16586 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.522727 16551 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.521759 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:18.523837 16589 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.524214 16465 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.524796 16465 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:18.525161 16551 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.507900 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.512944 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.525825 16465 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.530937 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:18.493117 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46672.3us
I20260709 13:08:18.535127 15382 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.535019 16392 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.542593 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.547292 16002 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:18.483180 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.547806 15301 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.555408 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:18.557886 16366 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.561169 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:18.563434 16520 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:18.574703 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52401.2us
I20260709 13:08:18.585098 15273 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.587304 16466 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.593361 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:18.587215 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:18.598591 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:18.599465 15230 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.606317 16002 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.612511 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:18.613297 15348 leader_election.cc:400] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:18.613731 15348 leader_election.cc:403] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.614298 16584 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.614918 16606 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.617939 15377 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:18.599362 15301 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.620724 15348 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.623911 15305 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:18.621285 15230 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:18.624414 15305 pending_rounds.cc:85] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 1
I20260709 13:08:18.624796 15305 pending_rounds.cc:107] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:18.625061 15305 raft_consensus.cc:2889] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.625923 16504 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.626579 16526 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.627149 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:18.628932 16488 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.629443 16488 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:18.627130 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.633069 15230 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:18.632843 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:18.633839 15377 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.634230 15377 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:18.559878 15379 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:18.637531 15374 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:18.635694 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.636960 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:18.638496 15377 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:18.630458 16488 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:18.640203 15377 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.641705 16470 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:18.642627 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.644502 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.647138 15232 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.647583 16465 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.653067 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.658198 15377 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:18.661859 16465 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.663352 15232 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:18.666370 15233 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:18.667937 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.668151 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:18.644302 16606 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.670756 16380 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.672662 16380 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.644630 16584 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:08:18.673096 16380 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:18.674631 16520 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:18.680027 16380 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.670784 16539 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.679776 15377 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:18.689545 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.693912 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.695273 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:18.695900 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.687736 16606 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.693161 16589 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.696623 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:18.696856 16606 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:18.699774 15199 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc5a1ea32aef45d1b6e1ff8b0718d178. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:18.702183 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.685717 16486 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.709946 15305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50774
I20260709 13:08:18.710718 15305 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.711210 15305 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.703037 16486 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.719342 15232 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:18.693341 16505 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.685721 16392 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:18.731006 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.731143 15305 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.703795 16368 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.715754 16380 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.734966 16404 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.738211 15305 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:18.720294 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:18.750221 16606 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.755223 16486 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:18.756942 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:18.768224 16612 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:08:18.770196 16612 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.770804 16612 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:18.766889 15302 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:18.764043 16589 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:18.777334 16589 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.787477 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:18.788223 15380 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.788658 15380 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:18.791262 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:18.791790 15232 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.792116 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:18.792145 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:18.794561 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.789529 15380 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.796263 16537 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.796712 15380 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.796883 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 85) took 2324 ms. Trace:
I20260709 13:08:18.797397 15131 rpcz_store.cc:276] 0709 13:08:16.472938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.625235 (+152297us) service_pool.cc:224] Handling call
0709 13:08:16.824318 (+199083us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:18.796813 (+1972495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:18.556871 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:18.557505 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:18.557543 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:18.557562 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:18.557928 (+   366us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:18.558015 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:18.558051 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:18.558249 (+   198us) tablet.cc:701] Row locks acquired
0709 13:08:18.558268 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:18.558442 (+   174us) write_op.cc:270] Start()
0709 13:08:18.558568 (+   126us) write_op.cc:276] Timestamp: P: 1783602498558381 usec, L: 0
0709 13:08:18.558594 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:18.559405 (+   811us) log.cc:844] Serialized 535 byte log entry
0709 13:08:18.631735 (+ 72330us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.759811 (+128076us) write_op.cc:301] APPLY: starting
0709 13:08:18.759911 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.760025 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.760154 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.760471 (+   317us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.760656 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:18.760706 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:18.760919 (+   213us) log.cc:844] Serialized 22 byte log entry
0709 13:08:18.761130 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.761216 (+    86us) write_op.cc:454] Released schema lock
0709 13:08:18.761275 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.761704 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.761736 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":572397,"reported_tablets":1,"spinlock_wait_cycles":82285440,"child_traces":[["op",{"apply.queue_time_us":110410,"apply.run_cpu_time_us":1907,"apply.run_wall_time_us":1913,"num_ops":1,"prepare.queue_time_us":277676,"prepare.run_cpu_time_us":2866,"prepare.run_wall_time_us":2867,"replication_time_us":72967,"thread_start_us":167303,"threads_started":2}]]}
I20260709 13:08:18.809295 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:18.789455 16520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46416 (request call id 7) took 5452 ms. Trace:
I20260709 13:08:18.824239 15380 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:18.801350 16551 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.835352 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:18.835614 15127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 187) took 1359 ms. Trace:
I20260709 13:08:18.836213 15129 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 3, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.840030 15232 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:18.833274 16612 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:18.831826 16363 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.850024 16537 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.836262 15127 rpcz_store.cc:276] 0709 13:08:17.476538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.476752 (+   214us) service_pool.cc:224] Handling call
0709 13:08:18.210991 (+734239us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:18.835537 (+624546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:18.568035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:18.568629 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:18.568656 (+    27us) write_op.cc:435] Acquired schema lock
0709 13:08:18.568676 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:18.569116 (+   440us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:18.569202 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:18.569259 (+    57us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:18.569509 (+   250us) tablet.cc:701] Row locks acquired
0709 13:08:18.569527 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:18.569660 (+   133us) write_op.cc:270] Start()
0709 13:08:18.569797 (+   137us) write_op.cc:276] Timestamp: P: 1783602498569610 usec, L: 0
0709 13:08:18.569814 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:08:18.570636 (+   822us) log.cc:844] Serialized 598 byte log entry
0709 13:08:18.800434 (+229798us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.803496 (+  3062us) write_op.cc:301] APPLY: starting
0709 13:08:18.803578 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.803703 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.809795 (+  6092us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.811346 (+  1551us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.811505 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:18.811550 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:18.811980 (+   430us) log.cc:844] Serialized 22 byte log entry
0709 13:08:18.812184 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.812319 (+   135us) write_op.cc:454] Released schema lock
0709 13:08:18.812459 (+   140us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.812842 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.812868 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58310,"reported_tablets":5,"spinlock_wait_cycles":21784832,"child_traces":[["op",{"apply.queue_time_us":294,"apply.run_cpu_time_us":2074,"apply.run_wall_time_us":9287,"num_ops":1,"prepare.queue_time_us":103430,"prepare.run_cpu_time_us":2897,"prepare.run_wall_time_us":2896,"replication_time_us":222805}]]}
I20260709 13:08:18.838258 15129 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.830513 16520 rpcz_store.cc:276] 0709 13:08:13.337036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.337235 (+   199us) service_pool.cc:224] Handling call
0709 13:08:13.356792 (+ 19557us) log.cc:844] Serialized 506 byte log entry
0709 13:08:13.546071 (+189279us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b18003930a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53a7fb0b 00007f2f53b04b63 00007f2f53b2c752 00007f2f58aecd29
0709 13:08:18.789352 (+5243281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131821,"raft.queue_time_us":136507,"raft.run_cpu_time_us":2454,"raft.run_wall_time_us":8411,"spinlock_wait_cycles":2481920,"thread_start_us":84967,"threads_started":1,"wal-append.queue_time_us":135330,"wal-append.run_cpu_time_us":2649,"wal-append.run_wall_time_us":1009670}
I20260709 13:08:18.863174 15129 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3, now has a pending config: VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65), VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66), VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67), NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:18.865725 16537 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:18.897742 16537 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:18.904846 15129 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:18.918326 16612 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.940389 15382 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:18.981585 15232 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:19.027678 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:19.053390 16618 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 13:08:19.111805 15228 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.115768 15377 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.120784 16524 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:19.130272 15228 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:19.134390 15230 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.146741 16539 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:19.238173 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51708.4us
I20260709 13:08:19.175319 15127 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added, no longer has a pending config: VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65), VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66), VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67), NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:08:19.241874 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 60384.7us
I20260709 13:08:19.253319 15127 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:19.294452 16466 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:19.313086 16623 ts_tablet_manager.cc:933] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:19.387018 15377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:19.388118 15377 raft_consensus.cc:606] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
W20260709 13:08:19.392084 15199 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 362d7a17088a4e86a51428b5ee97346e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.398124 16623 tablet_copy_client.cc:323] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:08:19.426960 15233 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:19.461624 16621 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:08:19.468376 16005 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:19.473601 16461 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:19.478108 15377 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:19.477788 16612 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.511s	user 0.015s	sys 0.000s
I20260709 13:08:19.508946 16524 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:19.534168 15308 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.579805 15230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:19.580547 15230 raft_consensus.cc:606] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:19.583706 15233 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:19.585198 15375 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:19.599427 15380 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:19.613579 15382 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.616199 15381 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.617684 15226 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:08:19.646978 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44202us
I20260709 13:08:19.605978 16553 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:08:19.677579 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74106us
W20260709 13:08:19.688657 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 66270.2us
I20260709 13:08:19.618681 16631 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:08:19.720497 16632 raft_consensus.cc:993] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:08:19.737601 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78299.9us
I20260709 13:08:19.706910 16638 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:08:19.755024 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48990.6us
I20260709 13:08:19.757069 16520 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:08:19.770702 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet dc5a1ea32aef45d1b6e1ff8b0718d178 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:19.769668 16606 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:19.786938 16470 raft_consensus.cc:1081] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:19.781407 16553 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:08:19.842250 16587 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:19.841753 16528 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:19.821131 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet dc5a1ea32aef45d1b6e1ff8b0718d178 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-dc5a1ea32aef45d1b6e1ff8b0718d178
I20260709 13:08:19.848223 16006 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:19.856036 16551 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:19.858070 16629 raft_consensus.cc:993] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
W20260709 13:08:19.858639 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 80559.7us
I20260709 13:08:19.858752 16629 raft_consensus.cc:1081] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
W20260709 13:08:19.867869 16640 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:08:19.899420 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 140182us
W20260709 13:08:19.902650 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 143598us
I20260709 13:08:19.935326 15130 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 2 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:19.954187 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 211364us
I20260709 13:08:19.955113 15243 tablet_copy_source_session.cc:215] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:20.021739 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55101.4us
W20260709 13:08:20.093964 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 123246us
W20260709 13:08:20.095036 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 121487us
W20260709 13:08:20.106889 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.119861 15375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
I20260709 13:08:20.120952 15375 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.121835 15375 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:20.257750 16656 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:08:20.259302 16587 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.268767 16528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47386 (request call id 70) took 1151 ms. Trace:
I20260709 13:08:20.291746 15381 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:20.301524 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 191970us
I20260709 13:08:20.280894 16587 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:20.327975 15300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50774
I20260709 13:08:20.343590 15300 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.315573 15375 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:20.344599 15300 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:20.349169 16663 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:20.395859 15375 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:20.442575 15300 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:20.286293 16528 rpcz_store.cc:276] 0709 13:08:19.114524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.127398 (+ 12874us) service_pool.cc:224] Handling call
0709 13:08:19.240243 (+112845us) log.cc:844] Serialized 501 byte log entry
0709 13:08:20.259969 (+1019726us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3337,"raft.queue_time_us":57197,"raft.run_cpu_time_us":2317,"raft.run_wall_time_us":2315,"thread_start_us":126360,"threads_started":2,"wal-append.queue_time_us":130592}
I20260709 13:08:20.532012 16586 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:08:20.534130 16668 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:08:20.573400 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:20.574208 15308 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.574913 15305 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:20.577243 15300 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:20.583873 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:20.584734 15377 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.585335 15377 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:20.589219 16673 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:08:20.589710 16470 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:20.586027 16634 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.590853 16634 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:20.594069 16568 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:20.594765 16568 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:20.596609 16634 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:20.597924 16568 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:20.585845 15300 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:20.604322 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:20.605126 16587 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:20.611375 16606 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:20.612197 16606 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:20.621675 15376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:20.622432 15376 raft_consensus.cc:606] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:20.622819 15376 raft_consensus.cc:614] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:20.635109 16675 ts_tablet_manager.cc:933] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:20.632994 15377 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:20.634789 15308 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:20.640249 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:20.648778 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:20.649554 15225 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.652251 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:20.669160 15225 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:20.676913 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:20.650115 16486 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:20.709283 16623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc5a1ea32aef45d1b6e1ff8b0718d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.662228 15302 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:20.786319 16606 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:20.784853 16486 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:20.830346 15377 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.831444 16486 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:20.808218 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47058.5us
I20260709 13:08:20.840646 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:20.841866 15374 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:20.846365 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:20.847153 15230 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:20.847488 15230 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:20.848131 16522 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:20.848250 15230 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:20.848803 16522 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:20.850558 16006 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:20.851126 16522 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:20.763859 15974 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.BeginTabletCopySession -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56775.4us
I20260709 13:08:20.854265 15230 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.856747 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:20.858345 16675 tablet_copy_client.cc:323] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:08:20.860906 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 30992f1a0d1949a7aacbc6cbd114a206 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:20.862123 16658 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:20.862972 16658 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:20.853281 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.864910 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.865541 15130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 86) took 1008 ms. Trace:
I20260709 13:08:20.865832 16651 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:20.866899 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:20.867651 15374 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:20.881559 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:20.882297 16651 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:20.883131 16671 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:20.883613 16671 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.886293 15230 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
W20260709 13:08:20.895165 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.896720 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 179791us
I20260709 13:08:20.883950 16671 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.906389 15274 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:20.907006 15230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:20.917299 16539 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:20.918011 16539 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:20.919064 16539 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:20.921139 15376 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:20.923138 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:20.924623 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:20.912307 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:20.932240 15377 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:20.939690 15274 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:20.962883 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:20.959259 16470 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.959259 16606 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:20.959668 16602 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:20.865969 15130 rpcz_store.cc:276] 0709 13:08:19.857610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.858653 (+  1043us) service_pool.cc:224] Handling call
0709 13:08:19.901334 (+ 42681us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:20.865469 (+964135us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:20.310613 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:20.350211 (+ 39598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:20.350259 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:08:20.350279 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:20.350670 (+   391us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:20.350760 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:20.350795 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:20.351003 (+   208us) tablet.cc:701] Row locks acquired
0709 13:08:20.351022 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:20.351174 (+   152us) write_op.cc:270] Start()
0709 13:08:20.351291 (+   117us) write_op.cc:276] Timestamp: P: 1783602500351132 usec, L: 0
0709 13:08:20.351313 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:20.352074 (+   761us) log.cc:844] Serialized 535 byte log entry
0709 13:08:20.354454 (+  2380us) op_driver.cc:464] REPLICATION: finished
0709 13:08:20.404621 (+ 50167us) write_op.cc:301] APPLY: starting
0709 13:08:20.471233 (+ 66612us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:20.537717 (+ 66484us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:20.572126 (+ 34409us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:20.581057 (+  8931us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:20.588554 (+  7497us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:20.588617 (+    63us) write_op.cc:312] APPLY: finished
0709 13:08:20.588866 (+   249us) log.cc:844] Serialized 22 byte log entry
0709 13:08:20.589077 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.589171 (+    94us) write_op.cc:454] Released schema lock
0709 13:08:20.589216 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:20.589563 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:20.589597 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":56193792,"child_traces":[["op",{"apply.queue_time_us":5126,"apply.run_cpu_time_us":2412,"apply.run_wall_time_us":188206,"num_ops":1,"prepare.queue_time_us":339051,"prepare.run_cpu_time_us":3301,"prepare.run_wall_time_us":46169,"replication_time_us":2976,"thread_start_us":167457,"threads_started":1}]]}
I20260709 13:08:20.988556 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:20.997109 15227 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:21.001633 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.024735 16520 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:08:21.055605 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 126313us
W20260709 13:08:21.053437 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 89887.8us
I20260709 13:08:20.994086 16470 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.062619 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.067171 15379 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:21.043772 16680 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.032193 16606 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:08:21.073554 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77454.5us
I20260709 13:08:21.071048 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:21.069446 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 158670us
W20260709 13:08:21.079851 16679 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:21.069725 16602 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:08:21.082887 16680 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:21.052780 16651 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.068526 16658 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.055464 16520 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:21.070694 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 362d7a17088a4e86a51428b5ee97346e from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:08:21.095928 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 362d7a17088a4e86a51428b5ee97346e from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-362d7a17088a4e86a51428b5ee97346e
I20260709 13:08:21.096575 16694 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.096968 16522 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.097359 16694 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.098007 16522 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:21.129093 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47000.1us
W20260709 13:08:21.130236 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55980.6us
I20260709 13:08:21.092106 16520 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:21.072228 16586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46416 (request call id 8) took 2140 ms. Trace:
I20260709 13:08:21.101703 16694 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.123617 16522 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.164324 15308 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:21.132899 16486 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.132676 16658 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.133261 16651 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.197067 15230 raft_consensus.cc:606] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:21.197641 15230 raft_consensus.cc:614] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.162307 16694 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.222334 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.147114 16586 rpcz_store.cc:276] 0709 13:08:18.931761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.932088 (+   327us) service_pool.cc:224] Handling call
0709 13:08:18.967971 (+ 35883us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54001665a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa3520 00007f2f53b2cb42 00007f2f53b2b800 00007f2f58aecd29 00007f2f5206b1d4 00007f2f5206b162 00007f2f5206b091 00007f2f5206b00c 00007f2f5206a2c2 00007f2f51e6148c
0709 13:08:19.005909 (+ 37938us) log.cc:844] Serialized 506 byte log entry
0709 13:08:19.294486 (+288577us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b18002e5dc0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:08:19.407039 (+112553us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b18002e5dc0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:08:19.511721 (+104682us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b2c000014c8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242ea0a 00007f2f5242e693 00007f2f5242e631 00007f2f53b62b52 00007f2f53b62cf5 00007f2f53a9f691 00007f2f53a7feaa 00007f2f53a86d53 00007f2f53a86cd9 00007f2f53a86c69
0709 13:08:19.532696 (+ 20975us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b180016e5a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b62d01 00007f2f53a9f691 00007f2f53a7feaa 00007f2f53a86d53 00007f2f53a86cd9 00007f2f53a86c69 00007f2f53a86c31 00007f2f53a85dfd 000000000038f354 000000000038f199
0709 13:08:21.069224 (+1536528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12716,"raft.queue_time_us":11732,"raft.run_cpu_time_us":8458,"raft.run_wall_time_us":322442,"spinlock_wait_cycles":340663040,"thread_start_us":158138,"threads_started":1,"wal-append.queue_time_us":263426,"wal-append.run_cpu_time_us":4550,"wal-append.run_wall_time_us":1226067}
I20260709 13:08:21.192546 16658 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.195811 16651 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:21.253831 16665 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.872s	user 0.005s	sys 0.012s
I20260709 13:08:21.236019 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:21.238848 16505 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.195142 16486 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.232566 16694 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.232864 16671 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:21.276906 16645 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:08:21.255165 16686 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:08:21.278584 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 143129us
W20260709 13:08:21.280915 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 150439us
I20260709 13:08:21.228268 15243 tablet_copy_source_session.cc:215] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:21.295444 16671 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:21.292495 16004 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:21.279361 16505 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.313203 16486 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.277801 16645 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.313733 16658 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.309978 16651 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.323287 16694 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:21.327543 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 196111us
I20260709 13:08:21.327008 16505 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:21.328368 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 227489us
I20260709 13:08:21.350687 15974 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:21.365757 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.368835 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:21.369619 16645 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.377737 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.377533 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.380623 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.385485 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.384369 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.390651 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.393061 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.403113 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:21.383008 16612 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:21.380098 16671 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.429165 16671 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:21.429875 16623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46140 (request call id 212) took 2324 ms. Trace:
I20260709 13:08:21.430550 16623 rpcz_store.cc:276] 0709 13:08:19.105636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.106656 (+  1020us) service_pool.cc:224] Handling call
0709 13:08:19.313585 (+206929us) ts_tablet_manager.cc:934] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
0709 13:08:20.707143 (+1393558us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:21.249894 (+542751us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:21.250173 (+   279us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:21.359275 (+109102us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:21.359618 (+   343us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:21.429625 (+ 70007us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:21.429735 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":381,"tablet-copy.queue_time_us":205679,"thread_start_us":216206,"threads_started":2}
I20260709 13:08:21.407866 16680 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:21.397778 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47223us
I20260709 13:08:21.434593 16470 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.406103 16505 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:21.435765 16675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362d7a17088a4e86a51428b5ee97346e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.409408 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:21.442174 16368 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:21.446051 16671 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:21.414409 16658 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:21.424192 16520 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:21.425472 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.397121 16693 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:21.518468 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.519393 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.474220 16623 tablet_copy_client.cc:806] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:21.494434 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.493224 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:21.512607 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.521982 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.495971 16629 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:21.519573 15303 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:21.541814 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:21.516374 16693 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.523046 16520 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.540715 16623 tablet_copy_client.cc:670] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:21.542970 15379 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:21.636832 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:21.637760 15378 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.599210 16693 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.641510 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:21.644860 15376 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:21.647034 16520 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:21.641557 16647 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.652989 16647 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.659610 15375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:21.660573 15375 raft_consensus.cc:606] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:21.660988 15375 raft_consensus.cc:614] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:21.541862 16629 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.642004 16528 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:21.665712 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.667006 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.674765 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.675077 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.676558 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.682006 15232 raft_consensus.cc:2410] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:21.686779 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.688189 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:21.731261 16694 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.776908 16707 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:21.688369 16528 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.743208 16494 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:21.732249 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51709.1us
I20260709 13:08:21.794457 16494 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.795009 16629 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:21.745826 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.796964 16494 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.790087 16694 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:21.790601 16675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46140 (request call id 221) took 1625 ms. Trace:
I20260709 13:08:21.791165 16707 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:21.793843 16528 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:21.804260 16647 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:21.798583 16628 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:21.829531 15378 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:21.825433 16707 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:21.799615 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:21.843879 15225 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:21.846520 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:21.857829 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:21.859789 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:21.863788 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:21.869721 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.870699 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.871270 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:21.880620 16713 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:21.854856 16680 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:21.857332 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 95888.6us
I20260709 13:08:21.839850 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:21.839166 16628 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.090616 16708 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.110550 16680 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:22.155730 16680 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.156592 16680 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.801862 16675 rpcz_store.cc:276] 0709 13:08:20.240999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.255284 (+ 14285us) service_pool.cc:224] Handling call
0709 13:08:20.635572 (+380288us) ts_tablet_manager.cc:934] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
0709 13:08:21.434290 (+798718us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:21.449282 (+ 14992us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:21.449428 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:21.786708 (+337280us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:21.790052 (+  3344us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:21.790462 (+   410us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:21.790536 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":68482,"tablet-copy.queue_time_us":377253,"thread_start_us":420995,"threads_started":2}
W20260709 13:08:22.098304 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 269642us
I20260709 13:08:22.099046 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:22.160234 16675 tablet_copy_client.cc:806] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:22.129086 16685 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.139822 16628 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:22.197466 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:22.199314 16707 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.209617 16675 tablet_copy_client.cc:670] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:22.227304 16522 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:22.209105 16694 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:22.185930 16708 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:22.208448 16685 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.270840 16685 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.271416 16708 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.284451 16728 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.292999 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 110365us
I20260709 13:08:22.296639 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.297331 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.305042 15227 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:08:22.286170 16693 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.000s
I20260709 13:08:22.286375 16694 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.250414 16707 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.313222 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.285163 16728 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.318020 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:22.386109 16730 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:08:22.300796 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 199529us
I20260709 13:08:22.413357 16728 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:22.312728 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 94007.5us
I20260709 13:08:22.417016 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:22.417992 16671 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:22.418606 16671 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:22.419761 16729 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.419575 16671 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:22.423151 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 105259us
I20260709 13:08:22.318279 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.311103 16693 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.448177 15228 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:22.318037 16694 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:22.429998 16658 consensus_meta.cc:287] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.773s	user 0.013s	sys 0.002s
I20260709 13:08:22.443137 16465 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.429800 16713 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.433609 16683 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:22.457907 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 139663us
I20260709 13:08:22.450708 16647 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.454421 16659 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.457554 16735 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:22.461854 16702 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.420501 16729 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.509325 16694 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:22.512490 16680 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.491163 16738 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.501966 16647 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:22.504479 16382 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.504263 16638 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.538504 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:22.534196 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 109957us
I20260709 13:08:22.537956 15129 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 196) took 3259 ms. Trace:
I20260709 13:08:22.547715 15129 rpcz_store.cc:276] 0709 13:08:19.278688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.278917 (+   229us) service_pool.cc:224] Handling call
0709 13:08:22.537854 (+3258937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5,"reported_tablets":6}
I20260709 13:08:22.489373 16465 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.520197 16727 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.500087 16713 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.503487 16683 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:22.551805 16638 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.571659 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:22.552596 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48069.6us
W20260709 13:08:22.558648 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 124613us
I20260709 13:08:22.545172 16649 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:22.601142 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:22.603552 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 144278us
I20260709 13:08:22.604666 16710 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.505884 16659 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.605665 16674 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.607842 15375 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:22.558581 16707 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:22.549036 16382 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.600917 16551 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.619062 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:22.634711 16749 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.516072 16702 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.635145 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:22.635299 15198 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:22.636577 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:22.637096 16707 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.637421 16702 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.637899 16707 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.638024 16702 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.639665 16702 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.640239 16494 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:22.641338 16494 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:22.642040 16702 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:22.642256 16494 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:22.635339 16749 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.645036 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:22.645049 15373 raft_consensus.cc:2955] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:08:22.600620 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 143821us
I20260709 13:08:22.646494 15375 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:22.646188 16749 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.656111 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.746402 15230 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:22.657016 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.664839 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:22.671468 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.672457 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.673635 15378 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.725157 16733 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.613511 16680 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.724800 16675 tablet_copy_client.cc:538] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:22.614045 16649 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.519450 16738 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:22.631717 16693 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:22.629029 16647 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:22.658769 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:22.766047 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:22.747164 16623 tablet_copy_client.cc:538] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:22.769089 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:22.770961 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:22.781324 16697 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.748052 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:22.647025 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:22.751282 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:22.628475 16710 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.726246 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:22.675815 16551 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.759989 16749 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:22.561007 16727 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.806337 16727 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.808698 16741 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.817775 16649 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:22.775902 16638 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:22.796217 16647 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.628000 16674 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.838214 16738 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:22.834080 16659 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.809681 16741 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.835721 16638 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:22.881603 16710 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:22.813974 16697 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.885136 16642 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.874230 16738 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:22.873169 16465 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.875656 16638 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.778051 16733 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.899811 16729 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:22.899626 16738 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.901033 16683 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.905295 16382 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.848541 16647 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.916428 16674 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.914466 16642 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:22.958160 16736 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:22.959386 16738 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:22.959906 16697 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:22.960776 16713 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.958956 16736 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:22.967484 16647 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:22.980829 16741 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:22.969290 16658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54632 (request call id 70) took 2898 ms. Trace:
I20260709 13:08:22.979136 16733 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.984257 16736 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.990178 16675 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
W20260709 13:08:23.023504 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 432996us
W20260709 13:08:23.028729 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 391996us
I20260709 13:08:22.974962 16551 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:22.982851 16638 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:23.031610 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.042676 16729 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.043411 16642 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.044709 16729 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.026505 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:23.049367 16755 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.055011 16697 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:23.055915 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 243225us
I20260709 13:08:23.056257 16697 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.057209 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:23.062018 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:23.073856 16753 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:23.079358 16638 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.084858 16710 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.086058 16710 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:23.088263 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62273.1us
I20260709 13:08:23.055081 16758 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.089918 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:23.094229 16638 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.098208 16638 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:23.102391 15228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 91) took 1610 ms (client timeout 1627 ms). Trace:
I20260709 13:08:23.116942 16738 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:23.112865 15228 rpcz_store.cc:269] 0709 13:08:21.491702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.492794 (+  1092us) service_pool.cc:224] Handling call
0709 13:08:23.088230 (+1595436us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540012f7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:23.102007 (+ 13777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118441728}
I20260709 13:08:23.116942 16741 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:23.123018 16741 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:23.052314 16755 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.130309 16627 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:23.130312 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:23.131814 16729 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.133591 16584 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:23.134188 15271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.005s
I20260709 13:08:23.134434 16697 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:23.134764 15271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.006s	sys 0.005s
I20260709 13:08:23.139518 16741 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:23.146052 16641 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.158128 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:22.990000 16658 rpcz_store.cc:276] 0709 13:08:20.069710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.086652 (+ 16942us) service_pool.cc:224] Handling call
0709 13:08:20.290380 (+203728us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b58003a07d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a820aa 00007f2f53b04447 00007f2f53b2170a 00007f2f53b2276a 00007f2f53b2191b 00007f2f53b2d03c 00007f2f53b2c6b3 00007f2f53b249fa 00007f2f58aec4c9 00007f2f52068c54
0709 13:08:20.300150 (+  9770us) log.cc:844] Serialized 501 byte log entry
0709 13:08:20.591441 (+291291us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b5400530820. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa6b26 00007f2f53aa049a 00007f2f53a9f714 00007f2f53a7feaa 00007f2f53a86d53 00007f2f53a86cd9 00007f2f53a86c69 00007f2f53a86c31 00007f2f53a85dfd 000000000038f354
0709 13:08:22.968441 (+2377000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32772,"raft.queue_time_us":32641,"raft.run_cpu_time_us":3062,"raft.run_wall_time_us":395357,"spinlock_wait_cycles":27124352,"thread_start_us":44561,"threads_started":1,"wal-append.queue_time_us":279225,"wal-append.run_cpu_time_us":2139,"wal-append.run_wall_time_us":1028672}
I20260709 13:08:23.161952 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3005d9c450974fc299b5f0c0e92c745a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.164458 16710 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.168646 16522 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.169905 16522 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:23.173192 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 141901us
I20260709 13:08:23.174788 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.176309 16741 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.177999 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.179179 16741 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:23.180531 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.000s	sys 0.009s
W20260709 13:08:23.181260 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 545993us
I20260709 13:08:23.183619 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:23.091931 16758 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.149673 16697 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.148218 16641 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.204804 16685 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.206076 16672 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.207669 16641 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:23.200366 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53832.1us
I20260709 13:08:23.206135 16685 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.211648 16697 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.214278 16697 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.207376 16672 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.225381 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.225989 16522 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.230229 16685 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:23.227579 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 71436.4us
I20260709 13:08:23.228845 16747 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:23.232652 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49340.4us
W20260709 13:08:23.239792 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72030.8us
I20260709 13:08:23.254668 16758 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.255151 16707 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.256466 16003 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:23.241351 16755 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.253326 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:23.276237 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44554.2us
I20260709 13:08:23.276510 16758 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:23.277256 16758 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.277805 16758 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.283339 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.283865 16586 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.286916 16627 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.284564 15302 raft_consensus.cc:1813] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Handling vote request from an unknown peer b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.285595 16587 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.286013 16719 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.292104 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:23.293273 16006 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:23.293051 16719 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:23.288031 16627 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.297338 16719 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:23.289956 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:23.295197 16587 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.318861 16742 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.287591 16586 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.322839 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.316320 15302 raft_consensus.cc:2410] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:23.324801 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:23.329983 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.331475 16727 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:23.307644 16672 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.344703 15228 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:23.350066 16528 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.350971 16692 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.351516 16712 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.348968 16742 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.350996 16528 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.352900 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.354768 16742 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.354486 16712 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.355523 16755 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.355008 16528 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.358121 15348 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.361094 16702 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:23.356848 16755 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:23.369447 16587 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.371965 16629 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:23.372881 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.374250 16702 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.376855 16658 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:23.377053 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 135473us
I20260709 13:08:23.380198 16742 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.380884 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.382557 16735 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.382177 16742 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.383292 16735 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.386053 16735 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.386629 16623 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:08:23.390003 16739 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.391649 16759 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.390285 16742 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.380092 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.391063 16739 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.395048 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:23.381846 16766 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:23.376124 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.398365 15228 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:23.397820 16658 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.391052 15131 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.401714 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.392827 16759 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:23.403237 16551 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.402652 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.405665 16739 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.394683 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.408315 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.411104 16551 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.410969 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.393323 16627 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.411616 15226 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:23.403652 15131 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 2, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.420898 16629 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.421676 16629 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.425269 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.429069 15273 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.439355 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.439625 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.440236 15231 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:23.440231 15378 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.440441 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.442823 16465 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.443153 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:23.444370 16627 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:23.449061 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:23.449826 16728 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.450280 16728 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:23.450712 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.451668 16728 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:23.452214 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.453065 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.453734 15231 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:23.455027 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.456993 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.458575 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.459227 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.453655 16728 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.459517 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.460971 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.461946 15303 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.407387 16692 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.466171 16759 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:23.466158 16587 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.467960 16587 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.468504 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:23.471282 16587 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.472469 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:23.473333 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44360.7us
I20260709 13:08:23.473536 16002 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.438458 16739 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:08:23.475716 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:23.477492 16719 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:23.427809 16712 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.477962 16719 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.478543 16719 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.435388 15131 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.486601 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.486657 16692 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.488322 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.488718 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.490998 16586 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.493499 16755 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.499354 15305 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:23.501263 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.501744 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.502329 15376 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:23.506285 15131 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 2 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 3 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.509949 16758 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.518116 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.519207 15301 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.520491 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.523729 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.523901 16587 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.525674 16587 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.530527 16712 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.531481 16712 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.534348 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.532008 16758 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.532472 16742 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.536141 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.547950 16742 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.482106 16671 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.544274 16006 raft_consensus.cc:2955] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:23.548681 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.553357 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.548399 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:23.550184 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.555444 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.554042 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.553017 15229 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:23.556799 15227 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:23.559237 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:23.559520 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.560503 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.561316 15233 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:23.561895 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.575574 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.559432 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.561813 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.573364 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.579038 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.580803 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.581683 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.581619 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:23.583246 16528 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:23.584862 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:23.585201 15225 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:23.586849 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.589310 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.590073 15301 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.589393 16750 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.591022 16750 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.592638 16742 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.592784 16528 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:23.593780 16528 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.593972 16750 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.594360 16528 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.574074 16671 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:23.597424 15232 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:23.556988 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.556720 16712 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.604315 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.607193 16465 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.558326 16587 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.609540 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.612800 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.615008 15301 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.616257 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.617014 15376 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:23.613214 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.620848 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.621191 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.624676 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.631767 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.632881 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.633942 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:23.610940 16750 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.648492 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.642125 16728 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:23.601567 16747 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:23.646248 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.646773 15300 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.638419 15305 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:23.647416 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.657675 16586 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.632146 16758 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.669736 16539 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.670969 16647 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:23.671720 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.651763 16728 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.636530 16465 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.682101 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:23.677639 16728 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.658972 16586 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.692175 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.674795 16750 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.726372 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.728040 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.707901 15308 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:23.732749 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.736439 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.717064 16551 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:23.684718 16758 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.746438 15301 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:23.779016 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.779490 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.783939 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.752766 16551 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:23.788949 15306 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:23.792621 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:23.794564 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.797775 16587 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:23.797868 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.585s (SENT) [suppressed 3 similar messages]
I20260709 13:08:23.798441 16587 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.799141 16587 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.808634 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.828025 16629 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.830485 16671 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:23.837731 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.841985 16750 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.843339 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:23.851449 16587 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:23.856411 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:23.858143 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.859347 16587 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.874701 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:23.718371 16647 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:23.892645 15227 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:23.796250 16551 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:23.899219 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 104839us
I20260709 13:08:23.901923 16755 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:23.904434 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:23.906185 15971 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:08:23.907357 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 117999us
I20260709 13:08:23.921250 16465 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.923026 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:23.923183 15306 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:23.951370 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85043us
I20260709 13:08:23.954453 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:23.960729 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.945505 16755 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:23.970863 16758 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:23.957259 15224 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:23.978904 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:23.983496 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:23.976105 16755 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.988715 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:23.983682 16596 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.997469 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.009176 15379 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.014587 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.015079 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:23.985168 16629 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.022087 16528 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.029790 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.032102 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.033850 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.035045 15373 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:24.035259 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.037324 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.039080 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:24.039605 16587 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.029889 16739 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:23.999611 16692 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:24.049460 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:24.050477 15373 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.074021 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.077472 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:24.081686 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:24.082075 16647 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:24.083376 16742 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.084108 16742 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.084720 16742 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.088982 16704 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.089933 16704 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.090477 16704 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.100688 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:24.056042 16658 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:24.052874 16587 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:24.112251 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 370148us
I20260709 13:08:24.116953 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.095974 16528 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.118736 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.147596 16655 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.114755 16658 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.114496 16587 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.120736 16739 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.128962 16705 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:24.158545 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 143533us
I20260709 13:08:24.173520 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:24.172860 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48633.5us
I20260709 13:08:24.150282 15274 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.148908 16528 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:24.192341 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49240.7us
I20260709 13:08:24.152954 16586 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.155701 16655 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.173341 16587 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.165019 16658 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.194155 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:08:24.199383 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 59062.2us
I20260709 13:08:24.186530 16747 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:24.197839 16655 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.220803 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:24.192309 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70423.6us
I20260709 13:08:24.208681 16596 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.238271 16596 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.238934 16596 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.200573 16739 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:24.248843 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.250005 16551 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:24.250626 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.251374 15305 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:24.250159 16755 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.255394 16551 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:24.258039 16739 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:24.260596 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.262188 15307 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:24.209430 16671 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:24.262873 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53134.9us
I20260709 13:08:24.209873 16775 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:24.276520 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 92161.6us
W20260709 13:08:24.262668 16728 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.563s	user 0.007s	sys 0.007s
I20260709 13:08:24.279294 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:08:24.286780 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 85393.7us
I20260709 13:08:24.289767 15378 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:24.286355 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.295003 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:24.297001 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82474us
I20260709 13:08:24.298211 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:24.233537 16742 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.303288 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.279071 16775 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.286468 16728 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.297708 16647 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.314211 16647 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.314747 16647 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.318451 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:24.321552 15379 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:24.322180 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.303251 16586 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:24.320442 16719 consensus_meta.cc:287] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.841s	user 0.015s	sys 0.002s
I20260709 13:08:24.316525 16775 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.330847 16719 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:24.333393 16719 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:24.334168 16551 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.334709 16551 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.334409 16655 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.335158 16551 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.336795 15228 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:24.337570 16790 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.338346 16790 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.339502 16787 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.340224 16782 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.341205 16739 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:24.297498 16780 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:24.349380 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.352237 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.353214 15376 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:24.353442 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.353629 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.353950 16781 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.347664 16782 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.358309 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.358651 16671 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.371754 15274 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.364718 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.320312 16692 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:24.367844 15373 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:24.376703 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.381021 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.336853 16776 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.329506 16779 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.420240 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.423771 16739 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:24.425428 15376 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:24.427003 16596 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.428088 16702 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:24.428540 16702 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.428918 16702 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:24.427493 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82899us
I20260709 13:08:24.419634 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.374397 16782 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.370893 16780 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.378194 16671 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.448547 16596 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.430585 16735 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.381054 16781 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.378270 16658 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.453240 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:24.454176 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.379187 16692 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.559172 16692 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.437155 16627 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:24.562237 16627 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:24.563459 16684 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:24.477008 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.439870 16739 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:24.444864 16780 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.429898 16647 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.457973 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:24.524292 16789 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.454627 16755 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:24.445884 16776 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.452178 16704 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.538947 16655 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.543514 16587 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.546561 16658 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:24.548745 16781 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.507457 16735 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.549422 16742 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.549487 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.552577 16551 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.553918 16675 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:24.555274 16790 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:24.442569 16779 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.455595 16728 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.423146 16787 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:24.565841 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 181178us
W20260709 13:08:24.566959 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 213424us
W20260709 13:08:24.530387 16791 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:08:24.612691 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:24.571508 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 118378us
I20260709 13:08:24.555929 16775 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.613883 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:24.615474 16775 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.615684 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.573812 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.615477 16787 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:24.563632 16627 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.616937 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.617302 16758 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:24.617756 16758 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.618192 16758 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.570353 16006 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.620924 16692 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:24.601577 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 279901us
I20260709 13:08:24.607223 16551 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.609849 16779 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:24.611522 16647 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.616190 16775 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.642216 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:24.644287 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:24.656390 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:24.658874 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:24.661712 15231 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:24.667848 16006 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:24.669773 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:24.672199 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47229us
I20260709 13:08:24.689612 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:24.689762 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:24.672613 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:24.691802 16008 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:24.692252 15227 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:24.707055 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.598285 16789 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:24.691162 16692 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.719915 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:24.721194 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46888.8us
I20260709 13:08:24.719851 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.724978 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.714000 16735 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.733112 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:24.730969 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.733558 16775 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.737732 16775 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.738150 16775 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.739351 16704 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.739568 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.716315 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:24.740670 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.741766 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.742769 16702 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.728328 16675 tablet_bootstrap.cc:492] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:24.737272 15230 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:24.744417 16675 ts_tablet_manager.cc:1403] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 1.755s	user 0.050s	sys 0.046s
W20260709 13:08:24.753634 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 126287us
I20260709 13:08:24.762542 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:24.766165 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46414.7us
I20260709 13:08:24.766928 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.756291 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.767222 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.770156 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.767092 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:24.749338 16742 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:24.776674 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51059.2us
I20260709 13:08:24.782353 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.782721 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.775614 16586 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:24.755107 16671 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:24.790159 16671 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.793666 16775 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.798446 16675 raft_consensus.cc:359] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:24.799708 16675 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:24.804700 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:24.803922 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 47734.6us
I20260709 13:08:24.752502 16800 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.822696 15381 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:24.775364 16587 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.836642 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.838292 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.775815 16742 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.839758 16742 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.831964 16675 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:24.842547 16675 ts_tablet_manager.cc:1434] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:08:24.842803 16780 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.805440 16807 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.806228 16655 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.846742 16655 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:24.848603 16702 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.845976 16807 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:24.854079 16776 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:24.854314 16807 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.851656 16758 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.852200 16780 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.822885 16800 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.856437 15230 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:24.857029 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:24.859122 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.807163 16775 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:24.861548 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:24.869089 15224 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:24.869984 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.870815 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:24.921281 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 64357us
I20260709 13:08:24.859293 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.930809 16778 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:24.931126 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 71890us
I20260709 13:08:24.931422 16809 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.931540 16776 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.931895 16778 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:24.932580 16778 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:24.932876 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:24.933596 16778 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.934435 15382 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:24.934677 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:24.934823 16778 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.935323 15225 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:24.913692 16800 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.922669 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.926848 15233 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:24.932055 16776 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:24.923789 15228 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:24.939637 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 189355us
I20260709 13:08:24.951151 15379 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:24.949303 16776 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.956976 16623 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:24.958657 16623 tablet_bootstrap.cc:492] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:08:24.959473 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.961768 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.961467 15274 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:24.848032 16655 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:24.966164 15373 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:24.967190 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:24.967778 16684 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:24.971249 16684 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:24.971628 16684 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.972564 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:24.931941 16809 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:24.979838 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.970244 16623 ts_tablet_manager.cc:1403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 1.584s	user 0.040s	sys 0.023s
I20260709 13:08:24.983822 16789 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:24.986374 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.987313 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.987955 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:24.989697 16782 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 13:08:24.990060 16804 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:08:24.965713 16775 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:08:24.990579 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:24.991046 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.993525 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:24.997984 15301 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.998275 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:24.998433 16782 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:24.996045 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:25.000553 16782 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.001253 15229 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.001606 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:25.001683 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.003575 16804 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.003976 16804 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:25.005206 16775 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.005760 16775 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:24.981542 16809 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.009799 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.013484 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.016068 16587 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.016364 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.017218 16587 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.018217 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-362d7a17088a4e86a51428b5ee97346e received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:25.018839 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-362d7a17088a4e86a51428b5ee97346e on tablet 362d7a17088a4e86a51428b5ee97346e with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:25.025490 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:25.026268 16005 raft_consensus.cc:1813] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.026777 16005 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:25.028692 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:25.029590 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:25.029835 16797 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.030968 16797 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.006863 16775 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.032568 16779 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:25.032929 16775 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.033113 16787 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.033954 16755 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.034256 16787 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.034391 16755 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.034723 16787 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.035413 16755 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.035624 16787 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.036551 16658 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.032956 16779 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:25.009050 16782 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.014258 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:25.031888 16797 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:25.055184 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:25.058005 15233 raft_consensus.cc:1813] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.058115 16797 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:25.058656 15233 raft_consensus.cc:2410] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:25.041467 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:25.058138 16623 raft_consensus.cc:359] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:25.043340 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:25.060031 16623 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:08:25.060456 16002 raft_consensus.cc:1813] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Handling vote request from an unknown peer b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.015131 16789 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.061064 16002 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 2: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:25.060817 16623 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:25.043803 16003 raft_consensus.cc:1217] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:25.042564 15301 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:25.044425 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.051787 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.053690 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.055259 16772 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.062755 16684 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.058564 16797 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.042212 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:25.044026 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.066711 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.064889 15196 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:08:25.067850 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58130us
I20260709 13:08:25.023871 16742 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.071584 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:25.081509 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.075883 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.086576 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.091135 16800 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:25.092535 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.052183 16658 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.063685 16779 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.093247 16781 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:25.073642 16782 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.095511 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.109177 15378 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.110544 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:25.108043 15199 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:25.119652 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.105331 16755 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.117422 15224 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.125319 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.110725 16781 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:25.098948 16658 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.206271 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:25.226749 15382 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:25.116001 16787 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.227478 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.263023 15233 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:25.225136 15374 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:25.240983 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.262807 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.217063 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.126410 15227 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.203955 16742 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.264791 15230 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:25.181316 16758 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.122093 16788 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.202657 16623 ts_tablet_manager.cc:1434] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.205s	user 0.008s	sys 0.000s
I20260709 13:08:25.149622 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:25.154062 16797 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.287050 16797 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.203585 16800 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.149020 16002 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:25.281320 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.291788 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.191442 16684 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.210073 16782 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.293496 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.294247 15233 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:25.214488 16779 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.300691 15233 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.313954 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.314610 15227 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:25.325533 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:25.326570 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.328045 16790 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.299508 16776 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.311327 16781 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.347134 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.347033 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.349303 16747 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.356776 16804 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.358109 16804 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.360076 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:25.362640 15227 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.305294 16809 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.366776 15380 raft_consensus.cc:1813] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.367542 15380 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:25.368216 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.369064 15231 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:25.371531 16658 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.372749 15229 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.366498 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.373710 15230 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:25.372752 16786 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.375041 16786 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.377236 16786 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.387020 15130 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 4, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:25.387780 15376 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:25.389802 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:25.392560 16779 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:25.375029 16772 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.395232 15127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 189) took 5327 ms. Trace:
I20260709 13:08:25.395612 15127 rpcz_store.cc:276] 0709 13:08:20.067997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.068205 (+   208us) service_pool.cc:224] Handling call
0709 13:08:25.395023 (+5326818us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199744,"reported_tablets":3}
I20260709 13:08:25.399660 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 189) took 5979 ms. Trace:
I20260709 13:08:25.401829 15227 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:25.406306 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-dc5a1ea32aef45d1b6e1ff8b0718d178 received from {username='slave'} at 127.0.0.1:46420
I20260709 13:08:25.406857 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-dc5a1ea32aef45d1b6e1ff8b0718d178 on tablet dc5a1ea32aef45d1b6e1ff8b0718d178 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:25.412586 16776 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:25.414425 16809 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.415855 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:25.416637 15225 raft_consensus.cc:606] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.417464 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:25.418030 15227 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:25.418802 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.420181 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.424167 16779 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:25.425285 16779 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.425670 16779 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.426534 16779 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.427770 16779 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.429287 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.429533 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.430327 16782 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:25.430511 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.430727 16782 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:25.430831 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.431182 16782 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.431690 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.433619 15306 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.433991 15306 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:25.434304 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:25.434758 15306 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.435684 15306 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.436118 16787 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.437172 16787 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.442354 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:25.443235 16003 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:25.443332 16002 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.444940 16005 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.445288 16792 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.447681 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.402146 15131 rpcz_store.cc:276] 0709 13:08:19.420281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.420515 (+   234us) service_pool.cc:224] Handling call
0709 13:08:25.399602 (+5979087us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:23.974748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:24.030473 (+ 55725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:24.030540 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:08:24.030573 (+    33us) tablet.cc:662] Decoding operations
0709 13:08:24.031389 (+   816us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:24.031476 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:24.031506 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:24.032012 (+   506us) tablet.cc:701] Row locks acquired
0709 13:08:24.032070 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:08:24.032280 (+   210us) write_op.cc:270] Start()
0709 13:08:24.057316 (+ 25036us) write_op.cc:276] Timestamp: P: 1783602504032198 usec, L: 0
0709 13:08:24.057378 (+    62us) op_driver.cc:348] REPLICATION: starting
0709 13:08:24.190819 (+133441us) log.cc:844] Serialized 1705 byte log entry
0709 13:08:24.825170 (+634351us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.005359 (+180189us) write_op.cc:301] APPLY: starting
0709 13:08:25.005441 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.005622 (+   181us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.005762 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.006699 (+   937us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.006982 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:08:25.007044 (+    62us) write_op.cc:312] APPLY: finished
0709 13:08:25.090242 (+ 83198us) log.cc:844] Serialized 40 byte log entry
0709 13:08:25.090445 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.090543 (+    98us) write_op.cc:454] Released schema lock
0709 13:08:25.090599 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.090978 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.091008 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":172911,"apply.run_cpu_time_us":3082,"apply.run_wall_time_us":85593,"num_ops":4,"prepare.queue_time_us":297107,"prepare.run_cpu_time_us":17741,"prepare.run_wall_time_us":404825,"raft.queue_time_us":148274,"raft.run_cpu_time_us":70653,"raft.run_wall_time_us":183897,"replication_time_us":720195,"spinlock_wait_cycles":51644800,"thread_start_us":379668,"threads_started":4,"wal-append.queue_time_us":214378}]]}
I20260709 13:08:25.453024 15273 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.453292 16792 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.445925 15306 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.455240 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.458570 16812 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.462095 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:25.463675 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.464883 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.466969 16792 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.471520 16776 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.472420 16792 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.473270 16787 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.473987 15130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 87) took 3788 ms. Trace:
I20260709 13:08:25.474668 16792 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.474856 15291 tablet_service.cc:1558] Processing DeleteTablet for tablet 30992f1a0d1949a7aacbc6cbd114a206 with delete_type TABLET_DATA_TOMBSTONED (TS 841138f50ace4746978e72d7f13878de not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50758
I20260709 13:08:25.476637 16792 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.477674 16747 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:25.478103 16747 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.478700 16747 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.478008 16792 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.481287 16792 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.474882 16787 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:25.482963 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52202.2us
I20260709 13:08:25.484442 16776 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.484894 16742 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.486538 16742 raft_consensus.cc:1064] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:25.489946 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.491784 15345 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.475348 15129 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index -1 to 2, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.493744 16812 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:25.494377 16812 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.497424 16812 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.498097 16742 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.502425 16586 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:25.502933 16586 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.508905 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.510094 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.511065 15274 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.513432 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:25.523694 16775 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.499006 16779 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.525475 16781 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.527799 16782 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.499034 16776 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.487454 16787 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.529775 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.531139 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.479856 15130 rpcz_store.cc:276] 0709 13:08:21.685627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.685821 (+   194us) service_pool.cc:224] Handling call
0709 13:08:25.473874 (+3788053us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:25.410544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:25.411197 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:25.411245 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:08:25.411264 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:25.411636 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:25.411698 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:25.411728 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:25.411894 (+   166us) tablet.cc:701] Row locks acquired
0709 13:08:25.411910 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:25.412052 (+   142us) write_op.cc:270] Start()
0709 13:08:25.412164 (+   112us) write_op.cc:276] Timestamp: P: 1783602505412006 usec, L: 0
0709 13:08:25.412187 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:25.424494 (+ 12307us) log.cc:844] Serialized 535 byte log entry
0709 13:08:25.448673 (+ 24179us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.449021 (+   348us) write_op.cc:301] APPLY: starting
0709 13:08:25.449107 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.449216 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.449301 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.449586 (+   285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.449739 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:25.449782 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:25.449957 (+   175us) log.cc:844] Serialized 22 byte log entry
0709 13:08:25.450122 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.450200 (+    78us) write_op.cc:454] Released schema lock
0709 13:08:25.450238 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.450575 (+   337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.450599 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":793605,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":97,"apply.run_cpu_time_us":1509,"apply.run_wall_time_us":1509,"num_ops":1,"prepare.queue_time_us":18637,"prepare.run_cpu_time_us":2753,"prepare.run_wall_time_us":36966,"replication_time_us":36334,"thread_start_us":17182,"threads_started":1}]]}
I20260709 13:08:25.514781 16596 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.532173 16790 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.542761 16586 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.547264 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:25.520964 16812 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.548660 16647 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.536520 15224 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.554598 16655 raft_consensus.cc:993] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:25.555601 16787 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.556993 16787 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.559698 15129 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 197) took 2057 ms. Trace:
I20260709 13:08:25.562772 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:25.561017 15129 rpcz_store.cc:276] 0709 13:08:23.502698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.503106 (+   408us) service_pool.cc:224] Handling call
0709 13:08:25.559613 (+2056507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:25.543544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:25.544050 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:25.544091 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:08:25.544107 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:25.544462 (+   355us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:25.544511 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:25.544536 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:25.544705 (+   169us) tablet.cc:701] Row locks acquired
0709 13:08:25.544722 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:25.544848 (+   126us) write_op.cc:270] Start()
0709 13:08:25.544972 (+   124us) write_op.cc:276] Timestamp: P: 1783602505544809 usec, L: 0
0709 13:08:25.544994 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:25.545559 (+   565us) log.cc:844] Serialized 598 byte log entry
0709 13:08:25.548695 (+  3136us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.551500 (+  2805us) write_op.cc:301] APPLY: starting
0709 13:08:25.551573 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.551671 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.551763 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.551978 (+   215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.552129 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:25.552173 (+    44us) write_op.cc:312] APPLY: finished
0709 13:08:25.552331 (+   158us) log.cc:844] Serialized 22 byte log entry
0709 13:08:25.552501 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.552578 (+    77us) write_op.cc:454] Released schema lock
0709 13:08:25.552614 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.552920 (+   306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.552953 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15101,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":1458,"apply.run_cpu_time_us":1397,"apply.run_wall_time_us":1398,"num_ops":1,"prepare.queue_time_us":88,"prepare.run_cpu_time_us":2273,"prepare.run_wall_time_us":2274,"replication_time_us":2051}]]}
I20260709 13:08:25.529798 16658 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:08:25.570235 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.538924 16799 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:08:25.565096 16747 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.547406 16587 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:08:25.565676 16758 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:08:25.582772 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.585602 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.585793 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.571740 16647 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.570076 16596 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.587214 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.595872 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:25.596668 15229 raft_consensus.cc:2393] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:25.594295 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.599323 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.600224 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.583810 16789 raft_consensus.cc:1081] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:25.580559 16684 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:08:25.608661 16776 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.609134 16776 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.609589 16781 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.609970 16776 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.611310 16776 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.612910 16596 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.617688 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:25.621809 15305 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.622331 15227 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.616858 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.624150 15375 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.625195 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:25.591810 16780 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.625722 15225 raft_consensus.cc:606] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.627050 15228 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.608722 15224 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.624224 16551 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.598405 16790 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.638891 16002 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.602294 16647 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:25.645507 16747 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.645654 16647 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.625061 16658 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.649684 15129 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.650947 16775 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.651345 16775 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:25.623579 16804 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.652093 15129 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 4, term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to <none>, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 2 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:25.654672 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.656502 16587 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.657821 16587 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.657961 16627 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.660517 16780 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:25.661458 16780 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.662146 16658 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:25.662451 15305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:08:25.663036 15305 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.663409 15305 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.663790 16797 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.664796 16797 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.673312 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.672796 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.617319 16812 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.663169 16658 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.672552 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.675413 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b75da66513484f36a3807f62f4177e56"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:25.675585 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.685101 16779 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.678328 15225 raft_consensus.cc:606] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.685536 16779 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.686851 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:25.684897 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 93200.1us
I20260709 13:08:25.687469 15379 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.673350 16797 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.701593 16797 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.702986 16797 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.684763 16799 consensus_queue.cc:1243] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:25.705703 15380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:35242
I20260709 13:08:25.689133 16779 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.709765 16779 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.712484 15301 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:25.652133 16775 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.713794 15375 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:08:25.716799 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 134100us
I20260709 13:08:25.719431 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.721318 15225 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:25.683038 16728 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:08:25.744712 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.745339 16775 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.765273 16824 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.767511 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.771255 15233 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:25.781951 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:25.784410 15305 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.790323 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:25.736388 16804 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:08:25.792743 15379 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:25.796617 15305 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:25.798127 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:25.798938 16008 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.804124 16658 raft_consensus.cc:2764] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:08:25.810422 16820 tablet_replica.cc:333] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:08:25.810503 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:25.811815 15233 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.812202 15233 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:25.813131 15233 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.813591 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:25.733214 16781 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:08:25.814592 16786 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.815289 16786 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:25.815580 16005 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:25.816370 16786 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:25.817471 16787 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.817888 16787 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:25.818862 16787 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:25.820035 15233 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.827831 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:25.830075 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62632.6us
I20260709 13:08:25.784528 16782 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:25.838325 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:25.820190 16787 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.811828 16820 raft_consensus.cc:2243] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:25.851414 15233 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:25.834882 16758 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.855499 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:25.841562 16800 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.834985 16807 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:08:25.849824 16704 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.857718 16799 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:25.878235 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.839422 16826 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:08:25.889986 16008 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:25.866938 16800 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:25.924729 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.902516 16820 raft_consensus.cc:2272] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:25.909761 16804 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.086119 15380 raft_consensus.cc:606] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:26.086730 15380 raft_consensus.cc:614] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:26.089493 16830 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:08:25.898904 16781 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
W20260709 13:08:26.099819 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 224576us
I20260709 13:08:25.902773 16647 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.137s
I20260709 13:08:25.898826 16828 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.160s
W20260709 13:08:26.109197 16816 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:08:26.107059 16827 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:08:26.112686 16804 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:26.159320 16834 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:26.158872 16804 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:26.170361 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:26.171890 16833 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
I20260709 13:08:26.172696 16797 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.173262 16797 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.176002 16797 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:26.184689 16551 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:26.185581 16551 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.186525 16551 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:26.214437 16776 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.603s	user 0.005s	sys 0.009s
I20260709 13:08:26.229844 15375 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:08:26.226981 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 122345us
I20260709 13:08:26.216065 16684 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.188215 16551 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.240227 16820 ts_tablet_manager.cc:1916] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:26.243623 15304 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:26.233361 16684 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.261653 16684 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.263796 16776 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.264526 16776 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.263159 16684 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.271780 16728 raft_consensus.cc:993] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:26.272233 16776 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:26.272413 16728 raft_consensus.cc:1081] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:26.277386 16776 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.279524 16776 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.280917 16587 raft_consensus.cc:993] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:26.282574 16742 raft_consensus.cc:1081] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:08:26.285374 16728 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.286326 15378 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:26.288546 16728 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:26.244592 15305 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:26.323235 16799 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.323854 16799 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.329955 16839 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:26.330536 16839 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.331444 16839 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.336779 16002 raft_consensus.cc:1217] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Deduplicated request from leader. Original: 1.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:08:26.334197 16799 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.340632 15376 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:26.340883 16839 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.344929 16799 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.297982 16776 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:26.295845 16800 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.355212 16800 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.356086 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:26.356913 15233 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
W20260709 13:08:26.316359 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.364847 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:26.367460 15305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b75da66513484f36a3807f62f4177e56"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:08:26.368296 15302 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.369028 15300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:08:26.369654 15300 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.370039 15300 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.372120 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:26.373016 15224 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:26.368319 15305 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.379317 15305 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:26.384184 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 151678us
I20260709 13:08:26.385202 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.396554 16684 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.402362 15233 raft_consensus.cc:1217] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:26.413549 15233 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:26.402575 16587 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:26.399044 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.406087 16742 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:26.407826 15215 tablet_service.cc:1558] Processing DeleteTablet for tablet 3005d9c450974fc299b5f0c0e92c745a with delete_type TABLET_DATA_TOMBSTONED (TS b0f9eceec749442cb9a06c87f00f3caf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47386
I20260709 13:08:26.423496 15228 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.411341 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:26.425570 15224 raft_consensus.cc:606] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:26.428306 16684 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:26.430691 16856 tablet_replica.cc:333] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:08:26.430287 15131 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:26.440843 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:26.441612 16856 raft_consensus.cc:2243] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:26.433231 16845 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:26.446317 15224 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:26.446769 16856 raft_consensus.cc:2272] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:26.448730 16655 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:26.450837 16856 ts_tablet_manager.cc:1916] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:26.444645 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:26.454617 16851 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:08:26.454936 15378 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:26.455780 16776 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:26.450610 16005 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:26.442579 16787 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:26.442034 15131 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.431849 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.456732 16776 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.406133 15300 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:26.434900 15305 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:26.491559 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59723.8us
I20260709 13:08:26.492508 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.497596 16826 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.499249 16684 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:26.497131 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 93524.7us
I20260709 13:08:26.501303 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:26.505012 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.506836 15300 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:26.506259 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.508828 15305 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:26.510914 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:26.511372 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:26.511725 15233 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:26.512084 15233 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:26.489754 16787 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.490991 16776 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.516146 15233 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:26.518260 16847 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.513590 16828 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.530489 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:26.531232 16002 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.489435 16779 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:26.536705 16779 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.540145 16779 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:26.515708 16826 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.520311 16825 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.520169 15233 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.519130 16787 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.551095 16820 ts_tablet_manager.cc:1929] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:26.551797 16820 log.cc:1199] T 30992f1a0d1949a7aacbc6cbd114a206 P 841138f50ace4746978e72d7f13878de: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/wals/30992f1a0d1949a7aacbc6cbd114a206
I20260709 13:08:26.553812 16820 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50758 (request call id 69) took 1079 ms. Trace:
I20260709 13:08:26.561365 16742 raft_consensus.cc:993] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:08:26.562171 16742 raft_consensus.cc:1081] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:08:26.560559 15229 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.564237 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:26.564779 15229 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:26.565650 15229 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:26.560590 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45434.6us
I20260709 13:08:26.567131 15229 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.561050 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.571704 16684 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:26.561746 16820 rpcz_store.cc:276] 0709 13:08:25.474334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.474544 (+   210us) service_pool.cc:224] Handling call
0709 13:08:25.604403 (+129859us) ts_tablet_manager.cc:1151] Deleting tablet 30992f1a0d1949a7aacbc6cbd114a206
0709 13:08:25.604525 (+   122us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:25.810261 (+205736us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b5400430154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2eff9 00007f2f58b3c482 00007f2f58b6d2d0 00007f2f58b5383d 00007f2f58b537e9 00007f2f58b53779 00007f2f58b53741 00007f2f58b5296d 000000000038f354 000000000038f199
0709 13:08:26.407469 (+597208us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:26.550919 (+143450us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:26.553701 (+  2782us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49193,"spinlock_wait_cycles":210411392,"tablet-delete.queue_time_us":111668,"thread_start_us":39716,"threads_started":1}
I20260709 13:08:26.576246 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet 30992f1a0d1949a7aacbc6cbd114a206 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:26.578971 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.582767 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.583474 15224 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:26.604570 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.608779 15233 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:08:26.610255 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 110049us
W20260709 13:08:26.619599 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 117141us
W20260709 13:08:26.622958 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.625133 15375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
W20260709 13:08:26.632846 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47625us
I20260709 13:08:26.634047 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:26.626195 15375 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.636611 15375 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.641355 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.636832 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:26.651808 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.647027 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:26.658836 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.661991 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.662932 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:26.663849 15345 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.543s (SENT)
I20260709 13:08:26.631713 16825 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.618377 16779 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:26.667805 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.670624 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.663053 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:26.636065 16684 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.647975 16800 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:26.675050 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.673327 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.669451 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.683701 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:26.649786 16812 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.638971 16587 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:26.654623 16647 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.690359 15305 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:26.716853 15307 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:26.722699 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58891.4us
I20260709 13:08:26.673667 16002 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:08:26.723810 15345 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.545s (SENT)
I20260709 13:08:26.724705 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.701638 16684 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.733335 15229 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:26.644405 16855 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:08:26.715440 16800 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.677861 16779 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.738899 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:26.739220 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:26.739849 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.723357 16797 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:26.720002 16647 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.756237 16797 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:26.757139 16797 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.756793 16647 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.757913 16797 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:26.762202 16841 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.762854 16841 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:26.763964 16841 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.767805 16779 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:26.779345 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.720114 16587 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.740161 16843 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 13:08:26.803416 15306 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:26.806125 15375 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:26.846974 15299 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:26.847507 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.848246 15305 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
W20260709 13:08:26.865003 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.881100 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.852705 16845 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:26.781034 16684 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.908771 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.784650 16800 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:26.911306 15375 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:26.909627 15306 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:26.920650 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:26.923344 16747 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.923990 16747 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:26.926800 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 203036us
I20260709 13:08:26.927280 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:26.928124 15229 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:26.928651 15229 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:26.929459 15229 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:26.933694 16828 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:26.934319 16828 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:26.938060 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:26.939126 15300 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.944270 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.945040 16797 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:26.946772 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:26.947824 15299 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:26.932964 16779 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.904424 16845 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:26.958148 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:26.959187 16005 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:26.961871 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:08:26.979909 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57497.6us
I20260709 13:08:26.964309 16797 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:26.979617 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49774.3us
I20260709 13:08:26.987361 15300 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
W20260709 13:08:26.986425 15345 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.727s (SENT)
I20260709 13:08:26.994613 15345 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.986479 16797 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:26.996605 16866 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:26.997239 16866 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.997866 16866 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.998677 16797 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:27.002733 16862 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:08:27.014232 16797 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:27.016891 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:26.962760 16779 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:27.024725 16866 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:27.025725 16587 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.027491 16866 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:27.029222 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.030525 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.033268 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:27.034003 16005 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.059135 15302 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
W20260709 13:08:27.066788 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57909.5us
I20260709 13:08:27.065358 16866 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:27.076282 16866 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:27.078174 16005 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:27.077504 16866 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.080617 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:08:27.080363 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59722.8us
I20260709 13:08:27.094291 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.095530 15380 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:27.077437 16880 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:27.108690 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:27.032384 16747 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.043347 16797 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.043603 16868 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.130355 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.065495 16692 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.113770 16776 consensus_meta.cc:287] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.006s
W20260709 13:08:27.152458 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 120308us
I20260709 13:08:27.150146 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.153856 15300 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:27.155762 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:27.178535 15229 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.193836 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:27.194922 16005 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:08:27.197151 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.165912 16776 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.168583 16735 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.205405 15229 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:27.168803 16596 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:27.209455 15302 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:27.186203 16871 raft_consensus.cc:2764] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:27.161810 16692 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.195852 16828 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:27.229763 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.229904 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:27.215921 16776 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:27.199684 16878 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:27.212579 16627 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.220968 16856 ts_tablet_manager.cc:1929] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:08:27.249168 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.236773 16787 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.004s
I20260709 13:08:27.222214 16596 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.222376 16735 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.250710 16856 log.cc:1199] T 3005d9c450974fc299b5f0c0e92c745a P b0f9eceec749442cb9a06c87f00f3caf: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/wals/3005d9c450974fc299b5f0c0e92c745a
I20260709 13:08:27.243168 16865 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.262693 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:27.269737 15228 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.263679 16735 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.257444 16845 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:27.247875 16627 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.253221 16787 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.265945 16596 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.271951 16779 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:27.271790 16881 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:27.286888 16883 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:27.296602 16883 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:27.299347 16877 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:27.299760 16883 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:27.300244 16692 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.295333 16881 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.304028 16627 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.304739 16881 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:27.306128 16002 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:27.311614 16779 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:27.314455 16841 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:27.274075 16865 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.318914 16865 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.322039 15228 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:27.322643 16787 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:27.329391 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.349303 16779 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:27.351078 16779 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:27.360489 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.367920 16787 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.368680 16787 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.371165 16787 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:27.371765 16781 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.393222 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:27.403074 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.439872 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64300.7us
I20260709 13:08:27.456163 16884 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.468634 16878 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:27.469332 16884 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.470021 16878 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:27.476034 16797 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:27.476621 16797 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:27.477676 16797 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.479324 16797 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.459245 16873 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.496155 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 342454us
I20260709 13:08:27.506745 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:27.511746 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 284164us
I20260709 13:08:27.515707 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:27.525177 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.543301 15305 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:08:27.526579 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 432415us
I20260709 13:08:27.529752 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.455469 16781 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.565342 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.526010 16873 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:27.567041 16781 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.567157 16884 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:27.495457 16776 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.525172 16787 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:27.564154 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48562.3us
I20260709 13:08:27.531441 16868 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:27.566192 16893 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.627010 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.564821 16866 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:27.617527 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 87834.6us
I20260709 13:08:27.628293 15305 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
W20260709 13:08:27.611857 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47349.9us
I20260709 13:08:27.629660 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.562736 16551 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.633853 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.632597 15971 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:08:27.636961 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.627101 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 379279us
I20260709 13:08:27.614401 16873 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.631081 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.641141 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.567937 16776 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.641330 15308 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:27.633173 15378 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:27.645071 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.645744 15376 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:27.645838 15374 raft_consensus.cc:1217] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:27.645928 15379 raft_consensus.cc:2368] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:27.647141 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:27.647771 15376 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.646562 15374 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:27.651836 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.652745 15373 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:27.653391 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:27.653617 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.655998 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:27.657114 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.657699 15305 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.659319 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.689128 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.690270 15300 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:27.644330 16788 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:27.694214 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.695784 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:27.696764 15307 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:08:27.704350 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.635360 16868 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:27.705412 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.706182 15301 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:27.707180 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.707962 16868 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:27.663444 16886 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.692145 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:27.644536 16884 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:27.643006 16551 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.708863 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.655608 16866 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:27.713074 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:27.709860 15382 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:27.715763 15305 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:27.677340 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:27.720534 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.738436 15300 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:27.738832 15273 leader_election.cc:400] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:27.721629 15376 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:27.711416 16843 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.720544 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.642954 16787 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:27.659463 16892 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:27.739189 15273 leader_election.cc:403] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:27.719547 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:27.747187 15301 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:27.737905 15308 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.735239 15303 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:27.709491 16788 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.741151 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:27.750136 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.750921 15376 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:27.751847 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.753417 15376 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:27.753557 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:27.754385 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.741245 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.741887 15380 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:27.746327 15225 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:27.733222 16881 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.798008 16881 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.800645 15376 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:27.803747 16881 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:27.805687 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64530.6us
I20260709 13:08:27.778541 15307 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
W20260709 13:08:27.788174 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47120.2us
I20260709 13:08:27.808164 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:27.788815 15199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.007s	sys 0.007s
I20260709 13:08:27.779692 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:27.809549 15199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.007s	sys 0.007s
I20260709 13:08:27.760268 16776 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:27.809908 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 618146us
I20260709 13:08:27.791496 15118 catalog_manager.cc:5028] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): tablet 3005d9c450974fc299b5f0c0e92c745a (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:08:27.794180 16647 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.794013 16742 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:27.806028 16888 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.632975 16893 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.811029 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:27.816892 15308 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:27.755764 16788 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.734573 16684 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:08:27.777705 16868 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:27.859453 16551 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.859181 16868 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.778489 16884 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:27.864044 16884 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.870275 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.871699 15379 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:27.850309 16719 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.873210 16719 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.873379 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.874377 15379 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:27.875733 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.841378 16742 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.828364 16845 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:27.876382 16893 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.876710 16742 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.808101 16812 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:27.856851 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:27.827855 16647 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:27.880127 16647 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.856148 16866 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.852927 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:27.875950 16719 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:27.882002 15379 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
W20260709 13:08:27.840940 15118 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67791.7us
I20260709 13:08:27.895159 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:27.876713 16845 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.774065 16787 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.755540 16843 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.862558 16868 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:27.882000 16881 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:27.908483 15379 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:27.914141 15377 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:27.901232 16845 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.902748 16880 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:27.928913 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 111762us
I20260709 13:08:27.929996 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:27.901093 16889 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:27.916229 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 162766us
I20260709 13:08:27.937371 16735 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:27.949580 16735 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.950044 16735 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.928671 16880 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.971517 16742 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:27.976997 16843 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:27.965441 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 178632us
I20260709 13:08:27.964792 16880 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.983177 16787 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:27.981328 16002 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEARNER]: Advancing to term 4
I20260709 13:08:27.988976 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:27.961336 16684 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:27.990514 15381 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:28.003930 16781 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.005503 16647 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:28.006700 16684 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.004029 16742 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.016408 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:28.010582 16781 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:28.026582 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:28.027519 15229 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.028921 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.031280 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.032992 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.029809 15230 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:28.057293 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.058184 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.058396 15231 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:28.062932 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.036638 16742 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.065979 16742 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.066617 16742 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:28.067134 16905 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:28.024887 16781 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.073982 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.076982 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.057384 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:28.082147 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50011.6us
W20260709 13:08:28.066141 16890 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.317s	user 0.003s	sys 0.001s
I20260709 13:08:28.096885 15232 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:28.105908 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74998us
I20260709 13:08:28.106926 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.108489 15231 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:28.110528 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.111619 15373 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:28.071714 16735 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.120213 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.114428 15229 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:28.117971 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.119563 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.122584 15379 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.121691 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.126214 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.128556 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.129539 15300 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:28.131101 16008 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:28.128638 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.133399 15299 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:28.107015 16868 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.138399 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.141373 15374 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:28.139765 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:28.139739 15300 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:28.125797 16884 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.158463 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1452) took 1020 ms. Trace:
I20260709 13:08:28.144922 16868 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.150542 16647 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:28.151170 16684 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.161350 16868 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.135888 16788 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:28.156186 16002 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:28.164613 15299 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:28.164659 16005 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:28.154224 16735 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.147986 16888 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:28.132444 16787 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.149785 16003 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:28.147878 16847 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:28.182796 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.183104 16847 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:28.122382 16825 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:08:28.183568 16847 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:28.148492 16587 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.184686 16847 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.173005 15379 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:28.177260 16788 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.175742 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.176506 15232 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:28.176388 15373 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:28.159058 15224 rpcz_store.cc:276] 0709 13:08:27.138118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.142882 (+  4764us) service_pool.cc:224] Handling call
0709 13:08:27.173934 (+ 31052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.183602 (+  9668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.188898 (+  5296us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.247099 (+ 58201us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.561716 (+314617us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:27.613090 (+ 51374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.613219 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.995828 (+382609us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:28.158051 (+162223us) raft_consensus.cc:1685] finished
0709 13:08:28.158077 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.158381 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":705,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":14653,"spinlock_wait_cycles":2632960,"thread_start_us":259652,"threads_started":1,"wal-append.queue_time_us":396918}
I20260709 13:08:28.192329 16881 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:28.179992 16787 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.193394 16787 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.169446 16888 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.198056 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:28.198916 16888 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:28.192085 16884 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:28.199424 16881 raft_consensus.cc:2764] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:28.181313 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.201045 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.201668 15381 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:28.167889 16845 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.208484 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:28.209517 16881 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.206678 16884 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:28.210857 16881 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:28.218498 16881 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:28.219159 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 73185.9us
I20260709 13:08:28.220118 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.221714 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.222163 16908 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:28.222669 16908 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.222755 16915 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:28.226765 16875 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:28.241922 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.230695 16627 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:28.231222 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 89) took 1895 ms. Trace:
I20260709 13:08:28.249101 15299 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:28.099663 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.259338 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.260051 15300 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.260587 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.261118 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.232004 15129 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.261904 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.262055 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:28.263932 16892 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.263724 16875 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.264439 16892 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:28.265003 16892 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.256934 16915 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:28.265535 16797 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.266634 16875 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.266909 16893 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.267277 15230 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:28.267613 16893 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:28.263759 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.268864 16893 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.233420 16655 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.237043 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.238981 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:28.279386 15306 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:28.282848 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.284729 15300 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:28.223099 16908 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.241046 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.229066 16776 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:28.267500 16915 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:28.252020 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.300706 15227 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:28.247962 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.257221 16627 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.237171 16889 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:28.263859 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.263274 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:28.275115 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.304601 15376 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.272804 15129 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.251477 15231 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:28.297979 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 59130us
I20260709 13:08:28.302052 15302 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.302870 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.320606 15300 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:28.257385 15131 rpcz_store.cc:276] 0709 13:08:26.335440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.337664 (+  2224us) service_pool.cc:224] Handling call
0709 13:08:26.383025 (+ 45361us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:28.231153 (+1848128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:26.777210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:26.778110 (+   900us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:26.778305 (+   195us) write_op.cc:435] Acquired schema lock
0709 13:08:26.778351 (+    46us) tablet.cc:662] Decoding operations
0709 13:08:26.779030 (+   679us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:26.779153 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:26.779199 (+    46us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:26.779706 (+   507us) tablet.cc:701] Row locks acquired
0709 13:08:26.779747 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:08:26.779960 (+   213us) write_op.cc:270] Start()
0709 13:08:26.780122 (+   162us) write_op.cc:276] Timestamp: P: 1783602506779906 usec, L: 0
0709 13:08:26.780155 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:08:26.898878 (+118723us) log.cc:844] Serialized 918 byte log entry
0709 13:08:27.258899 (+360021us) op_driver.cc:464] REPLICATION: finished
0709 13:08:27.472558 (+213659us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f5755cef0
0709 13:08:27.823256 (+350698us) write_op.cc:301] APPLY: starting
0709 13:08:27.827564 (+  4308us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:27.845390 (+ 17826us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:27.845425 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:27.879202 (+ 33777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:27.879391 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:27.879568 (+   177us) write_op.cc:312] APPLY: finished
0709 13:08:27.879878 (+   310us) log.cc:844] Serialized 28 byte log entry
0709 13:08:27.880080 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.880190 (+   110us) write_op.cc:454] Released schema lock
0709 13:08:27.880237 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:27.880689 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:27.880730 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44987,"reported_tablets":2,"spinlock_wait_cycles":99579776,"child_traces":[["op",{"apply.queue_time_us":501922,"apply.run_cpu_time_us":2720,"apply.run_wall_time_us":91304,"num_ops":2,"prepare.queue_time_us":269950,"prepare.run_cpu_time_us":5261,"prepare.run_wall_time_us":131763,"replication_time_us":467544,"spinlock_wait_cycles":21311872,"thread_start_us":598851,"threads_started":2}]]}
I20260709 13:08:28.203616 16866 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:08:28.294668 16868 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.247172 16587 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.280535 16875 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.317229 16692 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:28.240327 16781 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:28.356220 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 212142us
I20260709 13:08:28.296270 16797 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:08:28.304427 16776 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.366613 16797 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:28.367120 16797 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:28.330655 15129 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 2 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.343742 15302 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:28.318511 16627 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.386993 15376 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:28.296766 16655 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:28.390741 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.299276 16742 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.332044 16875 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:28.393085 15228 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:28.390363 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.364704 16888 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.400822 15129 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.405196 16868 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:28.410772 16908 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.329643 16878 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:08:28.425700 16843 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.425741 16647 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:28.426510 16843 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.426913 16843 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.427663 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:28.428633 16005 raft_consensus.cc:2368] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:28.323383 16889 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.429167 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.431517 16742 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.432431 15233 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:28.436296 15225 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.438031 15274 leader_election.cc:400] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:28.438720 15274 leader_election.cc:403] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.446996 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.448220 15302 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.397887 16875 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.458276 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.458606 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:28.459285 15229 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.461505 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.368091 16797 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.464511 15232 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:28.404204 16810 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.417843 16888 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.477998 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.482823 15377 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.398401 16825 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:08:28.500231 15302 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:28.515805 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.524657 15971 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:28.500625 15229 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:28.401762 16880 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:28.525965 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 215768us
I20260709 13:08:28.527520 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:28.529479 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.441180 16828 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:08:28.486896 16888 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.558350 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:28.517448 16776 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:28.548004 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 284783us
I20260709 13:08:28.571205 15374 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:28.533771 16873 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.523125 16810 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:28.563025 16923 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:08:28.529872 16797 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.537876 16845 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.567507 16786 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.562301 16551 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.518754 16906 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:28.532310 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:28.603384 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45173.1us
I20260709 13:08:28.592551 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.520668 16787 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.629074 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.629854 15304 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.630450 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.631793 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.632016 15382 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:28.608572 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.601840 16776 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.578178 16889 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:28.602725 16873 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:28.639314 15299 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:28.607980 16692 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.653129 16873 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:28.645016 16845 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:28.654428 16845 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.664009 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.663081 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.672672 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.674660 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.675940 16845 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.676417 16828 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:28.695254 15304 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:28.637945 15225 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:28.650979 16655 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:28.623809 16781 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.696600 15230 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:28.697254 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:28.652485 16880 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:28.716049 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:28.615799 16786 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:28.664903 16776 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:28.623559 16551 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.700835 16908 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.619498 16921 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:08:28.743407 16551 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.745065 16776 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.721560 16810 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.716558 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:28.732738 16826 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:08:28.755568 16786 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:28.721632 16828 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:28.735562 16627 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.756696 16828 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.757191 16828 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:28.735208 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 51020.6us
I20260709 13:08:28.759511 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.765364 15377 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:28.778126 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1465) took 1026 ms. Trace:
W20260709 13:08:28.774389 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 112352us
I20260709 13:08:28.781605 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.782349 15377 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:28.778832 15233 rpcz_store.cc:276] 0709 13:08:27.751618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.761220 (+  9602us) service_pool.cc:224] Handling call
0709 13:08:28.141339 (+380119us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800002798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:08:28.141577 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.432868 (+291291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.777701 (+344833us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540009cc54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:28.778023 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702921216}
I20260709 13:08:28.791791 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.792680 15379 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.797878 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.774252 16932 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:28.805567 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.806277 15306 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.806933 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.808876 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.810420 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:28.813915 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.816036 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.819917 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.810087 16551 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:28.824498 15299 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:28.810361 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:28.810738 16627 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.830277 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.832782 16551 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.833537 16551 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:28.840719 16551 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.826874 16826 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:08:28.822199 16881 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:28.847617 16881 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:28.844043 16826 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:28.855368 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.812764 16932 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:28.858527 16843 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.862351 16692 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:28.867365 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:28.853729 16826 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:28.886840 15231 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:28.867911 16847 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.887313 16826 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.870765 15376 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:08:28.871199 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59831.5us
W20260709 13:08:28.876320 16892 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.611s	user 0.014s	sys 0.000s
I20260709 13:08:28.885608 16875 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.876001 15306 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
W20260709 13:08:28.891446 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61284.1us
I20260709 13:08:28.898293 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.890288 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.901877 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.892063 15377 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:28.904531 15379 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:28.894398 16781 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:28.907287 16728 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:28.909862 16888 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.909863 16728 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:28.912410 16728 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.894670 16892 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.914705 16892 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:28.916775 16843 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.918089 16875 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:28.908248 16692 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.920251 16692 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:28.921132 15375 raft_consensus.cc:2368] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3.
I20260709 13:08:28.921674 16692 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.923667 15380 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:28.926932 15226 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:28.840565 16933 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:08:28.930310 16826 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.904691 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:28.937732 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:28.939703 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:28.940075 15231 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.940862 15228 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:28.906208 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:28.931538 15378 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:28.947974 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.951700 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.907683 16797 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:28.912225 16888 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:28.957008 15379 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:28.967062 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:28.967799 15231 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:28.972854 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.973714 15376 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:28.975303 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:28.939519 16933 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:28.988179 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:28.992275 16845 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.982185 16828 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:28.994196 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:29.001559 15376 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:28.997951 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:28.999008 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:29.007357 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:29.008616 16692 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:29.009200 16692 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:29.010217 16692 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.015579 15307 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:29.017300 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:29.018036 15307 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:29.025213 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:29.025985 15305 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:29.026119 16912 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:29.026309 15299 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:29.031184 15300 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:29.031667 16943 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:29.034466 16936 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:28.984045 16627 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.986722 16797 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:29.049309 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:29.050432 15308 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.051466 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:29.059029 15228 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:29.061527 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:29.063586 15306 raft_consensus.cc:2368] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:29.065570 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:29.065934 15304 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:29.070127 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:29.001039 16843 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:29.083026 15308 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:29.085153 15345 leader_election.cc:400] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:29.091470 15305 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:29.101859 15345 leader_election.cc:403] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.993435 16892 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:08:29.102722 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:29.057776 16841 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:28.993028 16845 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:28.984701 16786 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:08:29.124012 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 137646us
I20260709 13:08:29.056041 16936 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:29.098085 16908 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:29.131273 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61761.2us
I20260709 13:08:29.060858 16627 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.080922 16888 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:08:29.110139 16843 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.119712 16728 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.062636 16943 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:08:29.153759 16908 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:29.163789 16776 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:29.209967 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76443.3us
W20260709 13:08:29.212803 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 76573.6us
I20260709 13:08:29.221405 15225 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:29.199416 16950 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.171376 16881 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:08:29.235894 16932 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:29.235648 16914 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.246978 16926 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.251334 16932 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:29.266795 16843 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.269431 16627 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.220242 16936 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.275231 16828 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.276212 16828 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:29.246991 16950 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.276823 16828 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.280808 16908 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.283666 16728 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.281454 16950 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:29.306703 16944 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:08:29.307132 16776 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:29.309440 16845 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.310250 16787 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:29.321502 16828 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.261070 16914 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.334863 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:29.335247 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:29.344460 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 259466us
I20260709 13:08:29.346550 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.356805 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:29.358219 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:29.359436 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:29.360384 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:29.369985 15382 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:29.363286 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:29.372223 15377 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:29.375178 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.330802 16797 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:29.385061 15307 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:29.375782 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:29.376749 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:29.390843 15225 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:29.382375 16735 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.396167 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:29.375667 16865 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.394922 16787 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.420097 16914 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.420411 16787 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:29.421064 16787 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.423779 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:29.361744 16828 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:08:29.435954 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69640.6us
I20260709 13:08:29.412225 16735 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.391655 16797 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.423041 16943 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:29.457800 16955 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:29.458743 16955 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:29.473398 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1345) took 1298 ms. Trace:
I20260709 13:08:29.473924 15378 rpcz_store.cc:276] 0709 13:08:28.175004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.240686 (+ 65682us) service_pool.cc:224] Handling call
0709 13:08:29.473123 (+1232437us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400289bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:29.473277 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484865920}
I20260709 13:08:29.475422 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 171) took 1310 ms. Trace:
I20260709 13:08:29.475881 15374 rpcz_store.cc:276] 0709 13:08:28.165519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.170065 (+  4546us) service_pool.cc:224] Handling call
0709 13:08:29.475208 (+1305143us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54001ac7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:29.475355 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884215168}
I20260709 13:08:29.425797 16865 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.480746 16943 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.481364 16943 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.484772 15382 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:29.489611 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.490697 15299 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:29.496402 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:29.496918 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.497319 15304 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:29.446491 16735 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.526518 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:29.482666 16865 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.541947 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.576393 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:29.577734 16912 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.581704 16807 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.583300 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:29.582948 16807 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.578981 16912 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.590341 15198 leader_election.cc:400] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3.
I20260709 13:08:29.594731 15198 leader_election.cc:403] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:29.502991 16955 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:29.584255 16875 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.604871 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:29.622184 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64520.4us
I20260709 13:08:29.622961 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:29.585106 16787 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:29.593572 16742 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.624608 16881 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:29.654062 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:29.640404 16936 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3.
I20260709 13:08:29.630893 16933 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.667362 15196 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:29.621007 16875 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:29.675073 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:29.701349 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 74906.8us
I20260709 13:08:29.693228 16920 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:29.669749 16655 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.678399 16787 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:29.694664 16953 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:08:29.649921 16742 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.711959 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:29.710510 16920 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:29.729346 16912 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.729683 16742 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.709005 16868 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.730479 16868 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.729224 16920 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.719457 16864 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:29.737206 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:29.669057 16933 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.739857 15233 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:29.661036 16881 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.713557 16807 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:29.752061 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:29.754105 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.762874 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:29.768036 15374 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:29.772775 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.774880 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.777038 15303 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:29.777498 15303 pending_rounds.cc:85] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 1
I20260709 13:08:29.780056 16807 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:29.782953 16807 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:29.778385 15303 pending_rounds.cc:107] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:29.810117 15303 raft_consensus.cc:2889] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.771898 16728 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:29.790036 16797 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:29.828876 16946 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.831032 16797 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.832597 16868 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:29.867045 16797 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:29.886584 16807 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:29.904316 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:29.930228 15308 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:29.934481 16971 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:29.907302 16943 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:29.937247 16841 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.937903 16841 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.940791 16810 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:29.942094 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:29.931933 16935 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:08:29.945056 16881 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:29.930123 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:29.952538 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:29.950305 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:29.925429 16868 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:29.867960 16946 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:29.969987 16975 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:29.971973 16953 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.972957 16845 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.950555 16873 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.949235 16875 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:29.957613 16810 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.957921 16772 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:29.913452 16942 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
W20260709 13:08:30.152376 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 199981us
I20260709 13:08:30.153645 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.163174 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:30.217020 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.046s (SENT) [suppressed 5 similar messages]
I20260709 13:08:29.972958 16953 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:29.983901 16868 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.294066 16973 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:30.158046 16884 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:30.199451 16933 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.052697 16873 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.287321 16906 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.155941 16772 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.150098 16810 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.337201 16906 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.315115 16973 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.318626 16884 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:30.397127 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 180177us
I20260709 13:08:30.404245 16587 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:30.435349 16772 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.437130 16799 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:30.424160 16800 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.447072 16800 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.422183 16931 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:30.463698 15302 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:30.432473 16990 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.469107 16990 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.469709 16921 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.470396 16921 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.462111 16931 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.437885 16799 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:30.471995 16990 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.483349 15302 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:30.470424 16906 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:30.454929 16587 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.487639 16868 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.495661 16973 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.496486 16810 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.487262 16990 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.487775 16950 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.499207 16799 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.516593 15302 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:30.516484 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:30.518033 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:30.518067 15303 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:30.522357 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:30.524150 15302 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:30.534603 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:30.509980 16800 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:30.511548 16953 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.510079 16551 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:08:30.536904 16906 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.537879 16960 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.554149 16960 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.557201 16884 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:30.559350 16841 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.006s
I20260709 13:08:30.560549 16906 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:30.513398 16950 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.559883 16841 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.512514 16990 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.545091 16800 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.593327 16728 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:30.564229 16906 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:30.611517 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:30.612481 16005 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:30.611316 16800 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.601516 16889 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:30.604626 16728 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:30.615284 16797 consensus_meta.cc:287] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.746s	user 0.016s	sys 0.000s
I20260709 13:08:30.611769 16906 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.627087 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:30.627854 16949 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:30.660952 16912 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:30.664026 16587 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.680692 16003 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:30.682984 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:30.682178 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.680182 16841 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:30.689430 16841 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:30.690092 16841 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.692756 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.693174 16950 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.694419 16800 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:30.643103 16797 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.694998 16841 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.696564 16931 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.699030 16990 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.628010 16889 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.709605 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:30.709976 16845 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:30.714769 16845 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:30.715479 16845 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:30.722018 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:30.667750 16906 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:30.728729 15226 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:30.730229 16946 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.732196 16921 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.713579 17000 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:30.747766 17000 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:30.748278 17000 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:30.712146 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:30.749794 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:30.750298 16003 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:30.687809 16912 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.752259 15226 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:30.752759 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.753731 16912 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.688076 16949 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.754035 15127 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 2 to 1, leader changed from <none> to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 1 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:30.755506 15306 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:30.756449 16949 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.757369 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.761976 15129 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 198) took 4426 ms. Trace:
I20260709 13:08:30.726262 16797 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:30.726912 16960 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:30.770327 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:30.779603 15233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:30.795228 15233 raft_consensus.cc:606] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:30.783915 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.785233 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.788415 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.865247 16551 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:30.796105 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.877090 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.846880 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.878639 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:30.880291 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:30.880959 15374 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:30.762559 15129 rpcz_store.cc:276] 0709 13:08:26.335374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.335537 (+   163us) service_pool.cc:224] Handling call
0709 13:08:26.387689 (+ 52152us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:30.761898 (+4374209us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:28.498361 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:28.499243 (+   882us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:28.499283 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:08:28.499303 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:28.500068 (+   765us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:28.500163 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:28.500192 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:28.500669 (+   477us) tablet.cc:701] Row locks acquired
0709 13:08:28.500688 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:28.500921 (+   233us) write_op.cc:270] Start()
0709 13:08:28.501106 (+   185us) write_op.cc:276] Timestamp: P: 1783602508500850 usec, L: 0
0709 13:08:28.501143 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:08:28.502259 (+  1116us) log.cc:844] Serialized 1705 byte log entry
0709 13:08:28.507231 (+  4972us) op_driver.cc:464] REPLICATION: finished
0709 13:08:28.509186 (+  1955us) write_op.cc:301] APPLY: starting
0709 13:08:28.509307 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:28.509520 (+   213us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:28.509729 (+   209us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:28.644133 (+134404us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:28.646986 (+  2853us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:08:28.647035 (+    49us) write_op.cc:312] APPLY: finished
0709 13:08:28.647338 (+   303us) log.cc:844] Serialized 40 byte log entry
0709 13:08:28.647548 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:28.647661 (+   113us) write_op.cc:454] Released schema lock
0709 13:08:28.647723 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:28.648178 (+   455us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:28.648210 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87564,"reported_tablets":8,"spinlock_wait_cycles":114209024,"child_traces":[["op",{"apply.queue_time_us":1583,"apply.run_cpu_time_us":3694,"apply.run_wall_time_us":138984,"num_ops":4,"prepare.queue_time_us":53626,"prepare.run_cpu_time_us":4414,"prepare.run_wall_time_us":7826,"replication_time_us":5775,"thread_start_us":54129,"threads_started":2}]]}
I20260709 13:08:30.874943 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:30.875226 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 87243.9us
I20260709 13:08:30.801584 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:30.882786 15376 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:08:30.886221 15376 pending_rounds.cc:85] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 2
I20260709 13:08:30.886461 15376 pending_rounds.cc:107] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:30.886754 15376 raft_consensus.cc:2889] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.889580 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.858666 15305 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:30.875465 15382 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
W20260709 13:08:30.930620 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.936463 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:30.907557 15376 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:30.907348 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:30.944592 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.790725 16889 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:30.876366 16955 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.035s	sys 0.023s
I20260709 13:08:30.848230 16684 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.847124 16906 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:30.944657 15974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.011s	sys 0.020s
I20260709 13:08:30.951540 15376 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:30.960562 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:30.906518 16551 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:30.963104 15974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.020s
W20260709 13:08:30.955816 16955 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.256s	user 0.035s	sys 0.024s
I20260709 13:08:30.976274 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:30.978515 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:30.882350 15377 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:30.990221 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.990465 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.991057 15373 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:30.991461 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.992211 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:30.995335 16788 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:30.996012 16788 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:30.998879 16788 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:31.003424 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.005254 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.006168 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:30.928669 16960 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:08:30.793533 16921 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.876621 16969 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 1.184s	user 0.004s	sys 0.010s
I20260709 13:08:30.960978 16926 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:31.005463 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.004139 15381 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:30.928975 16797 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:08:30.793279 16990 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:08:31.066907 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60064.6us
I20260709 13:08:31.090922 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:31.068019 16950 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.068727 16587 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:30.974596 16728 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:08:31.071239 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58546.5us
I20260709 13:08:31.071759 16551 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:31.072472 16735 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:30.966809 16684 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.003952 16889 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:31.100546 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:31.012583 16884 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:08:31.010128 16881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.031s	sys 0.026s
I20260709 13:08:31.003661 16994 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.092566 16921 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.168876 16994 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.170748 16921 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:31.132097 16873 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:31.171103 16994 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:31.172644 16930 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.173038 16684 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:31.173195 16930 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.175391 16930 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:31.175942 15379 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:31.140149 16889 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.013733 16799 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.128265 16997 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.003763 17004 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:08:31.100577 16950 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.097841 16990 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.099864 16587 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:31.121603 16627 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:31.136499 16551 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.145423 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:31.201228 15233 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.146391 15225 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:31.204622 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.146659 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.146955 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.151078 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:31.152177 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51716.2us
I20260709 13:08:31.003641 16787 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:31.012853 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 242673us
I20260709 13:08:31.151636 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:31.178833 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:31.183575 15971 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.018s	sys 0.024s
I20260709 13:08:31.176469 16936 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:31.215173 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.215579 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.116137 16845 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.185010 16889 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:31.217777 15228 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:31.175524 17000 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.224800 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:31.212430 15971 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.019s	sys 0.024s
W20260709 13:08:31.225984 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 617124us
I20260709 13:08:31.218791 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.219491 15380 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
W20260709 13:08:31.201454 16933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.028s	sys 0.054s
I20260709 13:08:31.173127 16943 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:31.200120 16587 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:31.178364 16884 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.277240 15226 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:31.289458 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:31.278226 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69366.1us
I20260709 13:08:31.218160 16936 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:08:31.251087 16933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.029s	sys 0.054s
W20260709 13:08:31.310606 15375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.034s	sys 0.030s
W20260709 13:08:31.379258 15375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.035s	sys 0.030s
W20260709 13:08:31.379993 15273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.009s	sys 0.041s
W20260709 13:08:31.380591 15273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.010s	sys 0.041s
I20260709 13:08:31.212543 16873 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:31.322389 15232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.031s	sys 0.080s
W20260709 13:08:31.382800 15232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.031s	sys 0.080s
I20260709 13:08:31.322796 16956 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:31.323385 17006 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:08:31.195102 16997 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.388372 15377 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:31.389534 16845 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:31.390471 16884 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:31.390846 16915 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.391381 16915 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.393376 16915 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:31.393836 16915 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.393893 17000 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:31.394347 16915 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.395869 17000 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:31.251230 16002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 231) took 1706 ms. Trace:
W20260709 13:08:31.316422 16920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.041s	sys 0.035s
I20260709 13:08:31.276407 16921 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.411023 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:31.411334 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:31.411768 16006 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:31.411373 16921 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:31.269541 16960 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.415172 16915 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:31.414865 16960 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.313112 16895 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:31.417213 16920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.042s	sys 0.035s
I20260709 13:08:31.417649 16895 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.337916 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.421593 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.289507 16908 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:31.326042 16994 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.230778 16924 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:08:31.330288 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.225631 16551 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:31.372807 15308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.003s	sys 0.038s
W20260709 13:08:31.459098 15308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.004s	sys 0.039s
I20260709 13:08:31.375777 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:31.291152 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:31.460418 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 169384us
I20260709 13:08:31.461198 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:31.275846 15233 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:31.462404 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:31.386813 16941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.017s	sys 0.023s
I20260709 13:08:31.387385 16684 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:31.375522 17008 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.408910 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:31.474959 15377 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.451007 16921 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:31.390661 16906 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:31.457201 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.396540 16956 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.474134 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:31.492744 15198 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:31.494378 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:31.423393 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.480559 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:31.481503 16006 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:31.476225 16941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.018s	sys 0.025s
I20260709 13:08:31.481428 16864 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:31.482460 16942 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:31.465505 16920 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:31.483913 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:31.406225 17000 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.463899 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:31.472131 16655 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:31.472950 16895 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:31.453709 16908 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.454691 16994 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.552924 15377 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
W20260709 13:08:31.527486 15127 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.002s	sys 0.008s
W20260709 13:08:31.609081 15127 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.005s	sys 0.009s
I20260709 13:08:31.554685 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.501555 16893 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:31.503337 16735 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:31.406687 16873 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.384989 16936 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:31.503415 16845 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:31.633726 16845 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:31.634500 16845 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.590224 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:31.491737 16950 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:31.593550 15299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.014s	sys 0.013s
W20260709 13:08:31.635944 15299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.014s	sys 0.013s
W20260709 13:08:31.593847 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.010s	sys 0.009s
I20260709 13:08:31.476574 16684 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:31.596278 15231 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:31.503338 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:31.501552 16865 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:08:31.607561 15233 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
W20260709 13:08:31.508489 15272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.004s	sys 0.006s
I20260709 13:08:31.609941 15378 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
W20260709 13:08:31.650100 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 60100.6us
I20260709 13:08:31.615491 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.615971 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:31.618427 16997 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:31.621536 15229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:31.619946 16990 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:31.636624 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.010s	sys 0.009s
W20260709 13:08:31.703534 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 752357us
I20260709 13:08:31.494210 16906 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.710565 16906 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:31.651055 15377 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:31.684868 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.715106 15377 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:31.716038 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 196) took 1140 ms. Trace:
I20260709 13:08:31.716431 15375 rpcz_store.cc:276] 0709 13:08:30.575953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.577656 (+  1703us) service_pool.cc:224] Handling call
0709 13:08:30.592076 (+ 14420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.595711 (+  3635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.595748 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.596309 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.379802 (+783493us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:31.379843 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.379910 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.715854 (+335944us) raft_consensus.cc:1685] finished
0709 13:08:31.715871 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.715967 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3138,"raft.queue_time_us":9601,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":3994,"spinlock_wait_cycles":405760,"thread_start_us":764577,"threads_started":1,"wal-append.queue_time_us":1031557}
W20260709 13:08:31.687592 17015 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:31.718500 16864 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.719235 16864 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.720188 17011 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:31.720942 17011 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.601118 16655 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:31.722702 16655 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:31.723613 17011 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:31.725335 17016 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:08:31.692847 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.696723 15229 raft_consensus.cc:606] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:31.727707 15229 raft_consensus.cc:614] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:31.688762 16551 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:31.704546 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:31.685724 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.718720 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1478) took 1075 ms. Trace:
I20260709 13:08:31.729826 16551 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:31.627367 16735 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:31.729748 15232 rpcz_store.cc:276] 0709 13:08:30.643289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.643566 (+   277us) service_pool.cc:224] Handling call
0709 13:08:30.644065 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.675583 (+ 31518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.675625 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.680065 (+  4440us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.383522 (+703457us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:31.383562 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.383627 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.718520 (+334893us) raft_consensus.cc:1685] finished
0709 13:08:31.718538 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.718650 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29608,"raft.queue_time_us":31566,"raft.run_cpu_time_us":585,"raft.run_wall_time_us":28218,"thread_start_us":702836,"threads_started":1,"wal-append.queue_time_us":841575}
I20260709 13:08:31.730880 16864 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:31.705147 16008 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
W20260709 13:08:31.736972 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.042s	sys 0.056s
W20260709 13:08:31.744112 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 354728us
W20260709 13:08:31.744313 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.043s	sys 0.056s
W20260709 13:08:31.745333 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 624039us
I20260709 13:08:31.747938 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:31.689924 16684 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:31.691078 16893 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:31.760808 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.761157 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.761514 15299 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:31.762782 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.763307 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.763602 15302 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:31.763913 15300 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:31.764874 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.765002 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.765856 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:31.767150 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.767460 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.742172 16735 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.501240 17008 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:31.751024 16864 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:08:31.742497 16952 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.869s	user 0.033s	sys 0.053s
I20260709 13:08:31.406309 16002 rpcz_store.cc:276] 0709 13:08:29.518899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.531805 (+ 12906us) service_pool.cc:224] Handling call
0709 13:08:29.532221 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.532711 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.532751 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.533309 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.624979 (+ 91670us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:29.625034 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.625123 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.721133 (+1096010us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:31.194262 (+473129us) raft_consensus.cc:1685] finished
0709 13:08:31.194284 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.218274 (+ 23990us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1840,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":19052800,"thread_start_us":82854,"threads_started":1,"wal-append.queue_time_us":143040}
I20260709 13:08:31.775981 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:31.794077 15303 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
W20260709 13:08:31.796820 16952 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.919s	user 0.033s	sys 0.053s
W20260709 13:08:32.146261 17019 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.371s	user 0.000s	sys 0.000s
I20260709 13:08:32.147452 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.147866 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:32.148092 15303 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:32.151137 15300 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.148864 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.151954 15302 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:31.779452 16893 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:32.150388 17018 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.455s	user 0.000s	sys 0.000s
I20260709 13:08:32.153108 16893 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.187951 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1357) took 1395 ms. Trace:
I20260709 13:08:32.194905 16908 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:32.191938 15308 rpcz_store.cc:276] 0709 13:08:30.759418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.759567 (+   149us) service_pool.cc:224] Handling call
0709 13:08:30.759973 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.761572 (+  1599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.761606 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.762115 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.459529 (+697414us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:31.459573 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.459648 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.154083 (+694435us) raft_consensus.cc:1685] finished
0709 13:08:32.154101 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.154238 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1285,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":29381,"thread_start_us":697086,"threads_started":1,"wal-append.queue_time_us":845653}
W20260709 13:08:32.223732 16799 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.038s	user 0.010s	sys 0.000s
I20260709 13:08:32.242273 17000 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.278863 15300 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:32.277878 16799 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:32.265448 16956 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:32.299201 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.012s
W20260709 13:08:32.299815 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.003s	sys 0.012s
W20260709 13:08:32.304754 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 528281us
I20260709 13:08:32.305889 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:32.302088 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.008s
W20260709 13:08:32.307257 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.007s	sys 0.008s
W20260709 13:08:32.307694 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 531005us
I20260709 13:08:32.274441 17011 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.282152 16799 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.325899 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:32.333207 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:32.295249 16994 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:32.342849 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:32.340126 16906 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.308631 16873 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:32.399214 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56484.4us
I20260709 13:08:32.406734 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:32.337265 17020 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:32.337646 16551 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:32.412042 15306 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.023s	sys 0.015s
I20260709 13:08:32.340020 17011 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.421356 17020 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.422652 16955 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:32.423158 16955 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:32.424073 16955 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:32.424620 16551 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.425635 16955 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.426004 17008 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.426587 17008 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:32.427203 17008 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.427816 16551 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:32.416605 15306 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.024s	sys 0.015s
I20260709 13:08:32.420713 17011 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.415096 16906 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:32.412353 16873 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:32.437609 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1488) took 1689 ms. Trace:
I20260709 13:08:32.445627 15228 rpcz_store.cc:276] 0709 13:08:30.748555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.748711 (+   156us) service_pool.cc:224] Handling call
0709 13:08:30.749050 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.224309 (+475259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.437283 (+1212974us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54001c7854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:32.437526 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077456768}
I20260709 13:08:32.445081 15303 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:32.452747 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:32.460427 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:32.487002 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.510453 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:32.443100 17020 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.469025 16906 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:32.476645 16684 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:32.515313 17022 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:32.516379 16993 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.944s	user 0.017s	sys 0.002s
W20260709 13:08:32.519539 16845 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.882s	user 0.010s	sys 0.004s
I20260709 13:08:32.540956 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.497817 16994 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:32.452087 16873 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.573256 16887 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.591861 17024 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:32.598621 16892 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:32.626183 17024 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.627192 16892 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.628460 17024 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.629923 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:32.630525 16892 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:32.632586 16742 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:32.633881 16864 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.634727 16865 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:32.635205 16865 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:32.572957 17025 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:32.636015 17025 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.638924 17025 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:32.641855 16936 consensus_meta.cc:287] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.960s	user 0.013s	sys 0.000s
W20260709 13:08:32.642540 16655 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.919s	user 0.004s	sys 0.008s
I20260709 13:08:32.642344 16936 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.643203 16655 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.636022 16865 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.598259 17029 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:08:32.650645 16587 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.334s	user 0.014s	sys 0.000s
I20260709 13:08:32.626055 16887 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:32.663069 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.742309 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 185) took 1370 ms. Trace:
I20260709 13:08:32.573491 16684 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.742838 16008 rpcz_store.cc:276] 0709 13:08:31.359475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.359637 (+   162us) service_pool.cc:224] Handling call
0709 13:08:32.729681 (+1370044us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54004ecfd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:32.729916 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562121088}
I20260709 13:08:32.770584 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1295) took 1886 ms. Trace:
I20260709 13:08:32.608618 16845 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.741446 16936 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.776834 15374 rpcz_store.cc:276] 0709 13:08:30.883938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.980682 (+ 96744us) service_pool.cc:224] Handling call
0709 13:08:30.981072 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.084747 (+103675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.084775 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.084812 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:31.084858 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.770196 (+1685338us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003c3a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:32.770269 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.770485 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237941504}
W20260709 13:08:32.771546 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 355792us
I20260709 13:08:32.733496 16799 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.782065 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1415) took 1012 ms. Trace:
I20260709 13:08:32.598918 17022 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.784868 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1416) took 1014 ms. Trace:
I20260709 13:08:32.788832 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:32.780663 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 238367us
I20260709 13:08:32.618229 16994 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.750543 16865 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.793185 15306 rpcz_store.cc:276] 0709 13:08:31.769759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.770699 (+   940us) service_pool.cc:224] Handling call
0709 13:08:31.770995 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.771184 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:32.429472 (+658288us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.781585 (+352113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.781671 (+    86us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:32.781732 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.781822 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.781980 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":747084,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":41197,"thread_start_us":952516,"threads_started":2}
I20260709 13:08:32.729228 16587 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.815624 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:32.798334 15299 rpcz_store.cc:276] 0709 13:08:31.771404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.771800 (+   396us) service_pool.cc:224] Handling call
0709 13:08:31.772144 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.772320 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:32.508672 (+736352us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.784263 (+275591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.784320 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:32.784585 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.784668 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.784793 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50110,"prepare.queue_time_us":805815,"prepare.run_cpu_time_us":2446,"prepare.run_wall_time_us":13494,"raft.queue_time_us":36531,"thread_start_us":597205,"threads_started":2}
I20260709 13:08:32.837544 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1420) took 1044 ms. Trace:
W20260709 13:08:32.818856 16889 consensus_meta.cc:287] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.558s	user 0.014s	sys 0.003s
I20260709 13:08:32.843878 17046 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.846645 17046 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:32.848304 16551 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:32.849592 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.850312 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.850400 15227 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:32.722626 17029 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.862617 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:32.864207 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 233156us
I20260709 13:08:32.867259 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.867448 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.824622 17039 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:32.838683 15301 rpcz_store.cc:276] 0709 13:08:31.792880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.793034 (+   154us) service_pool.cc:224] Handling call
0709 13:08:31.793380 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.188842 (+395462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.188893 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:32.194623 (+  5730us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.393891 (+199268us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:32.791115 (+397224us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.837091 (+ 45976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.837204 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.837261 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:32.837280 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.837459 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":440556,"prepare.queue_time_us":226977,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":451086,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":26549,"thread_start_us":546617,"threads_started":2,"wal-append.queue_time_us":319348}
I20260709 13:08:32.871053 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.848843 16551 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:32.873751 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.777647 16906 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.876205 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.875522 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:32.878331 16008 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:32.872551 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.882879 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.898088 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.902608 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:32.901626 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 186923us
I20260709 13:08:32.873536 16892 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:32.909614 16845 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.879638 16990 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:32.855394 16889 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.896865 16952 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:32.873382 16841 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:32.930553 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.933605 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.935823 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.937763 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.938989 15229 raft_consensus.cc:2410] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:32.941636 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.944414 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:32.945890 15373 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:08:32.949234 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.927735 16955 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:32.945295 15229 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:32.944958 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:32.945413 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:32.944613 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.943457 16655 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.919786 16892 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:32.968461 15379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1378) took 1978 ms (client timeout 1980 ms). Trace:
W20260709 13:08:32.970960 15379 rpcz_store.cc:269] 0709 13:08:30.990137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.990245 (+   108us) service_pool.cc:224] Handling call
0709 13:08:32.968268 (+1978023us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540012b1d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:32.968405 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425043200}
I20260709 13:08:32.970377 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:32.973381 15225 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:32.974869 16587 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:32.973655 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:32.976325 16728 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.977583 16005 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:32.978273 16005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 180) took 1726 ms. Trace:
I20260709 13:08:32.978621 16005 rpcz_store.cc:276] 0709 13:08:31.251572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.269818 (+ 18246us) service_pool.cc:224] Handling call
0709 13:08:32.977137 (+1707319us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b5800003c98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:08:32.977340 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.978023 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.978219 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19214592}
W20260709 13:08:32.976133 15380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 207) took 1838 ms (client timeout 2087 ms). Trace:
I20260709 13:08:32.949946 16887 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:32.951725 16841 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:32.953388 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:32.982148 15380 rpcz_store.cc:269] 0709 13:08:31.138251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.154127 (+ 15876us) service_pool.cc:224] Handling call
0709 13:08:32.975968 (+1821841us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b54000028d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:32.976078 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16064896}
I20260709 13:08:32.941213 16952 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.989228 16960 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:32.989802 16960 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:32.990278 16960 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.990815 16952 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:32.991441 16952 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:32.991922 16952 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:32.994232 16952 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:32.918872 16551 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.940464 16990 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:32.988428 17029 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:32.985833 16873 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:32.996411 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.003504 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.006651 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:33.013118 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.013535 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:32.963466 16955 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:33.027477 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53905.8us
I20260709 13:08:33.028704 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.030155 15225 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.030360 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.031498 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.033087 15225 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.036521 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.029633 15228 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.038043 17028 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:33.009125 17044 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.104s	user 0.002s	sys 0.000s
I20260709 13:08:33.041141 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:33.040079 16915 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:08:33.015075 16735 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.226s	user 0.015s	sys 0.001s
I20260709 13:08:33.008998 16994 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.023514 16873 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:33.008989 17059 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.024083 17025 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:33.053350 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.999814 16841 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.042428 16952 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:33.043195 17061 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:08:33.043813 17058 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.048996 17028 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.047556 16889 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.046142 16915 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:33.066870 17059 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.056883 16960 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.055248 16994 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:33.068665 16841 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:33.058815 17025 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:33.045878 17022 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.065793 16952 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.071767 17028 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.073136 16915 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:33.087867 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44352.4us
I20260709 13:08:33.089636 16892 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.090036 17008 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:33.091673 16990 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.051508 16735 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.097779 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:33.074313 16994 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.094761 17067 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:08:33.094664 17025 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.084918 17058 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:33.115950 16915 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.117197 17058 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:33.118747 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.113389 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.121847 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.096858 17028 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.126111 16955 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:33.129850 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.134560 15348 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:33.138628 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.139074 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.141189 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.141566 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.142205 15224 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:33.143009 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.145648 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:33.138329 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.129297 17061 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.155972 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.156503 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:33.190722 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 136296us
I20260709 13:08:33.129547 16990 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.094147 17063 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:08:33.151036 16955 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.190929 15231 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:33.149626 16892 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.195644 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.198246 16005 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:33.201356 16892 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:33.202394 15233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1537) took 1804 ms (client timeout 2022 ms). Trace:
W20260709 13:08:33.202958 15233 rpcz_store.cc:269] 0709 13:08:31.398333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.462162 (+ 63829us) service_pool.cc:224] Handling call
0709 13:08:33.202155 (+1739993us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400284bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:33.202316 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332239104}
I20260709 13:08:33.188122 17061 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.210341 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:33.197803 16955 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:33.211469 16955 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.211525 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.214442 16994 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.215317 16994 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.215148 17025 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.215775 16994 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:33.217309 17061 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.218473 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.219952 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:33.221243 16952 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.221841 16952 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.222223 16952 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:33.222918 16952 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.216214 16994 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.231166 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.232189 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 238) took 1781 ms. Trace:
I20260709 13:08:33.232777 16000 rpcz_store.cc:276] 0709 13:08:31.450536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.484493 (+ 33957us) service_pool.cc:224] Handling call
0709 13:08:32.772728 (+1288235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.791734 (+ 19006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.800676 (+  8942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.807235 (+  6559us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:32.813120 (+  5885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.822092 (+  8972us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.231901 (+409809us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54004ecfd0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:33.232104 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2872415104}
I20260709 13:08:33.226213 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.234266 15999 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:33.226101 16735 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:33.250108 17066 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:33.250353 17025 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.251488 16892 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:33.242157 17034 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.367s	user 0.003s	sys 0.001s
I20260709 13:08:33.242702 17068 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.256640 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:33.254709 17028 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.272495 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.269511 16873 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:33.274418 16873 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.261617 17068 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:33.279287 17068 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.243739 16955 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.293619 16873 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:33.294402 17039 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:33.294708 17028 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:33.295167 17039 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:33.299381 17039 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.300845 17039 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.302528 17061 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:33.336184 17069 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 13:08:33.382979 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.262683 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1406) took 1503 ms. Trace:
I20260709 13:08:33.392587 15231 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:33.393644 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.388398 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.390697 15305 rpcz_store.cc:276] 0709 13:08:31.759248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.766348 (+  7100us) service_pool.cc:224] Handling call
0709 13:08:31.766771 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:31.771301 (+  4530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.771343 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.771774 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:08:32.437133 (+665359us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:32.791380 (+354247us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.813166 (+ 21786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.813243 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.223932 (+410689us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:33.261343 (+ 37411us) raft_consensus.cc:1685] finished
0709 13:08:33.262233 (+   890us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.262560 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47934,"prepare.queue_time_us":210104,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":26537,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":15295,"spinlock_wait_cycles":10310528,"thread_start_us":610955,"threads_started":2,"wal-append.queue_time_us":1029950}
I20260709 13:08:33.383908 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.397653 16627 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:33.398468 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.402460 16906 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:33.314529 16952 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:33.408165 17031 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.794s	user 0.000s	sys 0.009s
W20260709 13:08:33.409438 17007 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 2.084s	user 0.004s	sys 0.021s
I20260709 13:08:33.409060 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.395726 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:33.424896 16627 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.430645 15379 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:33.433753 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 147847us
I20260709 13:08:33.437240 17028 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:33.439706 17028 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.442652 16941 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:33.447005 16911 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:33.445693 16941 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:33.457585 15233 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.455291 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:33.469039 15381 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:33.472028 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.472873 17029 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:08:33.472226 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 79134.9us
I20260709 13:08:33.451686 16627 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.481011 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1311) took 1634 ms. Trace:
W20260709 13:08:33.485678 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 97711.7us
I20260709 13:08:33.485543 15373 rpcz_store.cc:276] 0709 13:08:31.773248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.774174 (+   926us) service_pool.cc:224] Handling call
0709 13:08:31.774385 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:32.946413 (+1172028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.403797 (+457384us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003c3f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:33.407616 (+  3819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2693626240}
I20260709 13:08:33.487627 17058 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:33.479250 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.418170 16906 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:33.340246 17061 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.477823 15973 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:33.487186 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.500384 17020 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.501228 17020 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:33.501798 17020 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.506145 17078 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.489418 16684 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:33.509739 17067 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.510509 17067 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:33.513252 16955 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.512892 17029 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.491770 16952 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.515806 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.511080 17067 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.510844 17028 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.525115 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:33.532137 15374 raft_consensus.cc:2410] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:33.491423 16911 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.533136 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.533375 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:33.535346 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.535739 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:33.536535 15379 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:33.536971 16003 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.538787 17022 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:33.539209 17022 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:33.546079 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.546633 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.546079 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.548765 15381 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:33.551018 17022 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.552824 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:33.555307 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.555464 15233 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:33.560850 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.562043 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:33.565497 16952 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:33.567158 16002 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:33.566980 16952 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.570793 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.571193 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:33.571748 15374 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:33.572705 16551 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.573712 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:33.569774 16941 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.576819 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.578454 15377 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:33.579644 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.580264 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.581723 17059 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.581991 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.582914 15376 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:33.570087 15379 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:33.592077 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.535883 16911 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.601598 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.601974 16889 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:33.603252 15382 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:33.603035 16889 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:33.605031 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 135055us
I20260709 13:08:33.605991 16889 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.606142 15973 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:33.608314 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.625622 17068 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.627503 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.627692 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.609107 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:33.628700 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.630192 15999 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.627637 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.618212 16906 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:33.650043 17080 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.650657 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.650964 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.652514 16005 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:33.651711 15378 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:33.654618 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 160) took 2323 ms. Trace:
I20260709 13:08:33.658990 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.659565 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.659898 16002 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
W20260709 13:08:33.659960 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.657048 15226 rpcz_store.cc:276] 0709 13:08:31.331306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.699298 (+367992us) service_pool.cc:224] Handling call
0709 13:08:33.203610 (+1504312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.204122 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.204143 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:33.204181 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:33.204204 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.204262 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.654185 (+449923us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400284bd0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:33.654384 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3439386496}
I20260709 13:08:33.661165 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.666801 15375 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.667430 15376 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.667462 15373 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
W20260709 13:08:33.678203 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72284.1us
I20260709 13:08:33.681197 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.684020 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:33.685353 16873 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.688468 17020 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.691057 17020 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.691290 15305 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:33.661762 17029 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:33.692828 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.703202 15225 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.705803 15374 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 1.
I20260709 13:08:33.707778 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.708966 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.709964 15230 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:33.714331 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.721374 16787 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:33.722177 16787 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.726660 15381 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.731428 15130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 191) took 7208 ms. Trace:
I20260709 13:08:33.728194 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.732050 15130 rpcz_store.cc:276] 0709 13:08:26.522902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.523081 (+   179us) service_pool.cc:224] Handling call
0709 13:08:33.731094 (+7208013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92383,"reported_tablets":3}
I20260709 13:08:33.733187 15381 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:33.733384 16952 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.733645 15131 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 2, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:33.744449 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.745374 15374 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:33.719364 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.756764 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.752966 17059 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.756018 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.748193 17022 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.777112 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:33.777729 17086 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:08:33.778915 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.776960 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.784101 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:33.784399 15274 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:33.786687 17027 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:33.747175 15131 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 2 to 3, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:08:33.791015 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.782840 15374 raft_consensus.cc:2376] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3. Re-sending same reply.
I20260709 13:08:33.796976 16799 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.797623 16799 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:33.800948 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.805936 15382 raft_consensus.cc:2410] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:33.811466 15227 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:33.788980 17027 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:33.814103 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70537.8us
I20260709 13:08:33.812106 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:33.798089 16799 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:33.821851 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 120012us
I20260709 13:08:33.824177 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.781365 16994 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.828001 15131 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:33.834529 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:33.837001 17029 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.837914 17029 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:33.838654 17029 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.846985 15381 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:33.846709 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.854607 15380 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.854996 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:33.856832 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.852319 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.862612 15376 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:33.865507 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:33.861768 15127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 190) took 7398 ms. Trace:
I20260709 13:08:33.861054 15224 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:33.873937 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.875993 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:33.885196 15377 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:33.890623 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.896127 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.905004 17046 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:33.906003 17046 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.846323 17027 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.918370 16003 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:33.925436 17046 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:33.926445 17039 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.012s
W20260709 13:08:33.933501 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.933791 16008 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.938212 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:33.939601 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:33.940659 16956 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:33.941010 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:33.941895 16889 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.942651 16889 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.943034 16889 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:33.943548 16889 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.941493 16956 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:33.923787 16941 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.943074 16781 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.891422 17059 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.948136 15375 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:33.946915 17074 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:33.952469 16781 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:33.953116 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:33.955137 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.956771 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.958009 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.932319 16787 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.959251 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.961488 15230 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.869658 15127 rpcz_store.cc:276] 0709 13:08:26.375724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.375903 (+   179us) service_pool.cc:224] Handling call
0709 13:08:26.389035 (+ 13132us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:33.771578 (+7382543us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:31.787561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:32.151577 (+364016us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:32.151616 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:08:32.151633 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:32.152032 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:32.152101 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:32.152125 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:32.152313 (+   188us) tablet.cc:701] Row locks acquired
0709 13:08:32.152331 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:32.152514 (+   183us) write_op.cc:270] Start()
0709 13:08:32.152626 (+   112us) write_op.cc:276] Timestamp: P: 1783602512152465 usec, L: 0
0709 13:08:32.152654 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:08:32.153416 (+   762us) log.cc:844] Serialized 535 byte log entry
0709 13:08:33.220446 (+1067030us) op_driver.cc:464] REPLICATION: finished
0709 13:08:33.320364 (+ 99918us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f5755cef0
0709 13:08:33.342829 (+ 22465us) write_op.cc:301] APPLY: starting
0709 13:08:33.342895 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:33.342963 (+    68us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:33.342975 (+    12us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:33.343172 (+   197us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:33.343279 (+   107us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:33.343305 (+    26us) write_op.cc:312] APPLY: finished
0709 13:08:33.343456 (+   151us) log.cc:844] Serialized 22 byte log entry
0709 13:08:33.343562 (+   106us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:33.343620 (+    58us) write_op.cc:454] Released schema lock
0709 13:08:33.343646 (+    26us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:33.343858 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:33.343876 (+    18us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1807676,"reported_tablets":7,"spinlock_wait_cycles":21946112,"child_traces":[["op",{"apply.queue_time_us":122151,"apply.run_cpu_time_us":1038,"apply.run_wall_time_us":1039,"num_ops":1,"prepare.queue_time_us":952460,"prepare.run_cpu_time_us":16775,"prepare.run_wall_time_us":828426,"raft.queue_time_us":81024,"raft.run_cpu_time_us":20952,"raft.run_wall_time_us":150695,"replication_time_us":1045571,"spinlock_wait_cycles":34462592,"thread_start_us":1346380,"threads_started":4,"wal-append.queue_time_us":695961}]]}
I20260709 13:08:33.966361 17067 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.967335 16994 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:33.939888 16911 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.969529 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:33.969981 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.992517 15374 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
W20260709 13:08:33.978965 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 119917us
I20260709 13:08:33.983482 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:33.979638 16781 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.979842 17029 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:33.996527 17067 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.996799 17029 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:33.998263 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:33.999011 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:34.001123 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.003899 15381 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:33.979419 16906 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:08:34.004875 15225 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.006186 15227 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:34.008302 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.009995 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.010327 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.012415 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:33.992746 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60083.3us
I20260709 13:08:34.015522 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:33.985538 15348 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:33.980018 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:33.987363 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:33.979365 16931 consensus_queue.cc:1059] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:08:33.944272 17078 raft_consensus.cc:2764] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:33.990752 15382 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.016543 15378 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:34.017982 17068 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:34.025592 17068 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.028733 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.029141 17068 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.029598 15380 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:34.034966 16781 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.039781 15999 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:34.044780 16002 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:34.045089 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.045552 16781 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:34.046491 15373 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:34.047415 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:34.049945 16952 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:34.050833 16952 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:34.053159 16931 raft_consensus.cc:3055] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.053678 16931 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:34.054956 16931 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.055598 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:34.060031 15305 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:08:34.068917 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 79333.1us
I20260709 13:08:34.088778 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.089140 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:34.090509 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.110616 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 63366.9us
I20260709 13:08:34.111130 15375 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.091975 16931 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.116660 16719 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:34.117280 15373 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:34.061621 16906 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:34.117324 16719 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:34.119920 16906 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.120658 16719 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.125079 15225 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:34.127491 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:34.129648 16873 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:34.131433 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:34.052084 16952 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.134820 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.136854 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:34.139680 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.140944 17062 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:34.127939 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.135840 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.149806 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.160876 17046 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.162526 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.166388 15300 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.140044 17008 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.089730 17068 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:34.069576 16911 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.151957 17062 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:34.099840 16994 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:08:34.182076 15303 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:34.186645 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56549.3us
I20260709 13:08:34.172669 17025 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.191813 17062 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.196619 17068 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.197255 16956 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.199112 16906 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.200747 17068 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:34.205675 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.208379 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:34.210721 16551 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.637s	user 0.016s	sys 0.002s
I20260709 13:08:34.212028 15308 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:34.213580 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 79) took 1344 ms. Trace:
I20260709 13:08:34.213991 15308 rpcz_store.cc:276] 0709 13:08:32.868768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.871167 (+  2399us) service_pool.cc:224] Handling call
0709 13:08:34.213309 (+1342142us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:34.213483 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3017804672}
I20260709 13:08:34.168970 17008 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:34.217403 17008 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.221035 17078 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:34.223292 17078 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:34.224352 17078 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:34.227766 17078 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.222678 16799 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.240159 15299 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:34.187449 15306 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:34.243083 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.252223 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:34.253089 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 125279us
W20260709 13:08:34.253782 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.219408 17008 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.168475 17046 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:08:34.262665 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:34.204120 16911 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.269032 15304 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:34.269797 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.251053 17078 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.274923 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.275367 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:34.276458 17098 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 13:08:34.277755 15304 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:34.282703 15306 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:34.290343 16799 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:34.291270 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:34.292794 16956 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.294265 17059 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.300316 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:34.332782 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.282717 17029 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:08:34.348376 15305 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:34.354298 16799 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.355088 16799 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.357272 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.357681 16799 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.357956 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:34.359570 16551 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.360014 16551 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:34.362986 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.338409 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:34.341003 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.325057 16627 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:34.341578 15999 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.368316 15300 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.369138 15231 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:34.369606 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:34.374185 17062 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.376631 16920 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:34.377604 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.378362 15300 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:34.379752 16920 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:34.380141 16920 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:34.380483 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:34.382962 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.381278 16920 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.382324 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:34.361629 16551 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.384585 16889 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:34.385497 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 85293.5us
I20260709 13:08:34.355110 15302 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:34.391359 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:34.398670 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.401286 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.407503 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.405788 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.411937 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.413515 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.416153 15299 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:34.418613 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.421275 17029 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:34.413537 15301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b"
dest_uuid: "841138f50ace4746978e72d7f13878de"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:36746
I20260709 13:08:34.423734 15301 raft_consensus.cc:606] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:34.424171 15301 raft_consensus.cc:614] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:34.429515 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.432539 15305 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:34.433243 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.436619 15301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55ea5972868497eb17221413640fbea"
dest_uuid: "841138f50ace4746978e72d7f13878de"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:36746
I20260709 13:08:34.439502 15301 raft_consensus.cc:606] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:34.411543 16911 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:34.438714 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.396999 16941 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:08:34.436443 16920 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.443132 17029 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:08:34.445822 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:34.458505 15301 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:34.459936 17000 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:34.460450 17000 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:34.460956 16911 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:34.461738 17000 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.462388 16911 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.463601 17000 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.465001 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.479923 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.479522 16627 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.481819 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:34.483613 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:34.484750 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:34.486718 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:34.487008 16627 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.487599 16627 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:34.484751 15232 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:34.474220 16889 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:34.495008 17029 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:34.495745 17029 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:34.499075 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62920.6us
I20260709 13:08:34.500288 17097 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:34.489301 16627 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.497784 17029 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.501863 17097 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:34.504769 16889 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.529863 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:34.533165 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:34.539305 15999 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:34.540973 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.542192 16941 raft_consensus.cc:993] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:08:34.542384 16787 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:34.542670 16941 raft_consensus.cc:1081] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:08:34.542892 16787 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:34.522935 17097 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.550984 17107 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:34.562532 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.569240 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.553339 16956 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:34.582314 15345 connection.cc:256] RPC call timeout handler was delayed by -1.7781099149999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:08:34.583024 15345 connection.cc:256] RPC call timeout handler was delayed by -1.6953099150000526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:08:34.583504 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5729099149999684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 13:08:34.583921 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5171099149999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:08:34.584390 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4769455950000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 13:08:34.584838 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4685099150000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:08:34.585273 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4514099149999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:08:34.585883 15345 connection.cc:256] RPC call timeout handler was delayed by -1.3446455950000882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 13:08:34.586835 15345 connection.cc:256] RPC call timeout handler was delayed by -1.3317099150000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:08:34.587949 15345 connection.cc:256] RPC call timeout handler was delayed by -1.2894099149999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:08:34.588943 15345 connection.cc:256] RPC call timeout handler was delayed by -1.24710991500001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 13:08:34.597491 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:34.544317 16787 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.610023 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:34.604822 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58310.1us
I20260709 13:08:34.576939 16956 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:34.569641 16889 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.598778 17020 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:34.617959 17020 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:34.618420 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51869.7us
I20260709 13:08:34.618494 17020 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.624527 16627 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.630781 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.632208 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:34.636507 16719 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:34.640281 16719 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:34.636801 16994 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:34.640923 16719 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:34.642441 17104 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:34.644433 16889 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:34.644699 17008 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:34.653148 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55779.8us
I20260709 13:08:34.654093 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:34.632085 16956 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:34.671085 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78183.8us
I20260709 13:08:34.672690 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:34.641052 16994 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:34.680891 16994 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.672312 16551 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.738511 17020 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.738773 17000 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.740262 17000 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.742098 16956 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.634583 16781 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:08:34.759861 16781 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.760435 16781 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:34.761812 16781 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.734565 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.734710 17112 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:34.764829 17112 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.766479 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.768579 16799 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.769235 16799 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:34.769544 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.769869 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:34.770839 16003 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:34.735948 17108 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.771083 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:34.749010 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55183.8us
I20260709 13:08:34.744439 16911 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:34.763839 16781 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.768061 17112 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:34.753549 16719 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.734037 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:34.732460 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.737784 17097 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.749459 15999 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:34.772208 16941 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.773262 17046 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.755728 16002 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:34.777036 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.777908 17097 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:34.770355 16799 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:34.779093 17020 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.779178 15232 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:34.777769 16920 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:34.782164 16920 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:34.782037 16952 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:34.782894 16889 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:34.783195 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50934.3us
I20260709 13:08:34.785784 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.786120 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.787107 16889 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:34.787540 16889 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:34.788069 16889 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.783808 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:34.833169 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62154.8us
I20260709 13:08:34.838279 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.840994 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:34.844034 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.850682 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.851442 15382 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:34.855329 17000 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:34.860008 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 74036.6us
I20260709 13:08:34.861905 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:34.850697 17113 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.061s	user 0.003s	sys 0.009s
I20260709 13:08:34.837606 17008 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:34.869907 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 90) took 5889 ms. Trace:
W20260709 13:08:34.870211 17114 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.010s
I20260709 13:08:34.871605 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:34.886293 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:34.890523 17115 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:34.891145 17115 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:34.891619 17115 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.890784 16920 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:34.877193 15127 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.893019 15127 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:34.893567 16719 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.894546 16719 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:34.896967 17078 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:34.898093 17078 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:34.898423 17078 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:34.899473 17078 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.901926 15232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:34.902501 15232 raft_consensus.cc:606] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:34.903726 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:34.872797 15131 rpcz_store.cc:276] 0709 13:08:28.980913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.984184 (+  3271us) service_pool.cc:224] Handling call
0709 13:08:34.869722 (+5885538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:34.221298 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:34.222104 (+   806us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:34.222185 (+    81us) write_op.cc:435] Acquired schema lock
0709 13:08:34.222211 (+    26us) tablet.cc:662] Decoding operations
0709 13:08:34.222892 (+   681us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:34.222994 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:34.223021 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:34.223672 (+   651us) tablet.cc:701] Row locks acquired
0709 13:08:34.223725 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:08:34.223921 (+   196us) write_op.cc:270] Start()
0709 13:08:34.258064 (+ 34143us) write_op.cc:276] Timestamp: P: 1783602514223846 usec, L: 0
0709 13:08:34.265099 (+  7035us) op_driver.cc:348] REPLICATION: starting
0709 13:08:34.287973 (+ 22874us) log.cc:844] Serialized 1365 byte log entry
0709 13:08:34.492708 (+204735us) op_driver.cc:464] REPLICATION: finished
0709 13:08:34.675131 (+182423us) write_op.cc:301] APPLY: starting
0709 13:08:34.738180 (+ 63049us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:34.738346 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:34.738532 (+   186us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:34.757351 (+ 18819us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:34.757659 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:08:34.757735 (+    76us) write_op.cc:312] APPLY: finished
0709 13:08:34.758093 (+   358us) log.cc:844] Serialized 35 byte log entry
0709 13:08:34.758301 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:34.758392 (+    91us) write_op.cc:454] Released schema lock
0709 13:08:34.758452 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:34.758897 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:34.758932 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1665295,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":166624,"apply.run_cpu_time_us":7373,"apply.run_wall_time_us":83725,"num_ops":3,"prepare.queue_time_us":253143,"prepare.run_cpu_time_us":5985,"prepare.run_wall_time_us":67438,"replication_time_us":203800,"spinlock_wait_cycles":75520,"thread_start_us":166182,"threads_started":2}]]}
I20260709 13:08:34.905381 16627 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.907305 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:34.895360 15127 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.924819 15999 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:34.906366 17078 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.927699 16952 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.868458 17020 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:08:34.941895 15127 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.923017 17000 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:34.946287 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77540.1us
I20260709 13:08:34.947129 15127 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.938177 16799 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:34.954574 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:34.958766 15302 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.957356 15127 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.964306 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:34.966625 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.955446 16719 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:34.967522 15303 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.973097 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:34.975071 15301 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:34.944135 16956 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:34.957877 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:34.927757 17115 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.931347 16994 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:34.994102 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:34.978499 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:34.995500 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.951156 16781 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.983973 15127 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.000777 15377 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:34.960590 16799 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.013397 15302 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:34.951426 16889 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.034178 16551 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:35.034641 16551 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:35.013422 16799 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.035477 16551 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.037353 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:35.037631 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.039009 17107 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.027287 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:35.040584 15379 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:35.040784 15381 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:35.028474 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.028719 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:35.029069 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:35.045609 15374 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.031375 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:35.002549 16781 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.039110 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:35.026438 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48043.8us
I20260709 13:08:35.048504 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:35.052158 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:35.052910 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 87632.4us
I20260709 13:08:35.050613 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:35.058586 16551 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:35.049522 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 187720us
I20260709 13:08:35.057852 15127 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.035486 16889 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.078681 15127 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 2 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:08:35.105077 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44395.9us
W20260709 13:08:35.105566 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55057.1us
I20260709 13:08:35.106529 15273 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.055534 17074 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.113963 15303 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:35.055229 17046 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.120265 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:35.110802 16931 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.128069 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.101791 16952 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.152241 16551 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.122534 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:35.153187 15377 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:35.132119 15127 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 4 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:35.055662 17107 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.117640 17020 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:35.115759 17074 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.162542 15127 catalog_manager.cc:5697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:35.165170 16809 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:35.165473 16994 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:35.152671 17046 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.163178 16952 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.158073 17107 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:35.157742 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:35.169744 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:35.179114 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58956.6us
I20260709 13:08:35.165470 15127 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:35.190801 16781 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:35.190325 15127 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:35.184942 17074 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.168327 17046 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:35.168797 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:35.182494 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:35.195865 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 83705.8us
I20260709 13:08:35.196842 16889 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.197567 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.198766 16889 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:35.200088 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:35.201555 16005 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:35.190963 16952 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.206806 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:35.208155 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.209393 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:35.210485 15273 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:35.162966 17128 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:08:35.211637 16551 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.213243 16551 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.213588 16551 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.213892 16551 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.214469 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:35.199374 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:35.222946 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93922.8us
I20260709 13:08:35.155282 17090 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.227181 17090 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.228019 15231 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:35.229741 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.230656 17135 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.181461 17107 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.232441 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.236872 15374 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:35.244099 15380 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:35.186497 17008 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.264783 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:35.267402 15305 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:35.223369 17046 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.274482 16873 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:35.275866 16873 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:35.276221 16873 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:35.277659 16873 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.277971 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:35.279155 16873 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.231352 16719 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.231177 16931 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:35.289474 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 90259.8us
I20260709 13:08:35.247359 16941 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:35.293504 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:35.247560 16952 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:35.295342 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 163154us
I20260709 13:08:35.229782 17090 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.270279 17008 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.306545 16551 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.307811 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.289706 17120 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.257120 16994 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:35.288496 16719 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.315313 16719 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.311772 17120 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.322744 17120 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.301270 16809 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.311151 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:35.296918 16941 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.289902 16931 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.300983 17112 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:08:35.334846 16952 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:35.361112 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53388.8us
I20260709 13:08:35.330519 17115 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:35.375010 16008 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:35.376874 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67640.1us
W20260709 13:08:35.377760 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69487.3us
I20260709 13:08:35.448407 15231 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:35.449736 15374 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:35.380604 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.386108 16551 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.363178 17074 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.453840 17008 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.456147 17074 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.456794 17074 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:35.447813 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:35.458087 15300 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:35.457909 16719 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:35.462229 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 75425.4us
I20260709 13:08:35.464495 17020 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:35.442536 16931 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.465895 17115 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.468823 17097 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:35.469375 17097 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.444305 15232 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:35.450824 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:35.451346 17104 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.007s
I20260709 13:08:35.452800 17120 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.454264 15380 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:08:35.474745 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 94247.6us
I20260709 13:08:35.474895 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.367749 16799 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.477633 15376 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.442312 16941 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.495779 16873 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:35.496595 16873 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.498018 17135 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.498595 17135 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.499011 16781 raft_consensus.cc:993] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:08:35.499742 16781 raft_consensus.cc:1081] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:08:35.498950 16920 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:35.478515 16994 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.518561 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:35.519306 15305 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:35.519469 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:35.520617 16008 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.523789 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:35.485226 17124 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:35.522926 16994 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.533970 16994 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.535326 16799 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.500485 16873 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.516204 16719 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:35.536157 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:35.544685 17090 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:35.536307 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61577.7us
I20260709 13:08:35.545447 17090 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.545986 17090 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.546342 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.548683 16889 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.549116 16889 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.549530 16889 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.552912 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.554562 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.559099 15999 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEARNER]: Advancing to term 5
I20260709 13:08:35.563346 17120 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.476464 17107 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.564244 17097 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.569901 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.572494 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.567698 15230 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:35.544981 15228 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:35.572551 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:08:35.585953 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.592010 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66958.4us
I20260709 13:08:35.592592 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:35.593395 15224 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:35.600247 15376 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:35.601924 17151 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:35.602622 17151 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:35.603099 17151 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:35.603698 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 136657us
I20260709 13:08:35.573149 17124 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.605326 17124 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.565590 17008 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.567476 17107 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:35.607857 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59728.9us
I20260709 13:08:35.609841 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:35.615679 16008 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:35.564967 16994 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.603662 16799 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.559103 17149 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:08:35.636116 17149 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:35.636655 17149 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:35.637638 17149 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.639065 17149 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.632896 17137 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:35.633957 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:35.647012 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:35.624917 17046 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.631052 17140 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:35.653034 15300 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:35.653899 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:35.654856 15305 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:35.660035 15299 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:35.665382 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:35.666257 15301 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.670055 17152 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:35.671568 17152 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:35.672003 17152 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.676177 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:35.678624 17146 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:35.679658 17146 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.682708 17137 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:35.684087 17152 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.687078 15999 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:35.696589 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.688083 15226 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:35.696676 17152 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.698449 16956 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.699602 16956 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:35.699985 16956 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.700899 16956 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.704326 17124 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.705827 15301 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:35.648916 17046 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.708699 17046 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.709321 15299 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:35.689635 17090 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.691797 16911 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:35.692534 17140 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.694522 16994 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.685098 17146 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.706895 17135 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.706805 16889 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.707316 16941 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.730535 15299 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:35.707864 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:35.708263 17124 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.710309 15305 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:35.722893 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.734372 15308 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:35.734607 17107 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.734704 15300 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.646577 16799 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.737248 15307 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:35.737334 17121 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:35.723196 17008 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:08:35.738559 17153 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:35.739617 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.741842 16994 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.742734 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.743747 16787 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:35.744184 16787 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:35.744567 16787 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.746025 17141 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:35.751344 16889 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.748103 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:35.786064 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:35.786863 15382 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.789036 15375 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:35.791775 15375 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.793193 15379 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:35.797703 15374 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.724123 16956 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:35.801651 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.804283 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:35.807574 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64946.9us
I20260709 13:08:35.752262 16809 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:35.809866 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:35.815680 15381 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.737926 17121 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.801487 16911 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:35.808631 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.773916 17153 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.757052 17137 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:08:35.807147 15376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
I20260709 13:08:35.837791 15376 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:35.838275 15376 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.814683 16809 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.809451 17008 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:35.858417 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.854697 16911 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:35.855965 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.786s (SENT) [suppressed 20 similar messages]
I20260709 13:08:35.843402 16994 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:35.845121 15999 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:35.863778 16911 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.880530 16920 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.881655 16920 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:35.882033 16920 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.884517 16809 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.887552 16941 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.889307 16952 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:35.890707 16799 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.890699 17130 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:35.893813 17107 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:35.894312 17107 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:35.897166 17140 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:35.897754 15381 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:35.900537 16787 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:35.901654 15379 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.908095 16787 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:35.819708 16931 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:35.911711 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.912837 15382 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:35.842725 17097 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:08:35.911478 15376 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:35.919696 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61390.2us
I20260709 13:08:35.921512 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.925113 16809 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.921597 17153 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.857431 16627 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:08:35.874154 17124 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.944428 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.946416 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:35.953152 16931 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:35.954252 17090 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.954456 15303 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:35.895552 17107 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.903918 17046 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:35.959370 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:35.960505 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.963536 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.968314 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:35.971684 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:35.972718 15300 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:35.978798 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:35.981961 15376 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:35.996279 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:35.997788 15304 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:35.995002 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:36.000643 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43851.3us
W20260709 13:08:36.007025 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85717.7us
I20260709 13:08:36.007541 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:36.009948 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:35.970723 16787 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.023736 17097 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.922251 17121 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.044606 17121 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.993058 17145 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:36.046979 17145 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:35.990056 16799 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:08:36.000136 16809 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:36.000125 17151 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.029616 17154 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:36.030135 16941 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.032670 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.008149 17141 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:08:36.019438 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 163480us
W20260709 13:08:36.049431 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 294094us
I20260709 13:08:36.000605 17107 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.053480 15224 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
W20260709 13:08:36.067662 15273 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.894s (SENT)
I20260709 13:08:36.067901 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:36.068130 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:36.062904 16809 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:36.058959 17135 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:08:36.087769 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73549.8us
I20260709 13:08:36.088835 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.089404 17135 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:36.090390 17135 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.091766 17135 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.091470 16920 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.094918 16941 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.081923 16809 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.096805 16005 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:36.098210 15381 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:36.097947 17146 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.071200 17140 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.099743 17141 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:36.053663 17097 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:36.106405 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.077808 17154 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:36.114264 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.121968 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:36.140659 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:36.152926 15225 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.083312 16952 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:36.145632 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77985.5us
I20260709 13:08:36.148216 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:36.129508 17008 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.167132 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45262us
I20260709 13:08:36.170270 15224 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:36.089394 16781 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:08:36.176474 17165 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.119509 17145 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.150048 17046 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:36.173259 16920 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.168025 16952 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:36.170321 16799 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.170619 17140 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:36.179658 17149 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:36.186403 17146 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:36.170506 16719 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:08:36.204885 16952 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.209998 17140 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.175419 17000 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:36.211352 17139 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.183136 17127 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:36.186638 17058 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.179108 17008 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:36.265669 15273 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.982s (SENT)
I20260709 13:08:36.214486 16787 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.222424 17145 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.276707 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:36.288072 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 173899us
I20260709 13:08:36.239056 17139 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:36.299569 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.299890 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:36.300593 17171 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:08:36.302039 17172 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:08:36.221630 16799 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.243227 17127 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.336760 16889 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.346604 16994 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.345979 16889 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.347256 17127 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:36.349489 16889 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:36.349961 17008 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:36.312309 17165 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.354300 17153 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.354836 17153 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:36.239598 17149 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:36.359336 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93730.1us
I20260709 13:08:36.358697 17008 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.340389 17137 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:36.367187 17008 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.367800 17137 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:36.368933 17137 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.370357 17137 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.371835 17008 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:36.238852 17146 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:36.384595 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.341487 17174 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:08:36.377336 15273 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.058s (SENT)
I20260709 13:08:36.292286 16941 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.395270 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.403282 15374 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:08:36.441414 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 75518.2us
W20260709 13:08:36.451512 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74245.8us
W20260709 13:08:36.454278 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.264555 17154 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.461393 17152 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.464325 17152 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.443087 17096 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.466872 17152 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:36.466723 17096 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.467943 17130 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:36.050987 17029 consensus_queue.cc:1175] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:36.469820 17130 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:36.470407 17130 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:36.383085 17153 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.443549 17139 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:36.480687 17180 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.481706 15273 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.131s (SENT)
I20260709 13:08:36.482263 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.483083 17151 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:36.488447 17146 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:36.489248 17008 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.481350 17180 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.493551 17180 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:36.496412 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.508438 16911 consensus_queue.cc:1175] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5c70ddb5aae14b059dc90fd40125b034" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260709 13:08:36.508701 15225 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:36.496083 17096 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:36.498947 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:36.499934 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:36.442728 17046 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.455813 17097 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:36.529450 15999 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:36.524233 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:36.542881 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 243088us
I20260709 13:08:36.544319 15226 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
W20260709 13:08:36.550209 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 248814us
I20260709 13:08:36.373227 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.551719 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:36.550292 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:36.554718 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:36.556326 16008 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:36.570904 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:36.577144 15273 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.159s (SENT)
I20260709 13:08:36.478235 16799 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:36.539383 17145 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.578069 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.578048 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:36.592965 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.593439 15301 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:36.594764 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.597380 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:36.520870 17149 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:36.570374 15130 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 1 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:36.569931 17046 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.578748 17058 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:36.653291 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60413.4us
I20260709 13:08:36.657589 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:36.661129 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84038.8us
I20260709 13:08:36.547816 16952 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.683003 17189 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.684538 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:36.685377 16008 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:36.690867 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:36.691705 15224 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:36.607182 17165 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.609625 17046 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.609308 17151 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.655496 17122 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.654999 16787 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.645823 16799 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.546667 17130 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.698269 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:36.709746 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.595896 17145 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:36.707839 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 236805us
I20260709 13:08:36.717924 15974 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:36.746436 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.747669 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:36.748853 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.747771 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.725116 16008 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:36.756160 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:36.757508 15226 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:36.760015 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:36.724028 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:36.763576 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:36.724143 17141 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.777715 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:36.779196 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:36.788050 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78724.4us
I20260709 13:08:36.788697 15381 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:36.789011 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:36.709463 16787 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:36.764729 17158 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.723663 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:36.791882 17192 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:36.791841 17122 raft_consensus.cc:2764] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:36.794000 17184 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.794265 17145 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:36.794838 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.761475 16809 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:36.771605 17020 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.704418 17165 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.797569 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.706354 17046 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.768134 17149 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.811244 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:36.829798 15232 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:36.830892 15382 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:36.832680 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:36.834061 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:36.714135 17151 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:36.788177 17141 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.809484 16787 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.777189 17154 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:36.818569 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:36.810883 17158 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.817520 16799 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:36.824923 16809 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.826401 17020 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:36.827322 16952 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:36.861339 15226 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
W20260709 13:08:36.840921 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46167.9us
I20260709 13:08:36.847199 15378 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:36.840824 17122 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.837891 17124 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.838397 17135 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.857764 16799 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.843302 17149 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:36.859882 17020 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.868955 17135 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.874630 17135 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.862519 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.862331 15378 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:36.866055 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 148279us
I20260709 13:08:36.854679 17158 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.842917 17141 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.884004 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:36.880535 16889 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.898253 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:36.902136 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50248.5us
I20260709 13:08:36.903415 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:36.907274 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.908051 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.907735 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.909381 15382 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:36.912114 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.912463 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.913095 15382 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:36.915253 15376 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:36.914227 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:36.916887 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.919344 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:36.923007 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.921060 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.924242 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:36.927256 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.892118 17149 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:36.932145 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:36.932693 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:36.933008 15305 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:36.932154 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:36.933845 15373 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:36.936513 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:36.937247 15305 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:36.937525 15299 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:36.938438 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:36.941648 15300 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:36.905467 17127 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.934312 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:36.905609 17122 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:36.939806 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:36.905081 16809 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:36.948763 15307 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:36.920917 17000 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:36.963855 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.979363 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:36.980660 15374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d55ea5972868497eb17221413640fbea"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54648
I20260709 13:08:36.982631 15374 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.983354 15374 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.894330 17189 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:08:36.994359 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:36.994354 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:36.995523 15306 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:36.995669 15224 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:36.997176 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:36.997176 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:36.991380 16799 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:36.915472 17151 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:36.961664 17000 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.152384 17000 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:37.154124 17194 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.333s	user 0.000s	sys 0.002s
W20260709 13:08:37.157428 17193 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.333s	user 0.001s	sys 0.001s
I20260709 13:08:37.009806 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.037803 15374 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.163864 15374 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:37.165032 17198 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.204s
I20260709 13:08:37.169737 17146 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.122783 15273 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.888s (SENT)
I20260709 13:08:37.171685 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:37.172675 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 175614us
I20260709 13:08:37.170588 17146 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.181222 17008 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:37.182020 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.182332 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.183808 15382 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:37.184311 17008 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.187016 17008 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.189173 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:37.191491 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.191706 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.192688 15382 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:37.192832 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.193068 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.194087 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.195133 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.181685 15381 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:37.187173 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:37.196823 15232 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.192422 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.198464 15376 raft_consensus.cc:2368] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:37.199169 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.199247 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.199883 15377 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:37.199220 15374 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:37.200834 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.201802 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.202536 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.203639 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.204751 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:37.205276 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82570.9us
I20260709 13:08:37.205868 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.206380 15376 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:08:37.206174 15273 leader_election.cc:336] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.943s (SENT)
I20260709 13:08:37.208506 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.201756 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.202564 15374 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:37.204923 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.212205 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.213233 15381 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:37.214124 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.178606 16799 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:37.181012 17090 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:37.203828 17173 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.979s	user 0.014s	sys 0.004s
I20260709 13:08:37.198953 17145 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:37.213068 17008 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:37.233352 17190 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.438s	user 0.007s	sys 0.000s
I20260709 13:08:37.235474 17135 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.237617 15301 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:37.240037 17135 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.232312 17149 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.241626 17149 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.243505 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:37.244186 17149 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.244431 17146 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.244719 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:37.245419 15224 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.245666 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.222011 17186 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.247268 17218 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.247283 17186 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.250716 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.252594 16003 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:37.252738 15376 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:37.253574 17122 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.254146 17122 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.254729 17188 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:37.256464 17188 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:37.256877 17188 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:37.257931 17188 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.259892 17188 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.219388 17090 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:37.261111 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.262135 15232 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:37.207015 17046 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.220819 17020 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.216826 16799 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:37.265254 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:37.266001 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:37.266870 17145 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.267017 17218 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.266310 15224 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:37.267874 15304 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:37.268381 17046 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.270191 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:37.270361 16008 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:37.272251 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.264142 17090 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.273015 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:37.239946 17158 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.277091 17046 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.272008 17127 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:37.271206 16799 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.278278 17127 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:37.277520 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:37.281210 16003 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:37.283001 17020 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.283377 17186 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.283753 17020 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:37.282367 17158 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:37.273134 17218 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.284865 17020 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.285820 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.273398 17149 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:08:37.286761 17046 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.286958 17218 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.287645 17135 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:37.288077 17135 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:37.288998 17135 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.290547 17135 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.291565 17000 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.296480 15273 leader_election.cc:400] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:37.297564 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.299015 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.295284 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:37.301311 16994 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:37.279724 17127 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.307327 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.322520 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.320917 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.301801 17149 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.303175 17145 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.306556 17046 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:37.304545 17218 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:37.333979 17046 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.321825 17008 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.338910 17046 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.319500 17000 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.345209 17218 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.350803 16799 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.352276 17218 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.353389 16799 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.305425 16994 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.368212 15230 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:37.355530 16787 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.000s
W20260709 13:08:37.370711 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63415.9us
I20260709 13:08:37.373500 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.376704 16799 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.378162 16994 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.383318 17141 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.384423 16787 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.387355 16787 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.396804 17149 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.397658 17149 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.398386 17197 raft_consensus.cc:1064] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:08:37.405033 17090 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.375329 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:37.408882 15232 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:37.413441 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:37.413769 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.420848 15381 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:37.421203 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.422276 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.424378 16005 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:37.414022 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:37.425904 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50686.1us
I20260709 13:08:37.426034 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.426923 15302 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.426990 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:37.427739 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:37.428607 15233 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:37.430215 15379 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:37.420614 15378 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.430513 15974 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.434638 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.441411 15378 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.410075 17141 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.411224 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:37.411882 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:37.427841 17218 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.424212 17207 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:37.448957 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:37.457139 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.408245 17090 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.435550 16799 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:37.434903 17020 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:37.427592 17046 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.447854 17211 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.430707 17158 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:37.463595 17207 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.436862 17149 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.488085 15302 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:37.463922 17020 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.462435 17008 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.490113 16799 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.462496 17218 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:37.506068 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49024.5us
I20260709 13:08:37.495157 17020 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.508756 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.508989 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:37.509454 15306 raft_consensus.cc:2368] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:37.510993 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.511759 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.512740 15306 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:37.512998 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.513655 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.514076 15308 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.515101 17046 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.502257 17008 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.496434 17189 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:37.521586 17189 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.507965 16799 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.526546 17179 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.527187 17179 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:37.499039 17149 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.518602 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.519753 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:37.526923 16799 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.559795 17189 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.537508 17207 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.532335 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.537959 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.538182 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.532181 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.532171 17197 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.572194 17130 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.606396 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.610421 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:37.611109 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:37.600245 15306 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.612150 15306 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:37.613327 15306 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.614573 15306 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.614466 17122 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:37.600744 15302 raft_consensus.cc:2410] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:37.601416 15300 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:37.518536 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.617380 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:37.543053 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.602121 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.622256 15374 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.622895 15382 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:37.624531 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.604315 15381 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:37.604000 15380 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:37.589202 15378 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:37.631821 15381 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:37.620086 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.633522 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.634285 15382 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:37.611212 15301 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:37.604975 15225 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:37.634059 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.635931 15232 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:37.634053 17046 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:37.637269 17115 raft_consensus.cc:1027] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: attempt to promote peer 5c70ddb5aae14b059dc90fd40125b034: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:08:37.637596 17046 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.638114 16956 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.638706 16956 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:37.641016 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 108790us
I20260709 13:08:37.641188 16956 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.642079 15299 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:37.645040 16994 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.645241 15301 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:37.648965 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:37.601294 17185 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.806s	user 0.008s	sys 0.008s
I20260709 13:08:37.650200 17189 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.644168 15299 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:37.656553 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.657641 15345 leader_election.cc:400] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:37.657805 15382 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.659426 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:37.660671 17188 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.661569 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1477) took 1507 ms. Trace:
I20260709 13:08:37.661567 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.656935 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.658165 15345 leader_election.cc:403] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.662209 15303 rpcz_store.cc:276] 0709 13:08:36.154752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.156503 (+  1751us) service_pool.cc:224] Handling call
0709 13:08:36.179026 (+ 22523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.194987 (+ 15961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.195025 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.195589 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.543843 (+348254us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:36.543895 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.543984 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.599554 (+1055570us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:37.654419 (+ 54865us) raft_consensus.cc:1685] finished
0709 13:08:37.654447 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.661450 (+  7003us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2551,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":8037,"spinlock_wait_cycles":10823424,"thread_start_us":304979,"threads_started":1,"wal-append.queue_time_us":496678}
I20260709 13:08:37.678750 15299 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:37.686633 15374 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:37.682773 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:37.687407 15382 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:37.689658 15374 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:37.695622 16002 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEARNER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:37.696453 17225 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:37.697420 17225 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:37.700543 17149 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:37.701265 17149 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.703917 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:37.704576 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48006.2us
I20260709 13:08:37.704921 17154 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:37.705490 17154 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.705856 17154 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.706018 16799 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:37.706089 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:37.706696 16799 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.708544 17221 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:37.709025 17221 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.709455 17221 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.710711 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:37.711560 17199 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:37.713552 17140 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:37.714263 17140 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.730780 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.739182 17124 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.688737 17197 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.740229 17197 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:37.732256 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.714166 15382 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:37.744221 15377 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:37.643054 16956 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:08:37.738243 17155 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:37.736472 16911 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.746675 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:37.753877 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.793793 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.691406 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:37.795704 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 104390us
I20260709 13:08:37.739420 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:37.765618 15373 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:37.767726 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:37.768756 15305 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:37.802165 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:37.802464 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.803144 15225 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.528247 17179 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:37.769935 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 112523us
I20260709 13:08:37.805275 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.809194 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.812966 15306 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:37.814173 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:37.817415 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.823385 15225 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:08:37.824179 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70735.9us
W20260709 13:08:37.886758 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72701us
I20260709 13:08:37.792224 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.661588 17188 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:37.843254 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 103926us
I20260709 13:08:37.855197 16787 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:37.907636 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 225017us
W20260709 13:08:37.908149 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 116006us
W20260709 13:08:37.908839 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.857539 16799 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:37.775202 17155 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.913686 17155 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.913775 17211 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.914496 17211 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:37.846313 17197 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:37.850129 17141 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:37.825018 17145 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.827806 16911 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.897248 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:37.905887 15382 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:37.909607 15308 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:37.919090 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.876432 17225 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:37.942394 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:37.936360 15380 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:37.943418 15382 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:37.907938 17151 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:37.924881 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:37.937355 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.910530 16787 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.913589 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:37.941844 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:37.914026 17226 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:37.961807 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64712.4us
I20260709 13:08:37.910786 17204 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.963636 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.963909 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.963274 15377 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:37.965350 15232 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:37.963292 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:37.957149 17090 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:08:37.959280 16787 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.916934 17020 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.956985 17230 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:37.945048 17141 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:37.976248 17145 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:38.000595 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 195470us
I20260709 13:08:37.972195 16002 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.972551 17000 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:37.973408 17151 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:38.031809 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:38.038662 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.977383 17226 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:37.982980 17199 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:37.985486 17135 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:08:38.051522 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:37.969095 17211 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:38.071522 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 112) took 1532 ms. Trace:
I20260709 13:08:38.073153 15304 rpcz_store.cc:276] 0709 13:08:36.539134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.539773 (+   639us) service_pool.cc:224] Handling call
0709 13:08:38.069854 (+1530081us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400128c54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:38.071443 (+  1589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588996992}
I20260709 13:08:38.040386 17000 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:38.087889 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 116752us
I20260709 13:08:38.049068 17145 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:38.071071 17139 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.096045 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:38.099340 17188 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:38.088663 17096 consensus_queue.cc:1175] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 3 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:38.090839 17000 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.095377 16809 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:08:38.107645 17242 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.109025 16002 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:38.109802 17242 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.087148 17211 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.114928 16911 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.086404 17140 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.116832 17236 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.116598 17141 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.117698 17236 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.085032 17224 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.130399 17218 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.130752 17226 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.131680 17145 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:38.124711 15999 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.001s
I20260709 13:08:38.145517 15999 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:38.135215 17224 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:38.153653 17020 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.138897 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:38.156111 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:38.139120 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:38.139940 17151 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:38.141561 17221 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.143105 17236 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:38.144906 17149 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.163368 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.115017 17124 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:38.170460 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:38.170825 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.171799 15302 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:38.174388 15301 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:38.176980 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:38.178191 15306 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:38.164736 15304 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:38.138536 16809 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.193145 15305 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:38.161665 17199 raft_consensus.cc:2764] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:38.199142 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:38.202029 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.206393 15303 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:38.210711 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:38.220770 15231 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:38.225267 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:38.197036 16719 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.189495 16809 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:38.247923 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.248915 15302 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:38.252539 15228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1577) took 1436 ms (client timeout 1632 ms). Trace:
I20260709 13:08:38.226465 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.270248 15303 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:38.197405 16956 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.223632 17008 consensus_meta.cc:287] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.600s	user 0.014s	sys 0.000s
I20260709 13:08:38.190258 16787 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:38.253294 15228 rpcz_store.cc:269] 0709 13:08:36.790105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.790301 (+   196us) service_pool.cc:224] Handling call
0709 13:08:38.225032 (+1434731us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800002798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:08:38.226239 (+  1207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3786624}
W20260709 13:08:38.284422 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.284984 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.287889 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 236558us
I20260709 13:08:38.289345 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.290794 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.290794 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:38.291953 15230 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
W20260709 13:08:38.293146 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.259539 16809 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.300717 15375 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:38.301115 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.201701 17154 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.304944 15345 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:38.290067 17008 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:38.305330 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 125724us
I20260709 13:08:38.316668 15230 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:38.312165 15302 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:38.260385 16719 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.361994 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.362353 16719 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.308794 17236 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:38.315287 17224 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:38.364992 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:38.365867 15225 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.322319 17229 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.302104 17124 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.309271 16994 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.337184 17107 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.331995 16787 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:38.342983 17243 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.344247 15226 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:38.347682 17000 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:38.350086 17230 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.318071 17237 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:38.352900 17154 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.348031 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:38.374577 15308 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:38.282481 16956 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.319180 17153 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.386873 16005 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:38.390586 15225 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
W20260709 13:08:38.393535 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.397689 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.398480 15381 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:38.398834 15379 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:38.406445 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:38.407401 15379 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.409322 17165 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:38.411085 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.412267 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:38.413035 17046 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.416374 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:38.417625 17179 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.421564 17008 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:38.422252 17008 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:38.423704 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.423348 17008 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:38.424604 15304 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:38.425844 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:38.427410 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.428155 15376 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:38.413108 16005 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
I20260709 13:08:38.432112 17139 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:38.435689 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:38.500402 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.501430 15375 raft_consensus.cc:2376] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5. Re-sending same reply.
I20260709 13:08:38.503073 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1435) took 1559 ms. Trace:
I20260709 13:08:38.503561 15373 rpcz_store.cc:276] 0709 13:08:36.943253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.943434 (+   181us) service_pool.cc:224] Handling call
0709 13:08:36.954972 (+ 11538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.799892 (+844920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.502770 (+702878us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b540023f0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:38.502984 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820117376}
I20260709 13:08:38.505348 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.505079 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.506363 15377 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 2: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:38.495970 15130 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 1 to 3, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:38.495952 15379 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:38.515774 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:38.528580 15381 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.532509 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.524406 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:08:38.540638 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.544142 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:38.545193 15299 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.546234 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.539330 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:38.549924 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:38.551288 17221 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.551590 17197 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.552150 17141 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.391360 17230 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.554474 15300 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:38.546041 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.374089 17107 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:38.556859 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 148014us
W20260709 13:08:38.558557 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51822.8us
I20260709 13:08:38.560204 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:38.568315 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.571602 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.572265 15299 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:38.575659 15304 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:38.585795 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.556859 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:38.515619 17046 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.515336 17224 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.589659 17115 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:38.569336 17124 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:08:38.564320 17020 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.594062 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.589308 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:38.574268 17141 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.564019 17226 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.564473 17145 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:38.384315 17243 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.595935 17230 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:38.601706 15381 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:38.603798 16719 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:38.617175 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.614476 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:38.670414 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56029.4us
I20260709 13:08:38.614229 17237 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:38.677666 16799 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.678292 16799 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.678733 16799 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.680634 17238 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.681238 17238 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.681689 17238 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.599660 15377 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
W20260709 13:08:38.629344 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 193769us
W20260709 13:08:38.637463 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43517.4us
I20260709 13:08:38.641042 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.644531 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:38.541260 17154 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:08:38.572484 16781 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:38.674170 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 84952.6us
I20260709 13:08:38.681517 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:38.639562 17207 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.584482 15308 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:38.637545 17141 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.637072 17149 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:38.739420 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51117.6us
W20260709 13:08:38.739480 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50076.4us
I20260709 13:08:38.740435 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.623265 17218 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.643646 17127 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.741034 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:38.755777 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67669.5us
I20260709 13:08:38.659035 17197 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:38.756572 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 112129us
I20260709 13:08:38.767954 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:38.762929 17107 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.764828 17237 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:38.693445 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:38.774951 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:38.613554 17224 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:38.794788 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:38.782665 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:38.638469 17046 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.658475 17135 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:08:38.795931 15375 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.664927 17137 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 13:08:38.745797 16719 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:38.666088 17020 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:38.835074 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46388us
I20260709 13:08:38.783427 17178 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.766583 17197 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.644899 17145 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.660449 17226 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:38.798733 17139 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:38.795387 17241 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:38.786697 17127 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:38.739212 16781 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.757722 17149 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:38.855947 17211 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.006s
W20260709 13:08:38.790330 17151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.017s
I20260709 13:08:38.848901 17178 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.776410 17230 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:08:38.855540 17197 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:38.901896 17256 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:08:38.903034 17247 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:08:38.903586 17000 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:38.904241 17237 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:38.842168 16911 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:08:38.911968 17020 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:38.912838 17250 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:08:38.914806 17149 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.916935 17178 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.917683 17243 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:38.766832 17218 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:38.865860 17124 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.935976 17244 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:38.806401 15300 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:38.793016 17122 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 13:08:38.894354 17151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.003s	sys 0.021s
I20260709 13:08:38.939116 15375 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:38.942754 15302 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:38.890761 16781 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:38.945706 15307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.016s
I20260709 13:08:38.869282 17199 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:08:38.922710 16956 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:38.919842 17241 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:38.957954 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 345308us
I20260709 13:08:38.922329 17138 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:38.942533 17155 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.028s	user 0.016s	sys 0.000s
W20260709 13:08:38.962571 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.900466 17127 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:38.924021 15199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.019s
W20260709 13:08:39.002712 15199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.006s	sys 0.019s
I20260709 13:08:38.936374 17008 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:38.971369 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 330638us
I20260709 13:08:39.004633 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:38.978945 15307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.008s	sys 0.017s
I20260709 13:08:39.006413 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.940900 17211 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.008019 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.956450 16003 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 13:08:38.993983 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.980657 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 239670us
W20260709 13:08:39.034078 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 174344us
I20260709 13:08:39.038540 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1443) took 1113 ms. Trace:
I20260709 13:08:39.039094 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:39.042927 15229 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:39.039077 15374 rpcz_store.cc:276] 0709 13:08:37.924705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.925624 (+   919us) service_pool.cc:224] Handling call
0709 13:08:37.926014 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.093929 (+167915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.093985 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.094785 (+   800us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.417015 (+322230us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:38.417082 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.417191 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.038295 (+621104us) raft_consensus.cc:1685] finished
0709 13:08:39.038321 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.038458 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162790,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":3323,"thread_start_us":447903,"threads_started":2,"wal-append.queue_time_us":471976}
I20260709 13:08:39.041699 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:39.044642 15300 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:39.031385 16003 pending_rounds.cc:85] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Aborting all ops after (but not including) 4
I20260709 13:08:38.980130 17124 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.008925 17008 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.100575 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:39.102234 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:39.103329 15300 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:39.114670 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:39.116192 15379 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:08:39.117980 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76837.2us
I20260709 13:08:39.048772 17020 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.136255 15378 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
W20260709 13:08:39.139509 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 98907.7us
I20260709 13:08:39.140614 15273 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:38.999750 17155 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.130914 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:39.132329 17258 log.cc:927] Time spent T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:08:39.133610 17259 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:39.188977 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:39.134068 17261 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:39.049937 17236 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:08:38.990067 17244 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:08:39.000130 17138 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.193058 15225 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:39.194829 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:39.056273 17149 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.199628 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:39.049436 17139 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:39.120226 17224 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:39.193420 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:39.131350 17127 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.242146 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:39.243369 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:39.130937 16809 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.004s
W20260709 13:08:39.151425 16994 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.778s	user 0.014s	sys 0.000s
I20260709 13:08:39.151113 17135 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:39.221160 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 83598.8us
I20260709 13:08:39.140116 17046 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.119185 17270 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.140519 17020 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.057916 16003 pending_rounds.cc:107] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:39.058966 17211 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.221405 17090 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.220619 17226 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.360679 17224 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.377810 17264 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.401628 16994 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.401650 17224 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.402961 16003 raft_consensus.cc:2889] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:39.395848 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:39.378664 17263 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.378302 17268 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.283905 16719 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.407132 17268 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.409181 16719 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.403988 17264 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.410125 17211 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.414669 17268 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.221562 17241 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.140043 17008 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.185803 17115 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:39.416241 17115 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.247685 17145 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.347210 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:39.421415 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:39.423295 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1506) took 1253 ms. Trace:
I20260709 13:08:39.424983 15299 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:39.423846 15308 rpcz_store.cc:276] 0709 13:08:38.169970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.170142 (+   172us) service_pool.cc:224] Handling call
0709 13:08:39.423028 (+1252886us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400186ad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:39.423201 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467586304}
I20260709 13:08:39.399617 17020 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.440933 17274 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.455430 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 108315us
I20260709 13:08:39.448714 17268 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.398895 16809 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.457628 17268 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:39.461076 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 320547us
I20260709 13:08:39.463333 15232 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.463662 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:39.473249 17252 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 13:08:39.471819 17265 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.470361 17271 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:39.434950 17122 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.435279 17149 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.448402 16719 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:39.487452 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.496181 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:39.452433 17179 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.034s	user 0.011s	sys 0.011s
I20260709 13:08:39.400251 17090 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.446375 17218 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.466898 17226 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.536680 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:39.356842 17275 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.223s
I20260709 13:08:39.546587 17160 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:39.547983 15229 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:39.548565 16005 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:39.473946 16994 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.487902 17230 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.550580 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 87062.3us
I20260709 13:08:39.497611 17224 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.451686 17046 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:39.563320 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:08:39.550684 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 52978.1us
I20260709 13:08:39.575588 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:39.453972 17139 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.547114 17264 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.567108 17240 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:39.520126 17000 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:39.550179 17160 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.635614 17283 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.556581 17218 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.518966 17270 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
W20260709 13:08:39.604144 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 182833us
I20260709 13:08:39.485471 17274 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.721035 15376 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:39.631795 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:39.637784 17135 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.544310 17149 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.625583 17046 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.653477 15999 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:08:39.605703 17237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.024s
I20260709 13:08:39.656075 15375 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:39.626916 17269 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:39.656714 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93496.7us
I20260709 13:08:39.659168 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:39.568320 16994 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.628665 17229 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:39.544260 17122 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.642547 17155 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.712653 15227 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.570140 17230 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.718824 15233 raft_consensus.cc:1217] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:08:39.775228 15233 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:39.776762 17230 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.776885 15379 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:39.722610 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 130647us
I20260709 13:08:39.727376 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1522) took 1184 ms. Trace:
W20260709 13:08:39.733637 17292 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:39.688470 17224 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:39.547250 17265 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.769323 17270 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:39.797418 17224 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:39.797657 17270 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:39.797986 17090 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.734679 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:39.729578 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 96657.7us
I20260709 13:08:39.688680 17240 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:39.708734 17226 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.766235 17140 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:39.551005 17271 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.752622 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:39.709918 17124 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.753057 15232 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:39.753814 17244 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.769891 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:39.773483 17257 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.439s	user 0.000s	sys 0.002s
I20260709 13:08:39.755385 17268 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.773958 17277 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:39.844578 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 92040.4us
I20260709 13:08:39.780180 15305 rpcz_store.cc:276] 0709 13:08:38.542813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.543747 (+   934us) service_pool.cc:224] Handling call
0709 13:08:38.544122 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.843685 (+299563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.843739 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:38.843795 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:38.843863 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.727090 (+883227us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540017a054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:39.727144 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.727299 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688316160}
I20260709 13:08:39.733901 17289 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.768882 16809 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.767566 17229 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:39.739446 17266 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.739845 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:39.820684 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86121.3us
W20260709 13:08:39.747983 17237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.004s	sys 0.041s
I20260709 13:08:39.735903 17135 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.819437 17224 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.727705 17218 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:39.841176 17290 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:08:39.852551 16799 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.173s	user 0.017s	sys 0.013s
I20260709 13:08:39.873270 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:39.847193 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:39.803122 17138 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.827920 17155 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:39.854036 16781 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.858s	user 0.013s	sys 0.000s
I20260709 13:08:39.905889 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:39.905664 16781 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.906661 15300 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.857609 17279 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:39.908777 17279 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.911650 17279 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.857988 17233 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:39.912423 17233 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:39.913518 17233 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.915267 17233 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.725849 17283 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.919260 17283 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.920091 17138 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:39.920848 17138 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.923717 17138 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:39.898874 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51924.1us
I20260709 13:08:39.878801 15308 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:39.934096 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:39.850569 17268 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.924976 17155 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.935642 17268 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.935853 15308 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:08:39.942363 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:39.838824 17226 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:39.943957 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64878.8us
W20260709 13:08:39.944033 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 96459.8us
I20260709 13:08:39.951741 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:39.951828 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:39.956202 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:39.865199 17266 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.956317 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:39.950033 16781 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:39.841814 17240 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.963231 17240 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:39.963877 17153 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.455s	user 0.013s	sys 0.002s
I20260709 13:08:39.968319 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 122) took 1550 ms. Trace:
I20260709 13:08:39.969417 17302 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.864315 17277 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.971962 15224 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:39.975988 15300 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:39.980865 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1521) took 1438 ms. Trace:
I20260709 13:08:39.969004 15307 rpcz_store.cc:276] 0709 13:08:38.417767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.419207 (+  1440us) service_pool.cc:224] Handling call
0709 13:08:38.419650 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.420069 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.420098 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.420729 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.006902 (+586173us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:39.006985 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.007090 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.967994 (+960904us) raft_consensus.cc:1685] finished
0709 13:08:39.968018 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.968222 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4498,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":375,"thread_start_us":585502,"threads_started":1,"wal-append.queue_time_us":645319}
I20260709 13:08:39.981451 15301 rpcz_store.cc:276] 0709 13:08:38.542486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.543168 (+   682us) service_pool.cc:224] Handling call
0709 13:08:38.543522 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.851901 (+308379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.851941 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:38.851989 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:38.852065 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.980550 (+1128485us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54001d5e54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:39.980615 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.980790 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708615424}
I20260709 13:08:39.877775 17265 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:39.943459 17280 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:39.879770 16799 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:39.868325 17289 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:39.967703 16719 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:39.964489 16787 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:39.959515 17266 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.984221 17130 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.025286 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:40.029700 15308 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.838984 17270 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:39.970150 17302 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:40.053012 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 119010us
I20260709 13:08:40.007316 17279 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.054471 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:40.024194 16719 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:40.061914 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.066129 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.073447 15375 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:40.068130 15376 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:40.016966 17265 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.029062 17135 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.024845 17241 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.087175 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.040719 17149 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.078388 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.092478 15375 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:40.022445 17280 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.031205 16787 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.080622 17270 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.073602 16719 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.079797 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.117802 17280 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.047060 17130 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.122624 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.121657 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.126509 15375 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:40.075752 17279 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.103499 17149 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:40.130188 15376 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:40.137850 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.136168 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.139461 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.107064 17260 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:40.145296 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:40.130965 17238 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.449s	user 0.012s	sys 0.006s
I20260709 13:08:40.090929 17265 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:40.093338 17241 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.127411 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:40.153707 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.136564 17273 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.101897 17271 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.154282 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.142052 17218 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.151036 17096 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.149431 17149 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:40.203293 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 89850.2us
W20260709 13:08:40.196700 17141 consensus_meta.cc:287] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.399s	user 0.017s	sys 0.001s
I20260709 13:08:40.154079 17291 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.212916 15308 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:40.193451 17226 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.187333 17284 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:40.221654 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.225543 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.228415 15307 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:40.209362 17096 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.231899 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 211) took 2264 ms. Trace:
I20260709 13:08:40.232376 17096 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.232578 17149 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.182861 17238 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.218997 17135 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.251598 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.255079 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.198396 17300 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:40.233976 17207 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.458s	user 0.012s	sys 0.006s
I20260709 13:08:40.261540 17279 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.261260 17221 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.232425 16003 rpcz_store.cc:276] 0709 13:08:37.967940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.982639 (+ 14699us) service_pool.cc:224] Handling call
0709 13:08:37.995721 (+ 13082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.405626 (+1409905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.231561 (+825935us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54004182d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:40.231796 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127293696}
I20260709 13:08:40.262357 17221 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.265241 17277 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.219908 17141 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:40.244585 17295 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
W20260709 13:08:40.271641 17304 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:08:40.275120 17309 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:40.260839 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1526) took 1246 ms. Trace:
I20260709 13:08:40.201083 17260 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.268740 17207 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.267649 17300 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.276588 15302 rpcz_store.cc:276] 0709 13:08:39.014992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.033035 (+ 18043us) service_pool.cc:224] Handling call
0709 13:08:39.065624 (+ 32589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.065927 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:39.563619 (+497692us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.259325 (+695706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.259400 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:40.259465 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.260541 (+  1076us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.260750 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40262,"prepare.queue_time_us":86602,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":60,"raft.queue_time_us":92035,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":13491,"thread_start_us":1132235,"threads_started":3,"wal-append.queue_time_us":560859}
I20260709 13:08:40.224287 17291 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.257592 17135 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.221138 17299 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 13:08:40.300724 17300 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.329202 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.340137 15302 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:40.257459 17305 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.352525 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1624) took 1127 ms. Trace:
I20260709 13:08:40.354203 15225 rpcz_store.cc:276] 0709 13:08:39.224844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.265632 (+ 40788us) service_pool.cc:224] Handling call
0709 13:08:39.265968 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.420115 (+154147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.420152 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.432646 (+ 12494us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.496826 (+ 64180us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:39.496894 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.497012 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.352124 (+855112us) raft_consensus.cc:1685] finished
0709 13:08:40.352157 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.352431 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34371,"raft.queue_time_us":26931,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":17454,"thread_start_us":25434,"threads_started":1,"wal-append.queue_time_us":421890}
I20260709 13:08:40.304033 16787 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.300856 17265 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:40.362690 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:40.348703 17178 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.376s	user 0.018s	sys 0.007s
I20260709 13:08:40.352782 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.351752 17238 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.319235 17308 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.359206 17260 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:40.361351 17197 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.443s	user 0.014s	sys 0.005s
W20260709 13:08:40.360626 17306 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 13:08:40.308048 17289 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.373136 15302 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:40.376243 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 299344us
I20260709 13:08:40.379557 15302 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.367360 17245 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.382006 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:40.383461 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:40.385486 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:40.384423 17224 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:40.390507 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.391952 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.375638 17241 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:40.379341 17255 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.416s	user 0.000s	sys 0.007s
I20260709 13:08:40.393077 15376 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:40.391960 17307 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:40.367884 17178 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.393019 17314 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:40.401254 17314 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.401682 17314 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.401978 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1516) took 2200 ms. Trace:
I20260709 13:08:40.402391 15303 rpcz_store.cc:276] 0709 13:08:38.202189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.357667 (+155478us) service_pool.cc:224] Handling call
0709 13:08:38.358158 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.358556 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.358587 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.359154 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.621825 (+262671us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:38.621896 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.622013 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.191585 (+1569572us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:40.401620 (+210035us) raft_consensus.cc:1685] finished
0709 13:08:40.401643 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.401906 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":24987904,"thread_start_us":262181,"threads_started":1,"wal-append.queue_time_us":421365}
I20260709 13:08:40.396837 17307 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.404647 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.404874 17307 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.405642 15303 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:40.369658 17308 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.408202 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:40.410899 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.413134 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1459) took 1311 ms. Trace:
I20260709 13:08:40.413508 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.414299 15303 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
W20260709 13:08:40.405570 17008 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.989s	user 0.014s	sys 0.005s
I20260709 13:08:40.376217 17197 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.415899 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.413591 15378 rpcz_store.cc:276] 0709 13:08:39.101567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.101906 (+   339us) service_pool.cc:224] Handling call
0709 13:08:40.412924 (+1311018us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b540014d2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:40.413035 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75170048}
I20260709 13:08:40.392838 17224 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:40.407105 17020 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.954s	user 0.009s	sys 0.021s
I20260709 13:08:40.419796 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.414692 17284 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.423637 15302 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:40.425209 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.356109 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.430938 15130 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 2 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:40.467828 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.419759 17289 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.423071 17224 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.431288 17284 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.394797 17245 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.496879 17280 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.514473 17280 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.519752 17141 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.524718 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:40.525876 15302 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:40.420607 17008 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.495399 17241 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.495308 17226 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.498921 16787 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.538589 17046 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.541517 17178 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.545331 17221 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.552723 16787 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.499696 17127 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:40.431622 17020 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.507134 17284 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.509651 17291 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.568279 15305 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:40.524107 17130 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.567317 17315 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.589529 15302 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:40.498842 17289 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:40.561295 17233 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.007s
I20260709 13:08:40.602484 15375 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:40.609730 15127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 199) took 6258 ms. Trace:
I20260709 13:08:40.610010 17008 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.611147 17308 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.612820 17245 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:40.614629 17240 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.006s
W20260709 13:08:40.614857 17266 consensus_meta.cc:287] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.000s
I20260709 13:08:40.600711 17315 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.623672 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:40.610323 15127 rpcz_store.cc:276] 0709 13:08:34.351266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.351639 (+   373us) service_pool.cc:224] Handling call
0709 13:08:35.373392 (+1021753us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b5400381680. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f57490161 00007f2f57564b89 00007f2f5755a7ad 00007f2f5751be0b 00007f2f5751bbe4 00007f2f59a1c2d1 00007f2f59a1cb2f 00007f2f598dbd4b 00007f2f599e3c3e 00007f2f57ea42a4 00007f2f57ea4232
0709 13:08:40.609624 (+5236232us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:35.536786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:35.537511 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:35.537581 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:08:35.537607 (+    26us) tablet.cc:662] Decoding operations
0709 13:08:35.538917 (+  1310us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:35.538992 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:35.539026 (+    34us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:08:35.554181 (+ 15155us) tablet.cc:701] Row locks acquired
0709 13:08:35.554197 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:35.554350 (+   153us) write_op.cc:270] Start()
0709 13:08:35.554474 (+   124us) write_op.cc:276] Timestamp: P: 1783602515554307 usec, L: 0
0709 13:08:35.554495 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:35.636954 (+ 82459us) log.cc:844] Serialized 5193 byte log entry
0709 13:08:35.638823 (+  1869us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b21e28 00007f2f5755c581 00007f2f5755bd58 00007f2f575609f1 00007f2f575609a9 00007f2f57560939 00007f2f57560901 00007f2f5755fb2d 000000000038f354 000000000038f199
0709 13:08:35.909655 (+270832us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.107610 (+197955us) write_op.cc:301] APPLY: starting
0709 13:08:36.107713 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.108010 (+   297us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.108031 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.278112 (+170081us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.287869 (+  9757us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:08:36.287938 (+    69us) write_op.cc:312] APPLY: finished
0709 13:08:36.299343 (+ 11405us) log.cc:844] Serialized 95 byte log entry
0709 13:08:36.299681 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.299868 (+   187us) write_op.cc:454] Released schema lock
0709 13:08:36.299946 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.324572 (+ 24626us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.324618 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82654,"reported_tablets":25,"spinlock_wait_cycles":9764096,"child_traces":[["op",{"apply.queue_time_us":197662,"apply.run_cpu_time_us":6978,"apply.run_wall_time_us":192773,"num_ops":13,"prepare.queue_time_us":113075,"prepare.run_cpu_time_us":7618,"prepare.run_wall_time_us":113475,"replication_time_us":354961,"spinlock_wait_cycles":51301248,"thread_start_us":153564,"threads_started":2}]]}
I20260709 13:08:40.559597 17241 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.560725 17226 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.615576 17266 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.587248 17127 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.590814 16719 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.669018 15302 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.639283 17308 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:40.682422 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.684677 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:40.685297 15376 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.669497 17270 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.705751 17271 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:40.706202 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:40.706519 17271 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.690258 17179 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.707048 15373 raft_consensus.cc:2368] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3.
I20260709 13:08:40.676193 17197 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.688512 17240 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.717041 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1534) took 1572 ms. Trace:
I20260709 13:08:40.692857 17254 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:40.717549 15299 rpcz_store.cc:276] 0709 13:08:39.144540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.373114 (+228574us) service_pool.cc:224] Handling call
0709 13:08:39.424471 (+ 51357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.425488 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.716795 (+1291307us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b5400186ad0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:40.716968 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116958080}
I20260709 13:08:40.692518 17139 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:40.711934 17179 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:40.719399 17310 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:40.711330 17314 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.713212 17141 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:40.723073 17310 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.723783 17141 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.722366 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:40.725368 15299 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.683455 17308 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.727591 17310 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.728396 17308 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.728600 17141 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.731578 17008 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.732379 17008 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.732417 17302 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.735018 17008 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.720156 17240 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:40.736740 15224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1606) took 3315 ms (client timeout 1876 ms). Trace:
I20260709 13:08:40.737470 17254 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.739116 17139 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.725129 17046 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:40.740867 15229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1607) took 1553 ms (client timeout 1722 ms). Trace:
I20260709 13:08:40.741684 17241 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.741427 17046 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:40.745214 17046 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.731690 17268 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:40.746937 15376 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:40.737215 15224 rpcz_store.cc:269] 0709 13:08:37.421155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.422029 (+   874us) service_pool.cc:224] Handling call
0709 13:08:40.736518 (+3314489us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b5400359dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:40.736633 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5862163712}
I20260709 13:08:40.748577 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:40.749500 15376 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.698915 17315 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:40.741420 15229 rpcz_store.cc:269] 0709 13:08:39.187885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.193130 (+  5245us) service_pool.cc:224] Handling call
0709 13:08:40.740674 (+1547544us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54003c28d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:40.740798 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703219072}
I20260709 13:08:40.753098 17289 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.722177 17307 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.709185 17270 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.746423 17284 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:40.754932 17274 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:40.755620 17314 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.755856 15303 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:40.756078 17284 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.757673 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.760094 17240 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:40.859062 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 108216us
W20260709 13:08:40.870249 15274 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.722s (SENT) [suppressed 10 similar messages]
I20260709 13:08:41.028452 15299 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:40.902091 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 234667us
I20260709 13:08:40.982308 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:41.037464 15308 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:41.057381 17289 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.038594 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:41.058347 15299 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:40.755632 17270 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.057561 17241 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:41.059643 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:41.058055 17289 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.056910 15302 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:41.059396 17241 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:41.026228 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 165042us
I20260709 13:08:41.023137 15376 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:41.068055 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:40.881739 17020 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.877851 17284 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.057606 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:40.880926 17308 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.062018 17289 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.048854 17291 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.072757 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:41.078503 15229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:41.079836 16787 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.082222 17307 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:40.880038 17179 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.049468 17263 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:40.880438 17271 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.093124 17308 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.095676 15376 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.096421 15229 raft_consensus.cc:606] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:08:41.070309 17224 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.006s
W20260709 13:08:41.098203 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 357957us
I20260709 13:08:41.090783 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:41.134104 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:41.159759 17165 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:41.093190 16719 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:41.133657 17300 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.786s	user 0.015s	sys 0.000s
I20260709 13:08:41.165189 15345 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:41.098914 17291 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.098034 17284 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.096143 17302 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:08:41.113572 17263 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:41.272034 15373 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.048s	sys 0.046s
W20260709 13:08:41.494264 15373 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.057s	sys 0.066s
I20260709 13:08:41.497004 15345 leader_election.cc:403] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.180905 15299 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:41.171824 17165 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:41.492947 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 355228us
I20260709 13:08:41.496317 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:41.137648 17179 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:41.529227 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:41.509567 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:41.530558 15224 raft_consensus.cc:606] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
W20260709 13:08:41.258435 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 388197us
I20260709 13:08:41.531001 15224 raft_consensus.cc:614] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:41.562551 15376 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:41.575870 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.577998 15376 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:41.196681 17243 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.587512 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.436095 17135 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:41.093189 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:41.196877 16787 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:41.227116 17127 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:41.511741 16719 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:41.531103 17165 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:41.533547 17314 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:41.588625 17243 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:41.606724 17243 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.597640 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:41.605862 17158 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.609993 15376 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.162408 17224 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.529816 17300 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.601634 16787 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.590814 17302 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:41.604628 17308 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.627642 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:41.628499 15224 raft_consensus.cc:606] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:41.628918 15224 raft_consensus.cc:614] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:41.609546 17326 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:41.592374 17179 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.632092 15301 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:41.632695 15308 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:08:41.613601 15118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 520635us
W20260709 13:08:41.620668 17318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.057s	sys 0.068s
I20260709 13:08:41.624055 16787 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.636886 15376 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:41.611917 16719 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.645442 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:41.615389 17314 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:41.631129 17241 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.648960 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.655565 15376 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:41.657251 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:41.640633 17318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.057s	sys 0.068s
I20260709 13:08:41.666524 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:41.667533 15224 raft_consensus.cc:606] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:08:41.668032 15224 raft_consensus.cc:614] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:41.669317 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 504334us
I20260709 13:08:41.630633 17302 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:41.670931 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.673110 17332 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.674055 17332 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.674744 17331 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:41.677364 17332 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.678135 17332 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:41.678655 17308 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.678900 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:41.678804 17332 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:41.680711 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:41.681936 17300 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.683243 17291 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.683558 17326 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.685411 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 203) took 1997 ms. Trace:
I20260709 13:08:41.685662 17326 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.694079 15198 leader_election.cc:400] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3.
I20260709 13:08:41.694612 15198 leader_election.cc:403] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:41.631536 17165 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:41.692656 17135 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.693275 17275 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.698335 17165 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.700666 17326 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.702947 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1494) took 1138 ms. Trace:
I20260709 13:08:41.706620 17237 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:41.703694 15306 rpcz_store.cc:276] 0709 13:08:40.564835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.789824 (+224989us) service_pool.cc:224] Handling call
0709 13:08:40.790304 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.869127 (+ 78823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.869169 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.063267 (+194098us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.501656 (+438389us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:41.501709 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.501787 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.702712 (+200925us) raft_consensus.cc:1685] finished
0709 13:08:41.702732 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.702871 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105575,"raft.queue_time_us":78769,"raft.run_cpu_time_us":9062,"raft.run_wall_time_us":140997,"thread_start_us":408120,"threads_started":1,"wal-append.queue_time_us":562922}
I20260709 13:08:41.685894 15231 rpcz_store.cc:276] 0709 13:08:39.687958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.688167 (+   209us) service_pool.cc:224] Handling call
0709 13:08:39.688620 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.851954 (+163334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.851992 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.852048 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.852115 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.685121 (+1833006us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002d0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:41.685181 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.685339 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375018880}
I20260709 13:08:41.675700 17331 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.739885 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1458) took 2621 ms. Trace:
I20260709 13:08:41.740706 15374 rpcz_store.cc:276] 0709 13:08:39.100887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.106254 (+  5367us) service_pool.cc:224] Handling call
0709 13:08:39.107336 (+  1082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.337538 (+230202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.337592 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.419491 (+ 81899us) log.cc:844] Serialized 564 byte log entry
0709 13:08:39.452080 (+ 32589us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.452159 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.693334 (+2241175us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400003054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:41.693393 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.693454 (+    61us) raft_consensus.cc:1685] finished
0709 13:08:41.693467 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.721729 (+ 28262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527594752,"thread_start_us":31335,"threads_started":1,"wal-append.queue_time_us":147266,"wal-append.run_cpu_time_us":4832,"wal-append.run_wall_time_us":1277072}
I20260709 13:08:41.744416 15306 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.745519 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1560) took 1003 ms. Trace:
I20260709 13:08:41.745962 15306 rpcz_store.cc:276] 0709 13:08:40.742593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.743638 (+1001045us) service_pool.cc:224] Handling call
0709 13:08:41.744111 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.745139 (+  1028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.745431 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:41.771924 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.773175 15374 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:41.774649 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.776530 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:41.784014 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 255065us
I20260709 13:08:41.800112 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:41.804329 15374 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:08:41.809787 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 133221us
I20260709 13:08:41.707607 17237 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:41.836321 16994 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.845407 17135 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:41.846235 17308 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:41.846724 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1555) took 1258 ms. Trace:
I20260709 13:08:41.848871 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:41.921119 15299 rpcz_store.cc:276] 0709 13:08:40.588614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.066783 (+478169us) service_pool.cc:224] Handling call
0709 13:08:41.072888 (+  6105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.497805 (+424917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.846269 (+348464us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54002fb054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:41.846621 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247146240}
I20260709 13:08:41.898198 17335 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.901650 17326 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:41.900018 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 219411us
I20260709 13:08:41.786293 17329 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:41.825533 17263 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.929782 17337 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:08:41.918916 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 225892us
I20260709 13:08:41.936688 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:41.922188 16994 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:41.924611 17218 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:41.953383 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.955384 15373 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:41.957074 15374 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:41.932701 17224 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.918916 17338 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3.
I20260709 13:08:41.963732 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:41.941313 17329 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.970029 17179 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.970510 17332 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:41.926426 17135 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.929004 17308 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:41.935510 17335 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.998574 17254 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.973189 17314 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:41.983385 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1446) took 4057 ms. Trace:
I20260709 13:08:41.960166 16994 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:41.974027 17338 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:41.997254 17330 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:42.002190 17338 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:42.002907 17330 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:42.003473 16994 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:42.003677 17338 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.006815 17335 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.974557 17237 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:41.995961 17165 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.955219 17337 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:42.009603 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1466) took 2435 ms. Trace:
I20260709 13:08:42.009235 17165 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:42.010080 15377 rpcz_store.cc:276] 0709 13:08:39.574112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.574248 (+   136us) service_pool.cc:224] Handling call
0709 13:08:39.574594 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.820484 (+245890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.820521 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.820571 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:39.820608 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.009317 (+2188709us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54001ab8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:42.009372 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.009532 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564792704}
I20260709 13:08:42.011492 17337 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:42.011857 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.991379 17302 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:42.017246 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:42.013711 15232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1598) took 3858 ms (client timeout 1727 ms). Trace:
W20260709 13:08:42.021220 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.032735 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:41.937068 17326 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.030043 15377 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.042342 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.042999 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:42.042426 17287 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.920s	user 0.011s	sys 0.026s
I20260709 13:08:42.044111 17229 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:42.045470 17229 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:42.046020 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1533) took 2911 ms. Trace:
W20260709 13:08:42.046219 17327 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:08:42.046463 15304 rpcz_store.cc:276] 0709 13:08:39.134813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.203401 (+ 68588us) service_pool.cc:224] Handling call
0709 13:08:39.204127 (+   726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.204774 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:39.297274 (+ 92500us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.430533 (+133259us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.434945 (+  4412us) log.cc:844] Serialized 564 byte log entry
0709 13:08:39.435145 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.435204 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.435287 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.422929 (+987642us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18001d46a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:08:42.041704 (+1618775us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:42.045698 (+  3994us) raft_consensus.cc:1685] finished
0709 13:08:42.045723 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.045906 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53811,"prepare.queue_time_us":127572,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":3994,"raft.queue_time_us":71322,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8176,"spinlock_wait_cycles":12258944,"thread_start_us":78955,"threads_started":1,"wal-append.queue_time_us":751290}
I20260709 13:08:42.043495 16008 raft_consensus.cc:2410] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:42.048682 17314 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:42.031890 17269 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:42.053189 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.054339 16003 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:41.972204 17329 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:41.990348 17115 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:42.033922 15373 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:08:42.029843 15232 rpcz_store.cc:269] 0709 13:08:38.155281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.155813 (+   532us) service_pool.cc:224] Handling call
0709 13:08:42.013464 (+3857651us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001c7d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:42.013617 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3004493056}
I20260709 13:08:42.001513 15382 rpcz_store.cc:276] 0709 13:08:37.925643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.975289 (+ 49646us) service_pool.cc:224] Handling call
0709 13:08:38.328477 (+353188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.328987 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.329023 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.329745 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.499100 (+169355us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:38.499148 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.499226 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.647019 (+1147793us) raft_consensus.cc:1685] finished
0709 13:08:39.647049 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.982900 (+2335851us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54002896d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:41.983274 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":811064704,"thread_start_us":168898,"threads_started":1,"wal-append.queue_time_us":475987,"wal-append.run_cpu_time_us":5059,"wal-append.run_wall_time_us":1825099}
W20260709 13:08:41.993507 17272 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 2.336s	user 0.012s	sys 0.020s
I20260709 13:08:42.081975 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.085995 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.086423 17326 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:42.086529 17308 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:42.087831 17330 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.091100 17122 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:42.093236 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 162271us
I20260709 13:08:41.976583 17331 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:41.973564 16719 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.096727 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:42.099243 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.107733 16008 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:41.959501 17218 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.044121 15999 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:42.051909 17269 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.029676 17165 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.114722 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:42.118911 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 115399us
I20260709 13:08:42.119490 16008 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 1.
W20260709 13:08:42.112772 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 176243us
I20260709 13:08:42.116854 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.118373 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:42.124506 15307 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 2: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:42.124933 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:42.126665 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:42.128909 17153 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.129232 17343 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.129498 17333 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.129570 17153 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.134559 15373 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:42.135457 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.136214 15232 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:42.136806 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.137032 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.138455 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.138820 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.139169 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.139562 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.095288 17314 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:08:42.138141 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.142089 15232 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:42.140115 15225 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:42.144647 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:42.130286 17333 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.145448 15299 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:42.146052 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:42.146893 15307 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:42.147564 17333 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.148674 15229 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:42.155372 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.155769 15377 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:42.150664 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52719.1us
I20260709 13:08:42.163434 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:42.164062 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:42.165040 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:42.165977 15225 raft_consensus.cc:2376] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3. Re-sending same reply.
I20260709 13:08:42.165030 15374 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 1.
I20260709 13:08:42.164228 15307 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:42.132205 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:42.198930 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:42.206305 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.206532 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:42.210608 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.211746 16008 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:42.195000 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.163108 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.214368 16005 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:42.216176 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:42.219092 17153 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:42.220679 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 95936.3us
W20260709 13:08:42.220765 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60781.9us
I20260709 13:08:42.220216 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.224987 17160 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.225762 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:42.226576 15373 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
W20260709 13:08:42.227186 15301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1473) took 2092 ms (client timeout 1896 ms). Trace:
I20260709 13:08:42.227592 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:42.228102 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.228435 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.225139 17346 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:42.229285 15225 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
W20260709 13:08:42.227666 15301 rpcz_store.cc:269] 0709 13:08:40.134938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.135823 (+   885us) service_pool.cc:224] Handling call
0709 13:08:42.226906 (+2091083us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540026bbd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:42.227076 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3433823488}
I20260709 13:08:42.230186 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.230626 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.229007 15373 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.231823 15232 raft_consensus.cc:2410] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:42.232715 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.233358 15231 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:42.204394 16003 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.237934 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.240932 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.238536 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.238780 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.241832 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:42.249413 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:42.252251 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.254216 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:42.254908 17243 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.008s
I20260709 13:08:42.255203 16001 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:42.255478 17243 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.248826 17342 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:42.141008 17343 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:42.243237 17346 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:42.367833 15302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1553) took 1801 ms (client timeout 1945 ms). Trace:
I20260709 13:08:42.385778 17218 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.272240 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:42.468542 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:42.314033 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.354194 15224 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:42.473836 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:42.250813 17286 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.473836 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.477538 17346 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:42.379802 15274 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.727s (SENT)
I20260709 13:08:42.481781 17286 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:42.373581 17107 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:42.354717 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 132611us
I20260709 13:08:42.483074 15232 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:42.477603 15302 rpcz_store.cc:269] 0709 13:08:40.566263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.593937 (+ 27674us) service_pool.cc:224] Handling call
0709 13:08:42.367544 (+1773607us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54001d5954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:42.367728 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94191360}
I20260709 13:08:42.484246 17107 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:42.484673 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:42.486514 17267 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.486968 17267 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:42.487363 17267 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.488840 15198 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:42.428855 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 172089us
I20260709 13:08:42.489358 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.334441 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1464) took 2764 ms. Trace:
I20260709 13:08:42.339638 15373 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
W20260709 13:08:42.483218 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 103514us
W20260709 13:08:42.477869 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 228496us
I20260709 13:08:42.493377 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1508) took 1432 ms. Trace:
I20260709 13:08:42.495757 15373 rpcz_store.cc:276] 0709 13:08:41.061439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.227290 (+1165851us) service_pool.cc:224] Handling call
0709 13:08:42.493309 (+266019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:42.385586 17179 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.493093 15379 rpcz_store.cc:276] 0709 13:08:39.570228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.571285 (+  1057us) service_pool.cc:224] Handling call
0709 13:08:39.571585 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.777446 (+205861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.334155 (+2556709us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54003c3f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:42.334363 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471083904}
I20260709 13:08:42.490844 15198 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:42.278083 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:42.271196 17332 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.352s
I20260709 13:08:42.332139 16002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 351) took 2109 ms. Trace:
W20260709 13:08:42.801311 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.453011 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:42.541944 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:42.638550 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51722.6us
I20260709 13:08:43.113986 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1485) took 3047 ms. Trace:
W20260709 13:08:43.478394 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.611397 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 97918.3us
I20260709 13:08:42.511904 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:42.840042 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 276) took 2311 ms. Trace:
I20260709 13:08:43.479686 15379 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:43.481045 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.481184 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.481967 15377 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:43.474310 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:42.839087 15308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1565) took 1741 ms (client timeout 1991 ms). Trace:
I20260709 13:08:43.088374 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1537) took 3225 ms. Trace:
I20260709 13:08:43.116662 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1549) took 2889 ms. Trace:
I20260709 13:08:43.482558 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 281) took 1459 ms. Trace:
I20260709 13:08:43.479780 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:43.484539 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1504) took 2424 ms. Trace:
I20260709 13:08:43.485567 15379 rpcz_store.cc:276] 0709 13:08:41.060321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.511614 (+1451293us) service_pool.cc:224] Handling call
0709 13:08:43.484481 (+972867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.484539 15377 rpcz_store.cc:276] 0709 13:08:42.023303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.480924 (+1457621us) service_pool.cc:224] Handling call
0709 13:08:43.482503 (+  1579us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:43.483834 15308 rpcz_store.cc:269] 0709 13:08:41.097416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.097490 (+    74us) service_pool.cc:224] Handling call
0709 13:08:42.838694 (+1741204us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540025a8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:42.838975 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230970624}
I20260709 13:08:43.484166 15303 rpcz_store.cc:276] 0709 13:08:40.226802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.510182 (+283380us) service_pool.cc:224] Handling call
0709 13:08:40.510512 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.756394 (+245882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.104098 (+2347704us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54004119d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:43.116546 (+ 12448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563720448}
I20260709 13:08:43.483950 15305 rpcz_store.cc:276] 0709 13:08:39.863133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.865239 (+  2106us) service_pool.cc:224] Handling call
0709 13:08:39.865707 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.587105 (+721398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.087842 (+2500737us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54001874d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:43.088233 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1614820608}
I20260709 13:08:43.493590 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:43.447870 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:43.478266 15375 rpcz_store.cc:276] 0709 13:08:40.066685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.146406 (+ 79721us) service_pool.cc:224] Handling call
0709 13:08:40.146745 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.603007 (+456262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.113531 (+2510524us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b540023ebd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:43.113866 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047011584}
I20260709 13:08:43.491426 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:43.522544 15232 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.503329 17345 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:42.600915 17229 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.555s	user 0.015s	sys 0.000s
W20260709 13:08:42.808598 16787 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.157s	user 0.001s	sys 0.016s
I20260709 13:08:43.532024 15373 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:43.523831 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:42.644129 17333 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:43.480022 15378 rpcz_store.cc:276] 0709 13:08:40.528457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.528815 (+   358us) service_pool.cc:224] Handling call
0709 13:08:40.529364 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.674523 (+145159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.674547 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.674582 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:40.674604 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.839717 (+2165113us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54001fde54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:42.839781 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.839957 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333346048}
I20260709 13:08:43.508198 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1480) took 2750 ms. Trace:
I20260709 13:08:43.537130 15379 rpcz_store.cc:276] 0709 13:08:40.757827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.506998 (+2749171us) service_pool.cc:224] Handling call
0709 13:08:43.507469 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.507737 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.507779 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.507841 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:43.507899 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.507974 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.508120 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:42.913331 17353 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.001s
W20260709 13:08:43.456115 17121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.001s	sys 0.008s
I20260709 13:08:43.445745 17286 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.981386 17266 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.558104 17269 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:43.532102 15374 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:43.551908 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:43.552145 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1476) took 2841 ms. Trace:
I20260709 13:08:43.552506 15374 rpcz_store.cc:276] 0709 13:08:40.714049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.494152 (+2780103us) service_pool.cc:224] Handling call
0709 13:08:43.531909 (+ 37757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.551897 (+ 19988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.552093 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:42.270762 17152 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 1.226s
I20260709 13:08:43.442850 17218 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.525298 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1479) took 2798 ms. Trace:
I20260709 13:08:43.497424 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1478) took 2777 ms. Trace:
I20260709 13:08:42.525545 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:42.545378 17139 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:42.837172 17226 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:43.535662 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.277482 17342 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:43.534658 17241 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.563252 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:42.503191 17179 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.537894 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:43.565450 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.566677 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.567312 15378 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
W20260709 13:08:43.519233 15380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.015s
I20260709 13:08:43.568531 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:43.569010 15380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.001s	sys 0.015s
I20260709 13:08:43.569485 15378 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:43.533089 15375 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:42.977278 17243 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:42.695704 17289 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:43.055847 17165 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.056181 17331 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:43.549156 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:43.529309 17345 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.558274 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:43.547729 17121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.002s	sys 0.009s
I20260709 13:08:42.693754 16719 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.854s
I20260709 13:08:43.559201 15377 rpcz_store.cc:276] 0709 13:08:40.726583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.509494 (+2782911us) service_pool.cc:224] Handling call
0709 13:08:43.516257 (+  6763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.524936 (+  8679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.524969 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.525018 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:43.525056 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.525115 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.525239 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.545763 17332 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:08:43.557281 17135 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:43.545089 17284 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:43.570503 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:43.562036 17269 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:43.580195 15232 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:43.626194 15229 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:43.618952 17331 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:43.651005 17342 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:43.618157 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.570582 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.630666 15378 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.589588 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.547374 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 280) took 1318 ms. Trace:
W20260709 13:08:43.600212 15373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 284) took 1365 ms (client timeout 1582 ms). Trace:
I20260709 13:08:43.621778 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:43.559280 15382 rpcz_store.cc:276] 0709 13:08:40.720086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.496590 (+2776504us) service_pool.cc:224] Handling call
0709 13:08:43.496890 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.497103 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.497128 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.497169 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:43.497216 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.497272 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.497368 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.596614 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 356) took 1338 ms. Trace:
I20260709 13:08:43.475400 16002 rpcz_store.cc:276] 0709 13:08:40.222898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.239275 (+2016377us) service_pool.cc:224] Handling call
0709 13:08:42.246490 (+  7215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.270824 (+ 24334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.277735 (+  6911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.322782 (+ 45047us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:42.331770 (+  8988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.331885 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.332054 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.539906 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.580915 17127 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:43.577122 17139 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.580611 17226 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:43.578802 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:43.621227 17267 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.133s	user 0.013s	sys 0.002s
I20260709 13:08:42.534801 17107 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:43.545063 16787 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:43.599550 15305 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:43.580092 17241 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:43.597908 17289 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:43.134933 17343 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:43.600807 17345 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.663749 17346 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:43.791566 17346 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:43.793421 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:43.709394 16003 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.458s	user 0.011s	sys 0.004s
I20260709 13:08:43.794198 17346 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:43.795621 16003 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:43.707867 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.705744 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:43.796939 15373 rpcz_store.cc:269] 0709 13:08:42.234356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.533174 (+298818us) service_pool.cc:224] Handling call
0709 13:08:43.599927 (+1066753us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b54001abdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:43.600115 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124421888}
I20260709 13:08:43.713744 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.716384 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.706833 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:43.581274 17179 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.802963 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.798739 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.806027 15229 pending_rounds.cc:85] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 2
I20260709 13:08:43.714892 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 274) took 3710 ms. Trace:
W20260709 13:08:43.703464 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 250302us
W20260709 13:08:43.635694 17351 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 13:08:43.630098 17362 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:43.937417 15228 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:43.937933 17362 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:43.661892 17364 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.941129 17364 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:43.941890 17364 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.942552 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:43.939738 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:43.794384 15375 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:43.619709 17165 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:43.795686 15382 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:43.581393 17286 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.953106 17286 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:43.953449 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.954528 15382 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:43.954847 15375 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:43.955504 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1498) took 2896 ms. Trace:
I20260709 13:08:43.831357 17127 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:43.790807 16001 rpcz_store.cc:276] 0709 13:08:42.257938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.264057 (+  6119us) service_pool.cc:224] Handling call
0709 13:08:43.596502 (+1332445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.570703 17360 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:43.802032 17267 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:43.959229 17360 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:43.799417 15999 rpcz_store.cc:276] 0709 13:08:42.218156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.242943 (+ 24787us) service_pool.cc:224] Handling call
0709 13:08:43.531777 (+1288834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.776185 17266 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:43.879583 15379 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:43.969328 17266 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:43.969805 17165 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:43.663707 17356 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.220s	user 0.001s	sys 0.004s
I20260709 13:08:43.971530 17266 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:43.891785 15380 rpcz_store.cc:276] 0709 13:08:40.004444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.004588 (+   144us) service_pool.cc:224] Handling call
0709 13:08:40.033019 (+ 28431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.033553 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.033608 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.084146 (+1050538us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b18003d2520. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a
0709 13:08:42.893359 (+1809213us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b2c00083318. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:08:42.901845 (+  8486us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.580715 (+678870us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:43.580778 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.581100 (+   322us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.714100 (+133000us) raft_consensus.cc:1685] finished
0709 13:08:43.714178 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.714597 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4428,"raft.queue_time_us":7649,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":19715,"spinlock_wait_cycles":82711680,"thread_start_us":633750,"threads_started":1,"wal-append.queue_time_us":657629}
I20260709 13:08:43.976681 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.978328 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1483) took 2907 ms. Trace:
I20260709 13:08:43.905946 15229 pending_rounds.cc:107] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:43.981091 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1463) took 4411 ms. Trace:
I20260709 13:08:43.984625 15229 raft_consensus.cc:2889] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.936081 17346 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.985121 15381 rpcz_store.cc:276] 0709 13:08:39.569828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.570431 (+   603us) service_pool.cc:224] Handling call
0709 13:08:39.570883 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.536163 (+2965280us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18002a21a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b1ebfb 00007f2f53b2964b
0709 13:08:42.536410 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.536437 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:42.537397 (+   960us) log.cc:844] Serialized 52 byte log entry
0709 13:08:42.795409 (+258012us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:43.663039 (+867630us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:43.912976 (+249937us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.913709 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.913938 (+   229us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.980464 (+ 66526us) raft_consensus.cc:1685] finished
0709 13:08:43.980492 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.980726 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1184998,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":119345,"raft.run_cpu_time_us":654,"raft.run_wall_time_us":17869,"spinlock_wait_cycles":88450176,"thread_start_us":789888,"threads_started":3,"wal-append.queue_time_us":905952}
I20260709 13:08:43.987782 17371 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:43.908970 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 429136us
I20260709 13:08:43.988497 17371 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.988955 17371 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.990005 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1484) took 2863 ms. Trace:
I20260709 13:08:43.990290 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:43.907258 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:43.911621 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 463010us
I20260709 13:08:43.912647 17226 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:43.980177 17266 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.914233 17340 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:43.914434 15225 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:43.992600 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:43.993201 17340 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:43.915148 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 413084us
I20260709 13:08:43.915939 15376 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:43.916530 17333 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:43.990613 15381 rpcz_store.cc:276] 0709 13:08:41.127383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.988317 (+2860934us) service_pool.cc:224] Handling call
0709 13:08:43.989070 (+   753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.989445 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.989481 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.989562 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:43.989605 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.989689 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.989902 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.734395 16911 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:43.984656 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:43.920645 16003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 218) took 1846 ms (client timeout 1509 ms). Trace:
I20260709 13:08:43.921428 17284 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:43.921371 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:43.915009 17373 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:43.925558 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 287874us
I20260709 13:08:43.930680 16787 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:43.885748 17241 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:43.570367 17218 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:44.019176 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.020851 17218 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:44.000483 16003 rpcz_store.cc:269] 0709 13:08:42.068689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.097723 (+ 29034us) service_pool.cc:224] Handling call
0709 13:08:43.897586 (+1799863us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:44.021947 15348 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.876s (SENT)
I20260709 13:08:44.022516 17340 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:44.023253 17340 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.010516 17333 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.026167 17127 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:43.945729 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:43.953987 17286 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.650575 16799 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:43.956068 15382 rpcz_store.cc:276] 0709 13:08:41.058629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.953129 (+2894500us) service_pool.cc:224] Handling call
0709 13:08:43.953856 (+   727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.955095 (+  1239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.955402 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.940006 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.967805 17267 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:44.037117 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.935858 15377 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:44.038267 15231 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:44.039431 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.987607 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.024081 17340 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.042474 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.992286 15373 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:44.045135 17340 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:43.912890 17289 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:43.913551 17269 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.051170 15378 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:43.993824 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.054080 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.917862 17331 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:43.978921 15380 rpcz_store.cc:276] 0709 13:08:41.085152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.976742 (+2891590us) service_pool.cc:224] Handling call
0709 13:08:43.977314 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.977830 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.977869 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.977924 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:43.978028 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.978103 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.978251 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.920392 16000 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:44.058934 15233 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:43.993229 17226 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.060078 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.061157 15233 raft_consensus.cc:2376] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4. Re-sending same reply.
I20260709 13:08:44.062111 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.062922 15233 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:44.063696 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:43.971920 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1482) took 2907 ms. Trace:
I20260709 13:08:44.064718 15379 rpcz_store.cc:276] 0709 13:08:41.064123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.969804 (+2905681us) service_pool.cc:224] Handling call
0709 13:08:43.970724 (+   920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.971358 (+   634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.971389 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.971472 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:43.971533 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.971600 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.971791 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:43.971787 17165 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:44.068729 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.068991 17165 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.070056 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.071275 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.004680 17360 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:43.954964 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.072593 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.073549 15232 raft_consensus.cc:2368] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4.
I20260709 13:08:44.074335 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.074182 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.075762 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.075979 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 628041us
I20260709 13:08:44.077158 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:44.078935 17267 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:44.007748 15376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1490) took 2385 ms (client timeout 1545 ms). Trace:
I20260709 13:08:44.010437 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:44.011368 17284 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.017455 15374 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.003224 17373 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:44.056644 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 565130us
I20260709 13:08:44.059744 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 280) took 2092 ms. Trace:
I20260709 13:08:44.047806 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 278) took 2081 ms. Trace:
I20260709 13:08:44.055999 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.082644 15382 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:44.064793 15375 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:44.090351 15380 rpcz_store.cc:276] 0709 13:08:41.967073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.057847 (+2090774us) service_pool.cc:224] Handling call
0709 13:08:44.058632 (+   785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.059168 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.059213 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.059280 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:44.059330 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.059411 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.059621 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.103596 17286 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.091040 15228 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:44.105581 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.106521 17286 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.106829 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.092522 15373 rpcz_store.cc:276] 0709 13:08:41.966663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.045201 (+2078538us) service_pool.cc:224] Handling call
0709 13:08:44.045909 (+   708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.046724 (+   815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.046844 (+   120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.046982 (+   138us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:44.047075 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.047306 (+   231us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.047677 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.099695 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1501) took 3040 ms. Trace:
I20260709 13:08:44.108763 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 282) took 2036 ms. Trace:
I20260709 13:08:44.081758 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.085095 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1498) took 2396 ms. Trace:
W20260709 13:08:44.083401 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 73168.7us
W20260709 13:08:44.083019 15376 rpcz_store.cc:269] 0709 13:08:41.622551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.656833 (+ 34282us) service_pool.cc:224] Handling call
0709 13:08:44.007278 (+2350445us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b5400218c54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:44.007604 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4941062016}
I20260709 13:08:44.093325 15225 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 1.
I20260709 13:08:44.086025 17373 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.090066 17269 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:44.111785 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:08:44.083401 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.112557 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.109174 15375 rpcz_store.cc:276] 0709 13:08:41.059484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.955902 (+2896418us) service_pool.cc:224] Handling call
0709 13:08:44.012363 (+ 56461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.099382 (+ 87019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.099603 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.114212 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.115108 15225 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:44.091969 17165 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.114334 17107 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:44.116391 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.116627 17107 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:44.117340 17107 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.109232 15379 rpcz_store.cc:276] 0709 13:08:42.059125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.066636 (+2007511us) service_pool.cc:224] Handling call
0709 13:08:44.067327 (+   691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.067899 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.067946 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.068048 (+   102us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:44.068139 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.068239 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.094941 (+ 26702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.118047 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:44.119318 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.085800 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1493) took 2451 ms. Trace:
I20260709 13:08:44.108273 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.120592 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.086637 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:44.110184 15377 rpcz_store.cc:276] 0709 13:08:41.688325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.038847 (+2350522us) service_pool.cc:224] Handling call
0709 13:08:44.039511 (+   664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.040049 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.040101 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.040169 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:44.040216 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.084751 (+ 44535us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.084965 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.115217 15375 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:44.125463 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45128.8us
W20260709 13:08:44.095498 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 153306us
I20260709 13:08:44.123685 15374 rpcz_store.cc:276] 0709 13:08:41.634145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.016476 (+2382331us) service_pool.cc:224] Handling call
0709 13:08:44.017031 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.085499 (+ 68468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.085718 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.116377 17165 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:44.083711 17139 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:44.130973 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.131505 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.085261 17284 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.128823 15226 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:44.060212 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 358) took 1566 ms. Trace:
I20260709 13:08:44.133980 15233 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:44.138736 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 279) took 2171 ms. Trace:
I20260709 13:08:44.135250 17139 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:44.093102 17362 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:44.144750 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58277.9us
I20260709 13:08:44.139506 15378 rpcz_store.cc:276] 0709 13:08:41.966899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.052291 (+2085392us) service_pool.cc:224] Handling call
0709 13:08:44.120575 (+ 68284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.125069 (+  4494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.125099 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.129571 (+  4472us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:44.138433 (+  8862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.138524 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.138657 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.136916 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1496) took 2476 ms. Trace:
I20260709 13:08:44.134032 17165 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:44.140605 17289 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.140870 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.145635 15382 rpcz_store.cc:276] 0709 13:08:41.660799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.035162 (+2374363us) service_pool.cc:224] Handling call
0709 13:08:44.081893 (+ 46731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.097281 (+ 15388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.136569 (+ 39288us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b54001a95d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:44.136817 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105998208}
W20260709 13:08:44.142047 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 130604us
I20260709 13:08:44.141331 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.150741 15232 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:44.142084 15227 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:44.141491 17372 raft_consensus.cc:993] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:08:44.146692 17269 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:44.148787 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 130141us
I20260709 13:08:44.155786 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.155647 17139 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.157760 15226 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:44.143909 17366 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.154098 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.080307 17345 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.149245 17165 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.138615 16000 rpcz_store.cc:276] 0709 13:08:42.494039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.494288 (+   249us) service_pool.cc:224] Handling call
0709 13:08:43.796598 (+1302310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.057564 (+260966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.059933 (+  2369us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540064f5d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:44.060116 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993105664}
I20260709 13:08:44.176915 15973 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:44.169795 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.160898 17269 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.178831 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.148757 17333 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:08:44.182317 15224 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:44.184751 15229 raft_consensus.cc:2368] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3.
I20260709 13:08:44.183468 15228 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:44.186805 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44689.5us
I20260709 13:08:44.192044 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1492) took 2562 ms. Trace:
I20260709 13:08:44.192916 15381 rpcz_store.cc:276] 0709 13:08:41.629474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.015863 (+2386389us) service_pool.cc:224] Handling call
0709 13:08:44.127259 (+111396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.178492 (+ 51233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.178533 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.182484 (+  3951us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:44.191564 (+  9080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.191698 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.191921 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:44.160578 17364 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.198333 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:44.182897 17269 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.202823 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.204986 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.216097 17267 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:44.155689 15131 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:44.215052 15226 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:44.177024 17289 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.218062 17267 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:44.233563 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 66022.6us
I20260709 13:08:44.235705 15224 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:44.236686 17383 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:44.237442 17383 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.237936 17383 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.241165 17345 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:44.223309 17371 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.242628 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.244174 15231 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:44.246417 17364 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.231256 17267 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:44.213080 17372 raft_consensus.cc:1081] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
W20260709 13:08:44.239344 15974 leader_election.cc:336] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.513s (SENT)
I20260709 13:08:44.263443 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:44.218204 17376 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:44.302762 17376 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:44.303351 17376 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.255272 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:44.259179 15226 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:44.309186 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.315590 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.797s (SENT)
I20260709 13:08:44.263128 17267 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.248167 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.329089 15233 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:44.329708 17267 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.330832 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.327397 17380 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 13:08:44.264516 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.273984 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51330.3us
I20260709 13:08:44.274236 17372 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:44.336519 17366 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:44.278515 15130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 192) took 9613 ms. Trace:
I20260709 13:08:44.337105 17366 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:44.251206 17289 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:44.288219 17377 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 13:08:44.289747 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:44.338686 17284 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:44.339267 17284 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:44.338423 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48875.2us
I20260709 13:08:44.294559 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.339978 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 165852us
I20260709 13:08:44.341074 15228 raft_consensus.cc:2368] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4.
I20260709 13:08:44.340018 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.341563 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:44.342365 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.342754 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.343863 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.225979 17362 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:08:44.301183 17332 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:44.344269 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.281935 15131 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 4, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 4 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:08:44.251688 17373 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.345212 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.345368 17332 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.298436 17371 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.322700 17342 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.341094 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:44.347640 17373 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:44.348385 17362 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.348496 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:44.348716 17373 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.348978 17362 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:44.349402 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.322341 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 94168.7us
I20260709 13:08:44.349664 17362 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.350147 17366 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.351248 15224 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:08:44.325524 17365 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:44.336426 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:44.355155 16003 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:44.356938 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.348286 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:44.357776 15305 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:44.358600 17360 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:44.359140 17360 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:44.359572 17360 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.339866 17284 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.337383 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.345907 17332 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:44.365885 17332 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.366809 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.367620 17332 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.316670 17241 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.367726 15303 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:44.368744 17241 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.344058 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.353300 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:44.370749 15308 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:44.371925 17241 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:44.373610 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.374856 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.375186 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.346427 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:44.322280 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.290817 17379 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.358245 17179 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:44.337311 15130 rpcz_store.cc:276] 0709 13:08:34.665024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.665215 (+   191us) service_pool.cc:224] Handling call
0709 13:08:44.278077 (+9612862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:40.719926 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:40.727502 (+  7576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:40.727547 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:40.727566 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:40.728335 (+   769us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:40.728466 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:40.728497 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:40.728869 (+   372us) tablet.cc:701] Row locks acquired
0709 13:08:40.728890 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:08:40.729055 (+   165us) write_op.cc:270] Start()
0709 13:08:40.729207 (+   152us) write_op.cc:276] Timestamp: P: 1783602520729000 usec, L: 0
0709 13:08:40.729231 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:40.730018 (+   787us) log.cc:844] Serialized 1307 byte log entry
0709 13:08:42.058983 (+1328965us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b18002fbea0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1
0709 13:08:42.127505 (+ 68522us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.696191 (+568686us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b18002fbea0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39557 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:08:42.896620 (+200429us) write_op.cc:301] APPLY: starting
0709 13:08:42.897709 (+  1089us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.903388 (+  5679us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.910018 (+  6630us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:43.252870 (+342852us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:43.361961 (+109091us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:08:43.455486 (+ 93525us) write_op.cc:312] APPLY: finished
0709 13:08:43.527207 (+ 71721us) log.cc:844] Serialized 35 byte log entry
0709 13:08:43.945333 (+418126us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.945743 (+   410us) write_op.cc:454] Released schema lock
0709 13:08:43.945841 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:43.946647 (+   806us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.946672 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3882621,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":755612,"apply.run_cpu_time_us":38397,"apply.run_wall_time_us":1060087,"num_ops":3,"prepare.queue_time_us":102619,"prepare.run_cpu_time_us":135933,"prepare.run_wall_time_us":1351632,"raft.queue_time_us":314470,"raft.run_cpu_time_us":69307,"raft.run_wall_time_us":155656,"replication_time_us":1386589,"spinlock_wait_cycles":16520448,"thread_start_us":1494163,"threads_started":5,"wal-append.queue_time_us":1223914,"wal-append.run_cpu_time_us":55082,"wal-append.run_wall_time_us":1298693}]]}
I20260709 13:08:44.379150 15304 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:44.379716 17289 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.380430 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:44.307883 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.393066 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:44.393889 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:44.394383 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:44.394909 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:44.393092 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:44.395334 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:44.443676 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 197197us
I20260709 13:08:44.335526 17107 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:44.448068 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 132557us
I20260709 13:08:44.450207 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.455175 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.456959 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:44.457721 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:44.475406 15233 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:44.479514 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:44.391196 17365 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.483852 15225 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:44.490329 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.393141 17366 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:44.526882 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69274.1us
I20260709 13:08:44.461180 17383 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.497833 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:44.498615 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 263282us
I20260709 13:08:44.530525 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:44.531317 15303 raft_consensus.cc:2376] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5. Re-sending same reply.
I20260709 13:08:44.535835 15231 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 2: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:44.536589 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47942us
I20260709 13:08:44.533139 15382 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:44.539786 17331 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.533860 16002 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.553673 15373 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:44.565393 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.546623 17286 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.534207 15999 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:44.571695 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:44.571404 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 332291us
I20260709 13:08:44.554116 17331 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:44.575220 17331 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.581627 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:44.549223 17376 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.588466 17376 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.583950 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.604728 16000 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:44.606719 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.607616 15301 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 2.
I20260709 13:08:44.608942 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.610323 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.612907 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.614094 15302 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:44.617202 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.618211 15300 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.618909 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:44.619867 15233 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:44.621022 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.621071 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.622731 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.622551 17286 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.624099 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.617193 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.625700 17284 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.627128 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.628023 15229 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:44.619695 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.627389 15308 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6.
I20260709 13:08:44.626106 15299 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:44.623050 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.629462 15232 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:44.636615 16002 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:44.632999 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.638118 15274 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.722s (SENT)
I20260709 13:08:44.641388 15229 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:44.648751 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 103431us
I20260709 13:08:44.652384 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.608963 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.654771 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:44.649358 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:44.667446 15301 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.677790 17226 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:44.678208 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.678460 17226 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:44.679003 17226 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.679291 15301 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:44.683123 17241 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.683856 17241 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.686609 17241 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:44.687798 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.689311 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.630124 17383 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:44.689673 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.690337 15378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
I20260709 13:08:44.662935 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:44.690599 15381 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.710774 15374 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.573884 17269 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.694139 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:44.628191 17360 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.696485 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:44.696893 15225 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:44.697552 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:44.653926 17165 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.692688 15306 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:44.723709 15378 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.733397 15378 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.725149 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.726552 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.734640 15381 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.726871 17286 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:44.740103 15379 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:44.727694 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:44.728983 15231 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.629185 17284 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.743795 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.761485 15308 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.763835 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.768785 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:44.771790 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.730064 17179 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:44.772748 15233 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:44.776556 16002 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:44.775305 15302 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:44.778316 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.791675 15375 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.793076 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.804738 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:44.806481 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.811911 15229 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:44.816665 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:44.825373 15233 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.791675 17383 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:44.812207 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:44.832988 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:44.877686 17107 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.788587 17362 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.881219 17360 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:44.853279 15307 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:44.873623 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49590.6us
W20260709 13:08:44.849465 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 265311us
I20260709 13:08:44.776116 15305 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:44.886899 15228 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:44.811789 17284 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.853303 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:44.824093 15232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:44.919822 15232 raft_consensus.cc:606] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:44.920372 15232 raft_consensus.cc:614] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:44.855266 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:44.839744 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:44.926833 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 232707us
I20260709 13:08:44.931939 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:44.822816 16000 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.937389 15306 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.938555 15301 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:08:44.940472 15348 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.860s (SENT)
I20260709 13:08:44.943167 16001 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:44.944131 15224 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:44.942166 15378 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.950524 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:44.953469 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:44.950472 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.954453 16003 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:44.954768 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:44.955976 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:44.957561 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:44.959199 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:44.960531 16005 raft_consensus.cc:2376] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5. Re-sending same reply.
I20260709 13:08:44.964895 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:44.968386 15380 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:44.969120 15374 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:44.973495 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.811s (SENT)
I20260709 13:08:44.941519 17165 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:45.013298 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:44.952536 17383 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:44.992971 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.997947 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.059021 16006 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:44.997126 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:44.997884 17331 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:44.992870 17340 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.995854 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.062893 15378 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:45.063445 16005 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:08:45.056207 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 104176us
W20260709 13:08:45.037748 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.065876 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.001602 15227 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:45.062021 16004 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:44.989243 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.957439 17266 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.035271 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:44.998627 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.072355 15381 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
W20260709 13:08:45.008627 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76789us
I20260709 13:08:44.941023 17289 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.003923 17360 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:08:45.069862 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 125775us
I20260709 13:08:45.034197 15999 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:45.001855 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:45.066780 15382 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:45.074743 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:08:45.077541 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 152264us
I20260709 13:08:45.034812 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:45.012266 17267 consensus_meta.cc:287] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.004s
I20260709 13:08:45.072793 16007 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:45.088548 15306 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:45.088626 15308 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:45.083911 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82480.4us
I20260709 13:08:45.049094 17269 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.090922 15303 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.092679 16008 raft_consensus.cc:2410] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:45.092868 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.091403 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.044836 17362 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.093434 15973 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:45.099006 15376 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.003168 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.076455 17346 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.043092 17397 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:45.102001 15375 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:45.106601 15226 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:45.083470 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:45.116353 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.117395 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.118469 16001 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:45.118798 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.097143 17165 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:45.122599 17388 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:45.122267 17400 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:45.106477 17346 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:45.123003 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.123767 17346 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.124127 17400 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:45.124610 17400 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.125123 16000 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:45.126977 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:45.128237 17241 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:45.129871 17383 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.129658 17400 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.130540 17383 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:45.131245 17400 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.130033 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:45.118045 17366 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:45.133208 15274 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.922s (SENT)
I20260709 13:08:45.133651 15376 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:45.135139 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.120134 16001 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:45.135840 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 193408us
I20260709 13:08:45.134171 15233 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:45.092162 17399 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:45.142256 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:45.090766 17226 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.108644 17397 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:45.163420 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.109097 17286 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.164888 15228 raft_consensus.cc:2410] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:45.168032 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.172303 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:45.171774 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80889.5us
I20260709 13:08:45.174073 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:45.175558 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.177331 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.178797 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.178979 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.179797 15224 raft_consensus.cc:2376] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4. Re-sending same reply.
I20260709 13:08:45.180721 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.182300 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:45.183629 17266 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:45.184266 17266 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:45.184804 17266 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.185556 17331 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.169530 17286 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:45.186668 17286 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.186985 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.187922 15231 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:45.188141 17179 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:45.189149 17107 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:45.205361 17179 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.205914 17179 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.205969 17107 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:45.206528 17107 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.206559 17376 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:45.207204 17376 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:45.174297 17397 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.210472 17371 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.217298 17371 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:45.218585 17371 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.208214 17376 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.220975 17267 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:45.221668 17267 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:45.211546 15345 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.896s (SENT)
I20260709 13:08:45.222802 17267 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.211732 15229 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:45.212220 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.225970 15228 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:45.219172 17284 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:45.230408 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.232772 15232 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:45.178537 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.152601 17165 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:08:45.193121 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82669.7us
I20260709 13:08:45.158658 17360 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.197095 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.249796 15233 raft_consensus.cc:2368] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:45.197933 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:45.199546 17226 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:45.189718 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52947.7us
I20260709 13:08:45.200477 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.144099 17388 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:45.253854 17388 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:45.201210 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84411.5us
I20260709 13:08:45.207680 17107 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.140025 17399 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:45.203732 17346 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.257994 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:45.260835 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62995.2us
W20260709 13:08:45.261066 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 142003us
I20260709 13:08:45.262835 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:45.259256 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80909.7us
I20260709 13:08:45.266595 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:45.267515 17401 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:45.269008 17401 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.269111 15198 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:45.276746 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.279330 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.279531 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.281001 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:45.281775 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:45.282903 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.269656 17401 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.258399 17267 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.286839 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.287256 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.290403 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.290654 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:45.292196 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.291832 17165 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.296506 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:45.299144 17284 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:45.300305 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:45.285283 15274 connection.cc:256] RPC call timeout handler was delayed by -1.0740936610000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24980000000000002s for a response
W20260709 13:08:45.301287 15274 connection.cc:256] RPC call timeout handler was delayed by -1.0721819479999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 13:08:45.301779 15274 connection.cc:256] RPC call timeout handler was delayed by -1.0605936609999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2513s for a response
W20260709 13:08:45.302443 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.509s (SENT)
I20260709 13:08:45.281399 17333 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:45.281720 17372 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:45.302839 17362 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:45.303484 17372 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.304559 17226 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:45.307227 17284 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:45.308506 17284 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.277360 17366 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:08:45.310024 17346 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:45.311405 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:45.303089 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Timed out: RequestConsensusVote RPC to 127.13.196.68:44351 timed out after 1.509s (SENT)
I20260709 13:08:45.316639 17345 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.317610 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.318068 17376 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:45.319464 17406 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:08:45.321265 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.321754 17333 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.263123 17399 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.288607 17401 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:45.338438 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 211601us
W20260709 13:08:45.339418 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74943.3us
I20260709 13:08:45.324692 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.327606 15305 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:45.273263 17400 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:45.340608 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56591.2us
I20260709 13:08:45.307531 17179 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.326714 17345 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:45.344424 17412 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.329684 17372 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.359320 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:45.365067 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61382.3us
I20260709 13:08:45.366328 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.348533 17107 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.330698 17266 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.386663 15974 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:45.359282 15198 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:45.354621 17345 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.356508 17412 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.356375 17331 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:45.396108 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 92298.9us
I20260709 13:08:45.395327 17404 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:45.400862 17413 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.402776 17266 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:45.391505 17416 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 13:08:45.393705 17286 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.406165 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.407826 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.408651 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.409045 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.450076 15306 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:45.450685 15305 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:45.409863 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.410615 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.452497 15301 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:45.411372 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.400187 17397 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.416787 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.418357 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:45.425993 15303 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:45.457320 15304 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:08:45.439293 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84914.5us
I20260709 13:08:45.429203 17179 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.435497 17412 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:45.427012 17415 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
W20260709 13:08:45.462234 15274 leader_election.cc:336] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.603s (SENT)
I20260709 13:08:45.468274 15381 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.462193 15307 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:45.472254 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.473130 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:45.475741 15380 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.477021 15374 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:45.472162 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:45.478163 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:45.473839 15299 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:45.482424 15375 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:45.481977 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:45.492033 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:45.470650 17266 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.495504 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.495779 17266 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.496546 17286 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:45.480646 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46246.9us
I20260709 13:08:45.449250 17404 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:45.415506 17333 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.509495 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:45.509629 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47447.4us
I20260709 13:08:45.511577 15376 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:45.515704 15373 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:45.517009 17266 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.518110 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:45.539880 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.540802 15274 leader_election.cc:336] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Timed out: RequestConsensusVote RPC to 127.13.196.68:44351 timed out after 1.603s (SENT)
I20260709 13:08:45.541405 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.545186 17372 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.547264 17397 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.550159 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.551102 15302 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:45.552089 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.552903 15306 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:45.553634 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.554461 15302 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:08:45.554867 15302 pending_rounds.cc:85] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 1
I20260709 13:08:45.555145 15302 pending_rounds.cc:107] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:08:45.555184 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.555500 15302 raft_consensus.cc:2889] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.555588 17414 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:45.556708 17414 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:45.557088 17414 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:45.557330 15274 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.757s (SENT)
W20260709 13:08:45.558478 15274 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.946s (SENT)
I20260709 13:08:45.558166 17414 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.555927 15303 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:45.559696 17414 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:45.560732 15274 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 2.116s (SENT)
I20260709 13:08:45.561259 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.563203 17289 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:45.563714 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:45.559810 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.566766 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.568608 17331 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.568257 17404 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.572649 17401 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.575491 17401 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:45.576928 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.581007 15380 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:45.584748 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.593228 15299 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:45.603283 17345 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.606763 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.607152 17345 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.607887 15305 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:45.608779 17345 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:45.609241 17401 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:45.600880 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93827.5us
I20260709 13:08:45.568608 17397 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:45.607833 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44214us
I20260709 13:08:45.564231 17289 consensus_queue.cc:1243] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:45.616269 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.621254 17421 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:45.621393 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.622809 15303 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:45.622155 17421 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.622237 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.621434 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.624986 15305 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:45.621495 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.564997 17399 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.630549 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.630904 15307 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:45.634258 15302 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
W20260709 13:08:45.634940 15274 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 2.122s (SENT)
I20260709 13:08:45.636888 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.617601 17365 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.638110 15304 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:45.639961 17340 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.632439 17289 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.632915 17427 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:45.682690 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:45.677239 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55912.9us
I20260709 13:08:45.678922 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.681443 15196 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6.
I20260709 13:08:45.684444 15302 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:45.683516 15230 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:45.686381 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.686913 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.691457 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.693212 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:45.694869 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67544us
I20260709 13:08:45.701663 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.699786 17412 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.705461 17412 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:45.705873 17399 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:45.679001 17397 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.718639 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.718845 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:45.720016 15226 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.723090 17340 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.632977 17421 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.730918 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.734504 15299 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:45.736084 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91316.3us
I20260709 13:08:45.737197 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:45.751830 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:45.754729 17179 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:45.755697 17286 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:45.756644 17286 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.759825 15376 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:45.760282 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:45.763643 17286 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.762109 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:45.765411 15381 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.766935 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.767899 15304 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:45.767346 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.768111 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.769045 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.769268 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.769951 15302 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:45.770076 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.762494 17139 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.770694 15307 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.770978 17139 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:45.771569 17139 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.772831 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.774544 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.775239 15302 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:45.764834 15380 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:45.776188 15380 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:45.776369 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.776655 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.777066 15305 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:45.777181 15380 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.778401 15380 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.777189 15303 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:45.780303 17332 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:45.781075 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 68295.1us
I20260709 13:08:45.780814 17332 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:45.782259 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.783398 17340 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:45.782553 17332 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.784557 17413 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.785233 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.799309 17332 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.785328 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:45.799722 16008 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:45.687131 17427 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:45.789889 17421 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.802886 17427 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:45.794366 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.796240 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.806816 15302 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:45.766880 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:45.809902 15231 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:08:45.810729 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67709.4us
I20260709 13:08:45.811843 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.812119 15274 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.813122 17412 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:45.813757 17360 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.816615 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.817890 15308 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:45.824177 15307 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
W20260709 13:08:45.833436 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 66646.7us
I20260709 13:08:45.867683 15381 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:45.870685 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:45.769114 15299 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:45.832765 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.877375 15308 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:08:45.855510 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.829043 15373 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:45.884883 15226 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
W20260709 13:08:45.891090 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 51932.7us
I20260709 13:08:45.893412 15229 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:45.895208 15380 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:45.895713 15380 pending_rounds.cc:85] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 1
I20260709 13:08:45.895987 15380 pending_rounds.cc:107] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:45.896240 15380 raft_consensus.cc:2889] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.909613 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:45.852180 17366 raft_consensus.cc:2764] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:45.917073 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:45.918524 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:45.919929 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:45.926810 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:45.927778 15308 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:45.928709 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 91) took 10055 ms. Trace:
I20260709 13:08:45.916200 17286 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:45.908643 17241 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:08:45.914314 17413 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.914175 17372 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:45.950304 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:45.950922 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:45.922156 17376 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.893543 17397 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:08:45.938258 17267 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:45.942631 17331 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.936540 17400 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.910223 17360 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:45.966732 15380 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:08:45.972728 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62460.2us
I20260709 13:08:45.974279 17376 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:45.919071 17427 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:08:45.975571 17333 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:45.983603 15307 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.987942 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.929607 15131 rpcz_store.cc:276] 0709 13:08:35.861801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.861967 (+   166us) service_pool.cc:224] Handling call
0709 13:08:45.916661 (+10054694us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:45.034275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:45.035186 (+   911us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:45.035258 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:08:45.035284 (+    26us) tablet.cc:662] Decoding operations
0709 13:08:45.035971 (+   687us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:45.036069 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:45.036104 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:45.106268 (+ 70164us) tablet.cc:701] Row locks acquired
0709 13:08:45.112604 (+  6336us) write_op.cc:260] PREPARE: finished
0709 13:08:45.112854 (+   250us) write_op.cc:270] Start()
0709 13:08:45.113068 (+   214us) write_op.cc:276] Timestamp: P: 1783602525112771 usec, L: 0
0709 13:08:45.113098 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:08:45.117409 (+  4311us) log.cc:844] Serialized 982 byte log entry
0709 13:08:45.508236 (+390827us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.681790 (+173554us) write_op.cc:301] APPLY: starting
0709 13:08:45.682096 (+   306us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.682511 (+   415us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.686023 (+  3512us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.743416 (+ 57393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.743872 (+   456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:45.746915 (+  3043us) write_op.cc:312] APPLY: finished
0709 13:08:45.747384 (+   469us) log.cc:844] Serialized 29 byte log entry
0709 13:08:45.749554 (+  2170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.832680 (+ 83126us) write_op.cc:454] Released schema lock
0709 13:08:45.832733 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.833302 (+   569us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.833339 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":125567,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":173194,"apply.run_cpu_time_us":5192,"apply.run_wall_time_us":151433,"num_ops":2,"prepare.queue_time_us":329492,"prepare.run_cpu_time_us":7506,"prepare.run_wall_time_us":197698,"raft.queue_time_us":120432,"raft.run_cpu_time_us":37467,"raft.run_wall_time_us":132025,"replication_time_us":394948,"thread_start_us":395220,"threads_started":4,"wal-append.queue_time_us":136812}]]}
I20260709 13:08:45.989097 15304 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:45.990583 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:45.991497 15381 raft_consensus.cc:2376] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4. Re-sending same reply.
I20260709 13:08:45.992865 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.994988 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.993793 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:45.965514 17340 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:45.998596 15373 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:45.988595 17286 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:08:46.001600 15302 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:46.001917 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:45.976635 17331 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:46.004208 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.006319 17400 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.007189 17267 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.007912 15299 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:46.009696 15304 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:45.954658 17346 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:46.011008 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:46.012377 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.018254 15307 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.020798 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:46.013299 15302 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:45.985348 17360 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:45.958806 17372 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:45.955163 17413 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:46.023650 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 73476.5us
W20260709 13:08:46.016247 17107 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.625s	user 0.014s	sys 0.003s
I20260709 13:08:45.967088 17425 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:08:46.043790 17376 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:46.045199 17425 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:46.045596 17425 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.046525 17425 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.048084 17372 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:46.048717 17425 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:46.053864 15307 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:46.016479 17331 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.031217 15302 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:46.035075 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.038162 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:46.068007 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55756.1us
I20260709 13:08:46.068756 15376 raft_consensus.cc:2376] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4. Re-sending same reply.
I20260709 13:08:46.070027 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:45.993721 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.004208 17333 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.071220 17360 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:46.071688 17360 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:46.007637 17267 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.072021 17333 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:46.075117 17419 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:46.075589 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.089s (SENT) [suppressed 106 similar messages]
I20260709 13:08:46.031381 15303 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.075640 17419 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.080847 17419 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.082615 17419 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.084759 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.042665 17399 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.073210 17267 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.086941 17267 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.089032 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.092262 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.093761 15373 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:46.094318 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:46.095321 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.097721 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.061177 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.085541 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.108621 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:46.100991 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.109946 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:46.072105 17360 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.113399 15302 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.115397 17418 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.116138 17418 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.117347 17418 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:46.121260 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 80952.7us
I20260709 13:08:46.121127 17332 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:46.122781 17241 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.123556 17401 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:46.123872 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:46.132975 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.124209 17401 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:46.146257 17401 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:46.147014 17399 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:46.147944 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62499.5us
W20260709 13:08:46.126847 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.164158 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.164407 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:46.163663 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 183537us
I20260709 13:08:46.166509 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.175359 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:46.089488 15129 catalog_manager.cc:5697] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 3 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.176581 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.181111 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.182825 15374 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:46.162416 17346 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.158615 17413 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:46.186918 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.189256 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.189983 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.190498 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:46.117244 17372 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:08:46.170981 17241 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.198993 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:46.124995 17139 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.203553 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.199815 17179 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.207355 17345 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.207960 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:46.208164 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 84368.5us
I20260709 13:08:46.208480 17345 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.209414 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:46.209822 17365 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:46.197928 17371 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:08:46.211700 15376 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:46.218055 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.213649 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.210426 17365 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.171458 17366 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:08:46.191666 17401 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:08:46.209750 17345 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.239158 15376 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:46.200327 17286 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:46.239809 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:46.237668 15129 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.232769 17340 raft_consensus.cc:2764] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:46.271999 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.266239 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.296388 15301 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:46.266815 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.270437 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:46.300633 15225 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:46.285625 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:46.274699 15379 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:08:46.302062 15302 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:46.227937 17418 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:08:46.293231 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 83026.6us
I20260709 13:08:46.236599 17399 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:46.294977 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85674.6us
I20260709 13:08:46.201367 17397 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:08:46.291397 17345 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:46.309810 15129 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 4, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 4 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.313027 17399 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.313871 17107 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.316723 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:46.328974 15229 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:46.317893 15374 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:08:46.319712 17440 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:08:46.336937 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.327580 15373 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.334740 17399 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:46.334319 17345 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.335011 17421 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.285566 17365 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.347165 17445 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:46.347381 17365 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.347744 17445 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.348599 17439 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:46.348863 17445 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:46.335568 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 102494us
I20260709 13:08:46.351397 17139 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:46.352566 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:46.353030 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.353804 17241 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.355091 17360 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.345183 17421 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.357422 15348 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:46.357589 17421 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.310190 17289 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.359417 17421 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.359047 17331 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.360275 17360 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:46.360559 17241 raft_consensus.cc:2764] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:46.361047 17360 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.361675 17360 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:46.362876 17360 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:46.341396 15345 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.546s (SENT)
W20260709 13:08:46.365072 15345 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.548s (SENT)
I20260709 13:08:46.348191 17345 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:46.365531 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.341441 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:46.368955 17342 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.327272 17404 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:46.371630 17241 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:46.377525 15345 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.553s (SENT)
I20260709 13:08:46.373961 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:46.389601 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:46.394340 16008 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:46.397933 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:46.405966 15376 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:08:46.367528 17371 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:46.393752 17165 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:46.418752 17372 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:46.453317 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 250983us
W20260709 13:08:46.461041 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 149216us
W20260709 13:08:46.465649 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 180109us
I20260709 13:08:46.467006 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:46.467948 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.440503 17165 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.471287 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.424644 17345 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:08:46.481954 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:46.488734 15302 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:46.482839 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.467792 17413 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:46.478217 17165 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:46.555145 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 88217.6us
I20260709 13:08:46.554304 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:46.555094 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:46.569383 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.572261 15302 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:46.572762 15302 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:46.551162 17427 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.478457 17425 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:08:46.557391 17400 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.582168 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:46.590102 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:46.583424 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:46.483886 17421 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:08:46.593225 17421 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:46.603259 17400 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.606871 17449 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:46.607463 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.607865 17449 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:46.609015 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:46.649248 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65900us
I20260709 13:08:46.612193 17289 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:46.669122 17139 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:46.595468 17331 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:46.607875 17400 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.688602 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:46.696857 17438 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 13:08:46.703066 15225 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:46.574908 17413 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:46.679339 17454 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:08:46.725297 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.725924 15377 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:46.738572 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.738467 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 148511us
W20260709 13:08:46.748375 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 389468us
I20260709 13:08:46.749660 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:46.754650 15304 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.708618 17139 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:46.724222 17421 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.756429 17331 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.754681 17366 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.809306 15345 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.750703 17371 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:46.818374 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:46.795698 17421 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:46.802275 17289 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:46.823740 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:46.779654 17340 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:08:46.855041 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.858479 15308 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:46.820600 17331 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:46.807027 17449 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:08:46.813818 17360 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:08:46.833654 17289 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:46.820245 17366 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:46.925385 17449 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:46.823707 17139 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:46.996974 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 187304us
I20260709 13:08:46.915759 17414 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.006103 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:47.009002 15308 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:46.986599 17289 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.017035 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:46.992880 17449 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:47.005165 17452 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:46.925153 17331 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.028544 17408 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:47.029630 17466 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:47.030851 17455 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:08:47.033046 17448 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:47.034723 17425 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.037012 17475 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.037948 17366 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:47.041314 17463 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:08:47.007483 17404 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.089128 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:47.016469 17241 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:47.078418 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 260178us
I20260709 13:08:47.020381 17340 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:47.095556 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:08:47.098590 17404 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:47.101640 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 181214us
I20260709 13:08:47.104055 15376 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:47.096761 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.010s
W20260709 13:08:47.107900 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.010s
W20260709 13:08:47.110801 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.088534 17448 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:47.114066 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:47.115885 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.118845 17404 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:47.120052 17486 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.120738 17486 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.121224 17486 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.095273 17241 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:47.124701 17241 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.124435 17476 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.125639 17476 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:47.126286 17466 raft_consensus.cc:2764] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:47.126505 17476 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.127558 17421 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:47.107205 17366 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.129106 17366 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:47.112555 17165 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.539s	user 0.014s	sys 0.000s
I20260709 13:08:47.137207 15303 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:47.140759 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 669516us
I20260709 13:08:47.112807 17266 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.144745 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 76897.9us
I20260709 13:08:47.095608 17425 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.130863 17340 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:47.150691 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:47.143005 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:47.183302 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:47.101250 17475 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.097750 17408 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.137409 17165 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.248759 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:47.254638 16007 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:47.250671 15375 raft_consensus.cc:2410] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:47.185329 17466 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.154577 17266 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.271057 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:47.279099 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71185.9us
I20260709 13:08:47.280742 17469 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.281376 17469 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.145056 17449 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:47.282006 17427 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.005s
I20260709 13:08:47.282567 17427 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.283345 17450 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.283762 17450 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.284104 17450 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.287940 17408 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:47.289198 17484 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:08:47.259752 17466 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.263087 17286 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.301138 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:47.302013 15303 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:47.305991 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 190233us
W20260709 13:08:47.319348 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 148979us
I20260709 13:08:47.320530 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.345018 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:47.347615 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 159913us
I20260709 13:08:47.348501 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:47.349359 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:47.351770 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:47.359556 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45079.7us
I20260709 13:08:47.359826 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.366951 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.312830 17466 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.346382 17461 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.209142 17448 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.352761 17427 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.369987 15374 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:47.415783 17489 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.414577 17457 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.415275 17488 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:47.365845 17474 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.352944 17340 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.449723 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.451504 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.352643 17286 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:47.376013 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.381991 17480 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:08:47.483299 17475 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:47.376834 17461 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.500259 17476 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.475194 17489 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.485364 17450 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.485402 17427 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:47.502113 17441 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.229s	user 0.003s	sys 0.009s
W20260709 13:08:47.513386 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 63838.4us
I20260709 13:08:47.483668 17289 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:47.531401 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 79981.1us
W20260709 13:08:47.538885 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 172023us
I20260709 13:08:47.541917 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.545989 17165 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:47.547140 17466 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.549269 17266 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:47.507310 17457 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.483668 17241 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.512710 17474 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.554975 17491 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.555445 17461 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:47.555619 17475 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.540740 17427 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:47.562027 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:47.658928 16002 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:47.660684 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:47.603633 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44261.1us
I20260709 13:08:47.709475 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:47.658528 17486 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.004s
I20260709 13:08:47.627297 17266 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.736330 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.740512 17499 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.680322 17491 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:47.662179 17427 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.782140 17497 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.783022 17497 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.783725 17491 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.786684 17481 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.787281 17481 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.787963 17489 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:47.790786 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:47.791169 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 81811.6us
I20260709 13:08:47.792608 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:47.819095 16002 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:47.736462 17475 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.835246 15378 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:47.734849 17486 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.796947 17505 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.789697 17481 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:47.842165 17502 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:08:47.843357 17504 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:47.778261 17494 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:08:47.800089 17461 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.852308 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:47.791287 17241 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:47.853494 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:47.737468 17266 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.838038 17422 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.829541 15274 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.831745 17488 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:47.796438 17450 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:47.797955 17457 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:47.796185 17289 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:47.859563 15381 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:47.863601 16008 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:47.800639 17286 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:47.792136 17476 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:47.791024 17474 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:47.843874 17504 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:47.863381 17481 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.863389 17461 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.922674 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:47.925052 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:47.925734 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 135050us
W20260709 13:08:47.926748 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 384941us
W20260709 13:08:47.933552 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 104495us
I20260709 13:08:47.941197 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.942050 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:47.914480 17332 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:47.940513 16002 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.921631 17466 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:47.947134 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:47.932420 17475 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:47.948228 17475 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.950380 17475 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:47.939602 17514 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:47.951489 17514 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:47.953572 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.929785 17505 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.955193 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:47.955994 15231 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:47.956243 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:47.958316 16002 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:47.960506 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:47.941953 17461 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.943986 17286 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.963632 17286 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.964154 17286 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.936527 17504 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.934305 17241 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:47.969316 15231 raft_consensus.cc:1217] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:47.970075 15231 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:47.973078 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:47.974131 15233 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:47.975173 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:47.975657 15233 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.976184 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:47.977458 15232 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:47.978453 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:47.939519 17450 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.979115 15232 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:08:47.982183 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:47.982816 16008 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:47.941267 17512 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.940491 17509 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.985015 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:47.945225 17332 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.986121 15274 leader_election.cc:400] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:47.987133 15274 leader_election.cc:403] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:47.986138 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:47.987833 16002 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:47.989732 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:47.992241 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:47.992722 15233 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:47.946530 17486 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:47.954872 17457 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.953907 17514 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:47.969127 17289 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.932160 17422 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:47.997448 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:47.969437 17506 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.979022 17474 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:48.004109 15231 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.996487 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:48.013032 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 56852.5us
I20260709 13:08:48.014165 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:48.010556 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:47.943274 17481 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.015363 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:47.989202 17332 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:48.020124 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.022452 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:47.986370 17241 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.026191 15229 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:48.027319 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.011874 17506 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.028997 17513 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:48.017442 17501 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:48.029794 17513 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.029999 17501 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.030333 17513 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.030505 17501 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.032033 17506 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.003969 17505 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.036418 17266 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.038012 17469 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:48.025699 17478 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.211s	user 0.001s	sys 0.019s
I20260709 13:08:48.034063 17289 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:48.042047 17289 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:48.042461 17289 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.017697 17476 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:48.025051 17488 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.044028 17476 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:48.044945 17476 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.991434 17450 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:48.050284 17447 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.717s	user 0.000s	sys 0.027s
I20260709 13:08:48.051935 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1560) took 1884 ms. Trace:
I20260709 13:08:47.996599 17512 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.057420 17241 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:48.057798 17516 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:48.058459 17516 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.058842 17516 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.060613 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 314) took 1157 ms. Trace:
I20260709 13:08:48.061086 15378 rpcz_store.cc:276] 0709 13:08:46.902834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.902983 (+   149us) service_pool.cc:224] Handling call
0709 13:08:46.903364 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.835846 (+932482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.060312 (+224466us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b540023f5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:48.060541 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665340288}
I20260709 13:08:48.062402 17422 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.066634 17497 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 2. Current term is 3.
I20260709 13:08:48.067462 17497 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.052297 15380 rpcz_store.cc:276] 0709 13:08:46.167902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.168149 (+   247us) service_pool.cc:224] Handling call
0709 13:08:46.168555 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.178210 (+  9655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.178237 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.184115 (+  5878us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.294010 (+109895us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:46.294043 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.294175 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.049410 (+1755235us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:48.051537 (+  2127us) raft_consensus.cc:1685] finished
0709 13:08:48.051563 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.051851 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":9594,"spinlock_wait_cycles":10199936,"thread_start_us":81084,"threads_started":1,"wal-append.queue_time_us":137898}
W20260709 13:08:48.074093 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53045.5us
I20260709 13:08:48.046902 15302 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.028162 17514 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:48.005017 17457 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.086630 17466 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:48.088584 17475 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:48.085824 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:48.100517 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73263.6us
I20260709 13:08:48.103447 15302 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:48.111236 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 91187.7us
I20260709 13:08:48.112574 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.082994 17469 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.117637 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.114142 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:48.120508 15971 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.519s (SENT)
I20260709 13:08:48.091661 17512 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.105351 17179 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.125715 17241 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:48.090363 17514 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:48.131887 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:48.132164 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:48.136895 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:48.145339 15224 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:48.149426 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:48.150573 15232 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.107839 17427 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.153076 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.123822 17474 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:48.144105 17514 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.134117 17241 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.111086 17422 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:08:48.166224 17523 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.151700 17475 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.175314 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:48.180809 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 66734.5us
I20260709 13:08:48.170034 17527 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:08:48.126919 17469 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.193889 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:48.136257 17179 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.200449 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:48.209407 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:48.193720 17241 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:48.215826 15224 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:48.242342 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:48.211148 15274 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.233737 17518 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:48.234259 17517 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:48.238148 15971 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.864s (SENT)
W20260709 13:08:48.236650 17443 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.914s	user 0.011s	sys 0.020s
I20260709 13:08:48.164373 17418 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:08:48.196638 17497 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.267378 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66898.5us
I20260709 13:08:48.268687 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:48.272444 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61406.6us
I20260709 13:08:48.273615 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.274663 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:48.284610 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.238734 17450 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.244928 17518 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.361335 15231 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:48.388974 17466 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:48.360847 17481 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.400766 17179 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.271132 17508 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.403160 17508 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.280182 17497 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.405895 17469 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.406869 17497 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.283536 17520 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.394894 17518 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.252681 17332 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:48.393842 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 115594us
I20260709 13:08:48.411221 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:48.411520 15231 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:48.276398 17524 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.424419 17524 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.426146 17366 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.426852 17524 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.277985 17488 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.427117 15230 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:48.430640 17516 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.420509 17534 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.421458 17414 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:48.421978 17522 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:48.422714 17457 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.206923 17523 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.432531 17427 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:48.418615 17332 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:48.468096 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:48.469388 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:48.470352 15374 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.435079 17504 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.435860 17536 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:48.472379 17513 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.472759 17536 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:48.436892 17491 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:48.440526 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.412866 17450 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.446300 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.456488 17509 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.458024 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 307) took 2126 ms. Trace:
W20260709 13:08:48.458309 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 183668us
I20260709 13:08:48.461762 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:48.462649 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.463629 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.480449 16007 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:48.481021 15375 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:48.464541 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.466728 17523 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.467514 17397 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.472656 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.395308 17474 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.475701 15302 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:08:48.478801 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:48.478999 15381 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:48.483942 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.474337 17289 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.579564 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.480024 15373 rpcz_store.cc:276] 0709 13:08:46.332592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.361752 (+ 29160us) service_pool.cc:224] Handling call
0709 13:08:46.362199 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.362894 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.362927 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.363460 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.516826 (+153366us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:46.516875 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.516958 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.441612 (+1924654us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b2400204218. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a77fb0 00007f2f536ee488 00007f2f536eebe8 00007f2f536c6398 00007f2f536c176a 00007f2f536c0bb6
0709 13:08:48.445716 (+  4104us) raft_consensus.cc:1685] finished
0709 13:08:48.445740 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.457941 (+ 12201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1502,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":54677376,"thread_start_us":152948,"threads_started":1,"wal-append.queue_time_us":356221}
I20260709 13:08:48.582010 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.582773 15373 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:48.584089 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.586871 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.587877 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:48.588115 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 470503us
I20260709 13:08:48.588264 15375 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:48.589025 15302 pending_rounds.cc:85] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 2
I20260709 13:08:48.589311 15302 pending_rounds.cc:107] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:08:48.589527 15302 raft_consensus.cc:2889] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.457695 17481 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:08:48.580633 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 96831.5us
I20260709 13:08:48.451207 17414 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.598080 17414 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.598310 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:48.595705 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.613160 15374 raft_consensus.cc:2410] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:48.621933 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.624033 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.452482 17461 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.486690 17516 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:48.627766 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.585821 17522 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.627198 15374 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:48.629881 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:48.462683 17427 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 13:08:48.591838 17524 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.487314 17491 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.139s
I20260709 13:08:48.633116 15379 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:48.637264 15375 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:48.491607 17501 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.638823 17537 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.634888 17466 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:48.489306 17536 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.662325 17466 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.473955 17534 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:48.636595 17476 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.007s
I20260709 13:08:48.665171 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 236) took 1963 ms. Trace:
I20260709 13:08:48.687271 15225 raft_consensus.cc:2368] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:48.495698 17450 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.686616 15226 rpcz_store.cc:276] 0709 13:08:46.702133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.703724 (+  1591us) service_pool.cc:224] Handling call
0709 13:08:46.723317 (+ 19593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.786320 (+ 63003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.786353 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.795440 (+  9087us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.172062 (+1376622us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b18003bb060. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:08:48.452617 (+280555us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:48.452660 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.452742 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.664730 (+211988us) raft_consensus.cc:1685] finished
0709 13:08:48.664753 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.665040 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66753,"raft.queue_time_us":63316,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":20914,"spinlock_wait_cycles":2337024,"thread_start_us":276450,"threads_started":1,"wal-append.queue_time_us":1853367}
I20260709 13:08:48.686980 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.637954 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1624) took 2055 ms. Trace:
W20260709 13:08:48.631151 17506 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.001s
I20260709 13:08:48.487027 17532 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:48.634912 17360 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:08:48.622274 17481 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.614144 17397 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.695463 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.696059 16007 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:08:48.698683 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76918.3us
I20260709 13:08:48.694041 15302 rpcz_store.cc:276] 0709 13:08:46.571524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.571726 (+   202us) service_pool.cc:224] Handling call
0709 13:08:46.572115 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.046470 (+1474355us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4c004f1400. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f51df2a20 00007f2f51e03a29 00007f2f51dc9644 00007f2f51df0f2d 00007f2f51df0b93 00007f2f53b2118b 00007f2f53b21cb5 00007f2f53b1cf30 00007f2f53b1e7de 00007f2f53b28b49 00007f2f53b29416
0709 13:08:48.625478 (+579008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.626677 (+  1199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4329856}
I20260709 13:08:48.670715 17427 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:48.717490 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:48.695216 17445 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.671178 17486 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:48.710039 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.662460 17501 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:48.678356 17286 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.000s
I20260709 13:08:48.708768 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.668642 17541 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:48.717036 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:48.720613 15374 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:48.694378 17475 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.731218 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:48.733225 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:48.679417 17241 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.680523 17524 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.758823 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.690486 17476 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.759354 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:48.718158 17504 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:48.717664 17427 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:48.726560 17513 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:48.760747 15373 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:08:48.765977 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48549.3us
I20260709 13:08:48.764966 17501 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.722014 17541 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:48.720060 17486 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:48.782393 15378 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:48.761818 15374 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:48.728248 17522 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.780932 15380 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:08:48.706418 17506 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.783303 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:48.734517 17457 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:48.786124 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 63162.7us
I20260709 13:08:48.755728 17532 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:48.727103 17286 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.795142 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:48.756505 17461 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:48.805893 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.778668 17542 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.784025 17505 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.810099 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:48.782631 17541 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:48.832484 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.823597 15300 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:48.814204 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.814536 15302 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:08:48.814723 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.834995 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.835937 15302 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:48.817709 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:48.820832 17442 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 2.513s	user 0.012s	sys 0.019s
I20260709 13:08:48.822494 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.823097 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.841002 15307 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.807785 17501 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:08:48.798554 17488 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.844224 15308 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:48.826004 17534 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.826437 17513 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.846127 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.846925 15301 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.826774 17286 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:48.829579 15232 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.677s	user 0.014s	sys 0.001s
I20260709 13:08:48.806069 17491 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:48.829952 17520 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.830725 15305 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:48.830314 17505 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:48.831768 17506 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:48.804852 17457 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:48.843101 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.825162 17450 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:48.818092 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.829751 17289 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:48.848081 15232 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:48.860448 15304 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 3: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:48.849395 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.860761 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:48.829579 17514 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.005s
W20260709 13:08:48.866998 17543 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:08:48.868188 17545 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:08:48.872053 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.850837 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.852659 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.874137 15308 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:48.874356 15300 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:48.875080 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.860985 15303 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.849977 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:48.861725 15302 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.873061 15305 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:48.878542 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.879119 15308 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.882066 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:48.850485 17491 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:48.883823 15307 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:48.881172 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.887339 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.888048 15304 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.882526 15305 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:48.816172 17427 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.852190 17513 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.872974 17486 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:48.875396 17514 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:49.082875 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:48.977036 15308 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:48.892486 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:49.424576 15374 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:49.426095 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:49.429787 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:48.922544 15304 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:48.997314 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:48.951150 15302 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:49.031210 15303 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:48.899116 15301 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:49.446290 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:49.405682 17427 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.985395 17457 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:49.406183 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 472636us
I20260709 13:08:48.893708 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:49.537981 15305 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.920769 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:49.407649 17522 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.002s
I20260709 13:08:48.991863 17476 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:48.991051 17414 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:49.102587 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.610174 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.447889 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:49.611581 15301 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:49.612977 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:49.613833 15301 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:49.404269 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:49.448938 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:49.615345 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:49.616587 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:49.450162 15308 raft_consensus.cc:2376] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4. Re-sending same reply.
I20260709 13:08:49.513079 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:49.618870 15376 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.887702 17491 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:49.570823 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:49.580262 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:49.287339 17518 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.879s	user 0.010s	sys 0.004s
I20260709 13:08:49.656173 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:49.657055 15308 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:49.658085 15225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1709) took 1689 ms (client timeout 1830 ms). Trace:
W20260709 13:08:49.658560 15225 rpcz_store.cc:269] 0709 13:08:47.969126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.975938 (+  6812us) service_pool.cc:224] Handling call
0709 13:08:49.657767 (+1681829us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54002d0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:49.657968 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616263552}
I20260709 13:08:49.660696 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:49.669222 15303 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:48.975461 17479 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.709s	user 0.007s	sys 0.027s
I20260709 13:08:49.279601 17540 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:49.630457 15304 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:48.922617 17505 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:48.989429 17515 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:49.725263 17515 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:49.730777 15376 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:49.684114 15382 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:49.607304 17522 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.916160 17548 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.780s
I20260709 13:08:49.721086 15308 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:48.927852 17397 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:49.605175 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65131.8us
I20260709 13:08:49.745905 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:49.746227 17515 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:49.747967 17548 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:49.572640 17549 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.295s
W20260709 13:08:49.787678 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 480396us
W20260709 13:08:49.797595 15971 leader_election.cc:336] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.923s (SENT)
I20260709 13:08:49.798128 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:49.674216 17518 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:49.803546 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1625) took 3062 ms. Trace:
I20260709 13:08:49.804699 15306 rpcz_store.cc:276] 0709 13:08:46.740801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.741090 (+   289us) service_pool.cc:224] Handling call
0709 13:08:46.764296 (+ 23206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.764853 (+   557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.764894 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.795815 (+ 30921us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.020095 (+224280us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:47.020149 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.020260 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.438707 (+1418447us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b18002f4a00. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:08:48.928360 (+489653us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:49.802924 (+874564us) raft_consensus.cc:1685] finished
0709 13:08:49.802975 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.803327 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91494,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"spinlock_wait_cycles":15682048,"thread_start_us":159912,"threads_started":1,"wal-append.queue_time_us":343480}
W20260709 13:08:49.799250 17542 consensus_meta.cc:287] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.000s
I20260709 13:08:48.888159 17532 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:49.771907 17548 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:49.790377 17537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.023s	sys 0.081s
I20260709 13:08:49.808027 15301 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:49.769222 15303 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:49.761993 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:49.822549 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.826637 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64764.8us
W20260709 13:08:49.815985 17445 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.094s	user 0.012s	sys 0.000s
I20260709 13:08:49.835041 15305 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:49.836580 15304 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:49.817641 17542 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.739671 17540 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:49.838289 17332 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.832050 17475 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:49.831638 17466 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:49.844664 17332 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:49.850275 17514 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:49.867100 15300 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:49.860381 17475 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:49.872825 17388 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.864353 17414 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:49.890998 17541 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.058s	user 0.012s	sys 0.002s
I20260709 13:08:49.894557 17541 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:49.893878 17518 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:49.892292 17388 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:49.859863 17466 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:49.862862 17513 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:49.924064 17551 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:08:49.955940 17524 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:50.212452 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.215969 15198 connection.cc:256] RPC call timeout handler was delayed by -1.1348189240000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
W20260709 13:08:50.216533 15198 connection.cc:256] RPC call timeout handler was delayed by -1.0739799200000562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 13:08:50.217535 17524 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:50.218127 17524 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.220254 17524 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.220996 17524 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.223376 17524 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:50.229929 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:50.231926 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.232501 17524 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.233286 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.234112 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.234464 17524 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:50.235025 17524 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.235447 17524 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.235733 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.236586 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.237787 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.248674 17483 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:50.249253 17483 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.249603 17483 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:50.263726 15382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1595) took 1812 ms (client timeout 1822 ms). Trace:
W20260709 13:08:50.265066 15382 rpcz_store.cc:269] 0709 13:08:48.451421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.451550 (+   129us) service_pool.cc:224] Handling call
0709 13:08:50.263417 (+1811867us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540023dcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.263591 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2761015552}
I20260709 13:08:50.267061 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:50.268360 15382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1568) took 1378 ms (client timeout 1696 ms). Trace:
W20260709 13:08:50.268973 15382 rpcz_store.cc:269] 0709 13:08:48.890177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.266673 (+1376496us) service_pool.cc:224] Handling call
0709 13:08:50.268269 (+  1596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.270709 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:50.274629 15382 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
W20260709 13:08:50.272218 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.283074 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.285059 17564 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.285660 17564 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.286069 17564 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.291290 15375 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:50.293598 15382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1566) took 1397 ms (client timeout 1753 ms). Trace:
I20260709 13:08:50.295519 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 238) took 2181 ms. Trace:
W20260709 13:08:50.300549 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62805.2us
I20260709 13:08:50.296562 17571 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.294598 17564 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.312458 17564 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.313383 17564 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.314424 17564 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:50.314733 17564 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:50.303236 17558 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:50.317016 17558 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:50.317996 17558 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.304060 17401 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:50.319218 17401 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.319660 17401 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:50.298323 17331 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.323139 17331 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:50.307528 15382 rpcz_store.cc:269] 0709 13:08:48.889341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.270257 (+1380916us) service_pool.cc:224] Handling call
0709 13:08:50.286331 (+ 16074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.304848 15229 rpcz_store.cc:276] 0709 13:08:48.114307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.114568 (+   261us) service_pool.cc:224] Handling call
0709 13:08:48.115274 (+   706us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:50.239932 (+2124658us) spinlock_profiling.cc:243] Waited 909 us on lock 0x7b180038e8a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b1ebfb 00007f2f53b2964b
0709 13:08:50.240107 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.240135 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:50.241065 (+   930us) log.cc:844] Serialized 52 byte log entry
0709 13:08:50.294854 (+ 53789us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:50.294911 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.295015 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.295073 (+    58us) raft_consensus.cc:1685] finished
0709 13:08:50.295090 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.295409 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9198,"raft.queue_time_us":36540,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":11124,"spinlock_wait_cycles":2090880,"thread_start_us":114188,"threads_started":2,"wal-append.queue_time_us":42240}
I20260709 13:08:50.309954 17571 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.326908 17571 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.327422 17483 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.328615 17331 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.329262 17331 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:50.329778 17331 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.330418 17524 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.332005 17331 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.332713 17524 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.315550 17564 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.300145 17563 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:50.345661 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:50.346061 17563 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:50.345453 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:50.347179 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1571) took 1456 ms. Trace:
I20260709 13:08:50.347494 17563 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.347822 15382 rpcz_store.cc:276] 0709 13:08:48.890626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.340462 (+1449836us) service_pool.cc:224] Handling call
0709 13:08:50.347103 (+  6641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.349615 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:50.350592 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1564) took 1461 ms. Trace:
I20260709 13:08:50.350980 15382 rpcz_store.cc:276] 0709 13:08:48.888818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.349225 (+1460407us) service_pool.cc:224] Handling call
0709 13:08:50.350522 (+  1297us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:50.351647 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.352489 17564 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:50.355062 17491 consensus_meta.cc:287] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.006s
I20260709 13:08:50.355486 17491 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.329624 17483 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.357698 15382 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:50.343724 17331 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.356747 17460 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:50.360491 17460 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.362753 17483 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:50.359019 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1561) took 1471 ms. Trace:
I20260709 13:08:50.356173 17486 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.364042 15382 rpcz_store.cc:276] 0709 13:08:48.888036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.351736 (+1463700us) service_pool.cc:224] Handling call
0709 13:08:50.352136 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.358659 (+  6523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.358936 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.363406 17483 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.369216 15382 raft_consensus.cc:1217] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 5.3->[]
I20260709 13:08:50.374516 15382 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:08:50.376784 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1562) took 1488 ms. Trace:
I20260709 13:08:50.377545 15382 rpcz_store.cc:276] 0709 13:08:48.888319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.368799 (+1480480us) service_pool.cc:224] Handling call
0709 13:08:50.369133 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:50.376258 (+  7125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.376675 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.363500 17460 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.421878 17491 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:50.364440 17331 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.432860 17331 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.433543 17331 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:50.434094 15373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1602) took 1966 ms (client timeout 1837 ms). Trace:
W20260709 13:08:50.434770 15373 rpcz_store.cc:269] 0709 13:08:48.467596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.583735 (+116139us) service_pool.cc:224] Handling call
0709 13:08:50.433794 (+1850059us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b540027b5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.433981 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404518144}
I20260709 13:08:50.368113 17563 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.434033 17331 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.440466 15382 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:50.442127 17401 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.444648 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1563) took 1556 ms. Trace:
I20260709 13:08:50.445006 15382 rpcz_store.cc:276] 0709 13:08:48.888588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.378856 (+1490268us) service_pool.cc:224] Handling call
0709 13:08:50.440279 (+ 61423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.444375 (+  4096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.444582 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.438342 17470 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:50.458426 17576 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:50.458612 17577 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.372128 17571 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.462035 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.462448 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.464586 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.466293 15229 raft_consensus.cc:2368] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:08:50.467191 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.466300 15225 raft_consensus.cc:2368] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6.
I20260709 13:08:50.469941 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.472708 17571 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.467270 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.474625 15229 raft_consensus.cc:2368] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:08:50.483114 15232 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:50.444214 17483 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:50.460450 17331 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.487870 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:50.489323 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.000s	sys 0.017s
W20260709 13:08:50.490427 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.000s	sys 0.017s
W20260709 13:08:50.490763 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 684902us
I20260709 13:08:50.492092 15229 raft_consensus.cc:2376] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6. Re-sending same reply.
W20260709 13:08:50.492436 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.478529 17466 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:50.493840 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.494886 15232 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:50.476393 17576 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.497187 17563 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.498054 17576 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.473985 17470 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.499104 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1590) took 2057 ms. Trace:
I20260709 13:08:50.500538 17470 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:50.504160 15971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.010s	sys 0.019s
I20260709 13:08:50.500168 15381 rpcz_store.cc:276] 0709 13:08:48.442169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.442364 (+   195us) service_pool.cc:224] Handling call
0709 13:08:48.442804 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.581382 (+138578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.498694 (+1917312us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400224054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:50.499006 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82639232}
W20260709 13:08:50.504941 15971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.011s	sys 0.019s
W20260709 13:08:50.505818 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 708201us
I20260709 13:08:50.510735 17576 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.511488 17470 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.512079 17578 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:50.483873 17577 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.517266 17578 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.518447 15229 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:50.518222 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:50.520064 15231 raft_consensus.cc:1217] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 5.3->[]
I20260709 13:08:50.518049 17470 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.513136 17576 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.521242 15231 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:08:50.490180 17401 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.508709 17331 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.523561 17340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.724s	user 0.010s	sys 0.031s
W20260709 13:08:50.551393 17340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.752s	user 0.011s	sys 0.032s
I20260709 13:08:50.551517 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.542035 17555 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.552433 17578 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.553035 17578 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.553541 17578 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.554946 17576 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.555493 17578 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.555593 17576 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.556131 17576 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.554839 17577 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.560576 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.561972 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.562810 15231 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:50.563766 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:50.568640 15229 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:50.570768 15374 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:50.571585 15225 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:50.571878 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1570) took 1681 ms. Trace:
I20260709 13:08:50.557642 17577 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.568854 17555 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:50.572494 15382 rpcz_store.cc:276] 0709 13:08:48.890488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.445579 (+1555091us) service_pool.cc:224] Handling call
0709 13:08:50.445805 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.445958 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:50.521682 (+ 75724us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.571194 (+ 49512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.571252 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:50.571304 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.571378 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.571529 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":116044,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":182,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"thread_start_us":107345,"threads_started":2}
I20260709 13:08:50.574206 15229 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:50.571686 17557 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:50.582031 17578 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.582293 17557 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:50.582629 17578 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.585843 17577 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.591233 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.592002 15225 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 2.
I20260709 13:08:50.553556 17331 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:08:50.582650 17557 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:50.597231 17578 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.604761 17413 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:50.606024 17557 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.607605 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.611059 17557 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.608652 17413 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.612792 17413 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.610162 17470 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.609098 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1557) took 4282 ms. Trace:
I20260709 13:08:50.613744 15377 rpcz_store.cc:276] 0709 13:08:46.327255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.355688 (+ 28433us) service_pool.cc:224] Handling call
0709 13:08:46.355995 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:46.747262 (+391267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.608784 (+3861522us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400224a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:50.609009 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850039552}
I20260709 13:08:50.614485 17331 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:50.616721 17413 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.630518 15225 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:50.630319 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.632123 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.632256 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.633126 15225 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.633848 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.634676 15231 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:50.635594 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:50.628019 15300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 143) took 1759 ms (client timeout 2194 ms). Trace:
I20260709 13:08:50.639313 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.641067 15231 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:50.637101 15300 rpcz_store.cc:269] 0709 13:08:48.868091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.892724 (+ 24633us) service_pool.cc:224] Handling call
0709 13:08:50.627764 (+1735040us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.627902 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480005888}
W20260709 13:08:50.642266 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76738.1us
I20260709 13:08:50.649703 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.650504 15228 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:50.650681 15229 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:50.643594 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:50.658327 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.658718 17413 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:50.659418 15228 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:50.660194 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.661885 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.663276 15228 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:50.673579 15225 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:50.673779 17516 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:50.674373 17516 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:50.674567 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.675403 15225 raft_consensus.cc:2368] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:50.676194 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:50.677368 15380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1596) took 2212 ms (client timeout 1528 ms). Trace:
W20260709 13:08:50.677874 15380 rpcz_store.cc:269] 0709 13:08:48.465495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.495002 (+ 29507us) service_pool.cc:224] Handling call
0709 13:08:50.677109 (+2182107us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54003c3f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.677271 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460855168}
I20260709 13:08:50.678557 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.682178 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.682673 15274 leader_election.cc:400] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:08:50.683382 15231 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:50.683727 15274 leader_election.cc:400] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6.
I20260709 13:08:50.683736 15225 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:08:50.684640 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.675525 17516 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.685688 15228 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:50.686034 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.689813 15274 leader_election.cc:400] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:08:50.690764 17413 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:50.697176 17586 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:50.698503 17589 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:50.694021 17516 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.709897 17586 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:50.710391 17586 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:08:50.710810 17532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.019s	sys 0.019s
W20260709 13:08:50.711213 17532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.019s	sys 0.019s
I20260709 13:08:50.700474 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.700703 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 152) took 1674 ms. Trace:
I20260709 13:08:50.711410 17586 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.712994 15304 rpcz_store.cc:276] 0709 13:08:49.026667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.724510 (+697843us) service_pool.cc:224] Handling call
0709 13:08:49.836054 (+111544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.837093 (+  1039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.700483 (+863390us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400128c50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.700637 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255374592}
I20260709 13:08:50.715557 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.705734 17139 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.720809 17523 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:50.722066 17523 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.717092 17541 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:50.722458 17523 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:50.718119 17419 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.723914 17419 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.726145 17331 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.726595 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.726819 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.727046 17578 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:50.727695 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:50.727957 17578 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:50.728343 17578 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.728758 17578 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.702394 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.730610 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.732028 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.732738 15232 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:50.726619 17331 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.733903 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.734735 15232 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:50.735090 17331 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.735594 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.739866 15224 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:50.740547 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.742805 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.747728 15231 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:50.749405 15231 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 6. Ops: []
I20260709 13:08:50.750746 15231 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:50.753873 15231 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:50.748203 17241 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:50.757879 17419 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:50.758476 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.760943 17523 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.726760 17470 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:50.763044 17332 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.735751 17331 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:50.766594 17331 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:50.768929 17523 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.769758 17331 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:50.766987 17427 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.182s	user 0.017s	sys 0.000s
I20260709 13:08:50.779366 17540 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:50.780700 17331 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.787678 15376 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:08:50.790283 15376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1559) took 1902 ms (client timeout 1696 ms). Trace:
W20260709 13:08:50.790855 15376 rpcz_store.cc:269] 0709 13:08:48.887486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.745490 (+858004us) service_pool.cc:224] Handling call
0709 13:08:50.790014 (+1044524us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540027bad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.790190 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336664832}
I20260709 13:08:50.799422 17537 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.800732 17537 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.802048 17537 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:50.802170 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:50.802522 17537 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:50.803061 17537 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.803097 16007 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:50.805058 17558 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.805183 16001 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:50.811295 17537 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.712649 17413 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.814128 17360 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:50.818212 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:50.819103 15999 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:50.819325 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:50.820025 16008 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:50.802277 17412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.010s	sys 0.006s
W20260709 13:08:50.819353 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.820701 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 151504us
W20260709 13:08:50.821168 17412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.010s	sys 0.007s
I20260709 13:08:50.814587 17537 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.824838 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:50.826001 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:50.828822 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:50.829584 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.831712 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:50.831754 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.829638 16001 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:50.822816 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.834244 17397 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:50.834739 17397 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:50.834605 17139 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.835356 17139 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.832603 16007 raft_consensus.cc:2368] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:08:50.835812 17139 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.837484 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1591) took 2391 ms. Trace:
W20260709 13:08:50.837627 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.837926 15378 rpcz_store.cc:276] 0709 13:08:48.445780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.445986 (+   206us) service_pool.cc:224] Handling call
0709 13:08:50.837306 (+2391320us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54003c4454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.837421 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702935424}
W20260709 13:08:50.838358 15273 connection.cc:256] RPC call timeout handler was delayed by -1.813296651000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2554s for a response
W20260709 13:08:50.839010 15273 connection.cc:256] RPC call timeout handler was delayed by -1.0248487790000809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:08:50.841804 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:50.843406 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:50.845703 16008 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:50.845973 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.835721 17397 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.851799 17518 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:50.852283 17397 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.853272 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:50.854372 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.855306 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.855509 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.856562 17527 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.857079 17527 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:50.857327 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:50.851866 17549 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:50.858836 17536 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:50.858803 17549 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.858168 17527 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.859733 17536 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:50.861025 15379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1593) took 2412 ms (client timeout 2119 ms). Trace:
W20260709 13:08:50.861501 15379 rpcz_store.cc:269] 0709 13:08:48.448993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.449186 (+   193us) service_pool.cc:224] Handling call
0709 13:08:50.860798 (+2411612us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54004056d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:50.860951 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330941312}
I20260709 13:08:50.862459 17536 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:50.862968 15373 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:50.856981 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.856891 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.882272 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:50.885691 16007 raft_consensus.cc:2368] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:50.885600 15231 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 2.
I20260709 13:08:50.887857 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:50.890863 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:50.892832 15348 connection.cc:256] RPC call timeout handler was delayed by -1.5016538720000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:08:50.893258 15348 connection.cc:256] RPC call timeout handler was delayed by -1.2505538719999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 13:08:50.893579 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.896275 15348 leader_election.cc:400] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:50.897209 15348 leader_election.cc:400] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:50.897626 15348 leader_election.cc:403] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:50.898939 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.899293 15232 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:50.901131 15348 leader_election.cc:400] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:50.884678 17445 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:50.902696 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.902961 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:50.874577 17523 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:50.892068 17536 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.893298 17540 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:50.822974 17578 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.902016 17516 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.905920 17523 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:50.905164 17541 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:50.927264 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800035ba0 after lost signal to thread 14100
I20260709 13:08:50.913219 17445 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:50.943758 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 199973us
I20260709 13:08:50.944578 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:50.949319 15232 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:50.950318 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47911.1us
I20260709 13:08:50.920389 17540 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.939028 17592 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:50.954607 17541 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:50.967163 17592 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.968128 17541 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.970254 17592 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:50.970877 17592 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.971340 17592 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.973865 17477 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:50.974648 17477 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:50.975098 17477 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:50.977839 17591 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:50.978223 17591 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.978634 17591 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:49.916793 17475 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.961910 17445 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.962271 17523 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:50.982649 17523 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.962289 17578 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:50.918658 17536 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.963198 17549 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:50.986680 17536 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:50.964184 17139 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:50.965035 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:50.992913 16005 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:50.993937 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:50.996552 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:50.999109 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:50.990281 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 146926us
I20260709 13:08:50.999922 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.005118 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.007266 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:50.999894 17241 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:51.009776 17514 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:51.013365 17514 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.013841 17514 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.975968 17477 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.004196 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:51.022123 15273 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.540s (SENT)
I20260709 13:08:50.998483 17466 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:08:51.024698 17331 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:51.025372 17331 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.026616 17540 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:51.027011 15273 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.696s (SENT)
I20260709 13:08:51.027195 17422 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.027460 17331 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:51.027562 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.030196 17516 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:51.032251 17422 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.032749 17139 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.009948 17536 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:51.036751 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 92251.5us
I20260709 13:08:51.038633 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.011193 17532 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:08:51.049067 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.038765 17331 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.038340 17139 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:51.041797 17536 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:51.048272 17578 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:51.050729 15274 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.053928 16000 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:08:51.077656 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.084107 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.093119 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.086009 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.612s (SENT) [suppressed 29 similar messages]
I20260709 13:08:51.097955 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:51.100651 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.101655 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:51.105660 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.106662 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.107264 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.109944 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.097179 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:51.111713 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.111979 15228 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:51.113255 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.114564 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.062474 17578 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.120319 15274 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:51.055418 17139 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:51.118502 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 106986us
I20260709 13:08:51.117316 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.124504 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:51.130479 15231 raft_consensus.cc:2376] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6. Re-sending same reply.
I20260709 13:08:51.130688 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:51.131438 15228 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.115260 15233 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:51.127151 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:51.132328 16002 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.091228 17499 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:51.096179 17331 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.135895 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.136930 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.125293 17578 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:51.121858 17532 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.141227 17499 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.150039 15228 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:51.150754 17499 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.126036 17549 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.151541 17549 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.152107 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:51.152410 17537 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:51.153163 17537 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:51.153532 17549 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.154525 17537 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.155700 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.158598 17577 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.159617 17577 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.138733 17241 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:51.161052 17241 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.163403 17241 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.139823 17331 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.164520 17331 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.140019 17397 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.167862 17397 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.155107 17527 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.170555 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.171330 17527 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.150777 15232 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:51.115250 17588 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:51.175369 17425 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:51.175700 15347 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.570s	user 0.003s	sys 0.032s
I20260709 13:08:51.176410 15225 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:51.177640 15225 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:51.128881 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:51.144500 16002 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:51.137782 17475 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.135196 17516 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:51.191598 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.175705 17536 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:51.198822 15347 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.593s	user 0.004s	sys 0.032s
I20260709 13:08:51.200641 15228 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:51.202654 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:51.203610 15231 raft_consensus.cc:2368] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:51.140734 17602 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:08:51.160185 17514 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.209573 15378 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:51.210122 15348 leader_election.cc:400] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:51.210803 15376 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:51.210803 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.211057 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.319017 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.319469 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:51.297137 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.216790 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.216511 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.320673 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:51.320808 15381 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:51.321470 15348 leader_election.cc:403] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:51.280292 17241 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:51.226326 17139 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.242228 17592 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:51.220789 15345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.390s	user 0.017s	sys 0.002s
I20260709 13:08:51.235086 15228 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:08:51.240772 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.204476 17476 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:08:51.247339 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.224174 17448 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.259115 17499 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:51.244138 17586 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.217366 17527 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:51.274097 17594 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.317s	user 0.005s	sys 0.000s
I20260709 13:08:51.266753 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:51.203706 17397 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:51.229436 15374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1565) took 2340 ms (client timeout 1540 ms). Trace:
I20260709 13:08:51.234356 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1600) took 2767 ms. Trace:
W20260709 13:08:51.226222 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800035ae0 after lost signal to thread 15165
I20260709 13:08:51.223969 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.180421 17532 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.243394 17331 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.222043 17591 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.260012 17427 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:51.192188 17537 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.205948 17475 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.283249 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.389550 15303 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:51.286600 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.390879 15308 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:51.281236 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.284022 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.285666 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.282552 15305 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:51.273846 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:51.293411 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1569) took 2403 ms. Trace:
W20260709 13:08:51.197297 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 77131.6us
I20260709 13:08:51.394037 15373 rpcz_store.cc:276] 0709 13:08:48.890349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.439801 (+1549452us) service_pool.cc:224] Handling call
0709 13:08:50.862790 (+422989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.863420 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.293175 (+429755us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54004056d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:51.293339 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922773760}
I20260709 13:08:51.394892 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:51.296259 17466 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:51.289393 15227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1714) took 3318 ms (client timeout 1551 ms). Trace:
I20260709 13:08:51.284816 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.399365 15306 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:51.268518 17549 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.246762 17576 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:51.321419 15376 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.191064 17516 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.323009 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.318300 15380 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:51.323329 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:51.407485 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.408396 15373 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:51.408597 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.324491 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:51.326876 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.408607 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.331669 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.322734 17289 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:08:51.343514 15345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.513s	user 0.021s	sys 0.004s
W20260709 13:08:51.412879 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.346844 15374 rpcz_store.cc:269] 0709 13:08:48.889072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.425701 (+536629us) service_pool.cc:224] Handling call
0709 13:08:51.229212 (+1803511us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001b99d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:51.229362 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2571043072}
I20260709 13:08:51.347069 15375 rpcz_store.cc:276] 0709 13:08:48.466958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.775967 (+309009us) service_pool.cc:224] Handling call
0709 13:08:48.784719 (+  8752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.291870 (+1507151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.233931 (+942061us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400080554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:51.234252 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3464205184}
I20260709 13:08:51.348261 15230 raft_consensus.cc:2368] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4.
I20260709 13:08:51.414940 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:51.415793 15374 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.347505 15382 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:51.341085 17139 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:51.342859 17499 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.357663 17514 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:51.360946 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.363406 17548 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.364573 17332 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:51.327513 17578 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.350797 17527 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:51.327648 17241 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.366602 17591 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:51.367825 15224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1724) took 3179 ms (client timeout 2052 ms). Trace:
I20260709 13:08:51.373646 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.374195 17532 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:51.427717 15224 rpcz_store.cc:269] 0709 13:08:48.188429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.241939 (+ 53510us) service_pool.cc:224] Handling call
0709 13:08:51.367616 (+3125677us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b54000109d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:51.367739 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5741598080}
W20260709 13:08:51.428987 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55415.7us
I20260709 13:08:51.380277 17558 consensus_queue.cc:1059] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:51.436841 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:51.384716 17481 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.441501 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.396865 15307 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:08:51.397469 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.397078 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:51.398406 15227 rpcz_store.cc:269] 0709 13:08:47.970778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.970972 (+   194us) service_pool.cc:224] Handling call
0709 13:08:51.289041 (+3318069us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54003ce454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:51.289252 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623393664}
I20260709 13:08:51.398195 17466 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:51.323194 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 112734us
W20260709 13:08:51.448094 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 51142.8us
I20260709 13:08:51.400857 16006 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:08:51.410104 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.451588 17591 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:51.330550 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 83278.3us
I20260709 13:08:51.452023 17331 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:51.453446 17591 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:51.457501 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:51.457759 17516 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.425601 17475 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.458922 17475 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.459759 17360 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:51.460376 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:51.460831 17360 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:51.461033 16001 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:51.461205 17360 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:51.462116 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:51.417543 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.401070 17470 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:51.462033 17475 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.379101 17422 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:51.462080 17360 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.463915 17601 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:51.464717 17360 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.464762 17601 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:51.434695 17588 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.436739 17499 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.472105 15377 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:51.442081 15373 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:51.441040 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.474004 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.451033 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.459681 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:51.465339 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.431501 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0222921290001068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 13:08:51.389127 17427 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.425968 17139 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:51.411321 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:51.479364 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68126.1us
I20260709 13:08:51.424717 17332 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:51.474207 15303 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:08:51.478920 17510 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.481854 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.476935 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.482721 15303 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:51.426635 17527 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:51.409009 17549 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.475616 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:51.475973 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.457000 17466 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.494891 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.494906 17413 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:51.498845 15303 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:51.501528 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.502156 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:51.512598 15376 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:51.513775 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.479462 17548 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.517828 15374 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:08:51.519434 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.519513 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:51.524071 15380 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:51.524778 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:51.499782 17541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.030s
I20260709 13:08:51.485433 17401 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:51.525657 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.499734 17470 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.543460 17470 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.543205 17139 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.543972 17470 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.520193 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.527683 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:51.524506 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:51.482120 17481 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.466318 17601 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.527788 17532 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:51.532380 17527 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.534438 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:51.565376 15378 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.536204 17241 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.536407 17513 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:51.558310 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80847us
I20260709 13:08:51.538784 17505 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.531054 17541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.030s
I20260709 13:08:51.527551 17540 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:51.541101 17578 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:51.542289 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.542564 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.618568 15303 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:51.510803 17510 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:51.552644 16005 raft_consensus.cc:2368] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:08:51.522131 17499 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:51.554104 17422 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:51.518286 17445 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.558074 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:51.569113 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82417.8us
I20260709 13:08:51.570724 15377 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:08:51.640792 15373 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:51.567571 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.511735 17493 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:08:51.530107 17401 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.631098 15378 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:08:51.632583 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 90400.8us
I20260709 13:08:51.556258 17427 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.654371 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.656327 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.657337 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:51.645351 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77867.4us
W20260709 13:08:51.646541 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.560077 17481 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:51.649787 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:51.665517 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:51.623582 17289 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:51.581365 17532 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:51.665661 15303 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.660085 15378 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.631649 17601 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.673430 15274 leader_election.cc:400] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4.
I20260709 13:08:51.667249 17331 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:51.631876 17513 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:51.640241 17422 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:51.650139 15333 heartbeater.cc:646] Failed to heartbeat to 127.13.196.126:35597 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.196.126:35597 timed out after 15.000s (SENT)
I20260709 13:08:51.680298 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.681658 15373 raft_consensus.cc:2410] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:08:51.674975 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 150327us
I20260709 13:08:51.642442 17448 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.652544 17590 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.651669 17527 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.687038 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.665385 17401 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:51.682610 17331 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:51.615598 17505 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.670773 17481 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.683691 17422 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:51.700215 17610 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:08:51.701273 17513 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.661851 17499 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:51.667382 17578 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:51.667580 17576 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.637806 17510 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.758289 17331 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.759701 17510 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.762050 15376 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:51.763615 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.764966 15305 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:51.723644 15378 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:51.723948 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50815.8us
I20260709 13:08:51.729839 15303 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:51.730494 15374 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:51.733711 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.743513 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:51.733490 17475 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.695797 17532 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:51.773581 15274 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Timed out: RequestConsensusVote RPC to 127.13.196.68:44351 timed out after 2.477s (SENT)
W20260709 13:08:51.744874 17614 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:08:51.769701 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.771139 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.774246 15274 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:51.775681 15373 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:51.782068 15378 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:51.780905 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.785418 15305 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:51.786628 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:51.787528 15162 debug-util.cc:398] Leaking SignalData structure 0x7b080038ba20 after lost signal to thread 15257
W20260709 13:08:51.794901 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800037120 after lost signal to thread 15258
I20260709 13:08:51.794998 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:51.796574 15162 debug-util.cc:398] Leaking SignalData structure 0x7b080027e4a0 after lost signal to thread 15332
I20260709 13:08:51.797077 15378 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:51.797752 15162 debug-util.cc:398] Leaking SignalData structure 0x7b080037baa0 after lost signal to thread 15406
I20260709 13:08:51.791262 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:51.773706 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:51.801623 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800391960 after lost signal to thread 16032
W20260709 13:08:51.801985 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800344d20 after lost signal to thread 16033
W20260709 13:08:51.802310 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800338560 after lost signal to thread 17345
W20260709 13:08:51.802699 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800395760 after lost signal to thread 17443
W20260709 13:08:51.803020 15162 debug-util.cc:398] Leaking SignalData structure 0x7b080036f7c0 after lost signal to thread 17461
W20260709 13:08:51.803426 15162 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbe40 after lost signal to thread 17497
W20260709 13:08:51.803637 15162 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbe80 after lost signal to thread 17504
W20260709 13:08:51.803912 15162 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbf80 after lost signal to thread 17517
W20260709 13:08:51.804167 15162 debug-util.cc:398] Leaking SignalData structure 0x7b08003444e0 after lost signal to thread 17528
I20260709 13:08:51.811066 15274 leader_election.cc:400] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:08:51.811474 15274 leader_election.cc:403] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:08:51.812268 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:51.775761 17516 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.813118 15303 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:51.810145 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:51.821385 15271 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50774 dropped due to backpressure: service queue is full with 50 items
I20260709 13:08:51.783998 17588 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:51.827740 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.830555 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:51.800041 17576 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:51.833158 15305 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:51.807886 17615 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:51.762125 17499 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.816383 17536 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:51.846300 15303 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:08:51.830812 17588 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:51.863070 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:51.867946 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.868584 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.890781 17615 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.891424 17615 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:51.891821 17615 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.896083 17470 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.897253 17139 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:51.897716 17139 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:51.898738 17139 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.848510 17578 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:08:51.863152 17588 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.910530 17139 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.865061 17536 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:51.919304 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.920221 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.913157 17586 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.000s
I20260709 13:08:51.907238 17470 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.930373 15379 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:51.937517 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.940003 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.941588 17586 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:51.943260 17586 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:51.943747 17586 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:51.933842 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:51.944895 15999 raft_consensus.cc:2410] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:51.945655 17586 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.947410 17586 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.950079 17532 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:51.950907 17532 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:51.944975 16001 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.953483 15379 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:51.953733 17515 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.957369 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.958227 15379 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:51.959225 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.962234 17532 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:51.913357 17481 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.960008 15379 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:51.967111 17598 raft_consensus.cc:3055] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:51.975379 17598 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:51.990633 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.967094 17481 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:51.992154 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.993057 15377 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:51.994088 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:51.997740 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.997731 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:51.999470 15381 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:51.996222 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.002840 15377 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:52.003710 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.008549 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.011997 15381 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.991011 16001 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:52.000186 17598 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:52.015996 17598 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.012434 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.121893 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.011236 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.030900 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.031415 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.032058 15228 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:08:52.031788 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:52.128129 15233 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.128764 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.033216 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:52.130527 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.130661 15226 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
W20260709 13:08:52.042234 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.135501 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.067966 15227 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:52.123916 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.139467 15377 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
W20260709 13:08:52.141209 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.141851 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.048671 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.185640 15374 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:52.056278 17615 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:51.821902 15271 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50774 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1646)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1670)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1655)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1648)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1652)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1577)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1578)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1654)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 168)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 169)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 170)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1660)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1661)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1663)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1671)
I20260709 13:08:52.066068 15381 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:52.076443 17401 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.080626 17578 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.069026 17536 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.111487 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:52.044132 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:08:52.148727 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.156791 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.158784 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.166415 17601 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.230381 15229 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:52.231387 15226 raft_consensus.cc:2368] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:52.171474 15233 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
W20260709 13:08:52.173991 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.174700 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.179927 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.180631 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.180939 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.239933 15380 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:52.240788 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.241082 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.058930 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:08:52.337422 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 278648us
W20260709 13:08:52.339143 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.137486 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:52.341009 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 203644us
I20260709 13:08:52.342381 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.055312 17449 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.343899 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.345510 17332 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:52.345973 17332 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.346366 17332 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.186153 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.187240 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.200392 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.206667 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.160881 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.231884 15382 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:52.156740 17481 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:52.238924 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.350180 15233 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:52.350263 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.241413 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:52.256004 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.257041 15226 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:52.260910 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:52.351622 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.351524 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 110453us
I20260709 13:08:52.262421 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:52.352306 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.264977 17401 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:52.269867 17331 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:52.272312 17527 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.005s
I20260709 13:08:52.355743 15377 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:52.282056 15224 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7.
I20260709 13:08:52.356621 17331 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.356971 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.357509 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:52.358443 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:52.358786 17331 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:52.359122 15224 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:52.359442 17632 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:52.282501 17540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.008s	sys 0.007s
I20260709 13:08:52.242349 17578 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.360175 17470 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:52.360327 15229 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:52.360854 17470 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:52.361742 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 236) took 1537 ms. Trace:
I20260709 13:08:52.362478 17578 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:52.362787 17476 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.362406 17470 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:52.071918 15273 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50774 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1670)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1655)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1648)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1652)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1577)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1578)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1654)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 168)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 169)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 170)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1660)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1661)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1663)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1671)
I20260709 13:08:52.239995 17601 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.362185 15999 rpcz_store.cc:276] 0709 13:08:50.824196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.824457 (+   261us) service_pool.cc:224] Handling call
0709 13:08:52.361543 (+1537086us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540068d654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:52.361682 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553677056}
I20260709 13:08:52.344437 17445 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:52.371886 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.372193 17601 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:52.372416 17445 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:52.366027 17481 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:52.374110 17422 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.001s
I20260709 13:08:52.373944 17445 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.375804 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.376272 17588 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:52.257793 17499 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:08:52.377144 15381 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:52.377828 17499 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:52.312238 17466 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.378388 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.379109 17549 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:52.314410 15225 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:52.315069 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.285071 17620 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.378448 17499 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:52.384069 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.384984 17499 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.386579 17499 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.323248 17615 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:52.335273 15232 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:52.390338 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.391181 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.391659 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.391945 15308 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:52.327889 17505 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:52.264003 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1615) took 1002 ms. Trace:
I20260709 13:08:52.392793 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.353060 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.394351 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.343933 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1614) took 1083 ms. Trace:
I20260709 13:08:52.395032 15224 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:52.395110 15376 rpcz_store.cc:276] 0709 13:08:51.260885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.513455 (+252570us) service_pool.cc:224] Handling call
0709 13:08:52.343688 (+830233us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001fe354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:52.343812 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569255680}
I20260709 13:08:52.348409 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.354990 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:52.353840 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:52.366317 15273 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50774 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1655)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1648)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1652)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1577)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1578)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1654)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 168)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 169)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 170)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1660)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1661)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1663)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1598)
I20260709 13:08:52.374629 17481 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.376761 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:52.366444 17425 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:52.356267 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:52.398962 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 45991.8us
I20260709 13:08:52.399274 15382 raft_consensus.cc:2376] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5. Re-sending same reply.
I20260709 13:08:52.380848 15301 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.400342 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.402652 15229 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:08:52.247633 15118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 199904us
W20260709 13:08:52.283844 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 164167us
I20260709 13:08:52.406893 17601 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:52.408430 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.409956 15303 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:52.396215 15228 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.407864 17425 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:52.374774 17422 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.413667 15230 raft_consensus.cc:2368] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6.
I20260709 13:08:52.413483 17425 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.393249 15378 rpcz_store.cc:276] 0709 13:08:51.261155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.797802 (+536647us) service_pool.cc:224] Handling call
0709 13:08:51.798075 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.808618 (+ 10543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.808663 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.816581 (+  7918us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.912301 (+ 95720us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:51.912385 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.912471 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.263602 (+351131us) raft_consensus.cc:1685] finished
0709 13:08:52.263621 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.263751 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9869,"raft.queue_time_us":10911,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12420,"thread_start_us":65831,"threads_started":1,"wal-append.queue_time_us":373929}
I20260709 13:08:52.357638 15300 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.417644 15382 raft_consensus.cc:2410] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:52.391206 15232 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:52.392251 15381 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.396936 15226 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:08:52.405867 17401 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:52.420855 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:52.396313 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48030us
I20260709 13:08:52.396313 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:52.429149 15376 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:52.381361 17540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.009s	sys 0.007s
I20260709 13:08:52.429788 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.431349 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.444774 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.397728 15273 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50774 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1674)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1677)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1655)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 171)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1586)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 165)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1648)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1652)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1577)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1578)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1654)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 167)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 168)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 169)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 170)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1660)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1661)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1662)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1663)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1669)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1598)
I20260709 13:08:52.437760 16005 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:52.440078 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.446533 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.426506 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.453895 15300 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:52.457602 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.447538 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.462194 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:52.487327 15228 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:08:52.490868 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.494671 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.495469 17449 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:52.495673 15300 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.496544 17459 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.494720 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:52.497256 17459 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:52.499293 17514 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.499357 15299 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:52.499831 17514 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:52.500469 17514 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:52.494939 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 68548.6us
I20260709 13:08:52.502770 15348 leader_election.cc:400] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:52.500025 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:52.503209 15348 leader_election.cc:403] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:52.492781 15301 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:52.515142 15300 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:52.516139 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1591) took 1057 ms. Trace:
I20260709 13:08:52.516629 15300 rpcz_store.cc:276] 0709 13:08:51.458548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.494284 (+1035736us) service_pool.cc:224] Handling call
0709 13:08:52.516053 (+ 21769us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.517998 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.519054 15300 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:52.523897 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:52.538262 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.539685 15306 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:52.539083 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.461848 17601 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.496611 17532 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:52.442018 17540 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:52.541936 15381 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:08:52.540740 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.473726 17505 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.464392 17139 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.487962 17493 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:52.490489 17576 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.490181 17518 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:08:52.427498 17620 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.418196 17331 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:08:52.548446 17601 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.510319 17449 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:52.567632 15300 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:52.608650 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1580) took 1152 ms. Trace:
I20260709 13:08:52.609143 15300 rpcz_store.cc:276] 0709 13:08:51.455969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.539274 (+1083305us) service_pool.cc:224] Handling call
0709 13:08:52.608555 (+ 69281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.562145 17598 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.610435 15302 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:08:52.610900 15302 pending_rounds.cc:85] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 5
I20260709 13:08:52.611166 15302 pending_rounds.cc:107] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:08:52.611459 15302 raft_consensus.cc:2889] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:52.611581 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:52.569046 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107094us
I20260709 13:08:52.473134 17513 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:08:52.542783 17419 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:52.522303 17541 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.577219 17139 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:52.553404 17515 consensus_meta.cc:287] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.005s
I20260709 13:08:52.544073 17555 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.580694 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1623) took 1310 ms. Trace:
I20260709 13:08:52.650007 15381 rpcz_store.cc:276] 0709 13:08:51.269827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.579410 (+1309583us) service_pool.cc:224] Handling call
0709 13:08:52.579836 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.580106 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.580149 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.580229 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:52.580281 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.580404 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.580598 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:52.547905 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.578749 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.547344 17617 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:08:52.541193 15301 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:52.551980 17422 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:52.461560 17548 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:08:52.612378 15307 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:52.612818 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:52.610452 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:52.672760 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 181994us
I20260709 13:08:52.672866 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1582) took 1216 ms. Trace:
I20260709 13:08:52.673215 15300 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.674765 15379 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:52.617107 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.619122 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1634) took 1289 ms. Trace:
I20260709 13:08:52.677109 15305 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:52.568816 17632 raft_consensus.cc:2764] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:08:52.645655 15299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1559) took 3792 ms (client timeout 2114 ms). Trace:
I20260709 13:08:52.679728 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.679942 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.607894 17601 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:52.653120 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.581765 17576 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.653127 15306 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:52.658350 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1587) took 1200 ms. Trace:
I20260709 13:08:52.663563 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.664834 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.576834 17505 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.676656 15373 rpcz_store.cc:276] 0709 13:08:51.329280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.686467 (+357187us) service_pool.cc:224] Handling call
0709 13:08:52.618819 (+932352us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b54004056d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:52.619034 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11152128}
I20260709 13:08:52.673627 15307 rpcz_store.cc:276] 0709 13:08:51.456461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.611276 (+1154815us) service_pool.cc:224] Handling call
0709 13:08:52.672778 (+ 61502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.680737 15308 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:52.681242 15305 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:52.648109 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:52.681754 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69038.2us
I20260709 13:08:52.647043 17445 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:08:52.679630 15299 rpcz_store.cc:269] 0709 13:08:48.818011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.818446 (+   435us) service_pool.cc:224] Handling call
0709 13:08:52.609819 (+3791373us) spinlock_profiling.cc:243] Waited 3.66 s on lock 0x7b54002300d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:52.609977 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8413581568}
W20260709 13:08:52.809492 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.810001 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1585) took 1352 ms. Trace:
I20260709 13:08:52.810288 15303 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:52.810526 15306 rpcz_store.cc:276] 0709 13:08:51.457161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.550692 (+1093531us) service_pool.cc:224] Handling call
0709 13:08:52.809932 (+259240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:52.767263 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.812629 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:52.687937 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.727012 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 149) took 3743 ms. Trace:
I20260709 13:08:52.815295 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1651) took 1397 ms. Trace:
W20260709 13:08:52.682421 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 158602us
I20260709 13:08:52.817617 15348 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7.
I20260709 13:08:52.817569 15304 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:52.819083 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1646) took 1490 ms. Trace:
I20260709 13:08:52.819501 15304 rpcz_store.cc:276] 0709 13:08:51.328489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.627232 (+1298743us) service_pool.cc:224] Handling call
0709 13:08:52.819018 (+191786us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:52.814268 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.701244 15381 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.823817 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1624) took 1553 ms. Trace:
I20260709 13:08:52.824700 15381 rpcz_store.cc:276] 0709 13:08:51.270144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.651467 (+1381323us) service_pool.cc:224] Handling call
0709 13:08:52.701026 (+ 49559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.823443 (+122417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.823742 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.701725 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:52.814559 15301 rpcz_store.cc:276] 0709 13:08:51.457629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.538072 (+1080443us) service_pool.cc:224] Handling call
0709 13:08:52.658259 (+120187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.826292 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1672) took 1018 ms. Trace:
I20260709 13:08:52.811028 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1647) took 1478 ms. Trace:
I20260709 13:08:52.828323 15230 raft_consensus.cc:2368] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5.
I20260709 13:08:52.812103 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.830289 15306 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.816072 15308 rpcz_store.cc:276] 0709 13:08:51.417774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.632823 (+1215049us) service_pool.cc:224] Handling call
0709 13:08:52.815223 (+182400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.690827 15300 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:52.832312 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1668) took 1066 ms. Trace:
I20260709 13:08:52.818547 15348 leader_election.cc:403] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:52.832809 15300 rpcz_store.cc:276] 0709 13:08:51.765873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.610048 (+844175us) service_pool.cc:224] Handling call
0709 13:08:52.832242 (+222194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.815061 15302 rpcz_store.cc:276] 0709 13:08:48.983789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.707255 (+723466us) service_pool.cc:224] Handling call
0709 13:08:52.609983 (+2902728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.611997 (+  2014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.726654 (+114657us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b54002300d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:52.726904 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6674934528}
I20260709 13:08:52.842782 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.838764 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.844838 15307 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 3: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:52.846591 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1653) took 1397 ms. Trace:
I20260709 13:08:52.847170 15307 rpcz_store.cc:276] 0709 13:08:51.448863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.838269 (+1389406us) service_pool.cc:224] Handling call
0709 13:08:52.846149 (+  7880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.641566 17493 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:52.840127 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.828617 15305 rpcz_store.cc:276] 0709 13:08:51.807928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.679634 (+871706us) service_pool.cc:224] Handling call
0709 13:08:52.826205 (+146571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.828878 15303 rpcz_store.cc:276] 0709 13:08:51.332280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.627312 (+1295032us) service_pool.cc:224] Handling call
0709 13:08:52.810962 (+183650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.654510 17139 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.857661 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.859262 15305 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.850062 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.653810 17476 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.856141 15301 raft_consensus.cc:2368] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4.
I20260709 13:08:52.872200 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1576) took 1417 ms. Trace:
I20260709 13:08:52.848460 15302 raft_consensus.cc:2376] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3. Re-sending same reply.
W20260709 13:08:52.872910 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.873183 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1575) took 1418 ms. Trace:
I20260709 13:08:52.873530 15302 rpcz_store.cc:276] 0709 13:08:51.454752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.842474 (+1387722us) service_pool.cc:224] Handling call
0709 13:08:52.873107 (+ 30633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.870775 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.875114 15299 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.658959 17419 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:52.882959 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.871091 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.680056 17549 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:52.748250 17633 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:08:52.872634 15301 rpcz_store.cc:276] 0709 13:08:51.455009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.839728 (+1384719us) service_pool.cc:224] Handling call
0709 13:08:52.872127 (+ 32399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.879557 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.884744 15304 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:52.657189 17449 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:52.824749 17576 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.825790 17505 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:52.921902 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 295134us
I20260709 13:08:52.699932 17470 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.890486 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:52.862329 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.820668 17401 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:52.643826 17598 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:52.906050 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93487.1us
I20260709 13:08:52.906190 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.908095 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.952066 15308 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:52.912618 15303 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.952907 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.953375 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1655) took 1434 ms. Trace:
I20260709 13:08:52.953677 15304 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:52.953786 15308 rpcz_store.cc:276] 0709 13:08:51.518614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.838724 (+1320110us) service_pool.cc:224] Handling call
0709 13:08:52.953283 (+114559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.913930 15305 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:52.871474 17541 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7.
I20260709 13:08:52.837698 17515 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:52.977035 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.977288 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1619) took 1715 ms. Trace:
I20260709 13:08:52.977829 15305 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:52.978498 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1586) took 1521 ms. Trace:
I20260709 13:08:52.978901 15305 rpcz_store.cc:276] 0709 13:08:51.457388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.976717 (+1519329us) service_pool.cc:224] Handling call
0709 13:08:52.978403 (+  1686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.870741 17413 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:08:52.701059 17617 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.871766 17476 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.683596 17331 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:52.928092 15381 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:52.679039 17555 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:52.871753 17527 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:52.940001 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.890595 17445 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:52.952011 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:52.854749 17513 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:08:52.904323 15348 leader_election.cc:400] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6.
I20260709 13:08:52.959206 15306 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:52.961752 16003 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:52.964083 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 516564us
I20260709 13:08:52.975767 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:52.987370 17638 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:08:52.977916 15376 rpcz_store.cc:276] 0709 13:08:51.262270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.440410 (+1178140us) service_pool.cc:224] Handling call
0709 13:08:52.441109 (+   699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.441539 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:52.657536 (+215997us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.976753 (+319217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.976829 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.976916 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.977014 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.977201 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3103,"prepare.queue_time_us":65549,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"thread_start_us":491704,"threads_started":2}
I20260709 13:08:52.988668 17449 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.989722 16001 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:52.988771 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:52.990828 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1618) took 1728 ms. Trace:
I20260709 13:08:52.992624 17419 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.924331 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:52.907194 17549 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:52.984464 15307 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:53.103155 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1617) took 1841 ms. Trace:
I20260709 13:08:53.102133 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:53.254998 15305 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.255564 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:53.015733 15303 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:08:53.008777 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:53.257068 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:53.257937 15307 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.113466 15299 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:53.170418 15300 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:53.259424 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1666) took 1528 ms. Trace:
I20260709 13:08:53.259810 15300 rpcz_store.cc:276] 0709 13:08:51.731146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.939662 (+1208516us) service_pool.cc:224] Handling call
0709 13:08:53.259346 (+319684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.260809 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1673) took 1450 ms. Trace:
W20260709 13:08:53.130729 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 303590us
W20260709 13:08:53.129902 15345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.011s
W20260709 13:08:53.262274 15345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.016s	sys 0.012s
I20260709 13:08:53.261157 15382 rpcz_store.cc:276] 0709 13:08:51.261988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.438204 (+1176216us) service_pool.cc:224] Handling call
0709 13:08:52.438747 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.489083 (+ 50336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.489309 (+   226us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.508585 (+ 19276us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.801395 (+292810us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.801456 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.801560 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.990568 (+189008us) raft_consensus.cc:1685] finished
0709 13:08:52.990592 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.990759 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49688,"raft.queue_time_us":54248,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"thread_start_us":231686,"threads_started":1,"wal-append.queue_time_us":435729}
I20260709 13:08:52.993955 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:53.264730 15308 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.267326 15301 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:53.099717 17499 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.713s	user 0.016s	sys 0.001s
I20260709 13:08:53.002282 15999 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:08:53.268734 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.112984 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1635) took 1772 ms. Trace:
I20260709 13:08:52.938446 17532 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:53.226861 15302 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:53.272682 15381 rpcz_store.cc:276] 0709 13:08:51.340991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.882487 (+1541496us) service_pool.cc:224] Handling call
0709 13:08:52.927855 (+ 45368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.112595 (+184740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.112918 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.273512 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:53.274279 15302 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:08:53.268782 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:53.274060 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:53.274763 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:53.226472 15348 leader_election.cc:403] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:53.229823 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:53.239102 17639 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.226938 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1677) took 1406 ms. Trace:
I20260709 13:08:53.276177 15306 rpcz_store.cc:276] 0709 13:08:51.820407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.811732 (+991325us) service_pool.cc:224] Handling call
0709 13:08:53.226867 (+415135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.757541 17540 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:53.281177 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 51496.3us
I20260709 13:08:53.276300 15299 rpcz_store.cc:276] 0709 13:08:51.810875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.809988 (+999113us) service_pool.cc:224] Handling call
0709 13:08:53.260737 (+450749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.282166 15374 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:53.281235 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:53.282673 15299 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.283136 15303 raft_consensus.cc:2376] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5. Re-sending same reply.
I20260709 13:08:53.283419 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1577) took 1828 ms. Trace:
I20260709 13:08:53.254802 15378 rpcz_store.cc:276] 0709 13:08:51.261744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.416855 (+1155111us) service_pool.cc:224] Handling call
0709 13:08:52.443355 (+ 26500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.443679 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:52.821307 (+377628us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.975511 (+154204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.975607 (+    96us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.975690 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.975816 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.102844 (+127028us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b540014d2d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:53.103059 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37716,"prepare.queue_time_us":108401,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":81,"raft.queue_time_us":26294,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":164,"spinlock_wait_cycles":60025600,"thread_start_us":450507,"threads_started":2,"wal-append.queue_time_us":207339}
I20260709 13:08:53.283778 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 165) took 1793 ms. Trace:
I20260709 13:08:53.284185 15303 rpcz_store.cc:276] 0709 13:08:51.490216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.280941 (+1790725us) service_pool.cc:224] Handling call
0709 13:08:53.283712 (+  2771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.284883 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:53.175292 17445 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:53.099668 17578 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:52.964534 17641 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.000291 17598 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:53.280762 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1639) took 1919 ms. Trace:
I20260709 13:08:53.285050 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:53.313915 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:53.013624 17459 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:53.283804 15299 rpcz_store.cc:276] 0709 13:08:51.455254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.282087 (+1826833us) service_pool.cc:224] Handling call
0709 13:08:53.282450 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.283135 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.283356 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.264719 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:53.154780 17331 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:53.022784 17515 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.024693 17481 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:08:53.283125 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 379007us
W20260709 13:08:52.994836 17635 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:08:53.009020 17588 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:53.155296 17476 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.950713 17470 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.097172 17620 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:53.277832 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:53.293764 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 364578us
I20260709 13:08:53.315093 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:53.285439 15303 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:53.313863 15376 rpcz_store.cc:276] 0709 13:08:51.361382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.279560 (+1918178us) service_pool.cc:224] Handling call
0709 13:08:53.279978 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.280246 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.280279 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.280379 (+   100us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.280421 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.280495 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.280681 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.009716 17401 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.321763 15305 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:53.336836 15377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.009s	sys 0.037s
W20260709 13:08:53.338255 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.343426 15300 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:53.415845 15305 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:08:53.416527 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 163) took 1927 ms. Trace:
I20260709 13:08:53.346064 15307 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:52.981302 17645 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.397s
I20260709 13:08:53.335091 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1640) took 1968 ms. Trace:
W20260709 13:08:53.374042 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.281287 17427 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.309013 17422 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:53.281514 17639 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:53.307331 17499 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.183531 17527 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.309526 17578 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:08:53.401714 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.375507 17466 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.997s	user 0.013s	sys 0.000s
I20260709 13:08:53.399171 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:53.334299 17331 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.410068 15974 leader_election.cc:400] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5.
I20260709 13:08:53.434163 16003 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
W20260709 13:08:53.403929 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 126207us
I20260709 13:08:53.410667 15378 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:53.411044 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.319487 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:53.022320 17493 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.171486 17617 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.411922 15304 raft_consensus.cc:2376] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6. Re-sending same reply.
W20260709 13:08:53.416086 15377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.010s	sys 0.038s
I20260709 13:08:53.411352 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1578) took 1955 ms. Trace:
I20260709 13:08:53.417248 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1589) took 1959 ms. Trace:
I20260709 13:08:53.411361 17425 raft_consensus.cc:2764] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:53.415845 15308 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:53.417084 15300 rpcz_store.cc:276] 0709 13:08:51.489257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.284305 (+1795048us) service_pool.cc:224] Handling call
0709 13:08:53.416471 (+132166us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:53.422013 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.334920 17518 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:08:53.422570 15382 rpcz_store.cc:276] 0709 13:08:51.366469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.334169 (+1967700us) service_pool.cc:224] Handling call
0709 13:08:53.334527 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.334727 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.334754 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.334803 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:53.334836 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.334895 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.335029 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.463521 15382 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:08:53.419193 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:53.411759 17413 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:53.453377 15303 rpcz_store.cc:276] 0709 13:08:51.455500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.284952 (+1829452us) service_pool.cc:224] Handling call
0709 13:08:53.285239 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.411058 (+125819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.411281 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.475427 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 168) took 1984 ms. Trace:
I20260709 13:08:53.475761 15303 rpcz_store.cc:276] 0709 13:08:51.491278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.474661 (+1983383us) service_pool.cc:224] Handling call
0709 13:08:53.474919 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.475085 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.475125 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.475165 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.475205 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.475263 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.475375 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.454036 15305 rpcz_store.cc:276] 0709 13:08:51.458084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.415252 (+1957168us) service_pool.cc:224] Handling call
0709 13:08:53.415614 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.416991 (+  1377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.417195 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.332087 17641 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.455588 15380 raft_consensus.cc:2410] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:08:53.459095 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 507152us
I20260709 13:08:53.379878 17481 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.461771 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1643) took 2094 ms. Trace:
I20260709 13:08:53.488143 16003 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.488606 15378 rpcz_store.cc:276] 0709 13:08:51.367493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.460869 (+2093376us) service_pool.cc:224] Handling call
0709 13:08:53.461149 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.461412 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.461437 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.461476 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:53.461510 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.461564 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.461718 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:53.423785 15346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.010s	sys 0.026s
I20260709 13:08:53.474093 15300 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:53.491470 15346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.010s	sys 0.026s
I20260709 13:08:53.491871 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 167) took 2001 ms. Trace:
I20260709 13:08:53.482992 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:53.492360 15300 rpcz_store.cc:276] 0709 13:08:51.490952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.473674 (+1982722us) service_pool.cc:224] Handling call
0709 13:08:53.473935 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.491583 (+ 17648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.491809 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.464017 15382 pending_rounds.cc:85] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 5
I20260709 13:08:53.493839 15382 pending_rounds.cc:107] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:08:53.492772 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.494210 15382 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.495277 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1644) took 2124 ms. Trace:
I20260709 13:08:53.495682 15382 rpcz_store.cc:276] 0709 13:08:51.370914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.462664 (+2091750us) service_pool.cc:224] Handling call
0709 13:08:53.463032 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.494999 (+ 31967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.495218 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:53.502720 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.508963 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.434818 17658 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.429965 17639 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.518915 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:53.451582 17422 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:53.520507 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:08:53.542268 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59368.4us
I20260709 13:08:53.520380 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:53.575948 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55514.9us
I20260709 13:08:53.489187 17620 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.430976 17427 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:53.520488 17514 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.019s	user 0.014s	sys 0.002s
I20260709 13:08:53.486147 17536 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.419545 17653 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:08:53.522166 17660 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:53.570616 17655 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:08:53.545270 17459 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:53.603402 15376 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:53.610909 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1646) took 2096 ms. Trace:
I20260709 13:08:53.611383 15376 rpcz_store.cc:276] 0709 13:08:51.514050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.546072 (+2032022us) service_pool.cc:224] Handling call
0709 13:08:53.590989 (+ 44917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.610554 (+ 19565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.610836 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.545436 17413 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:53.428300 17532 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:53.604718 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 150446us
I20260709 13:08:53.545310 17665 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:53.589318 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:53.618074 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1616) took 2356 ms. Trace:
I20260709 13:08:53.590087 17588 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.595217 17645 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.481328 17661 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.179s
I20260709 13:08:53.618657 15377 rpcz_store.cc:276] 0709 13:08:51.261457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.414691 (+1153234us) service_pool.cc:224] Handling call
0709 13:08:52.415054 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.415295 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:52.415670 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.617072 (+1201402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.617198 (+   126us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:53.617770 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.617861 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.618008 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9106,"prepare.queue_time_us":739,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4233,"raft.queue_time_us":34133,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":24855,"thread_start_us":1200904,"threads_started":2,"wal-append.queue_time_us":1040449}
I20260709 13:08:53.600157 17659 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:53.636204 15376 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:53.647811 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61360.8us
I20260709 13:08:53.653133 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 329) took 1883 ms. Trace:
I20260709 13:08:53.653251 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:53.616609 17332 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.270s	user 0.015s	sys 0.000s
I20260709 13:08:53.653613 15376 rpcz_store.cc:276] 0709 13:08:51.769528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.612359 (+1842831us) service_pool.cc:224] Handling call
0709 13:08:53.636041 (+ 23682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.652813 (+ 16772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.653066 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.613189 17598 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.657161 15377 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:53.578356 17578 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.660612 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1572) took 1845 ms. Trace:
W20260709 13:08:53.664978 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 345545us
I20260709 13:08:53.673290 15377 rpcz_store.cc:276] 0709 13:08:51.814957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.656460 (+1841503us) service_pool.cc:224] Handling call
0709 13:08:53.656870 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.660268 (+  3398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.660547 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.674000 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:53.675112 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 330) took 1837 ms. Trace:
W20260709 13:08:53.671430 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 151139us
I20260709 13:08:53.675559 15377 rpcz_store.cc:276] 0709 13:08:51.837963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.674190 (+1836227us) service_pool.cc:224] Handling call
0709 13:08:53.674532 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.674729 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.674765 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.674830 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.674871 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.674937 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.675049 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.677387 15377 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:08:53.678056 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1603) took 1684 ms. Trace:
I20260709 13:08:53.678406 15377 rpcz_store.cc:276] 0709 13:08:51.994039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.676755 (+1682716us) service_pool.cc:224] Handling call
0709 13:08:53.677128 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.677768 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.677996 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.679268 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:53.604975 17514 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.672883 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1753) took 1239 ms. Trace:
I20260709 13:08:53.604229 17536 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.686718 15376 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.681481 15226 rpcz_store.cc:276] 0709 13:08:52.433401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.434035 (+   634us) service_pool.cc:224] Handling call
0709 13:08:52.434482 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.434940 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.434972 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.628126 (+193154us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b2c000014c8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:08:52.642191 (+ 14065us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.915068 (+272877us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:52.915119 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.915199 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.672585 (+757386us) raft_consensus.cc:1685] finished
0709 13:08:53.672606 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.672824 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9223,"raft.queue_time_us":679,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":45338,"spinlock_wait_cycles":35827584,"thread_start_us":186759,"threads_started":1,"wal-append.queue_time_us":578575}
I20260709 13:08:53.680085 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1605) took 1685 ms. Trace:
I20260709 13:08:53.685654 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:53.688916 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52126.4us
I20260709 13:08:53.688861 15377 rpcz_store.cc:276] 0709 13:08:51.994542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.679223 (+1684681us) service_pool.cc:224] Handling call
0709 13:08:53.679515 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.679714 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.679746 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.679808 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:53.679852 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.679916 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.680030 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.650843 17659 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.712566 17659 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:53.713287 15377 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:53.692263 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1575) took 1867 ms. Trace:
I20260709 13:08:53.713907 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1606) took 1710 ms. Trace:
I20260709 13:08:53.714169 15376 rpcz_store.cc:276] 0709 13:08:51.825364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.657805 (+1832441us) service_pool.cc:224] Handling call
0709 13:08:53.686542 (+ 28737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.692017 (+  5475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.692208 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.635293 17652 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.546890 17658 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.608214 17660 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.725582 17667 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:53.695283 17555 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:53.655400 17459 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:53.640988 17588 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.720090 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1654) took 2237 ms. Trace:
I20260709 13:08:53.691752 17470 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:53.723603 17671 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.723843 17641 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:53.707158 15373 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.714284 15377 rpcz_store.cc:276] 0709 13:08:52.003573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.712602 (+1709029us) service_pool.cc:224] Handling call
0709 13:08:53.712953 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.713646 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.713850 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:53.750101 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 331) took 1730 ms. Trace:
I20260709 13:08:53.670055 17598 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.639838 17645 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.690248 17672 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:08:53.717732 17653 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.754562 15307 rpcz_store.cc:276] 0709 13:08:51.483073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.422243 (+1939170us) service_pool.cc:224] Handling call
0709 13:08:53.422554 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.422774 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:53.485718 (+ 62944us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.716889 (+231171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.716952 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.717015 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.718794 (+  1779us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.719863 (+  1069us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24255,"prepare.queue_time_us":191809,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":118614,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"thread_start_us":249533,"threads_started":3,"wal-append.queue_time_us":215450}
W20260709 13:08:53.726019 17650 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:08:53.631981 17665 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:53.743191 17646 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:08:53.717797 17664 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.659092 17332 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.783420 15376 rpcz_store.cc:276] 0709 13:08:52.019790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.715307 (+1695517us) service_pool.cc:224] Handling call
0709 13:08:53.749600 (+ 34293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.749789 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.749812 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.749851 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:53.749884 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.749935 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.750045 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:53.802376 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 116796us
W20260709 13:08:53.783675 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107501us
I20260709 13:08:53.792156 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:53.725603 17674 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.688508 17422 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.753027 17527 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:53.785351 17644 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:53.784281 17685 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:53.804672 15307 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:53.810917 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 131729us
I20260709 13:08:53.792727 17518 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:53.805222 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:53.794724 17666 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:53.709196 17413 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.813884 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:53.815570 16006 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:53.817699 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 401) took 1195 ms. Trace:
I20260709 13:08:53.785460 17671 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.803602 17664 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:53.797561 17673 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.820688 15231 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:08:53.835790 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.728058 17652 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:53.812702 17654 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:08:53.847632 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:53.783895 17459 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:53.820281 17601 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.961s	user 0.008s	sys 0.001s
I20260709 13:08:53.886780 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:53.825726 17679 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.825418 17588 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:53.817744 17332 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:53.868283 17617 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:53.846544 17513 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:08:53.958262 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 110689us
I20260709 13:08:53.820377 17514 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:53.921103 17690 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
W20260709 13:08:53.904177 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.964978 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.925472 17331 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.893081 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:08:53.931571 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.887619 17649 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.868595 17527 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
W20260709 13:08:53.984211 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 138680us
I20260709 13:08:53.960098 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:53.909802 17673 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.868171 17518 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:53.869210 17664 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.810038 17674 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.891528 17669 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.961995 17666 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.992902 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:53.999243 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.000205 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.002480 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:08:54.057855 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.962513 17513 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:53.992563 17688 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:53.968853 17505 consensus_meta.cc:287] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.019s	user 0.008s	sys 0.004s
I20260709 13:08:53.915828 17601 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:53.804102 17677 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 13:08:53.828863 17427 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:53.846803 15999 rpcz_store.cc:276] 0709 13:08:52.622391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.627772 (+  5381us) service_pool.cc:224] Handling call
0709 13:08:52.744959 (+117187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.279614 (+534655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.817420 (+537806us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54004b19d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:53.817622 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560819584}
W20260709 13:08:54.085472 17139 consensus_meta.cc:287] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.194s	user 0.011s	sys 0.004s
I20260709 13:08:54.003758 17679 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.003755 17641 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:54.090139 17681 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:08:54.056559 17527 consensus_queue.cc:1243] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:54.079695 17470 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.079509 17493 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.987684 17649 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.087281 17620 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.082527 17686 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.090241 17505 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.090771 17513 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.092044 17601 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.088254 17676 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.086426 17697 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:54.099509 17677 consensus_queue.cc:1243] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:08:54.095441 17675 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.307s	user 0.003s	sys 0.005s
W20260709 13:08:54.129977 17576 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.184s	user 0.013s	sys 0.000s
I20260709 13:08:54.106515 17679 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:54.008672 17669 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.138221 17665 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.138381 17679 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.122398 17697 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.140110 17669 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:54.140764 17576 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.128516 17653 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.132652 17664 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:54.136396 17639 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.002s
I20260709 13:08:54.126545 17659 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.124197 17652 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:54.136768 17649 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.135438 17673 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.137368 17671 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.106094 17658 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.141314 17697 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.113919 17645 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:53.980170 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 87196.8us
I20260709 13:08:53.985558 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 169) took 2494 ms. Trace:
I20260709 13:08:53.986886 15375 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:53.957422 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1581) took 2086 ms. Trace:
I20260709 13:08:54.261225 15301 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:54.113121 17493 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.537856 15379 rpcz_store.cc:276] 0709 13:08:51.871419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.240434 (+369015us) service_pool.cc:224] Handling call
0709 13:08:53.957234 (+1716800us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54001b9ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:53.957355 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995543296}
I20260709 13:08:54.539054 17576 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.112280 17518 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.376920 17445 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.527119 17682 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:54.548918 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.532802 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1610) took 1235 ms. Trace:
W20260709 13:08:54.396677 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.370251 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.498368 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.466238 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1626) took 3195 ms. Trace:
I20260709 13:08:54.547957 17515 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:54.528584 15380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1578) took 2684 ms (client timeout 3039 ms). Trace:
I20260709 13:08:54.152521 17679 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.464516 17513 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.250924 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1656) took 2701 ms. Trace:
I20260709 13:08:54.289202 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1652) took 2858 ms. Trace:
W20260709 13:08:54.382369 17476 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.971s	user 0.008s	sys 0.007s
I20260709 13:08:54.311368 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 166) took 2820 ms. Trace:
W20260709 13:08:54.467799 15374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1592) took 2504 ms (client timeout 3237 ms). Trace:
I20260709 13:08:54.530049 17466 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.417548 17401 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.532549 17505 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.584685 15130 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: config changed from index 2 to 6, term changed from 4 to 5, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.409611 15973 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.467941 17663 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.528854 17555 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.590999 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.367274 17331 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.572227 15381 rpcz_store.cc:276] 0709 13:08:53.263487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.274475 (+ 10988us) service_pool.cc:224] Handling call
0709 13:08:54.498564 (+1224089us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400224a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:54.498910 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673975680}
I20260709 13:08:54.301636 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1660) took 2650 ms. Trace:
I20260709 13:08:54.492905 17514 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.573189 15373 rpcz_store.cc:276] 0709 13:08:51.270721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.818661 (+1547940us) service_pool.cc:224] Handling call
0709 13:08:52.876975 (+ 58314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.782877 (+905902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.465518 (+682641us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b540012a7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:54.465988 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908786560}
W20260709 13:08:54.591050 15374 rpcz_store.cc:269] 0709 13:08:51.962998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.352280 (+389282us) service_pool.cc:224] Handling call
0709 13:08:54.467252 (+2114972us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54004051d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:54.467535 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030513920}
W20260709 13:08:54.575443 15380 rpcz_store.cc:269] 0709 13:08:51.843632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.240762 (+397130us) service_pool.cc:224] Handling call
0709 13:08:54.528017 (+2287255us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400289bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:54.528320 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790566144}
W20260709 13:08:54.250252 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 247593us
W20260709 13:08:54.600241 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.387153 17459 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.613094 17493 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.595012 17401 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:54.621240 17481 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.623476 17679 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:54.624053 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.624640 17659 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:54.624933 17466 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.625228 17555 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.598114 17476 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.491601 17677 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:08:54.590863 15308 rpcz_store.cc:276] 0709 13:08:51.490596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.473030 (+1982434us) service_pool.cc:224] Handling call
0709 13:08:53.473390 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.516080 (+ 42690us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:53.516225 (+   145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.519238 (+  3013us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.735906 (+216668us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:53.735969 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.736061 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.310829 (+574768us) raft_consensus.cc:1685] finished
0709 13:08:54.310869 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.311189 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29044,"raft.queue_time_us":195954,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":17279,"thread_start_us":174363,"threads_started":2,"wal-append.queue_time_us":260964}
I20260709 13:08:54.644531 17645 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:54.645591 17652 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.107474 17139 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.630322 17466 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:54.579487 15306 rpcz_store.cc:276] 0709 13:08:51.430530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.295042 (+1864512us) service_pool.cc:224] Handling call
0709 13:08:53.295515 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.424501 (+128986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.466643 (+ 42142us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.484756 (+ 18113us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.003198 (+518442us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:54.003258 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.003356 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.288655 (+285299us) raft_consensus.cc:1685] finished
0709 13:08:54.288696 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.289001 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":335124,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":23785,"thread_start_us":547584,"threads_started":2,"wal-append.queue_time_us":580257}
I20260709 13:08:54.579012 15300 rpcz_store.cc:276] 0709 13:08:51.549570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.493427 (+1943857us) service_pool.cc:224] Handling call
0709 13:08:53.493795 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.663208 (+169413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.663237 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.694961 (+ 31724us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.809604 (+114643us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.809646 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.809722 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.250295 (+440573us) raft_consensus.cc:1685] finished
0709 13:08:54.250348 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.250662 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53868,"raft.queue_time_us":227440,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":176240,"threads_started":2,"wal-append.queue_time_us":252188}
I20260709 13:08:54.631579 15303 rpcz_store.cc:276] 0709 13:08:51.491649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.477004 (+1985355us) service_pool.cc:224] Handling call
0709 13:08:53.477374 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.659905 (+182531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.659937 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.673681 (+ 13744us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.803098 (+129417us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:53.813107 (+ 10009us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.920472 (+107365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.920566 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.985354 (+ 64788us) raft_consensus.cc:1685] finished
0709 13:08:53.985374 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.985501 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131774,"prepare.queue_time_us":24590,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":311005,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":10857,"spinlock_wait_cycles":15566720,"thread_start_us":230258,"threads_started":2,"wal-append.queue_time_us":116075}
I20260709 13:08:54.657061 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:54.658242 15373 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.658495 15303 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 6. Ops: []
I20260709 13:08:54.659336 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1661) took 2995 ms. Trace:
I20260709 13:08:54.659720 15303 rpcz_store.cc:276] 0709 13:08:51.663477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.657718 (+2994241us) service_pool.cc:224] Handling call
0709 13:08:54.658203 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.659009 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.659234 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.660732 17645 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.662722 17683 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.599071 15307 rpcz_store.cc:276] 0709 13:08:51.651467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.824487 (+2173020us) service_pool.cc:224] Handling call
0709 13:08:53.824836 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.910371 (+ 85535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.910405 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.918590 (+  8185us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.300870 (+382280us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:54.300970 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.301089 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.301175 (+    86us) raft_consensus.cc:1685] finished
0709 13:08:54.301189 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.301427 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61679,"raft.queue_time_us":90349,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8083,"thread_start_us":327149,"threads_started":1,"wal-append.queue_time_us":158124}
I20260709 13:08:54.614859 17513 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.645601 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.673666 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.671277 15130 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 4, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 4 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:54.675287 15308 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:54.675976 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1662) took 3004 ms. Trace:
I20260709 13:08:54.676249 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.676623 17513 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:54.677577 15129 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 191) took 18489 ms (client timeout 15000 ms). Trace:
I20260709 13:08:54.678902 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.676867 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.672670 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.681190 17660 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.681823 15381 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:54.682123 17139 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.675488 15130 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.683090 17652 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.676321 15308 rpcz_store.cc:276] 0709 13:08:51.671237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.663182 (+2991945us) service_pool.cc:224] Handling call
0709 13:08:54.663852 (+   670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.675706 (+ 11854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.675905 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.690677 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.684132 15130 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 3 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:54.669312 17514 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:54.702569 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 293500us
I20260709 13:08:54.702765 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.704394 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.704828 17514 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.705905 16003 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:08:54.706844 15304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 164) took 3217 ms (client timeout 3297 ms). Trace:
I20260709 13:08:54.707190 17639 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:54.707408 15304 rpcz_store.cc:269] 0709 13:08:51.489777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.980587 (+1490810us) service_pool.cc:224] Handling call
0709 13:08:54.706339 (+1725752us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540017a054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:54.706544 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355834240}
I20260709 13:08:54.707353 15305 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:54.711138 17632 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.711758 17632 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:54.712702 15227 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.712939 17632 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.714212 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1648) took 3368 ms. Trace:
I20260709 13:08:54.714474 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:54.714797 15130 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.714730 15302 rpcz_store.cc:276] 0709 13:08:51.345549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.296558 (+1951009us) service_pool.cc:224] Handling call
0709 13:08:53.297028 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.004813 (+707785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.004845 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.005956 (+  1111us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.285266 (+279310us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:54.285373 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.713568 (+428195us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54003e26d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:54.713629 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.713712 (+    83us) raft_consensus.cc:1685] finished
0709 13:08:54.713730 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.714012 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":178973,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":572457216,"thread_start_us":462369,"threads_started":2,"wal-append.queue_time_us":14931}
I20260709 13:08:54.716912 17549 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:54.699465 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.718799 17662 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:54.718967 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47263.7us
I20260709 13:08:54.719290 17598 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.720536 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.722606 15308 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 7. Ops: []
I20260709 13:08:54.723306 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1664) took 3007 ms. Trace:
I20260709 13:08:54.723656 15308 rpcz_store.cc:276] 0709 13:08:51.716507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.721736 (+3005229us) service_pool.cc:224] Handling call
0709 13:08:54.722252 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.723028 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.723218 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.724640 17645 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.725440 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1663) took 3045 ms. Trace:
W20260709 13:08:54.726226 17499 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.292s	user 0.004s	sys 0.015s
I20260709 13:08:54.726841 17499 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6.
I20260709 13:08:54.696837 17555 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.728487 17667 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:54.730585 17652 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.717262 15130 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.734836 15130 catalog_manager.cc:5697] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 2, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 2 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:54.735925 15377 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.736554 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:54.736703 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.737143 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.737963 15377 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:54.738581 15382 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:54.737813 15130 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.739500 17664 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.740067 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:54.678059 15129 rpcz_store.cc:269] 0709 13:08:36.146912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.193732 (+ 46820us) service_pool.cc:224] Handling call
0709 13:08:54.633504 (+18439772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:46.605533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:47.037471 (+431938us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5c0028fd0c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59d18331 00007f2f59d18221 00007f2f59d12f6c 00007f2f57570d69 00007f2f5755c0a6 00007f2f5755bd58 00007f2f575609f1 00007f2f575609a9 00007f2f57560939 00007f2f57560901 00007f2f5755fb2d
0709 13:08:47.037587 (+   116us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:47.037636 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:08:47.037667 (+    31us) tablet.cc:662] Decoding operations
0709 13:08:47.038454 (+   787us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:47.038582 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:47.038621 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:47.039086 (+   465us) tablet.cc:701] Row locks acquired
0709 13:08:47.039115 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:08:47.039324 (+   209us) write_op.cc:270] Start()
0709 13:08:47.039572 (+   248us) write_op.cc:276] Timestamp: P: 1783602527039261 usec, L: 0
0709 13:08:47.039603 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:47.087854 (+ 48251us) log.cc:844] Serialized 1317 byte log entry
0709 13:08:47.997236 (+909382us) op_driver.cc:464] REPLICATION: finished
0709 13:08:48.251619 (+254383us) write_op.cc:301] APPLY: starting
0709 13:08:48.267874 (+ 16255us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:48.389345 (+121471us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:48.408927 (+ 19582us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:48.492193 (+ 83266us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:48.492425 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:08:48.492475 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:48.492694 (+   219us) log.cc:844] Serialized 35 byte log entry
0709 13:08:48.492868 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.492964 (+    96us) write_op.cc:454] Released schema lock
0709 13:08:48.493006 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:48.493407 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:48.493437 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36188,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":219461,"apply.run_cpu_time_us":2904,"apply.run_wall_time_us":252249,"num_ops":3,"prepare.queue_time_us":252162,"prepare.run_cpu_time_us":30621,"prepare.run_wall_time_us":700416,"raft.queue_time_us":559173,"raft.run_cpu_time_us":56691,"raft.run_wall_time_us":231531,"replication_time_us":929915,"spinlock_wait_cycles":27297664,"thread_start_us":610245,"threads_started":4,"wal-append.queue_time_us":191880,"wal-append.run_cpu_time_us":20928,"wal-append.run_wall_time_us":2284692}]]}
I20260709 13:08:54.733151 15373 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:08:54.737473 15378 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:54.742779 17639 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.741521 15302 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.696039 17674 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.745869 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1665) took 3026 ms. Trace:
I20260709 13:08:54.746326 15302 rpcz_store.cc:276] 0709 13:08:51.719269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.720503 (+3001234us) service_pool.cc:224] Handling call
0709 13:08:54.720909 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.744963 (+ 24054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.745577 (+   614us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b54002fba54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:54.745810 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46983040}
I20260709 13:08:54.741307 15130 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.749001 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.749681 15378 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:54.753499 15232 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:54.749059 15227 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:54.754678 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.757159 15224 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:54.714850 17632 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.725878 15303 rpcz_store.cc:276] 0709 13:08:51.679807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.698611 (+3018804us) service_pool.cc:224] Handling call
0709 13:08:54.724755 (+ 26144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.725066 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.725089 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:54.725135 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:54.725178 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.725226 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.725362 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:54.731323 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58267.7us
I20260709 13:08:54.720026 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:54.732486 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:54.769234 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:54.768846 15130 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.770079 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 170) took 3278 ms. Trace:
I20260709 13:08:54.777535 17476 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:54.770522 15305 rpcz_store.cc:276] 0709 13:08:51.491994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.477986 (+1985992us) service_pool.cc:224] Handling call
0709 13:08:54.706569 (+1228583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.708956 (+  2387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.769858 (+ 60902us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540017a050. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:54.770011 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824502656}
I20260709 13:08:54.801872 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:54.668435 17663 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:54.812938 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 59756.6us
I20260709 13:08:54.815222 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:54.816488 15308 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:54.817075 15304 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
W20260709 13:08:54.818145 17703 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.696s	user 0.003s	sys 0.000s
I20260709 13:08:54.812996 16003 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:08:54.818699 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 98898.2us
I20260709 13:08:54.821431 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:54.807696 15130 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 5, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.859338 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.850252 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1671) took 3030 ms. Trace:
I20260709 13:08:54.803400 17555 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.884393 15304 rpcz_store.cc:276] 0709 13:08:51.793650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.817846 (+3024196us) service_pool.cc:224] Handling call
0709 13:08:54.818249 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.818473 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.818498 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:54.823367 (+  4869us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:54.823448 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.823524 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.823625 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.859694 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:54.861224 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:54.865136 17674 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:54.896091 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:54.897183 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78353.6us
I20260709 13:08:54.856948 17422 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:08:54.897560 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:54.898214 15377 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.898937 17518 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:54.899423 17518 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:54.900537 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.893379 17660 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.900621 17518 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.901993 17518 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.901711 17660 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.903530 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.904047 15378 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:54.904209 17660 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.904870 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.896126 17653 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:54.905786 15224 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:54.905998 17493 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:54.906394 17493 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:54.906742 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.907353 17493 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.907958 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.908705 17493 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:54.909292 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 52400.1us
I20260709 13:08:54.909788 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.910849 17712 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:54.911099 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:54.911314 17712 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:54.911680 17712 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.912201 17476 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.912432 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.912750 17476 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.914130 17660 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.914556 17660 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.914901 17660 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.915015 17476 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:54.916472 15308 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 6. Ops: []
I20260709 13:08:54.857642 17481 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.918434 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.898932 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:54.856814 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 406) took 1097 ms. Trace:
I20260709 13:08:54.923048 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.923779 15378 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:54.924605 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:54.925382 15379 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:54.926295 17674 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:54.927575 17674 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:54.928805 15231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1746) took 2573 ms (client timeout 3323 ms). Trace:
W20260709 13:08:54.929250 15231 rpcz_store.cc:269] 0709 13:08:52.354876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.358215 (+  3339us) service_pool.cc:224] Handling call
0709 13:08:54.928368 (+2570153us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000e79d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:54.928595 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3360739584}
I20260709 13:08:54.931164 16006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 403) took 2303 ms. Trace:
I20260709 13:08:54.931663 16006 rpcz_store.cc:276] 0709 13:08:52.627569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.632397 (+  4828us) service_pool.cc:224] Handling call
0709 13:08:53.693552 (+1061155us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b5800003c98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:08:53.715403 (+ 21851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.847649 (+132246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.930719 (+1083070us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b54004f3654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:54.930983 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245694080}
I20260709 13:08:54.932554 17536 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:54.931035 15305 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.932129 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.926488 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 323) took 3714 ms. Trace:
I20260709 13:08:54.923933 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.934561 15232 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:54.935418 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.935747 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1669) took 3147 ms. Trace:
I20260709 13:08:54.936295 15308 rpcz_store.cc:276] 0709 13:08:51.773708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.817293 (+3043585us) service_pool.cc:224] Handling call
0709 13:08:54.894112 (+ 76819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.920475 (+ 26363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.920615 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.940368 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:54.942268 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.940469 17689 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.943717 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.933890 15375 rpcz_store.cc:276] 0709 13:08:51.211827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.788507 (+576680us) service_pool.cc:224] Handling call
0709 13:08:52.341584 (+553077us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:08:52.341902 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.539221 (+2197319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.926053 (+386832us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001abdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:54.926300 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3797398144}
I20260709 13:08:54.944787 17689 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:54.943526 17555 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.826068 17677 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:08:54.947741 17555 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.933780 16001 rpcz_store.cc:276] 0709 13:08:53.705040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.706689 (+  1649us) service_pool.cc:224] Handling call
0709 13:08:53.723347 (+ 16658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.812511 (+ 89164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.815444 (+  2933us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.816048 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.413743 (+597695us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b180018dc60. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:08:54.591334 (+177591us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:54.594640 (+  3306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.716234 (+121594us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b54005b2cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:54.716286 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.781284 (+ 64998us) raft_consensus.cc:1685] finished
0709 13:08:54.790815 (+  9531us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.802110 (+ 11295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4882,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":21733,"spinlock_wait_cycles":188760320,"thread_start_us":138435,"threads_started":1,"wal-append.queue_time_us":821720}
I20260709 13:08:54.949765 15300 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.950484 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1684) took 2093 ms. Trace:
I20260709 13:08:54.950806 15300 rpcz_store.cc:276] 0709 13:08:52.857476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.949110 (+2091634us) service_pool.cc:224] Handling call
0709 13:08:54.949508 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.950220 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.950427 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.945734 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:54.951706 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.955710 16006 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:54.957504 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.957201 17401 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.958532 15225 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:54.958491 17401 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.959612 15302 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.960268 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1687) took 2023 ms. Trace:
I20260709 13:08:54.960611 15302 rpcz_store.cc:276] 0709 13:08:52.937799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.958985 (+2021186us) service_pool.cc:224] Handling call
0709 13:08:54.959379 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.960028 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.960207 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:54.957652 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.962859 15307 pending_rounds.cc:85] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 1
I20260709 13:08:54.963197 15307 pending_rounds.cc:107] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:08:54.963511 15307 raft_consensus.cc:2889] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.965888 17661 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:54.967418 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.967854 17652 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:54.968295 17652 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:54.968469 15130 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 3, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.969244 17652 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.970486 17652 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.967123 17661 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.972074 17714 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.965868 17663 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.972852 15973 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:54.966308 17578 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.970268 15130 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 3, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.959587 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.823266 17598 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
W20260709 13:08:54.979918 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 120412us
W20260709 13:08:54.982110 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 83332us
I20260709 13:08:54.983487 15306 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:54.984681 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.985321 17677 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.985760 17677 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.986035 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:54.984098 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1691) took 1887 ms. Trace:
I20260709 13:08:54.985339 17588 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:54.987216 17588 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:54.979401 17714 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.988906 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:54.990012 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.991178 17588 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:54.992688 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.993933 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.994138 15130 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 4, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 4 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:08:54.995217 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:54.995883 16008 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.984747 17425 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:54.988938 17714 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.996835 17425 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:54.997911 17425 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:54.988375 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:54.986140 17677 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.004511 15376 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:08:55.005118 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59505.9us
I20260709 13:08:55.006379 17687 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.006695 15308 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.006839 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:55.007520 17663 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:55.007805 17686 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:55.008024 17663 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:55.008371 17686 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.008543 17663 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.009189 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1680) took 2353 ms. Trace:
I20260709 13:08:55.009275 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:55.009637 15301 rpcz_store.cc:276] 0709 13:08:52.656420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.268332 (+611912us) service_pool.cc:224] Handling call
0709 13:08:55.008955 (+1740623us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b540017aa54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:55.009115 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265603968}
I20260709 13:08:55.010854 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.011559 15301 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:55.013067 15299 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.013432 17665 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.014219 17665 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.014282 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:54.995779 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.015554 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:55.015642 15230 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:54.921597 17481 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.005618 17445 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.860044 17332 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:08:54.825847 17139 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:08:54.995602 15130 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.860162 17671 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:08:55.015021 15302 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 2.
I20260709 13:08:55.025571 15377 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:55.016873 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1689) took 2033 ms. Trace:
I20260709 13:08:54.986760 15306 rpcz_store.cc:276] 0709 13:08:53.097178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.982658 (+1885480us) service_pool.cc:224] Handling call
0709 13:08:54.983102 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.983853 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.984048 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:55.071568 15308 rpcz_store.cc:276] 0709 13:08:52.983422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.979528 (+1996106us) service_pool.cc:224] Handling call
0709 13:08:55.006427 (+ 26899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.007234 (+   807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.016823 (+  9589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:55.071797 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:55.072209 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 56847us
I20260709 13:08:55.027944 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:55.064618 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.025358 17555 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.054956 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.006876 17687 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:55.067674 15224 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:55.028690 17481 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.070606 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:55.086640 15380 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:55.090720 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:55.098125 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:55.098910 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:55.095943 15130 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.103317 15380 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:55.081682 17555 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.080904 17632 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.113085 15306 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:55.103895 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:55.090374 17615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.999s	user 0.005s	sys 0.013s
W20260709 13:08:55.098229 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 114036us
I20260709 13:08:55.068714 17682 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:08:55.106621 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0845557109998936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 13:08:55.064019 17712 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.108954 17541 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.110143 15225 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:55.110755 15304 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:55.110586 15130 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.111999 15302 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:08:55.116611 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1695) took 1416 ms. Trace:
I20260709 13:08:55.132483 15306 rpcz_store.cc:276] 0709 13:08:53.699927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.099173 (+1399246us) service_pool.cc:224] Handling call
0709 13:08:55.112692 (+ 13519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.116116 (+  3424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.116554 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:55.117085 15301 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
W20260709 13:08:55.123225 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52701.1us
I20260709 13:08:55.068598 17661 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:08:55.106745 15973 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:55.098964 17588 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:55.128319 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.077708 17332 consensus_queue.cc:1243] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:08:55.118065 17615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.242s	user 0.005s	sys 0.013s
W20260709 13:08:55.140151 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.118635 17555 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.141366 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1598) took 2766 ms. Trace:
I20260709 13:08:55.132301 15302 pending_rounds.cc:85] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 3
W20260709 13:08:55.148815 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 67247.4us
I20260709 13:08:55.149372 15302 pending_rounds.cc:107] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:08:55.149305 15304 rpcz_store.cc:276] 0709 13:08:52.365134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.952746 (+2587612us) service_pool.cc:224] Handling call
0709 13:08:55.072816 (+120070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.131495 (+ 58679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.131754 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:55.149780 15302 raft_consensus.cc:2889] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:55.153508 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1584) took 3696 ms. Trace:
I20260709 13:08:55.153975 15299 rpcz_store.cc:276] 0709 13:08:51.456931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.333191 (+1876260us) service_pool.cc:224] Handling call
0709 13:08:55.012767 (+1679576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.013520 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.139631 (+126111us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540017aa50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:55.153430 (+ 13799us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3758224256}
I20260709 13:08:55.132884 16006 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:55.156960 15230 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:55.156399 15130 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:55.166049 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0377557109999316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:08:55.175961 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0231700359998968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2752s for a response
I20260709 13:08:55.177390 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1694) took 1477 ms. Trace:
I20260709 13:08:55.177894 15302 rpcz_store.cc:276] 0709 13:08:53.699691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.096599 (+1396908us) service_pool.cc:224] Handling call
0709 13:08:55.111600 (+ 15001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.177052 (+ 65452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.177297 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:55.131958 17493 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.179857 17684 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:08:55.139010 17536 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.139623 17588 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:55.144507 17598 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:55.201092 17719 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:08:55.202060 15226 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:55.210764 17588 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.211310 17663 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.212136 17588 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:55.215091 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.215315 17712 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:55.214704 17687 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.144272 17541 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.157678 17682 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.234952 15231 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:55.244118 15227 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:55.236961 15306 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:55.251452 15305 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:08:55.252528 15303 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:55.261169 17725 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:55.234282 17682 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:55.234450 17541 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:55.269279 17714 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.278095 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:55.278766 15377 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.287555 16003 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:08:55.292361 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 256413us
I20260709 13:08:55.293066 17660 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.295305 17660 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:55.295964 16006 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.296753 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:55.297405 17659 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:55.298797 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:55.298928 17659 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.299333 17659 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:55.299086 17481 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.299755 17659 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.300355 15232 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:55.301311 17481 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:55.307020 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:55.310191 16005 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:55.200014 17598 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.312368 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:55.319070 15377 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:08:55.320498 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:55.320618 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:55.321250 15376 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.324257 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:55.325192 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:08:55.326514 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 172627us
W20260709 13:08:55.371627 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.280190 17687 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.372812 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:55.381436 15381 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.285821 17714 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:55.326826 17660 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:55.327179 17598 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.326498 17541 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:55.400707 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 178078us
I20260709 13:08:55.396281 17578 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.420954 17578 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.423749 17578 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:55.424723 17541 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:55.426055 17541 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.428498 15229 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:55.435472 17419 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:08:55.373243 17536 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:08:55.436774 17419 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.437296 17419 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:55.438388 17419 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.439787 17419 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.441896 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:08:55.449431 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.404265 17660 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.372812 17686 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:08:55.470001 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 149619us
I20260709 13:08:55.451697 17714 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:55.449172 17588 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:55.442781 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:55.456740 17660 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:55.483040 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98340.2us
W20260709 13:08:55.487588 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.488241 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 353508us
I20260709 13:08:55.462420 17139 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.497216 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:55.497944 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.476135 17661 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.499418 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.505137 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.510690 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.512804 15224 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.510614 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.513899 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.510741 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.515726 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.516633 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.499480 17476 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.518050 15225 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 3: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:08:55.514941 15376 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:55.501129 17588 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:55.508512 17493 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.499490 17139 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:55.523947 17139 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.501930 17401 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:08:55.525444 17727 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:55.525941 17727 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:55.526316 17727 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.523102 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:08:55.514650 17677 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.007s
I20260709 13:08:55.522096 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:55.511754 17663 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:55.506598 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:55.535535 15301 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.523692 17493 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.548199 15381 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:55.551373 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.556836 15224 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:55.557813 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.516263 17661 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:55.553408 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46908.3us
I20260709 13:08:55.583242 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.584054 15230 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:55.521384 17476 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.587174 15233 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:55.579953 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 69127us
I20260709 13:08:55.556001 17493 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.590798 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:55.591873 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.596936 15301 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:55.592516 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.534024 17677 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.586469 17425 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.582239 17663 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.609974 15345 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.114s (SENT)
I20260709 13:08:55.625646 15301 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:55.631206 17734 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.631909 17734 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:55.632216 17649 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:08:55.632264 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.632711 17649 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:55.633081 17737 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.632843 17734 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.633587 17737 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:55.633893 17649 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.634442 17737 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.636559 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.637735 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.638338 17677 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:55.638754 15301 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:55.639880 15301 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.641038 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:55.644652 15381 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:55.645025 15381 pending_rounds.cc:85] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 1
I20260709 13:08:55.645288 15381 pending_rounds.cc:107] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:55.645550 15381 raft_consensus.cc:2889] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:55.650695 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.651705 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.676463 15380 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:08:55.643767 17660 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.681259 15375 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:55.675561 17536 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.682400 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:55.683370 15378 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:08:55.681071 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:08:55.681371 17598 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.689268 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:55.690217 15374 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:55.690269 17661 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:55.690956 17598 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:55.692562 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.692978 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:55.693328 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.693562 15373 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:55.693774 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.694002 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:55.694412 17652 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.705s	user 0.005s	sys 0.005s
I20260709 13:08:55.694756 15301 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:55.695562 15233 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:08:55.695765 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 69520.4us
I20260709 13:08:55.696489 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:55.696743 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.697417 17422 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.697960 17422 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:55.698956 17422 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.697414 15225 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:08:55.682529 17660 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:55.703760 17555 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 13:08:55.687045 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.689451 15381 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:55.704171 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:55.705569 15374 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:55.705178 15224 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:55.616981 17425 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:08:55.732777 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44738.8us
I20260709 13:08:55.744624 15379 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.745440 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 174) took 2473 ms. Trace:
I20260709 13:08:55.745939 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:55.734579 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 212544us
I20260709 13:08:55.678529 17686 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:08:55.732218 15373 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:55.752969 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:55.762039 15381 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.763186 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:55.687881 17481 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.677862 17663 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:55.733450 15118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52561.7us
I20260709 13:08:55.770365 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:55.745970 15300 rpcz_store.cc:276] 0709 13:08:53.271875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.090349 (+1818474us) service_pool.cc:224] Handling call
0709 13:08:55.148794 (+ 58445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.234830 (+ 86036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.234856 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.235443 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.463533 (+228090us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:55.744827 (+281294us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.745076 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.745145 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.745193 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:55.745211 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.745384 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1420,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":9395,"thread_start_us":481853,"threads_started":2,"wal-append.queue_time_us":454800}
I20260709 13:08:55.704169 17555 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:55.778898 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.779852 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:55.780247 17742 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:55.780486 15305 raft_consensus.cc:2376] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6. Re-sending same reply.
I20260709 13:08:55.781028 17742 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.783285 17742 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:55.785327 17476 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:55.780326 16000 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:55.787403 17712 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.787912 17712 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:55.789695 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1779) took 1038 ms. Trace:
I20260709 13:08:55.790104 15229 rpcz_store.cc:276] 0709 13:08:54.750832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.755690 (+  4858us) service_pool.cc:224] Handling call
0709 13:08:54.756082 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.429065 (+672983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.789445 (+360380us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540002f654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:55.789636 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313629440}
I20260709 13:08:55.797140 15302 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.796766 17425 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.797427 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.797757 16001 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:55.778934 17481 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:55.802489 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:55.804255 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:55.804920 15380 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:08:55.678695 17588 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.799692 15301 raft_consensus.cc:2376] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3. Re-sending same reply.
I20260709 13:08:55.807595 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:55.809716 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:55.761595 17714 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:55.813681 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:55.816952 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.817934 15230 raft_consensus.cc:2368] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:08:55.818869 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:55.811352 15373 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.821312 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:55.766358 17653 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:08:55.823542 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.829394 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:55.802517 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1688) took 2845 ms. Trace:
I20260709 13:08:55.842639 15301 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:55.836745 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:55.804606 17139 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:55.845100 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.820940 17476 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.850255 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:55.876852 15381 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:55.889492 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:55.898411 15300 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:55.872049 15307 rpcz_store.cc:276] 0709 13:08:52.957149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.962086 (+2004937us) service_pool.cc:224] Handling call
0709 13:08:54.962508 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:54.964306 (+  1798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.964333 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:55.025487 (+ 61154us) log.cc:844] Serialized 52 byte log entry
0709 13:08:55.463799 (+438312us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:55.758318 (+294519us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.759154 (+   836us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.769270 (+ 10116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.769383 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.769430 (+    47us) raft_consensus.cc:1685] finished
0709 13:08:55.802351 (+ 32921us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.802466 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30308,"prepare.queue_time_us":474973,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":12153,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":21997,"spinlock_wait_cycles":4376960,"thread_start_us":630542,"threads_started":2,"wal-append.queue_time_us":602888}
W20260709 13:08:55.934052 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.004211 15373 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:08:55.836104 17659 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:56.055538 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 355420us
I20260709 13:08:56.023605 17536 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:56.019379 17555 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.026691 17663 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.058815 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:56.064422 17687 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.002s
I20260709 13:08:56.020557 17578 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.068451 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:56.050140 17714 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.090633 15973 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:08:56.111040 17536 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.891563 17712 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:56.114789 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.238919 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:56.126116 15301 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:56.239964 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 319) took 1250 ms. Trace:
I20260709 13:08:56.040930 17401 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.137444 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.141434 15374 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:08:56.244243 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.194483 15231 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:56.073735 16008 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:56.217108 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 457593us
I20260709 13:08:56.233846 16005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 321) took 1152 ms. Trace:
I20260709 13:08:56.233891 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:56.234609 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:56.246732 15373 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:56.250834 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 160303us
I20260709 13:08:56.141366 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:55.841567 17730 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.620s
I20260709 13:08:56.052058 17644 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.578s
I20260709 13:08:56.251466 17663 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:56.286732 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.444059 15348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.089s	sys 0.154s
I20260709 13:08:56.475317 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1681) took 3796 ms. Trace:
W20260709 13:08:56.476437 15348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.101s	sys 0.156s
I20260709 13:08:56.344431 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:56.476717 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.346637 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53330.1us
I20260709 13:08:56.476749 15303 rpcz_store.cc:276] 0709 13:08:52.678727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.940155 (+2261428us) service_pool.cc:224] Handling call
0709 13:08:55.252356 (+312201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.252912 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.474999 (+1222087us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400250150. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:56.475241 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716994432}
W20260709 13:08:56.477790 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.476972 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 641895us
I20260709 13:08:56.245741 16005 rpcz_store.cc:276] 0709 13:08:54.989898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.993543 (+  3645us) service_pool.cc:224] Handling call
0709 13:08:56.141943 (+1148400us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54007026d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:56.142086 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708026112}
I20260709 13:08:56.240572 16003 rpcz_store.cc:276] 0709 13:08:54.989210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.992431 (+  3221us) service_pool.cc:224] Handling call
0709 13:08:56.239810 (+1247379us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54004f3654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:56.239913 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644659072}
I20260709 13:08:56.262594 15299 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:56.349072 17419 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.002s
W20260709 13:08:56.499787 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.489796 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:56.364148 15379 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.002s
I20260709 13:08:56.235536 17686 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.512605 15373 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:56.233465 17536 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.498353 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:56.504500 15379 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:56.515728 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:56.517263 17541 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:56.516712 17652 raft_consensus.cc:2764] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:08:56.430935 17422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.004s	sys 0.018s
W20260709 13:08:56.502926 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80113us
W20260709 13:08:56.320254 17723 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:56.481484 17139 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:56.329139 17549 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.296434 17493 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.000s
I20260709 13:08:56.303721 17481 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.295097 17750 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:56.242937 17578 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:56.520324 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 461517us
I20260709 13:08:56.260859 17401 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:56.543393 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.537189 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:56.542322 17419 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:56.538056 17518 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:56.547875 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:56.541615 16004 raft_consensus.cc:2410] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:56.525979 17674 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.540104 17722 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.788s	user 0.003s	sys 0.001s
I20260709 13:08:56.551789 17759 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:56.553706 17749 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:56.367941 17734 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.190s
I20260709 13:08:56.555187 17750 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:56.562263 17763 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:56.545491 17730 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.577275 15304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.017s	sys 0.008s
W20260709 13:08:56.618806 15304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.017s	sys 0.008s
I20260709 13:08:56.620517 17762 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.621562 17762 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.579329 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:56.591316 15375 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 4: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:56.554548 17419 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:56.550757 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:56.602731 17401 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.604934 17541 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:08:56.566354 17671 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.011s	sys 0.030s
I20260709 13:08:56.542928 17493 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.617239 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:56.617645 17754 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:08:56.576965 17518 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:56.591152 17759 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.547187 17686 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.635658 17759 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.636245 17518 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.637704 17686 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.549929 17549 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.641203 17549 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:56.638521 17686 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.646495 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:08:56.632474 17671 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.012s	sys 0.030s
I20260709 13:08:56.652697 15232 raft_consensus.cc:2368] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6.
I20260709 13:08:56.589861 17674 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.664310 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:56.618835 17730 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.666824 17750 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.673103 17649 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.660775 17422 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:56.675792 17422 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:56.677079 17422 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.653318 17419 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:56.679986 17757 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.206s	user 0.001s	sys 0.003s
I20260709 13:08:56.627698 17763 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:56.662410 17727 consensus_meta.cc:287] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.136s	user 0.013s	sys 0.003s
I20260709 13:08:56.738716 17674 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.739383 17578 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.739548 17674 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:56.680642 17419 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:56.741279 17760 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:08:56.745070 17578 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:56.745657 17578 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.746060 17578 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.747269 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 414) took 1327 ms. Trace:
I20260709 13:08:56.747908 16008 rpcz_store.cc:276] 0709 13:08:55.419651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.419834 (+   183us) service_pool.cc:224] Handling call
0709 13:08:55.420253 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.245296 (+825043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.746774 (+501478us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54005b2cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:56.746989 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502263680}
W20260709 13:08:56.725117 17761 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:08:56.657262 17401 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:08:56.652216 17686 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.738835 17730 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:08:56.752096 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 197226us
W20260709 13:08:56.770344 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 220246us
I20260709 13:08:56.780661 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1607) took 1246 ms. Trace:
I20260709 13:08:56.752820 17663 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:56.781635 15304 rpcz_store.cc:276] 0709 13:08:55.534322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.538781 (+  4459us) service_pool.cc:224] Handling call
0709 13:08:55.558745 (+ 19964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.605360 (+ 46615us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:55.835608 (+230248us) log.cc:844] Serialized 14 byte log entry
0709 13:08:56.780087 (+944479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:56.780154 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:56.780239 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.780362 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:56.780557 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":243483,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":120733,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":1089317,"threads_started":3,"wal-append.queue_time_us":743697}
I20260709 13:08:56.756229 17762 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:56.788573 16006 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:56.799265 17763 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.807554 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1677) took 1105 ms. Trace:
I20260709 13:08:56.808152 15376 rpcz_store.cc:276] 0709 13:08:55.702277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.712466 (+ 10189us) service_pool.cc:224] Handling call
0709 13:08:55.756989 (+ 44523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.769142 (+ 12153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.769187 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.798879 (+ 29692us) log.cc:844] Serialized 26 byte log entry
0709 13:08:56.216617 (+417738us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:56.216680 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.216783 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:56.678828 (+462045us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:08:56.807169 (+128341us) raft_consensus.cc:1685] finished
0709 13:08:56.807194 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:56.807469 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15593,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"spinlock_wait_cycles":6567296,"thread_start_us":417259,"threads_started":1,"wal-append.queue_time_us":673919}
I20260709 13:08:56.812510 17660 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.813313 17660 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:56.815740 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.817685 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:56.732959 17727 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.819391 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:56.740242 17674 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.862197 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:56.881340 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.882071 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:56.793848 17769 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.886257 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67279.9us
I20260709 13:08:56.888181 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:08:56.892449 17752 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.348s	user 0.000s	sys 0.002s
I20260709 13:08:56.893270 17773 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:56.893877 17773 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:56.894352 17773 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.895694 17727 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:56.896731 17663 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.897675 16002 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:56.899391 15971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.572s (SENT) [suppressed 30 similar messages]
I20260709 13:08:56.831326 17660 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:56.878146 17401 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:56.876555 17652 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:56.903294 17652 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:56.903822 17652 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:08:56.911597 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 121415us
I20260709 13:08:56.860397 17518 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:56.915918 17518 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:56.786757 17759 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.918716 17518 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:56.880872 17771 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:56.919718 17771 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.920178 17771 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:56.920892 15379 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:08:56.925328 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.904924 17652 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.937529 17518 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:56.938141 17652 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.939651 17518 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:56.919852 17759 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:56.940117 17518 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:56.946416 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:56.950073 15274 leader_election.cc:400] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:08:56.950651 15274 leader_election.cc:403] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:08:56.953483 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 130105us
W20260709 13:08:56.958451 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59098.1us
I20260709 13:08:56.957775 17419 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.964211 17712 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.971830 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.976994 17518 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.974371 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:56.984863 17762 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.964391 17773 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.989463 17422 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.990795 17773 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:56.990893 17578 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:56.980518 15999 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:08:56.992750 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51953.7us
I20260709 13:08:56.883417 17772 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:08:56.998492 17727 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.005206 17727 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.006325 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:57.006785 17425 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:57.006312 17678 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:57.007663 17652 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:57.008278 17425 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:57.009259 17781 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:57.013111 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:57.013523 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.014007 15381 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:57.014247 15304 raft_consensus.cc:2376] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5. Re-sending same reply.
I20260709 13:08:57.015566 17541 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.979087 17776 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.016280 17541 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.016840 17518 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.016978 17776 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.019032 17541 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:57.020130 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.020175 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:57.021865 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.022986 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 283) took 1226 ms. Trace:
I20260709 13:08:57.023444 15232 rpcz_store.cc:276] 0709 13:08:55.797038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.797184 (+   146us) service_pool.cc:224] Handling call
0709 13:08:57.022760 (+1225576us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400312754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:57.022893 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961220992}
I20260709 13:08:57.023885 16006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 415) took 1220 ms. Trace:
I20260709 13:08:57.024716 16006 rpcz_store.cc:276] 0709 13:08:55.803651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.812018 (+  8367us) service_pool.cc:224] Handling call
0709 13:08:55.889112 (+ 77094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.797842 (+908730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.023575 (+225733us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54006b03d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:57.023808 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001453312}
I20260709 13:08:57.023815 17541 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.016175 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 324) took 1513 ms. Trace:
I20260709 13:08:56.922524 17769 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.032666 16000 rpcz_store.cc:276] 0709 13:08:55.502554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.522656 (+ 20102us) service_pool.cc:224] Handling call
0709 13:08:55.579457 (+ 56801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.786701 (+207244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.015729 (+1229028us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540068d654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:57.016079 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241440128}
I20260709 13:08:57.033595 17493 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:57.026840 17401 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.034824 17769 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.027709 17445 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.035640 17445 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.031970 15224 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:08:57.037217 15224 pending_rounds.cc:85] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 6
I20260709 13:08:57.037549 15224 pending_rounds.cc:107] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:08:57.037856 15224 raft_consensus.cc:2889] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:57.037729 17536 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.038555 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.034446 17401 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.039534 15307 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:56.965011 17775 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.043362 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.044430 15303 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:57.046057 17730 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:57.046572 17730 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:57.048769 15377 raft_consensus.cc:2368] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4.
I20260709 13:08:56.971405 17712 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.049166 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:08:57.049780 16003 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.049851 16008 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:08:57.050365 16008 pending_rounds.cc:85] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Aborting all ops after (but not including) 5
I20260709 13:08:57.050588 16008 pending_rounds.cc:107] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:08:57.050817 16008 raft_consensus.cc:2889] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:57.051152 17712 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.051688 17776 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.051867 15304 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.031176 17686 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.052745 16004 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:57.020951 15230 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:57.054188 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.054903 15307 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:57.055142 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.055876 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.056533 15303 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:57.057317 17687 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.057960 17687 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.058744 17578 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.059240 16003 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:57.059821 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.027838 17674 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:57.092677 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:57.093881 15225 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.993682 17659 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:57.061842 16002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 323) took 1565 ms. Trace:
W20260709 13:08:57.063241 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 80171.2us
I20260709 13:08:57.063789 15299 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:08:57.049913 15974 leader_election.cc:400] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6.
I20260709 13:08:57.095755 15974 leader_election.cc:403] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:57.089906 17541 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:57.090401 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.094688 16002 rpcz_store.cc:276] 0709 13:08:55.496594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.520993 (+ 24399us) service_pool.cc:224] Handling call
0709 13:08:55.534710 (+ 13717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.898254 (+1363544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.061540 (+163286us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54006f0254. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:57.061759 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133565824}
I20260709 13:08:57.080449 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:57.090561 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:57.089993 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.092257 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:57.101352 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:57.105050 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.100291 15303 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:08:57.109781 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:57.116145 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66365us
I20260709 13:08:57.119498 15301 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:08:57.122624 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.123739 15299 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.124986 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.127578 15301 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:57.136988 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.138260 15308 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:57.090667 17734 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:57.143044 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.008316 17652 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:57.142627 15301 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:08:57.095404 17536 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:57.114450 17476 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.005s	sys 0.000s
I20260709 13:08:57.047742 17730 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.108592 17649 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.160550 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.161269 15301 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:57.152194 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.162149 15306 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.157094 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.158612 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.163686 15300 raft_consensus.cc:2410] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:08:57.159464 17476 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.006s	sys 0.000s
W20260709 13:08:57.180164 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 384800us
I20260709 13:08:57.146027 17425 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:57.209263 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.286294 15301 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.221339 17776 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.211838 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.291718 15305 raft_consensus.cc:2410] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:57.146049 17734 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:57.222110 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.148799 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 316) took 2186 ms. Trace:
I20260709 13:08:57.157094 17687 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.224751 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.107674 17781 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:08:57.159682 17401 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:57.230461 17527 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.143350 17684 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:08:57.171078 17649 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.170219 17686 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:57.237788 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:57.310356 15232 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.245220 15299 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:57.312041 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.313320 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.243963 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.227977 17727 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.265880 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:57.138341 17674 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.293547 16001 rpcz_store.cc:276] 0709 13:08:54.950943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.980610 (+ 29667us) service_pool.cc:224] Handling call
0709 13:08:57.100418 (+2119808us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54006f0ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:57.115762 (+ 15344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832804736}
I20260709 13:08:57.319769 17401 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.320461 17419 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.320770 17401 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.321731 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 251) took 2000 ms. Trace:
I20260709 13:08:57.143556 17712 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6.
I20260709 13:08:57.295056 15225 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:57.324425 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1621) took 1254 ms. Trace:
I20260709 13:08:57.321357 15230 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:57.324201 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.283475 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.297619 15233 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:57.331439 15301 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:57.324908 15377 rpcz_store.cc:276] 0709 13:08:56.071711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.344074 (+272363us) service_pool.cc:224] Handling call
0709 13:08:57.324193 (+980119us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540023e6d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:57.324358 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313568000}
I20260709 13:08:57.344043 15305 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:57.346226 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.299113 17772 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:57.355208 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.350623 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.306073 17687 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.366851 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.309369 17663 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.310940 17649 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.354844 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.355791 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.369004 15305 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:57.370498 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.371697 15305 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:57.322201 15999 rpcz_store.cc:276] 0709 13:08:55.321380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.323472 (+  2092us) service_pool.cc:224] Handling call
0709 13:08:56.196222 (+872750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.992018 (+795796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.320430 (+328412us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54007026d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:57.321467 (+  1037us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54007026d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:57.321656 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3560867584}
I20260709 13:08:57.375407 15299 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:08:57.376950 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.380048 15301 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:57.366063 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:57.381824 15308 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:08:57.384562 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.390264 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.296710 17776 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.392752 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:57.312860 17527 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.397688 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:57.401265 15227 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:57.403276 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:08:57.413882 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.415207 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.348871 17536 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:08:57.339811 17686 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.416431 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:57.417790 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.416257 15305 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:57.422564 15307 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:57.422851 17750 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:57.423602 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.419255 15301 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:08:57.389817 17781 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:57.424477 15305 raft_consensus.cc:2368] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8.
I20260709 13:08:57.425608 15224 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:08:57.426647 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.427502 15227 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:08:57.430219 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1802) took 1726 ms. Trace:
I20260709 13:08:57.397861 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:57.380789 17758 consensus_queue.cc:1059] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:57.339450 17652 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.430680 15231 rpcz_store.cc:276] 0709 13:08:55.694601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.696442 (+  1841us) service_pool.cc:224] Handling call
0709 13:08:55.696715 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.244926 (+548211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.026669 (+781743us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b54001692a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a9ddc0 00007f2f53b29a02 00007f2f53b25dd6 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:08:57.420481 (+393812us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000e7ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:57.420734 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040479872}
I20260709 13:08:57.425740 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:57.438292 15301 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:57.436308 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.415712 17759 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.312078 17734 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.420164 17598 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:57.451589 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.453953 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:08:57.473018 17789 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:08:57.473285 15301 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:57.474051 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.475564 15301 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:57.477738 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.478853 15230 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:08:57.457197 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.488209 15305 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.420893 17401 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.389267 17663 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.497694 17663 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:57.498466 17663 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.498660 17776 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:57.499074 17663 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.379638 17687 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.501873 15233 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:57.463250 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.434635 17769 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.415113 17772 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.456018 17762 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.418411 17771 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:57.453446 17759 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:57.501426 17784 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:08:57.459651 17684 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:57.453738 17518 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:57.532543 17674 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.548751 17674 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.480201 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:57.510134 17598 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:57.527633 17734 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:57.533958 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.529753 17759 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.564855 17781 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:57.637928 15301 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:57.499737 17776 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:08:57.679204 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 255104us
I20260709 13:08:57.683571 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:57.528223 17769 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:57.695369 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.589455 17661 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.455s	user 0.012s	sys 0.000s
I20260709 13:08:57.556712 17401 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:57.529824 17762 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:57.733680 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 280918us
I20260709 13:08:57.552421 17684 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:57.737406 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 97530.7us
I20260709 13:08:57.715271 15305 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:57.723160 15301 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:57.650019 17794 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:08:57.645610 17425 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:57.672821 17750 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:08:57.724126 17661 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.590s	user 0.014s	sys 0.011s
I20260709 13:08:57.776624 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:57.782922 15305 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.649040 17518 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:57.735836 17401 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:58.014326 15347 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.005s	sys 0.010s
I20260709 13:08:57.795053 15301 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:58.215576 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 532093us
W20260709 13:08:58.215742 15347 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.006s	sys 0.015s
W20260709 13:08:58.000478 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 463206us
I20260709 13:08:58.030606 17805 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.997479 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:57.748157 17806 raft_consensus.cc:3055] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.219751 17663 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:58.220899 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:58.221146 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:58.186599 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.214792 15230 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:58.260573 15227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.011s	sys 0.017s
I20260709 13:08:58.258111 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:08:58.302649 15227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.013s	sys 0.017s
W20260709 13:08:57.816920 15232 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.503s	user 0.017s	sys 0.000s
I20260709 13:08:58.303543 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1817) took 1226 ms. Trace:
I20260709 13:08:58.303668 15232 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:58.224567 15301 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:58.009943 17536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.025s	sys 0.056s
W20260709 13:08:58.233402 15306 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.963s	user 0.018s	sys 0.000s
W20260709 13:08:58.275247 15307 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.852s	user 0.014s	sys 0.005s
W20260709 13:08:58.204257 17775 consensus_meta.cc:287] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.162s	user 0.017s	sys 0.002s
I20260709 13:08:58.300612 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:58.301404 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.342103 15301 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:08:57.780725 17686 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:58.143908 17674 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:58.341749 15306 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:08:58.342509 15301 pending_rounds.cc:85] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 3
W20260709 13:08:58.277758 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55263.3us
I20260709 13:08:58.305667 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1821) took 1227 ms. Trace:
W20260709 13:08:58.334961 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 559383us
I20260709 13:08:58.353649 15232 rpcz_store.cc:276] 0709 13:08:57.078154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.221167 (+143013us) service_pool.cc:224] Handling call
0709 13:08:58.305594 (+1084427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.354591 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:58.340832 15307 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:08:58.305354 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 288) took 1165 ms. Trace:
I20260709 13:08:58.344928 16001 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:08:57.882582 17445 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:58.266111 17807 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:58.295763 17805 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.342545 15304 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:58.299019 17806 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:58.352133 15305 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:58.295394 17687 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:58.346961 15301 pending_rounds.cc:107] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:08:57.883168 17527 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:08:57.866181 17793 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:08:58.355571 15230 rpcz_store.cc:276] 0709 13:08:57.139856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.728428 (+588572us) service_pool.cc:224] Handling call
0709 13:08:58.214593 (+486165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.305051 (+ 90458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.305283 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.303966 15227 rpcz_store.cc:276] 0709 13:08:57.076873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.485556 (+408683us) service_pool.cc:224] Handling call
0709 13:08:57.486173 (+   617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.553189 (+ 67016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.553239 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.553962 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.303187 (+749225us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:58.303229 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.303304 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.303349 (+    45us) raft_consensus.cc:1685] finished
0709 13:08:58.303359 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.303487 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86536,"raft.queue_time_us":74432,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":69359,"thread_start_us":602382,"threads_started":1,"wal-append.queue_time_us":621086}
W20260709 13:08:58.343184 17536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.031s	sys 0.096s
I20260709 13:08:58.371691 17536 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:58.347026 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 185) took 1237 ms. Trace:
I20260709 13:08:58.240321 17782 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:58.350450 17775 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:08:58.359439 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.386492 15306 rpcz_store.cc:276] 0709 13:08:57.109800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.110012 (+   212us) service_pool.cc:224] Handling call
0709 13:08:58.346932 (+1236920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.373920 17816 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:58.387617 15303 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:58.360131 17776 consensus_queue.cc:1243] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Peer 5c70ddb5aae14b059dc90fd40125b034 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:58.015620 17598 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.391129 15300 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:58.391399 17684 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:58.393254 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1632) took 1183 ms. Trace:
I20260709 13:08:58.364938 17807 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.393739 15300 rpcz_store.cc:276] 0709 13:08:57.210680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.222650 (+ 11970us) service_pool.cc:224] Handling call
0709 13:08:58.393044 (+1170394us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540026c5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:58.393181 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471215872}
I20260709 13:08:58.384876 17401 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:58.373546 17671 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.398705 17782 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.242923 17769 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:58.360826 15232 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:57.964986 17772 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:58.351872 17518 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:58.365820 15301 raft_consensus.cc:2889] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:58.402156 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 289) took 1256 ms. Trace:
I20260709 13:08:58.305354 17578 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:58.357988 17422 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.364s	user 0.018s	sys 0.004s
I20260709 13:08:58.339298 17810 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.366837 17661 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:58.372432 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 290) took 1218 ms. Trace:
I20260709 13:08:57.870862 17476 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.437s
I20260709 13:08:58.374402 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.444865 15304 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:08:58.375427 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:08:58.446436 15305 raft_consensus.cc:2376] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4. Re-sending same reply.
I20260709 13:08:58.304589 17804 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:58.364782 17663 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.392668 15999 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:58.236961 17762 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:58.226477 17802 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.136s
I20260709 13:08:58.399029 17801 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:58.174718 17750 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.441195 15228 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:08:58.440583 15230 rpcz_store.cc:276] 0709 13:08:57.153821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.370689 (+1216868us) service_pool.cc:224] Handling call
0709 13:08:58.371405 (+   716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.371741 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.371792 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.371865 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:58.371936 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.372037 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.372259 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.467783 15228 pending_rounds.cc:85] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 5
I20260709 13:08:58.468214 15228 pending_rounds.cc:107] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:08:58.468604 15228 raft_consensus.cc:2889] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:58.362491 17813 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:08:57.873112 17425 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.479889 15379 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:58.440250 17661 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:58.410784 17536 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.373777 17781 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:58.693666 17815 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.464s	user 0.002s	sys 0.000s
I20260709 13:08:58.455946 17804 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:08:58.694664 17804 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.694916 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.696619 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:58.696852 17773 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:58.674964 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.520900 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 293) took 1259 ms. Trace:
W20260709 13:08:58.576413 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 223288us
I20260709 13:08:58.402666 15232 rpcz_store.cc:276] 0709 13:08:57.145820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.360002 (+1214182us) service_pool.cc:224] Handling call
0709 13:08:58.360415 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.401808 (+ 41393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.402076 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.576763 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.570921 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 193) took 1434 ms. Trace:
I20260709 13:08:58.508828 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:58.701565 15304 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:58.454746 17652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.002s	sys 0.017s
I20260709 13:08:58.718748 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.719722 15307 rpcz_store.cc:276] 0709 13:08:57.142001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.169943 (+ 27942us) service_pool.cc:224] Handling call
0709 13:08:58.570580 (+1400637us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:58.570813 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298591488}
I20260709 13:08:58.725960 17773 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:58.723811 15230 rpcz_store.cc:276] 0709 13:08:57.261359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.467658 (+1206299us) service_pool.cc:224] Handling call
0709 13:08:58.519979 (+ 52321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.520300 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.520369 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.520447 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:58.520513 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.520603 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.520797 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.761197 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.723699 15381 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.761865 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:58.475245 17663 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:08:58.521929 17649 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.125s	user 0.017s	sys 0.006s
W20260709 13:08:58.767594 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 467056us
W20260709 13:08:58.768956 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 395724us
W20260709 13:08:58.655234 17759 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.006s	user 0.014s	sys 0.001s
I20260709 13:08:58.509188 17802 consensus_queue.cc:1243] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:58.770485 15306 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:08:58.776983 15307 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:08:58.723743 17652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.003s	sys 0.045s
I20260709 13:08:58.519090 17813 consensus_queue.cc:1243] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:58.701099 17661 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.774080 15226 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:08:58.467331 17801 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:08:58.774302 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:58.799335 15230 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:58.479702 17817 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.443670 17810 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.779135 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:58.779244 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:58.558728 17806 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.780849 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.780962 17413 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:58.782279 15303 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:58.773293 17671 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.778719 17827 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:58.787302 17828 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.573195 17808 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:08:58.780151 17759 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.788901 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.789532 17652 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:58.787822 17804 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.799321 15226 pending_rounds.cc:85] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 7
I20260709 13:08:58.855103 15226 pending_rounds.cc:107] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:58.800499 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1777) took 1497 ms. Trace:
I20260709 13:08:58.855432 15226 raft_consensus.cc:2889] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:58.855602 15230 rpcz_store.cc:276] 0709 13:08:57.302613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.769080 (+1466467us) service_pool.cc:224] Handling call
0709 13:08:58.797192 (+ 28112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.800158 (+  2966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.800429 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.856590 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 295) took 1594 ms. Trace:
I20260709 13:08:58.811539 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:58.808897 17659 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:58.815994 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.816663 17536 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:58.820210 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.858229 15306 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:08:58.858613 15307 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:58.864583 17663 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:58.866997 17810 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:58.868564 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1818) took 1791 ms. Trace:
I20260709 13:08:58.776012 17649 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.811534 17401 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:58.874032 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.856974 15226 rpcz_store.cc:276] 0709 13:08:57.262390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.760712 (+1498322us) service_pool.cc:224] Handling call
0709 13:08:58.773714 (+ 13002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.856263 (+ 82549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.856524 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.874938 15377 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:58.824434 17671 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.880858 17671 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:58.824369 17413 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:08:58.845952 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73082.8us
I20260709 13:08:58.872587 15381 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:58.880941 17659 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:08:58.869259 15231 rpcz_store.cc:276] 0709 13:08:57.077201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.509540 (+432339us) service_pool.cc:224] Handling call
0709 13:08:57.532937 (+ 23397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.599874 (+ 66937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.599912 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.214593 (+614681us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.462097 (+247504us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:58.462170 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.462304 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.868111 (+405807us) raft_consensus.cc:1685] finished
0709 13:08:58.868136 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.868319 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12990,"raft.queue_time_us":50493,"raft.run_cpu_time_us":684,"raft.run_wall_time_us":144624,"thread_start_us":154741,"threads_started":1,"wal-append.queue_time_us":483629}
I20260709 13:08:58.883874 15303 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:08:58.900859 15380 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:08:58.809273 17817 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.871773 17806 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.829942 17684 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.876221 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1789) took 1516 ms. Trace:
I20260709 13:08:58.908543 15226 rpcz_store.cc:276] 0709 13:08:57.359937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.875264 (+1515327us) service_pool.cc:224] Handling call
0709 13:08:58.875611 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.875812 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.875837 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.875885 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:58.875935 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.876016 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.876160 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.902484 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.853344 17805 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:58.891680 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.899798 15303 pending_rounds.cc:85] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 2
W20260709 13:08:58.911185 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 138343us
I20260709 13:08:58.916560 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.912423 15303 pending_rounds.cc:107] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:58.917789 15303 raft_consensus.cc:2889] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:58.908044 17401 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:08:58.919440 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.919817 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:58.919621 17401 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.920748 16006 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:58.921300 16006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 254) took 1558 ms. Trace:
I20260709 13:08:58.921213 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.922260 15307 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:58.868537 17808 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.928874 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.908267 17425 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.917390 15301 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:08:58.955571 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.921818 16006 rpcz_store.cc:276] 0709 13:08:57.363209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.375619 (+ 12410us) service_pool.cc:224] Handling call
0709 13:08:58.919648 (+1544029us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b5800003c98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:08:58.921227 (+  1579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12167936}
I20260709 13:08:58.942809 15375 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:58.958901 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57274.1us
I20260709 13:08:58.945955 17413 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.944482 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:58.960070 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:58.961550 15300 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:08:58.931891 17734 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.274s	user 0.011s	sys 0.006s
I20260709 13:08:58.972307 15381 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:58.973173 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:58.980469 15381 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:58.824656 17828 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.999644 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 286) took 2177 ms. Trace:
I20260709 13:08:59.003978 15229 rpcz_store.cc:276] 0709 13:08:56.820663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.820876 (+   213us) service_pool.cc:224] Handling call
0709 13:08:56.884499 (+ 63623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.922328 (+ 37829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.922364 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:56.922414 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:56.922460 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.997316 (+2074856us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400284bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:08:58.997371 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.997535 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86382336}
I20260709 13:08:58.823915 17827 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:58.872424 17773 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:58.959360 17687 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.972102 17422 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:58.908847 17801 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:59.063437 17773 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.045571 17422 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:59.070662 17807 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:59.056556 17805 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:08:59.073838 17819 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:08:59.075088 17771 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:59.096495 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 318773us
I20260709 13:08:59.054920 17759 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:59.107952 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 296485us
I20260709 13:08:59.035295 17687 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:59.070765 17422 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:59.113797 15381 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:59.121668 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1787) took 1778 ms. Trace:
I20260709 13:08:59.122221 15230 rpcz_store.cc:276] 0709 13:08:57.342846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.856503 (+1513657us) service_pool.cc:224] Handling call
0709 13:08:58.856915 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.911109 (+ 54194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.911163 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.923227 (+ 12064us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.105196 (+181969us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:59.105266 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.105367 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.121390 (+ 16023us) raft_consensus.cc:1685] finished
0709 13:08:59.121413 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.121592 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82539,"raft.queue_time_us":55038,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":165,"thread_start_us":122694,"threads_started":1,"wal-append.queue_time_us":158100}
I20260709 13:08:59.130512 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:59.131691 15381 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:08:59.096010 17527 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:59.114277 17834 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:08:59.108323 17804 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:59.114533 17649 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:59.137565 17772 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:08:59.140564 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 188) took 2004 ms. Trace:
I20260709 13:08:59.132858 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:59.146025 15381 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:08:59.025705 17659 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:59.145385 15302 rpcz_store.cc:276] 0709 13:08:57.134277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.134498 (+   221us) service_pool.cc:224] Handling call
0709 13:08:57.134992 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.135343 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:57.291050 (+155707us) log.cc:844] Serialized 14 byte log entry
0709 13:08:59.073268 (+1782218us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b18000c2e60. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a
0709 13:08:59.120174 (+ 46906us) log.cc:844] Serialized 14 byte log entry
0709 13:08:59.134249 (+ 14075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.137344 (+  3095us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:59.137420 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.138074 (+   654us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.138270 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7537,"prepare.queue_time_us":279261,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":4886,"raft.queue_time_us":2256,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":117,"spinlock_wait_cycles":32490752,"thread_start_us":286361,"threads_started":4,"wal-append.queue_time_us":252480,"wal-append.run_cpu_time_us":1490,"wal-append.run_wall_time_us":1009007}
W20260709 13:08:59.153446 15273 connection.cc:256] RPC call timeout handler was delayed by -1.1211742350000122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2811s for a response
I20260709 13:08:59.155387 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:08:59.140369 17527 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:59.169042 17808 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:59.170365 17841 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:59.171181 17527 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:59.172902 17687 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:59.153157 17772 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:08:59.182570 17833 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 13:08:59.185300 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73921.6us
W20260709 13:08:59.187491 15973 connection.cc:256] RPC call timeout handler was delayed by -1.8749079179998489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:08:59.196683 15973 connection.cc:256] RPC call timeout handler was delayed by -1.5082774989999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
I20260709 13:08:59.202715 15381 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:08:59.204416 15381 pending_rounds.cc:85] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 3
I20260709 13:08:59.205497 15381 pending_rounds.cc:107] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:08:59.206379 15381 raft_consensus.cc:2889] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:59.219522 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:59.220717 15373 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:59.161370 17817 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:59.228542 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 117845us
I20260709 13:08:59.217067 15382 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:59.232975 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46890.5us
I20260709 13:08:59.234200 15230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:59.235173 15230 raft_consensus.cc:606] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:59.242168 17827 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:08:59.227445 17830 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.247002 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 291) took 2035 ms. Trace:
I20260709 13:08:59.190033 17828 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:08:59.251161 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:59.252604 17687 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:59.257812 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 144278us
I20260709 13:08:59.259135 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:08:59.247587 15227 rpcz_store.cc:276] 0709 13:08:57.211258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.245869 (+2034611us) service_pool.cc:224] Handling call
0709 13:08:59.246280 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.246463 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.246489 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.246529 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:59.246567 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.246757 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.246920 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.285559 17762 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.286412 17762 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:59.216084 17541 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.288568 17828 raft_consensus.cc:2764] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:08:59.298542 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:59.302026 15196 leader_election.cc:400] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8.
I20260709 13:08:59.300122 17401 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:59.303426 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:08:59.303771 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:59.304283 16000 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:08:59.306152 15382 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:59.288642 17541 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:08:59.311547 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:59.313138 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:59.308422 17527 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:08:59.315883 17842 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:59.317055 17844 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:08:59.317749 17782 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:59.317678 17804 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:59.310998 17744 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:08:59.322923 17687 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:59.333195 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72146.1us
I20260709 13:08:59.228888 17661 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:08:59.329309 17842 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.348551 15374 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:59.349701 17541 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:08:59.342463 17518 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:08:59.353932 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:59.355516 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:59.357411 15308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 190) took 2222 ms (client timeout 2037 ms). Trace:
W20260709 13:08:59.357961 15308 rpcz_store.cc:269] 0709 13:08:57.135434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.146832 (+ 11398us) service_pool.cc:224] Handling call
0709 13:08:59.357116 (+2210284us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400185bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:59.357291 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502001920}
I20260709 13:08:59.360797 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:59.334372 17527 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:59.362003 17527 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:08:59.362509 17527 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.363279 15375 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:08:59.342669 17481 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:08:59.347936 17842 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:59.365851 15224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 294) took 2104 ms (client timeout 2078 ms). Trace:
W20260709 13:08:59.366466 15224 rpcz_store.cc:269] 0709 13:08:57.261957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.281183 (+ 19226us) service_pool.cc:224] Handling call
0709 13:08:59.365599 (+2084416us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b540012f7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:59.365764 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222199040}
I20260709 13:08:59.368561 15306 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:59.351119 17541 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.372854 15379 raft_consensus.cc:2410] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:08:59.376361 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10888684198543f19c54c7cbcb094157"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:08:59.377887 15224 raft_consensus.cc:606] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:59.378553 15224 raft_consensus.cc:614] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:59.340739 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81718.3us
I20260709 13:08:59.344173 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:08:59.375514 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:08:59.402122 15302 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:59.372112 17661 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:08:59.417138 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73105.9us
I20260709 13:08:59.418562 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:08:59.431591 15376 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 3.
I20260709 13:08:59.407052 17804 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:59.486126 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 274370us
W20260709 13:08:59.499800 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81378.9us
W20260709 13:08:59.502933 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86783.2us
I20260709 13:08:59.504077 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:59.503134 15973 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:08:59.485476 17804 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:08:59.519454 15233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 292) took 2282 ms (client timeout 2831 ms). Trace:
I20260709 13:08:59.495067 17671 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:59.515813 17598 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:59.523715 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:08:59.520135 15233 rpcz_store.cc:269] 0709 13:08:57.236887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.393863 (+156976us) service_pool.cc:224] Handling call
0709 13:08:59.516580 (+2122717us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b5400359dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:08:59.519356 (+  2776us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181994752}
I20260709 13:08:59.525475 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:59.516185 17659 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.538203 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:08:59.539153 15299 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:08:59.539737 15299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1703) took 2180 ms (client timeout 1633 ms). Trace:
I20260709 13:08:59.515784 17817 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.519044 17804 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:59.540148 15299 rpcz_store.cc:269] 0709 13:08:57.359768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.379710 (+ 19942us) service_pool.cc:224] Handling call
0709 13:08:59.537977 (+2158267us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b58000a1d98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:08:59.539649 (+  1672us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33999104}
W20260709 13:08:59.551060 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 290723us
I20260709 13:08:59.513782 17858 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:08:59.536415 17762 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:08:59.549988 17659 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.518827 17744 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:59.577068 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:08:59.556520 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 359426us
I20260709 13:08:59.578590 15274 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:08:59.557860 17661 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.545472 17481 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:08:59.594431 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76106us
I20260709 13:08:59.596165 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:59.571733 17659 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:59.626624 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 101278us
I20260709 13:08:59.590350 17661 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:08:59.648942 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61646us
I20260709 13:08:59.649888 17549 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:59.600761 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:08:59.658193 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62116.5us
I20260709 13:08:59.681788 17671 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:59.651152 17661 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.656034 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:08:59.625761 17762 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:59.682021 17422 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:59.692795 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:08:59.658339 17861 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.693403 17762 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.774497 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:08:59.776157 17834 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:59.782372 15225 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:59.765710 17855 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:08:59.791100 15226 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:08:59.711335 17869 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:59.795004 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:59.812390 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:59.707715 17865 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.694602 17808 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.080s
W20260709 13:08:59.775486 17856 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260709 13:08:59.817636 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:59.846596 15226 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:08:59.806171 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:59.779996 17828 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.828120 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:08:59.855610 15227 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:59.831725 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 132133us
I20260709 13:08:59.808615 17762 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.703002 17863 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:08:59.780990 17861 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.847503 15230 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:59.807065 17481 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.854269 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:08:59.763376 17734 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:08:59.869128 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:00.070062 15299 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
W20260709 13:09:00.041518 15302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.002s	sys 0.010s
W20260709 13:09:00.073988 15302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.004s	sys 0.010s
I20260709 13:09:00.045714 15300 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:59.898865 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 207203us
I20260709 13:09:00.111629 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:00.109449 17862 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.452s	user 0.001s	sys 0.001s
I20260709 13:09:00.070092 17861 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.123945 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.120607 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.035439 15227 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:00.127861 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:00.135229 15225 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:00.115595 17842 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.007s
W20260709 13:09:00.139367 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 446724us
I20260709 13:09:00.137792 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.111567 17687 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.144440 15300 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:00.126376 17859 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.495s	user 0.001s	sys 0.001s
W20260709 13:09:00.128039 17864 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.423s	user 0.000s	sys 0.002s
I20260709 13:09:00.148329 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:00.079664 17481 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.151871 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.157008 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.158625 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.159658 15227 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:00.164969 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.166528 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.166914 17481 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.167838 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.170888 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1688) took 1648 ms. Trace:
I20260709 13:09:00.171418 15380 rpcz_store.cc:276] 0709 13:08:58.522621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.718386 (+195765us) service_pool.cc:224] Handling call
0709 13:09:00.170647 (+1452261us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54001fe354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:00.170813 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407061888}
W20260709 13:09:00.173277 17867 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:09:00.175047 17873 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:09:00.175367 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:00.156453 17808 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:09:00.176893 17866 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:09:00.177404 15379 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:09:00.178557 17870 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:09:00.180871 17879 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.186872 15230 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:00.183792 15231 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:00.199869 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:00.201484 15231 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:00.205209 15230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:00.145233 17842 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.151239 17687 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.384127 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.444873 17874 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.525663 15231 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:00.159613 17875 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.501351 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.536662 15227 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:00.206085 15230 raft_consensus.cc:606] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:00.526461 17874 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:00.531001 17661 consensus_meta.cc:287] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.822s	user 0.006s	sys 0.009s
I20260709 13:09:00.550313 15230 raft_consensus.cc:614] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:00.211503 17871 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:09:00.460151 17527 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.097s	user 0.012s	sys 0.004s
W20260709 13:09:00.218823 17659 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
W20260709 13:09:00.493192 17817 consensus_meta.cc:287] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.937s	user 0.009s	sys 0.005s
W20260709 13:09:00.366696 17872 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
I20260709 13:09:00.590425 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:00.497573 17804 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.937s	user 0.012s	sys 0.002s
I20260709 13:09:00.594868 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1708) took 1485 ms. Trace:
I20260709 13:09:00.651643 15381 rpcz_store.cc:276] 0709 13:08:59.109925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.226916 (+116991us) service_pool.cc:224] Handling call
0709 13:08:59.231417 (+  4501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.231674 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:59.273336 (+ 41662us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.175369 (+902033us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b18003c99a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:09:00.594415 (+419046us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.594483 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:00.594541 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.594624 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.594798 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41210,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":19267,"spinlock_wait_cycles":2469632,"thread_start_us":418735,"threads_started":1}
W20260709 13:09:00.293851 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 140469us
I20260709 13:09:00.207927 15225 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:00.644423 15229 raft_consensus.cc:2410] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:00.190102 17863 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.331375 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:00.671415 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:00.673259 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:00.674471 15118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 343161us
I20260709 13:09:00.675410 15231 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:00.676784 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.679476 17481 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.682834 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 92573.2us
W20260709 13:09:00.688700 15199 connection.cc:256] RPC call timeout handler was delayed by -1.8118624859999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:09:00.691128 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.695273 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1727) took 1003 ms. Trace:
I20260709 13:09:00.695669 15381 rpcz_store.cc:276] 0709 13:08:59.691988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.670112 (+978124us) service_pool.cc:224] Handling call
0709 13:09:00.694735 (+ 24623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.694935 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.694954 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.694985 (+    31us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:00.695055 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.695117 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.695223 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:00.672384 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.008s	sys 0.012s
W20260709 13:09:00.699178 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.009s	sys 0.012s
W20260709 13:09:00.699520 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 1.00845e+06us
I20260709 13:09:00.700306 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:00.693297 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:00.658715 17817 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:00.680150 17481 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.714789 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1739) took 1798 ms. Trace:
I20260709 13:09:00.715493 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:00.715378 15306 rpcz_store.cc:276] 0709 13:08:58.916436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.922846 (+  6410us) service_pool.cc:224] Handling call
0709 13:08:59.367931 (+445085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.369470 (+  1539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.708315 (+1338845us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400185bd0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:00.714703 (+  6388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022680448}
I20260709 13:09:00.707849 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:00.718981 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.319936 17762 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.722821 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:00.726707 15225 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:09:00.595124 17661 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.729614 17661 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:00.730453 15380 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:00.694147 17865 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:00.206110 17879 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.692960 17422 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.738348 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:00.697083 17890 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.644099 17527 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.743297 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:00.748044 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:00.704728 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:00.666504 17804 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.697252 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:00.659510 17659 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.719494 17869 raft_consensus.cc:2764] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:09:00.756251 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 71044.2us
I20260709 13:09:00.760860 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1727) took 2373 ms. Trace:
I20260709 13:09:00.787803 15305 rpcz_store.cc:276] 0709 13:08:58.374866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.447299 (+ 72433us) service_pool.cc:224] Handling call
0709 13:08:59.364548 (+917249us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b58000a1d98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:08:59.364770 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.492879 (+128109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.492931 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.493627 (+   696us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.649520 (+155893us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:59.649564 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.649644 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.740513 (+1090869us) raft_consensus.cc:1685] finished
0709 13:09:00.740555 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.747982 (+  7427us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":195631,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":21961,"spinlock_wait_cycles":17632640,"thread_start_us":247714,"threads_started":2,"wal-append.queue_time_us":282370}
I20260709 13:09:00.582664 17875 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.790601 16002 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:00.793054 15231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
W20260709 13:09:00.797412 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 79666.7us
I20260709 13:09:00.797794 15231 raft_consensus.cc:606] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:00.798218 15231 raft_consensus.cc:614] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:00.799490 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1721) took 1411 ms. Trace:
I20260709 13:09:00.800357 15373 rpcz_store.cc:276] 0709 13:08:59.388452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.484941 (+ 96489us) service_pool.cc:224] Handling call
0709 13:08:59.485386 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.488921 (+  3535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.488970 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.494719 (+  5749us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.693434 (+198715us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:59.693477 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.693554 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.768603 (+1075049us) raft_consensus.cc:1685] finished
0709 13:09:00.798635 (+ 30032us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.799299 (+   664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3179,"raft.queue_time_us":2970,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":8113,"thread_start_us":167237,"threads_started":1,"wal-append.queue_time_us":361495}
W20260709 13:09:00.805297 15273 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.571s (SENT)
I20260709 13:09:00.824318 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:00.806008 15230 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:00.744743 17865 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:00.688097 17863 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.812326 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1725) took 1121 ms. Trace:
I20260709 13:09:00.786156 15999 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:00.818535 15224 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:00.820019 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76880us
I20260709 13:09:00.828681 15379 rpcz_store.cc:276] 0709 13:08:59.691389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.582079 (+890690us) service_pool.cc:224] Handling call
0709 13:09:00.650293 (+ 68214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.650541 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:00.681583 (+ 31042us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.810843 (+129260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.810923 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:00.811009 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.812046 (+  1037us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.812241 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40174,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":1226,"thread_start_us":128764,"threads_started":1}
W20260709 13:09:00.842450 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 94507.6us
I20260709 13:09:00.846297 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:00.814909 17661 raft_consensus.cc:2764] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:00.807086 17868 raft_consensus.cc:2764] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:00.755808 17422 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.835074 17865 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:00.870307 17875 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:00.871138 17875 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:00.871948 17836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.010s	sys 0.031s
W20260709 13:09:00.872416 17836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.011s	sys 0.031s
I20260709 13:09:00.858639 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:00.859200 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:00.850483 16001 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:00.861511 17904 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:00.874425 17527 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.874794 17661 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:00.865295 17481 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:00.875171 17527 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:00.875842 17481 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:00.874966 17904 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.877110 17905 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:00.879033 17904 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:00.874157 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:00.881345 17661 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:00.882149 17661 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:00.882800 17661 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.763698 17890 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.884717 15345 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:00.876477 17481 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:00.898821 17481 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.900754 17890 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.901247 17903 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:09:00.859655 17828 raft_consensus.cc:2764] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:00.908980 17762 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.909476 17817 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.911412 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:00.909806 17541 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:09:00.928517 17687 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:00.932873 17874 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.932646 17481 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:00.933657 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1724) took 1242 ms. Trace:
I20260709 13:09:00.934108 15380 rpcz_store.cc:276] 0709 13:08:59.690978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.198650 (+507672us) service_pool.cc:224] Handling call
0709 13:09:00.199070 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.730934 (+531864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.933383 (+202449us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540014d2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:00.933583 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221512448}
I20260709 13:09:00.934842 17730 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.935434 17481 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:00.935812 15380 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:00.936769 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 369) took 1060 ms. Trace:
I20260709 13:09:00.938468 17659 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.941370 17879 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:00.943655 17804 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.938405 15380 rpcz_store.cc:276] 0709 13:08:59.876254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.935072 (+1058818us) service_pool.cc:224] Handling call
0709 13:09:00.935432 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.936497 (+  1065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.936706 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.947173 15380 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:00.953281 17863 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:00.895531 17861 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.004s
I20260709 13:09:00.955040 17861 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.958417 17861 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.849390 17889 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:09:00.950011 17422 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:00.886293 17869 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:00.973706 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62395.5us
I20260709 13:09:00.986009 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:00.989503 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:00.993278 17476 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:00.994012 17476 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:00.994896 17476 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:00.996014 17476 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.999862 17541 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:01.000648 17541 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:01.001192 17541 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:00.974294 17891 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:09:01.010977 17831 log.cc:927] Time spent T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 1.957s	user 0.005s	sys 0.013s
I20260709 13:09:01.020995 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.020833 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:01.022785 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 301620us
W20260709 13:09:01.024881 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 219928us
I20260709 13:09:01.022537 15226 raft_consensus.cc:2376] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4. Re-sending same reply.
I20260709 13:09:01.023721 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:01.038064 15231 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:01.042543 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 284) took 4225 ms. Trace:
I20260709 13:09:01.043166 15228 rpcz_store.cc:276] 0709 13:08:56.817354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.817639 (+   285us) service_pool.cc:224] Handling call
0709 13:08:56.884968 (+ 67329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.469263 (+1584295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.042120 (+2572857us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002d0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:01.042441 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3570131328}
W20260709 13:09:01.042066 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 243754us
W20260709 13:09:01.061686 15273 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.638s (SENT)
I20260709 13:09:01.066582 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.062263 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.024366 17828 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:01.062665 17884 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.028790 17808 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:09:01.085731 15273 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.781s (SENT)
I20260709 13:09:01.044160 17649 raft_consensus.cc:2764] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:09:01.099889 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76298.5us
I20260709 13:09:01.061689 17869 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.085001 17861 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:01.102051 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:01.071995 17828 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:01.088613 17863 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.099427 17677 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:01.139201 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.113894 17758 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:01.144210 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58496.7us
I20260709 13:09:01.153057 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 366) took 1448 ms. Trace:
I20260709 13:09:01.100427 17905 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:09:01.133118 17828 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:01.154254 15381 rpcz_store.cc:276] 0709 13:08:59.704311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.706009 (+1001698us) service_pool.cc:224] Handling call
0709 13:09:00.722875 (+ 16866us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:00.750922 (+ 28047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.750973 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:00.808263 (+ 57290us) log.cc:844] Serialized 52 byte log entry
0709 13:09:01.111614 (+303351us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:01.129927 (+ 18313us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.130242 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.130357 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.152657 (+ 22300us) raft_consensus.cc:1685] finished
0709 13:09:01.152698 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.152971 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17998,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":16993,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":48935,"thread_start_us":253517,"threads_started":1,"wal-append.queue_time_us":303848}
I20260709 13:09:01.132644 17879 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.131695 17863 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.165190 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.165310 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.164317 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.166596 15305 raft_consensus.cc:2368] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:09:01.166079 15306 raft_consensus.cc:2368] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 5.
I20260709 13:09:01.166085 15381 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:01.128057 17712 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:09:01.169813 15974 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.170061 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.171615 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.173126 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.174997 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.175472 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.179200 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.177609 15301 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:01.152954 17861 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:01.128393 17869 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.171013 17863 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.174407 15306 raft_consensus.cc:2368] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4.
I20260709 13:09:01.177829 15304 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:01.173918 15308 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7.
I20260709 13:09:01.156718 17762 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:01.228667 15381 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:01.229672 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 367) took 1518 ms. Trace:
I20260709 13:09:01.230791 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.223974 17865 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.240417 15303 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:01.239730 15373 rpcz_store.cc:276] 0709 13:08:59.711425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.835765 (+1124340us) service_pool.cc:224] Handling call
0709 13:09:00.837179 (+  1414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.838700 (+  1521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.838754 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.839530 (+   776us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.171063 (+331533us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:01.171108 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.171201 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.229420 (+ 58219us) raft_consensus.cc:1685] finished
0709 13:09:01.229446 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.229582 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":14207,"thread_start_us":264025,"threads_started":1,"wal-append.queue_time_us":369914}
I20260709 13:09:01.242651 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.231565 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.245966 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.249744 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:01.250643 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.250895 15302 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:01.175175 17615 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:01.253783 17906 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:09:01.232185 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.157234 17758 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.255641 17762 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.238389 17861 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.258142 17762 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:01.258457 17861 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:01.259511 17910 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:09:01.172438 17913 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:09:01.154110 17677 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.236938 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.255551 15300 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:01.225666 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.247727 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.164791 17875 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:09:01.284225 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.285332 15307 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:01.286340 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.287072 15308 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.287576 15305 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 4: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:01.269389 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.177136 17912 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:01.233826 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.269330 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.292279 15301 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.293128 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.296521 17907 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:01.166054 17909 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:09:01.306617 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.307534 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.307555 15300 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:01.314901 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.315713 15300 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:01.316840 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.317737 15302 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:01.319816 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.321022 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.322481 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.324208 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.325002 15306 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:01.326073 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.327606 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.328639 15381 raft_consensus.cc:2410] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:01.328948 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.329821 15373 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:01.330688 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.330739 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.331286 15301 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:01.331795 15373 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.332501 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.333346 15306 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:01.333046 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:01.329090 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 155562us
I20260709 13:09:01.334324 15308 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:09:01.334550 15228 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:01.334987 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:01.336540 15308 raft_consensus.cc:1217] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-5.4]   Dedup: 3.3->[5.4-5.4]
I20260709 13:09:01.337769 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.336433 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.341445 15306 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:01.342536 15308 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:09:01.345737 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:01.353894 17861 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:01.357118 17861 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.357846 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.359285 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.374890 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.372601 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.361511 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.377590 15381 raft_consensus.cc:2368] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:09:01.377799 15304 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:01.368239 15301 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:09:01.367151 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:01.361129 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:01.364950 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.381901 15302 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.384720 15306 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:01.341637 17804 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.387651 15373 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:01.389060 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.389292 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:01.390463 15373 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:01.387936 15273 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.943s (SENT)
I20260709 13:09:01.391574 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.371723 17876 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:01.392104 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.390583 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.360229 17861 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:01.327447 17541 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:01.404065 15273 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.977s (SENT)
I20260709 13:09:01.380707 17762 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.404843 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.404407 15373 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:01.398288 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:01.339408 17661 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.409219 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.410869 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.411190 17661 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:01.411844 15373 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:01.412577 15380 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:01.413424 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.413844 17909 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:01.414332 17909 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:01.414727 17909 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.415037 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.417157 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:01.394407 17921 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:01.421502 17758 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:01.421928 17762 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:01.423023 17811 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:01.424435 17541 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:01.432413 17914 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.433995 17865 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:01.425088 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.406219 17687 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:01.436244 15302 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
W20260709 13:09:01.434976 15273 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.087s (SENT)
I20260709 13:09:01.454917 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.455194 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.390643 17804 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:01.455889 17804 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.432911 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.450687 17811 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:01.451093 17762 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:01.456540 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.463128 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:01.465822 17758 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:01.465473 17811 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.466807 17758 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.467139 17811 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:01.467526 17476 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:01.467984 17476 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:01.468899 17476 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.470134 17476 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:01.433225 17677 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:01.456518 15273 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.115s (SENT)
I20260709 13:09:01.435213 17861 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.477000 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.445468 15304 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
W20260709 13:09:01.478374 15273 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.126s (SENT)
I20260709 13:09:01.394872 17876 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:01.484864 17876 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.486018 17842 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:01.467208 17758 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:01.487761 17758 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:01.491204 17897 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.663s	user 0.000s	sys 0.007s
I20260709 13:09:01.436673 17890 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.478996 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:01.494797 15273 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.142s (SENT)
I20260709 13:09:01.480707 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1730) took 1361 ms. Trace:
I20260709 13:09:01.495754 17890 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.495419 15381 rpcz_store.cc:276] 0709 13:09:00.119392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.472583 (+1353191us) service_pool.cc:224] Handling call
0709 13:09:01.479952 (+  7369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.480161 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.480186 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.480231 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:01.480282 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.480374 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.480525 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:01.482621 17730 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.000s
I20260709 13:09:01.497344 15381 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:01.483556 17861 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.479681 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.498593 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.499092 15381 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:09:01.499501 15381 pending_rounds.cc:85] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:09:01.499758 15381 pending_rounds.cc:107] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:09:01.500464 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.499949 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.495021 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 364) took 1884 ms. Trace:
I20260709 13:09:01.500017 15381 raft_consensus.cc:2889] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:01.500124 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:01.508216 15273 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.158s (SENT)
W20260709 13:09:01.511749 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.511276 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.507273 17913 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:01.460405 17865 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:01.523994 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:01.501358 15378 rpcz_store.cc:276] 0709 13:08:59.611096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.180114 (+569018us) service_pool.cc:224] Handling call
0709 13:09:00.180548 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.181031 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.181068 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.181783 (+   715us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.643159 (+461376us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:00.643231 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.643361 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.490412 (+847051us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:01.494684 (+  4272us) raft_consensus.cc:1685] finished
0709 13:09:01.494707 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.494955 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1698,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":47102,"spinlock_wait_cycles":10979200,"thread_start_us":209798,"threads_started":1,"wal-append.queue_time_us":523894}
I20260709 13:09:01.524982 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.432284 17817 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.528760 15381 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:01.529264 15381 pending_rounds.cc:85] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 3
I20260709 13:09:01.529719 15381 pending_rounds.cc:107] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:01.530009 15381 raft_consensus.cc:2889] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:01.527959 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:01.532159 16005 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.533934 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.535171 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.527316 17649 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:01.536657 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:01.537413 17830 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:01.507365 17661 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.537969 17830 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:01.507937 17518 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.538762 17518 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.539117 17830 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.520803 17808 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:01.549541 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:01.549489 17649 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:01.587277 17804 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.548622 17884 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:01.589200 17884 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:01.590178 17884 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.591229 17909 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:01.595036 15273 leader_election.cc:336] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.181s (SENT)
I20260709 13:09:01.595839 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.597229 15228 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:01.554715 17808 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.553299 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.590204 17804 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:01.518824 17750 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:09:01.529966 17861 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.576860 17518 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:01.628290 17861 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.631085 17869 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:01.580876 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.577972 17828 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.610323 17909 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:01.613004 17649 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:01.614068 15273 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.195s (SENT)
I20260709 13:09:01.615561 15373 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:09:01.618803 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.524070 17849 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.550577 15225 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:01.607547 17762 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.625070 17863 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.631261 17861 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:01.632171 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51445.9us
I20260709 13:09:01.603451 17913 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.650698 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:01.639336 15273 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.212s (SENT)
I20260709 13:09:01.619320 17808 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.618096 17842 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:01.654170 17660 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:01.655948 17842 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:01.650520 17830 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.658301 17842 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:01.658042 17830 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.644125 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1686) took 3162 ms. Trace:
I20260709 13:09:01.659040 15374 rpcz_store.cc:276] 0709 13:08:58.482128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.482302 (+   174us) service_pool.cc:224] Handling call
0709 13:08:58.570544 (+ 88242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.349215 (+778671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.643868 (+2294653us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54003f2354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:01.644056 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788726144}
W20260709 13:09:01.648523 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.652400 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.665989 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.652765 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:01.653578 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 118479us
W20260709 13:09:01.643632 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.668526 16005 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:01.640308 17869 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:01.677572 15273 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.214s (SENT)
I20260709 13:09:01.678525 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.680680 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.677706 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.682543 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:01.683706 15226 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:01.687856 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:01.646978 17401 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.693907 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.694658 15374 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:09:01.687031 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:01.689543 17930 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:01.698581 17830 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:01.699152 17930 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:01.699524 17401 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.700222 17930 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:01.703205 17926 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:01.644856 17905 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:01.693173 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.732298 15226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:01.738536 15378 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:01.739063 15378 pending_rounds.cc:85] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 5
I20260709 13:09:01.738801 15226 raft_consensus.cc:606] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:01.736203 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58683.1us
I20260709 13:09:01.672310 17861 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.739362 15378 pending_rounds.cc:107] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:01.743404 15378 raft_consensus.cc:2889] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:01.687282 17869 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.741947 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.744004 17921 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:09:01.749773 17758 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:01.741074 17913 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:01.754400 17877 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.589s	user 0.007s	sys 0.012s
I20260709 13:09:01.756318 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1723) took 2367 ms. Trace:
I20260709 13:09:01.756798 15382 rpcz_store.cc:276] 0709 13:08:59.388987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.599851 (+210864us) service_pool.cc:224] Handling call
0709 13:08:59.628203 (+ 28352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.648055 (+ 19852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.648094 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.655191 (+  7097us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.899293 (+244102us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:59.899341 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.899433 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.753664 (+1854231us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:01.755891 (+  2227us) raft_consensus.cc:1685] finished
0709 13:09:01.755932 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.756224 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1811,"raft.queue_time_us":20905,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":38982528,"thread_start_us":181479,"threads_started":1,"wal-append.queue_time_us":461533}
I20260709 13:09:01.741151 17518 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:09:01.739297 17922 raft_consensus.cc:2764] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:01.759276 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.760779 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.762004 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:01.762633 15382 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:01.763353 17828 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:01.694782 17541 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:09:01.667368 17730 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:09:01.770524 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:01.771632 17865 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.778709 17869 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.758030 17671 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:01.747808 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.786656 15378 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.788702 15226 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:09:01.791275 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50649us
I20260709 13:09:01.797088 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:01.795787 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:01.785056 17671 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:01.830360 17671 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:09:01.848582 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 175595us
W20260709 13:09:01.849393 15377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1690) took 3191 ms (client timeout 2065 ms). Trace:
W20260709 13:09:01.849857 15377 rpcz_store.cc:269] 0709 13:08:58.658439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.666321 (+  7882us) service_pool.cc:224] Handling call
0709 13:09:01.849116 (+3182795us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540023dcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:01.849309 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347292032}
W20260709 13:09:01.858772 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.845099 17671 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.868556 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.871019 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.879841 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.880702 15300 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:01.881608 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.881618 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.889050 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.889834 15299 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.883663 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.894965 15301 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:01.896090 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:01.896610 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.897475 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.897554 15301 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:01.898150 15300 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:01.899092 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.900626 15377 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:01.899647 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.903323 15301 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:01.906617 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.909277 15302 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:01.914635 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:01.862454 17758 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:01.937407 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.942991 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:09:01.952816 17925 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:09:01.964008 15299 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:01.965466 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:01.976683 15299 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:09:02.021608 15273 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.811s (SENT)
I20260709 13:09:02.022593 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:02.037456 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:01.978536 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:02.041397 15377 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:02.045964 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:02.047681 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:01.942050 17677 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:01.866587 17868 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:09:02.053819 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:02.059209 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:02.061182 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:02.035954 17861 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.940230 17876 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:02.070779 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:02.064729 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:02.081902 15377 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:02.037222 17889 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:02.057448 17842 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:02.147594 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.062858 17921 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.065013 17796 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.065109 17518 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.113036 17804 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:02.062326 17687 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.066475 17762 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:02.113598 17922 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.155773 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:02.155795 17921 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.112709 17730 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:09:02.168761 17518 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.168630 17796 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.192606 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:02.173803 17687 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.212263 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:02.215634 15381 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:02.182492 17804 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:02.221680 15379 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:02.222237 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 4.811s (SENT) [suppressed 48 similar messages]
I20260709 13:09:02.187885 17922 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:02.221324 15376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 356) took 3741 ms (client timeout 2099 ms). Trace:
I20260709 13:09:02.194664 17921 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.207928 17796 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.230072 15381 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:02.203195 17518 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:02.227546 15376 rpcz_store.cc:269] 0709 13:08:58.479711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.479866 (+   155us) service_pool.cc:224] Handling call
0709 13:09:02.221058 (+3741192us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54000028d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:02.221238 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392743808}
I20260709 13:09:02.212738 17687 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.267458 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:02.270152 17804 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:02.271051 17401 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:02.273586 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1822) took 4971 ms. Trace:
I20260709 13:09:02.274086 15232 rpcz_store.cc:276] 0709 13:08:57.302056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.761863 (+1459807us) service_pool.cc:224] Handling call
0709 13:08:59.365794 (+603931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.366576 (+   782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.366617 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.367297 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.530214 (+162917us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:59.530306 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.530393 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.234347 (+703954us) raft_consensus.cc:1685] finished
0709 13:09:00.234380 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.273278 (+2038898us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540012f7d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:02.273515 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1400,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":24866,"spinlock_wait_cycles":1362244480,"thread_start_us":162037,"threads_started":1,"wal-append.queue_time_us":256582,"wal-append.run_cpu_time_us":4330,"wal-append.run_wall_time_us":1639562}
I20260709 13:09:02.240936 15377 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:02.255750 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:02.282783 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:02.283607 15233 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.285348 15303 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:02.260581 17808 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.002s
I20260709 13:09:02.288779 17801 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.289376 17808 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:02.291900 17808 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:02.293864 15308 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:02.294912 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:02.296584 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:02.298867 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1821) took 1031 ms. Trace:
I20260709 13:09:02.299640 15228 rpcz_store.cc:276] 0709 13:09:01.267822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.454564 (+186742us) service_pool.cc:224] Handling call
0709 13:09:02.295120 (+840556us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540009c754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:02.298780 (+  3660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318214400}
I20260709 13:09:02.300364 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:02.299026 15231 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.308954 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:02.303273 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 220691us
I20260709 13:09:02.231822 17922 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:02.329455 17947 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:09:02.349000 17943 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:02.328716 17555 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.354035 17555 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.354681 17555 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.376621 15233 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
W20260709 13:09:02.376823 15378 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.589s	user 0.022s	sys 0.007s
I20260709 13:09:02.377602 15378 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:02.377923 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:02.381590 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.382450 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.395592 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:02.328943 17413 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:09:02.406769 17876 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:02.407094 15306 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:02.413321 17772 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:02.414419 17555 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:02.392896 17758 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.518289 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:02.448738 17758 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:02.595233 16003 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:09:02.597859 15273 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.571s (SENT)
I20260709 13:09:02.599386 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:02.601300 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 435) took 1079 ms. Trace:
I20260709 13:09:02.604558 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1806) took 1437 ms. Trace:
I20260709 13:09:02.612356 17801 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:02.614043 16003 rpcz_store.cc:276] 0709 13:09:01.521893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.522067 (+   174us) service_pool.cc:224] Handling call
0709 13:09:02.594444 (+1072377us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b5800003c98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:09:02.594755 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.597081 (+  2326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.601142 (+  4061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16597888}
I20260709 13:09:02.615119 15377 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:02.589730 17895 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.612890 15226 rpcz_store.cc:276] 0709 13:09:01.167023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.794278 (+627255us) service_pool.cc:224] Handling call
0709 13:09:01.794608 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.794879 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:01.838509 (+ 43630us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.426381 (+587872us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b180039e440. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:09:02.604032 (+177651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.604099 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.604163 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.604252 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.604457 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37609,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2973,"raft.queue_time_us":3391,"spinlock_wait_cycles":55971072,"thread_start_us":172818,"threads_started":1}
I20260709 13:09:02.587741 17876 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.628511 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1799) took 2404 ms. Trace:
I20260709 13:09:02.629040 15230 rpcz_store.cc:276] 0709 13:09:00.223835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.646305 (+422470us) service_pool.cc:224] Handling call
0709 13:09:00.646791 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.826199 (+179408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.628185 (+1801986us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540043c454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:02.628441 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365344000}
I20260709 13:09:02.608057 17555 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:02.642025 17518 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:02.661226 15273 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.612s (SENT)
I20260709 13:09:02.643183 17921 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:02.649303 17950 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:09:02.650887 17758 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:02.626976 17876 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:02.679901 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.536093 17687 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:02.686937 15231 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:02.687683 15226 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:09:02.693359 17842 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.003s
W20260709 13:09:02.695880 17954 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:09:02.696245 17842 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:02.624749 17895 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:02.699465 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1809) took 1531 ms. Trace:
I20260709 13:09:02.700409 17801 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:02.701097 17801 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:02.702144 15232 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:02.703322 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 304) took 1204 ms. Trace:
I20260709 13:09:02.703691 17801 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:02.699978 15227 rpcz_store.cc:276] 0709 13:09:01.168029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.519701 (+1351672us) service_pool.cc:224] Handling call
0709 13:09:02.520144 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.520607 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.520645 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.521376 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.605568 (+ 84192us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.605626 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.605712 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.699111 (+ 93399us) raft_consensus.cc:1685] finished
0709 13:09:02.699138 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.699379 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":83664,"threads_started":1,"wal-append.queue_time_us":175860}
I20260709 13:09:02.703740 15232 rpcz_store.cc:276] 0709 13:09:01.498482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.701454 (+1202972us) service_pool.cc:224] Handling call
0709 13:09:02.701894 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.702857 (+   963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.703234 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.715654 15227 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:02.716538 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 305) took 1087 ms. Trace:
I20260709 13:09:02.716897 15227 rpcz_store.cc:276] 0709 13:09:01.628936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.714919 (+1085983us) service_pool.cc:224] Handling call
0709 13:09:02.715375 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.716170 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.716469 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.704100 17921 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:02.713687 17869 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.934s	user 0.012s	sys 0.004s
W20260709 13:09:02.757643 15971 connection.cc:256] RPC call timeout handler was delayed by -1.814684699000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:09:02.779654 15971 connection.cc:256] RPC call timeout handler was delayed by -1.1156773850000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 13:09:02.759191 17876 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:02.761556 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 307) took 1010 ms. Trace:
I20260709 13:09:02.780665 15227 rpcz_store.cc:276] 0709 13:09:01.751282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.718467 (+967185us) service_pool.cc:224] Handling call
0709 13:09:02.759930 (+ 41463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.760307 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.760848 (+   541us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.760930 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:02.761000 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.761118 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.761418 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.799140 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:02.811124 16003 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:02.830245 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:02.791549 17869 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:02.832307 17944 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.432s	user 0.000s	sys 0.001s
W20260709 13:09:02.841208 15273 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.808s (SENT)
I20260709 13:09:02.842443 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:02.850786 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:02.906818 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:02.907539 15225 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:02.852810 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:02.957916 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:02.920603 15229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1791) took 3142 ms (client timeout 2981 ms). Trace:
I20260709 13:09:02.961441 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:02.961900 15229 rpcz_store.cc:269] 0709 13:08:59.778442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.156677 (+378235us) service_pool.cc:224] Handling call
0709 13:09:02.920272 (+2763595us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540043d354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:02.920499 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049750784}
I20260709 13:09:02.963639 15229 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:02.812173 17912 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:02.933578 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57353.3us
W20260709 13:09:02.958097 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 263406us
I20260709 13:09:02.921325 15232 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:02.852064 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:02.975730 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1850) took 1112 ms. Trace:
I20260709 13:09:02.976233 15229 rpcz_store.cc:276] 0709 13:09:01.863542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.962908 (+1099366us) service_pool.cc:224] Handling call
0709 13:09:02.963342 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.975492 (+ 12150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.975673 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.976580 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:02.851655 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:02.977852 15229 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:02.966638 15227 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 7. Ops: []
I20260709 13:09:02.970351 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:02.980119 15300 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:02.957795 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.981060 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.981455 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:02.982195 15300 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 4: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:09:02.958547 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 117400us
W20260709 13:09:02.924569 17796 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.668s	user 0.015s	sys 0.000s
W20260709 13:09:02.983480 15273 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.878s (SENT)
I20260709 13:09:02.973511 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:02.918807 17801 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:02.984123 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:02.978597 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1854) took 1113 ms. Trace:
I20260709 13:09:02.918509 17687 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:02.917361 17518 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:03.019483 15229 rpcz_store.cc:276] 0709 13:09:01.864832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.977340 (+1112508us) service_pool.cc:224] Handling call
0709 13:09:02.977653 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.978387 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.978557 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.980167 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1845) took 1120 ms. Trace:
W20260709 13:09:02.912531 16001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 426) took 2253 ms (client timeout 2038 ms). Trace:
I20260709 13:09:02.914676 17734 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:09:03.003281 15303 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:02.911195 17555 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:09:03.005389 15304 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.006083 17869 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:02.972680 17772 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:03.008457 17413 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:03.012542 17796 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.014456 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:03.039858 15300 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.906407 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:02.911571 17849 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:03.020416 15227 rpcz_store.cc:276] 0709 13:09:01.859871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.782768 (+922897us) service_pool.cc:224] Handling call
0709 13:09:02.966433 (+183665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.979888 (+ 13455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.980103 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.975332 17876 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:09:02.851559 16004 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:03.018589 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:02.976135 17912 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.052279 15233 raft_consensus.cc:2368] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:09:03.056468 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:03.057616 15303 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.023674 17744 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:09:03.038774 17772 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.069562 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 306) took 1362 ms. Trace:
I20260709 13:09:03.070502 15232 rpcz_store.cc:276] 0709 13:09:01.707249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.717511 (+1010262us) service_pool.cc:224] Handling call
0709 13:09:02.920471 (+202960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.974327 (+ 53856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.069115 (+ 94788us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540043d350. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:03.069459 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423687936}
W20260709 13:09:03.021802 16001 rpcz_store.cc:269] 0709 13:09:00.658720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.667748 (+  9028us) service_pool.cc:224] Handling call
0709 13:09:02.912079 (+2244331us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b5400850f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:02.912396 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157042560}
I20260709 13:09:03.074733 17900 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:03.075373 17900 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:03.045389 17849 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.085901 15305 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:03.087332 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1758) took 1205 ms. Trace:
I20260709 13:09:03.087800 15305 rpcz_store.cc:276] 0709 13:09:01.885062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.084973 (+1199911us) service_pool.cc:224] Handling call
0709 13:09:03.085622 (+   649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.086941 (+  1319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.087251 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:03.092087 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:03.093521 17949 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.699s	user 0.000s	sys 0.002s
I20260709 13:09:03.094568 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:03.095481 15305 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.100914 17874 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:03.101647 17874 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:03.102771 17874 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:03.105228 17922 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.763s	user 0.011s	sys 0.006s
I20260709 13:09:03.105932 17922 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.106860 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:03.111167 17946 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.832s	user 0.002s	sys 0.000s
I20260709 13:09:03.128957 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.130366 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.131074 15378 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:09:03.131870 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.132684 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.133481 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 301) took 1872 ms. Trace:
I20260709 13:09:03.133839 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:03.134949 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.135368 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:03.137007 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:03.138298 15232 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.141177 15378 raft_consensus.cc:2410] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:09:03.143460 15303 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:03.144843 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.146196 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.147421 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:03.148865 17963 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:09:03.137338 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:03.149966 15229 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:03.150905 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:03.063968 17772 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:03.152115 15229 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.152628 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.156598 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.156810 15229 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:03.152933 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:03.155277 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.153230 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:03.133841 15226 rpcz_store.cc:276] 0709 13:09:01.261082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.618353 (+1357271us) service_pool.cc:224] Handling call
0709 13:09:02.687467 (+ 69114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.688027 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.133316 (+445289us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b54001c7850. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:03.133414 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158035328}
I20260709 13:09:03.158627 15227 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.158619 15377 raft_consensus.cc:2368] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:03.160982 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.162322 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1824) took 3406 ms. Trace:
I20260709 13:09:03.162801 15224 rpcz_store.cc:276] 0709 13:08:59.755693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.755863 (+   170us) service_pool.cc:224] Handling call
0709 13:08:59.756203 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.833060 (+1076857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.162082 (+2329022us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400010ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:03.162260 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442420608}
I20260709 13:09:03.163595 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.164439 15375 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:03.165617 15381 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:03.171028 15300 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:03.172840 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1729) took 3054 ms. Trace:
I20260709 13:09:03.178256 15380 rpcz_store.cc:276] 0709 13:09:00.118943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.953064 (+834121us) service_pool.cc:224] Handling call
0709 13:09:00.953380 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.413190 (+459810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.162407 (+1749217us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b540023f0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:03.172750 (+ 10343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055575936}
I20260709 13:09:03.175230 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.181062 15381 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
W20260709 13:09:03.162207 17884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.533s	user 0.052s	sys 0.100s
I20260709 13:09:03.207269 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:03.160674 17874 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.244763 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.245107 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.248371 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.241520 15303 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.240685 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:03.258185 15305 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:09:03.258859 15305 pending_rounds.cc:85] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 5
I20260709 13:09:03.259260 15305 pending_rounds.cc:107] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:09:03.259652 15305 raft_consensus.cc:2889] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:03.164815 17661 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:03.162887 17649 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.295198 15227 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:03.304302 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.308032 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.225697 17957 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.301847 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.315624 15305 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.310542 15380 raft_consensus.cc:2410] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:03.318917 15224 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:03.321887 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.323941 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:03.295817 17804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.034s	sys 0.071s
I20260709 13:09:03.150967 17922 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:03.327703 15227 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:03.240635 17961 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.188535 17965 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 13:09:03.182106 17808 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
W20260709 13:09:03.236038 17884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.607s	user 0.052s	sys 0.100s
I20260709 13:09:03.295019 17801 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:03.338152 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.198674 17900 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:03.347286 17961 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:03.332589 17946 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:09:03.335569 17804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.035s	sys 0.071s
I20260709 13:09:03.363337 15303 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:09:03.340133 15376 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:03.379014 15232 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:03.385244 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.386049 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.386876 15376 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:03.387825 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.388530 15376 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:03.386960 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 403488us
W20260709 13:09:03.391597 15273 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.887s (SENT)
I20260709 13:09:03.392030 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:03.394112 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 414400us
I20260709 13:09:03.394152 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:03.398929 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.406488 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 430248us
I20260709 13:09:03.326972 17957 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.318933 17649 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.410821 15230 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:03.397508 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 419778us
I20260709 13:09:03.422717 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:03.396595 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:03.392675 17758 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:03.434993 15227 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:03.444854 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 471419us
I20260709 13:09:03.440786 17660 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:03.447499 15232 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.442363 17825 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:03.436489 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 274850us
I20260709 13:09:03.446203 15377 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.450194 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.454200 15378 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:03.446702 17615 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:03.472633 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:03.474012 16004 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:03.475425 15376 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:03.476075 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:03.477382 16002 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:03.478720 17957 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:03.480165 17649 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:03.480590 17555 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:03.481155 17649 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.481905 17649 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.426481 17804 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.484850 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:03.447978 17660 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:03.491389 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.396657 17876 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:09:03.444111 17518 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:03.521957 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.523289 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1751) took 1643 ms. Trace:
I20260709 13:09:03.541841 16002 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:03.523765 15307 rpcz_store.cc:276] 0709 13:09:01.879597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.879913 (+   316us) service_pool.cc:224] Handling call
0709 13:09:01.880264 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:01.880658 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.880692 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:01.936432 (+ 55740us) log.cc:844] Serialized 52 byte log entry
0709 13:09:02.183816 (+247384us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.243326 (+ 59510us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.243731 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.243944 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.244035 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.110647 (+866612us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b24001c8668. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a7809d 00007f2f536aa10e 00007f2f536c188c 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221
0709 13:09:03.520913 (+410266us) raft_consensus.cc:1685] finished
0709 13:09:03.520952 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.523222 (+  2270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53992,"prepare.queue_time_us":60267,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":55,"raft.queue_time_us":3316,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":15480,"spinlock_wait_cycles":47868672,"thread_start_us":132373,"threads_started":1,"wal-append.queue_time_us":324035}
I20260709 13:09:03.445611 17798 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:09:03.552070 15377 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:03.560088 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.561414 15378 raft_consensus.cc:2410] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:09:03.561959 17661 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:03.449703 17758 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.569116 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:03.505756 17555 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:03.547341 17518 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:03.504971 17804 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.510279 17922 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:09:03.583401 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.560293 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:03.588704 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.566994 17971 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:03.567541 17974 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:03.595865 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.597110 17974 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.597851 17974 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.598294 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.503181 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.601052 15376 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:03.602613 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.603379 15378 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:03.576092 17876 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:09:03.607793 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 216214us
W20260709 13:09:03.610320 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 295606us
I20260709 13:09:03.608851 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.648392 15378 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:03.613719 15273 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.000s (SENT)
I20260709 13:09:03.648993 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:03.619817 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:03.594239 17895 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:03.651719 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:03.652884 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:03.605319 17973 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:03.609845 17922 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.657987 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:03.660260 15307 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:03.660722 15305 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:03.664449 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.668642 15307 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.678272 15376 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:03.686673 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:03.687956 15307 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.709324 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.654881 17909 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:03.720486 15375 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:03.728588 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46193us
I20260709 13:09:03.741401 15305 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:03.660878 17970 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.660581 17981 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:03.675155 17895 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:03.647243 17980 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
W20260709 13:09:03.772009 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 287257us
I20260709 13:09:03.732509 17909 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:03.787513 17912 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.009s
I20260709 13:09:03.671553 17922 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:03.811583 15307 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:03.834543 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61559.2us
I20260709 13:09:03.836267 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.838771 15375 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:09:03.839730 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 226038us
W20260709 13:09:03.840656 15273 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.010s (SENT)
I20260709 13:09:03.841120 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:03.742108 17555 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:03.660372 17518 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:03.717881 17661 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:03.841297 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:03.745879 17914 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:09:03.774909 17660 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:03.730157 17973 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:03.865671 15273 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.023s (SENT)
I20260709 13:09:03.864631 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:03.866627 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:03.782877 17988 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:03.798840 17876 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:03.865742 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:03.862785 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.874624 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.838666 17772 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:03.872802 17758 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:03.839377 17895 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:03.882651 17772 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.884024 17804 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:03.883839 17895 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:03.875571 17968 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
W20260709 13:09:03.887252 17874 consensus_meta.cc:287] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:09:03.858515 17991 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:03.888736 17922 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:03.859733 17981 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:03.889628 17981 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:03.890854 17981 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.893560 17995 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:03.894277 17995 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:03.896327 17849 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.811s	user 0.004s	sys 0.008s
I20260709 13:09:03.896857 17849 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.898674 15226 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.900785 17909 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.901360 17849 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:03.939729 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1733) took 2268 ms. Trace:
W20260709 13:09:03.909457 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.955547 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1636) took 2835 ms. Trace:
I20260709 13:09:03.956094 15373 rpcz_store.cc:276] 0709 13:09:01.119894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.414681 (+294787us) service_pool.cc:224] Handling call
0709 13:09:03.933954 (+2519273us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400404cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:03.955457 (+ 21503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458590592}
I20260709 13:09:03.961805 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:03.764438 17970 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.875247 17961 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:03.878293 17876 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:03.842582 17912 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.933847 17985 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.935458 17991 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:04.004525 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.929354 17804 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:03.973232 17969 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.363s	user 0.000s	sys 0.002s
I20260709 13:09:03.940199 15374 rpcz_store.cc:276] 0709 13:09:01.670847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.779605 (+108758us) service_pool.cc:224] Handling call
0709 13:09:01.779962 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.780208 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:03.797763 (+2017555us) spinlock_profiling.cc:243] Waited 7.65 ms on lock 0x7b18003c9a00. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf
0709 13:09:03.798012 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.939341 (+141329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.939394 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.939449 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.939517 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.939649 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10689,"prepare.queue_time_us":339220,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":17594112,"thread_start_us":534835,"threads_started":2}
I20260709 13:09:03.958438 17981 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:03.946990 17971 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:04.017891 15229 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:04.020087 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.000054 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:04.025380 15373 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:04.005729 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 140078us
I20260709 13:09:03.969995 17990 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:03.977074 17977 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.371s	user 0.000s	sys 0.002s
I20260709 13:09:04.013336 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:03.977605 17909 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.016870 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:04.063580 15224 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:04.075217 17990 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.076169 17863 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:04.076946 17874 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:04.078152 17975 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:04.075934 17990 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.079321 17974 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:04.080804 17990 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:04.081423 17884 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:04.078644 17975 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:04.082340 17884 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:04.083199 17975 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.084730 17975 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:03.902940 17988 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:03.990278 18001 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.079860 17827 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:04.109697 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:04.112488 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:04.115515 15308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1753) took 2235 ms (client timeout 2206 ms). Trace:
I20260709 13:09:04.115852 15300 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:04.116067 15308 rpcz_store.cc:269] 0709 13:09:01.880463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.884982 (+  4519us) service_pool.cc:224] Handling call
0709 13:09:04.115254 (+2230272us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:04.115433 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807846272}
I20260709 13:09:04.123150 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:04.111949 17863 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:04.126506 17863 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:04.132804 17979 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:09:04.134394 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 303) took 2795 ms. Trace:
W20260709 13:09:04.136685 17984 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:09:04.137349 17884 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.138536 17798 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:04.138990 17884 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.141961 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:04.133565 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.072306 17995 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:04.011677 17985 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.091253 17914 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
W20260709 13:09:04.381227 15273 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.116s	sys 0.140s
W20260709 13:09:04.684897 15273 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.180s	sys 0.227s
I20260709 13:09:04.685267 17971 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.685672 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 812293us
I20260709 13:09:04.685863 17971 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:04.688037 15273 connection.cc:256] RPC call timeout handler was delayed by -1.051081765000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29s for a response
I20260709 13:09:04.272867 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:04.688578 17971 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:04.688958 15273 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.122s (SENT)
I20260709 13:09:04.134855 17970 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:04.139055 17798 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:04.693751 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:04.694962 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:04.696028 15378 raft_consensus.cc:2410] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:04.689013 15373 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:04.562304 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.173231 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.709429 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.689699 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 302) took 3428 ms. Trace:
I20260709 13:09:04.268148 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1761) took 2382 ms. Trace:
I20260709 13:09:04.690460 15226 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:04.711441 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.265704 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:04.122933 18001 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:09:04.607620 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.020s	sys 0.029s
I20260709 13:09:04.104643 17827 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:04.691627 15227 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:04.273532 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:04.134831 15231 rpcz_store.cc:276] 0709 13:09:01.339177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.688597 (+1349420us) service_pool.cc:224] Handling call
0709 13:09:02.688932 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.689276 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.689302 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.717479 (+ 28177us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.117509 (+400030us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b180048ee60. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:09:03.500314 (+382805us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.500376 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.500440 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.134008 (+633568us) raft_consensus.cc:1685] finished
0709 13:09:04.134036 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.134327 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":18038,"spinlock_wait_cycles":65347456,"thread_start_us":382593,"threads_started":1,"wal-append.queue_time_us":937651}
I20260709 13:09:04.732281 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:04.716804 15273 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.128s (SENT)
I20260709 13:09:04.733543 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:04.734660 15273 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.627s (SENT)
I20260709 13:09:04.735031 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:04.710541 15230 rpcz_store.cc:276] 0709 13:09:01.261418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.630260 (+1368842us) service_pool.cc:224] Handling call
0709 13:09:02.630662 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.421954 (+791292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.689399 (+1267445us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b540009c754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:04.689622 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793583360}
I20260709 13:09:04.717422 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:04.600620 17895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.000s	sys 0.013s
W20260709 13:09:04.729491 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.021s	sys 0.030s
W20260709 13:09:04.520867 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.268471 17988 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:04.740370 15273 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.751s (SENT)
I20260709 13:09:04.740844 17974 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:04.740799 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.742098 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.743193 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.743108 18001 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.740171 17988 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:04.744565 17971 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:04.745014 17988 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.745218 17971 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.745484 17988 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.745669 17971 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:04.746898 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 1.09403e+06us
I20260709 13:09:04.747570 17971 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:04.729408 17970 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:04.748241 15304 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:04.748828 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:04.735889 15373 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:04.412737 17948 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.148815 17758 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.739534 15345 connection.cc:256] RPC call timeout handler was delayed by -1.8608192860000372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 13:09:04.768687 15345 connection.cc:256] RPC call timeout handler was delayed by -1.8176192859999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 13:09:04.769064 15345 connection.cc:256] RPC call timeout handler was delayed by -1.7168192860000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:09:04.769346 15345 connection.cc:256] RPC call timeout handler was delayed by -1.6664192859999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:09:04.769582 15345 connection.cc:256] RPC call timeout handler was delayed by -1.6592192859999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:09:04.769990 15345 connection.cc:256] RPC call timeout handler was delayed by -1.6115192859999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:09:04.770274 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5530192859999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 13:09:04.770516 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5476192859999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:09:04.770778 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5350192859999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 13:09:04.771266 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5251192859999492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:09:04.771339 15373 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
W20260709 13:09:04.771612 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4972192860000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:09:04.771927 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4297192860000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:09:04.736140 17661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.008s
I20260709 13:09:04.754361 15971 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:04.145450 17922 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.273520 16001 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:04.684090 17863 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:04.349812 17921 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:04.348482 17804 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.758643 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:04.890496 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 131918us
I20260709 13:09:04.747601 17988 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:04.892055 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:04.710750 15301 rpcz_store.cc:276] 0709 13:09:01.885921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.128837 (+1242916us) service_pool.cc:224] Handling call
0709 13:09:03.129141 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.522648 (+393507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.522676 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.550444 (+ 27768us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.837390 (+286946us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:03.941238 (+103848us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.955619 (+ 14381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.955701 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.267882 (+312181us) raft_consensus.cc:1685] finished
0709 13:09:04.267904 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.268072 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51478,"prepare.queue_time_us":54673,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":524217,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":41692,"thread_start_us":726495,"threads_started":3,"wal-append.queue_time_us":450511}
I20260709 13:09:04.748631 17987 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:04.168298 17992 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:09:04.773567 15974 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.013s	sys 0.021s
I20260709 13:09:04.774415 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:04.772255 15345 connection.cc:256] RPC call timeout handler was delayed by -1.405419285999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 13:09:04.893466 15974 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.013s	sys 0.021s
I20260709 13:09:04.731942 17660 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:04.757047 17895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.000s	sys 0.014s
I20260709 13:09:04.774430 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:04.898458 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.777719 15303 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:04.765079 17974 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:04.750716 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.783946 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:04.749164 17961 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:04.770004 15232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.011s	sys 0.013s
W20260709 13:09:04.911062 15232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.017s	sys 0.021s
I20260709 13:09:04.893674 15304 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:04.893602 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4045192859999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 13:09:04.911914 15345 connection.cc:256] RPC call timeout handler was delayed by -1.3577192860000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:09:04.912226 15345 connection.cc:256] RPC call timeout handler was delayed by -1.2695192859999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260709 13:09:04.912503 15345 connection.cc:256] RPC call timeout handler was delayed by -1.2569192859999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:09:04.912755 15345 connection.cc:256] RPC call timeout handler was delayed by -1.2290192860000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 13:09:04.893959 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 824293us
I20260709 13:09:04.774466 17970 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.764932 17948 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:04.100515 17876 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:04.778152 17661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.005s	sys 0.008s
I20260709 13:09:04.786173 17914 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:04.898555 17660 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:04.900094 18010 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:04.926265 17991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.021s	sys 0.055s
I20260709 13:09:04.903779 17921 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:04.775058 17995 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.150s
I20260709 13:09:04.908584 17987 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:04.940879 18012 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:04.914592 17527 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:04.784997 16001 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:04.896309 17518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.016s	sys 0.010s
I20260709 13:09:04.895615 17922 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.909655 17804 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.904706 17992 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.911520 17988 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:04.786545 18014 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.192s
I20260709 13:09:04.775883 17758 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:04.921135 17961 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:04.998158 17991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.022s	sys 0.056s
W20260709 13:09:05.002204 18003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.020s	sys 0.026s
I20260709 13:09:04.974596 17970 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.007449 18012 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:04.998939 17985 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:05.049834 18013 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
W20260709 13:09:05.055114 18003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.021s	sys 0.026s
W20260709 13:09:05.053911 17975 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.969s	user 0.009s	sys 0.014s
I20260709 13:09:05.049656 17991 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:05.103585 17948 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:05.104003 18008 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:09:05.054775 18012 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.123854 17957 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:05.124571 17957 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:05.125707 17957 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.127063 17957 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:05.131785 17981 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.066s	user 0.013s	sys 0.002s
W20260709 13:09:05.132081 18005 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.384s	user 0.001s	sys 0.008s
I20260709 13:09:05.212087 17987 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:05.208556 18015 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.238s	user 0.004s	sys 0.002s
W20260709 13:09:05.208330 18029 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.061s	user 0.002s	sys 0.003s
I20260709 13:09:05.209712 17991 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:05.222777 18020 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:09:05.221321 17992 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:05.221814 18023 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:09:05.231187 18021 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.128s	user 0.017s	sys 0.036s
I20260709 13:09:04.904493 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:09:05.325979 15377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1761) took 2085 ms (client timeout 2075 ms). Trace:
W20260709 13:09:05.326646 15377 rpcz_store.cc:269] 0709 13:09:03.239863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.301528 (+ 61665us) service_pool.cc:224] Handling call
0709 13:09:05.325343 (+2023815us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001fd454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:05.325628 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301990272}
W20260709 13:09:05.328879 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 424310us
I20260709 13:09:04.899662 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:05.332531 15224 raft_consensus.cc:2410] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:09:05.332902 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.778865 15225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 300) took 3604 ms (client timeout 2895 ms). Trace:
W20260709 13:09:05.312620 15233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1847) took 3449 ms (client timeout 2142 ms). Trace:
W20260709 13:09:05.334118 15233 rpcz_store.cc:269] 0709 13:09:01.862627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.379284 (+516657us) service_pool.cc:224] Handling call
0709 13:09:05.311935 (+2932651us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b540009cc54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:05.312256 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507910016}
I20260709 13:09:05.265230 15226 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:09:05.266412 15271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.025s	sys 0.039s
W20260709 13:09:04.905507 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 131143us
I20260709 13:09:05.337410 18004 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.320019 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 212) took 2198 ms. Trace:
I20260709 13:09:04.895025 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:05.269563 15305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.031s
W20260709 13:09:05.340140 15305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.010s	sys 0.032s
I20260709 13:09:05.340746 15301 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:05.341868 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 222) took 1113 ms. Trace:
I20260709 13:09:05.341944 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:04.961633 15306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.026s	sys 0.025s
I20260709 13:09:05.343148 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:05.343981 15306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.026s	sys 0.025s
I20260709 13:09:05.345441 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 216) took 1240 ms. Trace:
W20260709 13:09:04.913002 15345 connection.cc:256] RPC call timeout handler was delayed by -1.2245192860000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 13:09:04.901780 15307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.023s
I20260709 13:09:05.346043 17687 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:05.347095 15307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.009s	sys 0.023s
I20260709 13:09:05.348760 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 218) took 1242 ms. Trace:
I20260709 13:09:04.928872 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.350256 15303 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:05.351624 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:05.272796 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.012s	sys 0.008s
W20260709 13:09:05.352615 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.012s	sys 0.008s
W20260709 13:09:05.353366 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.355712 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.359359 17836 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.994334 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 368) took 5159 ms. Trace:
W20260709 13:09:05.011412 17518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.016s	sys 0.010s
I20260709 13:09:05.360595 17836 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.366919 15379 rpcz_store.cc:276] 0709 13:08:59.834775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.838023 (+1003248us) service_pool.cc:224] Handling call
0709 13:09:02.221236 (+1383213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.222128 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.993998 (+2771870us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54000028d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:04.994245 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3145875840}
W20260709 13:09:05.287269 15299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.002s	sys 0.001s
W20260709 13:09:05.370263 15299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.003s	sys 0.002s
I20260709 13:09:05.349177 15307 rpcz_store.cc:276] 0709 13:09:04.106579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.107549 (+   970us) service_pool.cc:224] Handling call
0709 13:09:04.107833 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.108401 (+   568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.108435 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.123742 (+ 15307us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.348154 (+1224412us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.348275 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.348408 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.348454 (+    46us) raft_consensus.cc:1685] finished
0709 13:09:05.348469 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.348698 (+   229us) inbound_call.cc:177] Queueing success response
0709 13:09:05.353347 (+  4649us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b48000b0058. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
Metrics: {"raft.queue_time_us":813,"raft.run_cpu_time_us":13378,"raft.run_wall_time_us":1240417,"spinlock_wait_cycles":175224064,"thread_start_us":992785,"threads_started":1,"wal-append.queue_time_us":813429}
I20260709 13:09:05.104218 17900 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.371508 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.304489 17973 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:05.307297 17970 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:05.309859 18013 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:09:05.384586 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.302213 17615 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:05.345889 15306 rpcz_store.cc:276] 0709 13:09:04.105552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.105965 (+   413us) service_pool.cc:224] Handling call
0709 13:09:04.106390 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.106915 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.106945 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.107441 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.122675 (+1015234us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b48000b0058. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:09:05.344768 (+222093us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.344838 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.344947 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.344998 (+    51us) raft_consensus.cc:1685] finished
0709 13:09:05.345015 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.345380 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":728,"raft.run_cpu_time_us":23037,"raft.run_wall_time_us":1011076,"spinlock_wait_cycles":62469888,"thread_start_us":1069075,"threads_started":1,"wal-append.queue_time_us":992499}
I20260709 13:09:05.385416 17615 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.383384 17798 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.386377 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:05.386941 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1862) took 1394 ms. Trace:
I20260709 13:09:05.387809 15307 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.314754 18014 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:05.315515 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.316143 17758 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:05.317142 17961 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:05.319211 17921 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:05.321723 17922 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:05.321959 15376 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.006s
W20260709 13:09:05.395022 15376 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.000s	sys 0.007s
W20260709 13:09:05.322489 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.324081 16001 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:05.334157 15225 rpcz_store.cc:269] 0709 13:09:01.174853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.652495 (+477642us) service_pool.cc:224] Handling call
0709 13:09:04.778584 (+3126089us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400359dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:04.778773 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851878656}
I20260709 13:09:05.263468 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 311) took 1401 ms. Trace:
W20260709 13:09:05.336134 15271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.026s	sys 0.039s
I20260709 13:09:05.343993 15375 raft_consensus.cc:2410] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:09:05.365011 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.365389 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.349159 17796 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:05.342730 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.347121 17687 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:05.372632 15303 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:05.342618 15305 rpcz_store.cc:276] 0709 13:09:04.263215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.263432 (+   217us) service_pool.cc:224] Handling call
0709 13:09:04.705604 (+442172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.717456 (+ 11852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.717487 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.729953 (+ 12466us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.341130 (+611177us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.341279 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.341446 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.341532 (+    86us) raft_consensus.cc:1685] finished
0709 13:09:05.341548 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.341779 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11370,"raft.queue_time_us":18963,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4160,"spinlock_wait_cycles":127872,"thread_start_us":575345,"threads_started":1,"wal-append.queue_time_us":347537}
I20260709 13:09:05.016695 17660 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.399536 16001 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.399886 17660 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.400484 18014 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.402418 17912 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:05.375739 17734 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:05.405279 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1859) took 2216 ms. Trace:
W20260709 13:09:05.405623 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.338511 15300 rpcz_store.cc:276] 0709 13:09:03.121593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.225769 (+104176us) service_pool.cc:224] Handling call
0709 13:09:04.115419 (+889650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.116237 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.319312 (+1203075us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54002c3150. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:05.319674 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2041145216}
W20260709 13:09:05.378015 15345 connection.cc:256] RPC call timeout handler was delayed by -1.1723192859999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
I20260709 13:09:05.405745 15229 rpcz_store.cc:276] 0709 13:09:03.189173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.189307 (+   134us) service_pool.cc:224] Handling call
0709 13:09:03.189605 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.018405 (+828800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.404634 (+1386229us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540002f654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:05.405082 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904438656}
I20260709 13:09:05.379390 17649 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:05.384857 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1759) took 3499 ms. Trace:
I20260709 13:09:05.412158 15302 rpcz_store.cc:276] 0709 13:09:01.885381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.393390 (+1508009us) service_pool.cc:224] Handling call
0709 13:09:03.424748 (+ 31358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.608044 (+183296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.608075 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.662580 (+ 54505us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.035717 (+373137us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:04.100920 (+ 65203us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.124318 (+ 23398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.124445 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.384118 (+1259673us) raft_consensus.cc:1685] finished
0709 13:09:05.384152 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.384629 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124542,"prepare.queue_time_us":63523,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":301173,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":88686,"thread_start_us":430282,"threads_started":2,"wal-append.queue_time_us":405411}
I20260709 13:09:05.414315 15304 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:05.415019 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.416119 15302 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:05.382468 17518 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:05.311314 17804 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:05.386413 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.387620 15227 rpcz_store.cc:276] 0709 13:09:03.992849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.993048 (+   199us) service_pool.cc:224] Handling call
0709 13:09:04.013816 (+ 20768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.731956 (+718140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.386196 (+654240us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54000dded4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:05.386709 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557841152}
I20260709 13:09:05.404831 17687 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.407927 17798 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:05.408634 15345 leader_election.cc:400] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:09:05.410877 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:05.314330 17909 consensus_meta.cc:287] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.222s	user 0.011s	sys 0.003s
I20260709 13:09:05.421763 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1700) took 1151 ms. Trace:
W20260709 13:09:05.407986 17914 consensus_queue.cc:1175] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 5 status { last_received { term: 4 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:05.426265 15304 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:05.450265 15301 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.371650 17836 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:05.462620 15306 raft_consensus.cc:2368] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:09:05.454375 15375 rpcz_store.cc:276] 0709 13:09:04.270070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.692687 (+422617us) service_pool.cc:224] Handling call
0709 13:09:05.341343 (+648656us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:09:05.421647 (+ 80304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18224384}
I20260709 13:09:05.462671 17827 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.395928 15232 rpcz_store.cc:276] 0709 13:09:03.861454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.861706 (+   252us) service_pool.cc:224] Handling call
0709 13:09:03.862152 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.862593 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.862624 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.863261 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.911452 (+1048191us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:04.911492 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.911556 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.262355 (+350799us) raft_consensus.cc:1685] finished
0709 13:09:05.262454 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.263057 (+   603us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7033,"raft.queue_time_us":106730,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":12571,"thread_start_us":1047842,"threads_started":1,"wal-append.queue_time_us":1086885}
W20260709 13:09:05.470420 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57176.4us
W20260709 13:09:05.471441 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63496.9us
I20260709 13:09:05.472055 15305 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:05.472945 15345 leader_election.cc:400] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 5.
I20260709 13:09:05.477202 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1830) took 1293 ms. Trace:
I20260709 13:09:05.475888 15302 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:05.472227 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.474457 17687 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.493110 15303 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:05.470459 17827 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.498191 17842 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:05.498807 17842 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:05.503365 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 161011us
I20260709 13:09:05.504774 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.506723 17970 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:05.508242 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.288555 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:05.509956 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.518599 17660 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:05.486244 15226 rpcz_store.cc:276] 0709 13:09:04.171626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.711178 (+539552us) service_pool.cc:224] Handling call
0709 13:09:05.418707 (+707529us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540043b554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:05.465307 (+ 46600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270629632}
I20260709 13:09:05.476223 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.533624 15301 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
W20260709 13:09:05.534822 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68798.4us
I20260709 13:09:05.562582 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:05.564239 17518 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:05.566315 16006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 424) took 4881 ms. Trace:
I20260709 13:09:05.565912 18012 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.566794 16006 rpcz_store.cc:276] 0709 13:09:00.656570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.670756 (+ 14186us) service_pool.cc:224] Handling call
0709 13:09:03.022281 (+2351525us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b5800003c98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:09:03.048384 (+ 26103us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.049242 (+   858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.049291 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.050374 (+  1083us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.437948 (+387574us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:03.438014 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.438114 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.199956 (+761842us) raft_consensus.cc:1685] finished
0709 13:09:04.199985 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.455231 (+1255246us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54004182d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:05.537326 (+ 82095us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25495,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":123,"spinlock_wait_cycles":77312256,"thread_start_us":386996,"threads_started":1,"wal-append.queue_time_us":517574,"wal-append.run_cpu_time_us":4776,"wal-append.run_wall_time_us":1710516}
W20260709 13:09:05.568858 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92908.6us
I20260709 13:09:05.569991 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.573240 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:05.573421 17615 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.575675 17804 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:05.576896 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.532869 17842 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.577558 15345 leader_election.cc:400] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 3. Current term is 4.
I20260709 13:09:05.572137 17957 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.578339 17961 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:05.579345 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:05.581180 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 217) took 1475 ms. Trace:
I20260709 13:09:05.562444 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:05.585457 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:05.589131 15307 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:05.559363 17660 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:05.590476 15299 rpcz_store.cc:276] 0709 13:09:04.106223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.106426 (+   203us) service_pool.cc:224] Handling call
0709 13:09:04.106842 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:04.121551 (+ 14709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.121594 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:04.153445 (+ 31851us) log.cc:844] Serialized 52 byte log entry
0709 13:09:05.370858 (+1217413us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.531336 (+160478us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.537302 (+  5966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.556976 (+ 19674us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.557022 (+    46us) raft_consensus.cc:1685] finished
0709 13:09:05.557034 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.581119 (+ 24085us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15033,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":53721,"thread_start_us":1084069,"threads_started":2,"wal-append.queue_time_us":973151}
I20260709 13:09:05.615945 15232 raft_consensus.cc:2410] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:09:05.613648 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 118866us
I20260709 13:09:05.591914 17961 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:05.581859 17798 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:05.605284 17970 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.605582 17804 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:05.623276 17961 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.636260 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.650259 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:05.655470 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:05.656299 15999 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:05.655767 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.662364 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:09:05.672973 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.673280 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67898.3us
I20260709 13:09:05.638113 18012 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:05.658048 15374 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:05.677268 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.685168 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1828) took 1468 ms. Trace:
I20260709 13:09:05.683799 15299 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:05.685580 16006 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:05.693409 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 121892us
W20260709 13:09:05.684425 15374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1698) took 1478 ms (client timeout 1525 ms). Trace:
W20260709 13:09:05.702746 15374 rpcz_store.cc:269] 0709 13:09:04.199153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.200886 (+  1733us) service_pool.cc:224] Handling call
0709 13:09:05.578931 (+1378045us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:09:05.677778 (+ 98847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14758784}
I20260709 13:09:05.711539 15303 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:05.685616 17734 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.717842 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.721355 15300 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:05.697628 17957 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:05.735620 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:05.736397 15232 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:05.736618 17734 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.742834 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:05.746596 17884 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.607s	user 0.021s	sys 0.008s
W20260709 13:09:05.730847 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92500.9us
I20260709 13:09:05.746855 17876 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.687537 15231 rpcz_store.cc:276] 0709 13:09:04.148434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.914806 (+766372us) service_pool.cc:224] Handling call
0709 13:09:05.270578 (+355772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.271443 (+   865us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:05.453761 (+182318us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.601903 (+148142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.601956 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.615636 (+ 13680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.615719 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.617020 (+  1301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30355,"prepare.queue_time_us":240790,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":7884,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":12985,"thread_start_us":316686,"threads_started":2,"wal-append.queue_time_us":140991}
I20260709 13:09:05.736174 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:05.716080 17842 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.697917 17801 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:05.743695 17804 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.778882 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:05.782369 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1674) took 1039 ms. Trace:
I20260709 13:09:05.759963 16001 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:05.794999 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.795979 15306 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.783041 15301 rpcz_store.cc:276] 0709 13:09:04.743074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.342510 (+599436us) service_pool.cc:224] Handling call
0709 13:09:05.782079 (+439569us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54001874d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:05.782280 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166404480}
I20260709 13:09:05.763551 17615 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:05.805506 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 184878us
I20260709 13:09:05.695412 17660 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:05.810598 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82649.1us
I20260709 13:09:05.701851 17796 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:09:05.816641 17991 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.817014 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 219) took 1594 ms. Trace:
I20260709 13:09:05.817993 15308 rpcz_store.cc:276] 0709 13:09:04.173170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.174604 (+  1434us) service_pool.cc:224] Handling call
0709 13:09:05.419370 (+1244766us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b58000a1d98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01eee 0000000000375939 00007f2f58a751e0 00007f2f58b3e0c4 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:09:05.504506 (+ 85136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.504997 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:05.616173 (+111176us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.767267 (+151094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.767329 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:05.767401 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.767488 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.767637 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":132545,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":7353,"spinlock_wait_cycles":34831488,"thread_start_us":228867,"threads_started":2}
I20260709 13:09:05.820623 15302 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:05.822302 17659 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.822991 17659 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.825287 17890 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:05.825776 17890 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.826200 17890 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:05.829106 18041 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:05.798188 17957 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.832870 17493 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:05.833021 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 131045us
I20260709 13:09:05.833662 17796 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:05.834276 17796 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:05.834416 17957 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:05.834847 15198 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:05.836426 17909 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.837368 15229 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:05.805552 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:05.840757 15299 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.841228 17900 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:05.842274 16004 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:05.835438 15303 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:05.799932 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 148199us
I20260709 13:09:05.858378 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:05.862005 15226 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:05.862422 15300 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:05.863570 17801 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:05.864580 17734 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:05.867465 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 105853us
I20260709 13:09:05.869700 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.872963 17758 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.862083 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:05.873895 17772 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:05.874529 15229 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:05.878835 15131 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 4 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.880702 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 442) took 1782 ms. Trace:
I20260709 13:09:05.881228 16001 rpcz_store.cc:276] 0709 13:09:04.098203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.102851 (+  4648us) service_pool.cc:224] Handling call
0709 13:09:04.273304 (+170453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.799482 (+1526178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.880600 (+ 81118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:05.881628 15131 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 2 to 5, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 5 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.895917 17869 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:05.896674 17869 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:05.896844 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60475.5us
W20260709 13:09:05.909350 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.866480 17801 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:05.918860 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:05.916102 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:05.923632 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:05.924880 17801 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:05.920238 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 288540us
W20260709 13:09:05.932718 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.933249 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.934363 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.940259 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.835476 17796 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.948014 15226 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:05.950474 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81225.3us
I20260709 13:09:05.949745 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:05.955080 17758 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:05.955842 17758 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.957266 15131 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 4, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 4 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.958808 17758 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:05.961735 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:05.965811 15382 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:05.967379 15300 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.967880 15382 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:05.968274 17890 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:05.972136 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46902.1us
I20260709 13:09:05.973439 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.974560 17772 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.975162 17734 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:05.975271 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:05.978268 16006 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:05.983263 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:05.982062 17734 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:05.985085 17734 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:05.985980 15131 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 2, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 2 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.992838 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:06.000391 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.006726 15303 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:05.997427 17772 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.015812 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.018826 17884 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:06.020431 17758 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:06.022472 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.023511 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:06.031472 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.036713 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.037767 15377 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:06.049563 17957 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:06.052498 17649 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:06.055028 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.925853 17869 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.065876 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.067972 16006 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:06.069855 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 186033us
I20260709 13:09:06.071002 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:06.072394 15303 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:09:06.070590 15196 connection.cc:256] RPC call timeout handler was delayed by -1.3857559069999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:09:06.077078 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:06.078258 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.078120 17869 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.080595 18012 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.081223 18012 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.081722 18012 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.078946 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:06.031664 17801 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.059203 15345 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7.
I20260709 13:09:06.029369 18014 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:06.087374 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57029.4us
I20260709 13:09:06.088582 17909 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.061383 15300 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:06.118096 15300 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:06.136520 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.126122 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:09:06.128539 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.125733 15382 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:06.125314 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:06.156044 15226 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:06.092494 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 311752us
I20260709 13:09:06.137352 15131 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.126636 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.141464 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:06.133978 17796 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.174940 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.124981 18031 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.180087 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 157923us
W20260709 13:09:06.206879 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.211455 15306 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:06.214169 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88227.8us
I20260709 13:09:06.211277 15299 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:09:06.212256 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 85792.5us
I20260709 13:09:06.123018 17687 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:09:06.216004 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.218360 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:06.104386 18014 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
W20260709 13:09:06.224844 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.122428 17909 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.207943 17884 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:06.167336 17961 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.208278 17983 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:06.126133 17996 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:09:06.256994 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.275575 15379 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:06.276863 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47905us
W20260709 13:09:06.261360 18055 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
I20260709 13:09:06.279464 16006 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:06.280467 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.280624 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.270470 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:06.293921 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.294816 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.295727 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.300870 15382 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:06.309283 17772 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.310186 17772 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.241698 18031 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.313170 18068 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.313743 18068 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:06.314122 18068 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.315110 18031 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:06.316207 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 297221us
I20260709 13:09:06.319983 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:06.281672 17804 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.330197 15377 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:06.337292 15226 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:06.317530 18067 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:06.341502 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 89074.8us
W20260709 13:09:06.346540 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.355743 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:06.338228 17842 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.008s
I20260709 13:09:06.358269 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.341615 17970 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.363934 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.338853 17804 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.365201 15231 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:06.367759 17677 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:06.368432 17677 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:06.368841 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.369498 17677 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.370584 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.354274 17914 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.372504 18070 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:06.373417 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:06.374086 15380 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.374361 18070 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:06.375267 18070 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:06.375591 18070 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:06.376405 18074 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:06.376650 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.376875 18074 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:06.377509 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.378115 18074 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.379818 18074 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:06.383993 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.385401 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.384733 17970 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.368427 18079 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:06.366307 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:06.389879 18014 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:06.398896 18014 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:06.387432 17804 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.390687 18079 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:06.400863 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 150975us
I20260709 13:09:06.396492 15377 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:06.402029 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.397473 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:06.392521 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 102698us
I20260709 13:09:06.404798 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:06.386307 18062 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:09:06.373138 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.407486 15380 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:06.397323 15229 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
W20260709 13:09:06.364601 18052 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 13:09:06.377612 15999 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:06.402225 15382 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
I20260709 13:09:06.344810 18067 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:06.366737 17772 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.417368 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:06.420086 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.420450 17827 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:06.456198 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.424510 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:06.341931 17996 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 13:09:06.427109 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54077.3us
W20260709 13:09:06.421378 18066 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.071s	user 0.004s	sys 0.000s
I20260709 13:09:06.467351 16004 raft_consensus.cc:2368] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:06.467662 17772 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.461611 17758 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:06.469684 17772 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.470315 17758 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.470866 17758 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.471674 17970 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.472270 17970 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:06.397662 18031 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:09:06.466320 16000 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:06.467485 18061 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.475418 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.480047 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 124692us
I20260709 13:09:06.400110 18014 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.466425 18060 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:06.428849 17909 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.467305 17996 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:06.463743 15273 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.525s (SENT)
I20260709 13:09:06.489245 15273 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.494499 15348 leader_election.cc:400] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:09:06.494881 15348 leader_election.cc:403] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:06.497027 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 83206.6us
I20260709 13:09:06.499058 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:06.486980 17687 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:06.506278 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80837.8us
I20260709 13:09:06.506870 17884 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:09:06.488942 17996 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:06.501278 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:06.490875 18061 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.424146 18070 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.518575 15227 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:09:06.513190 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:06.496330 17772 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:06.521718 15376 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.482594 17970 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.502635 17869 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:06.527383 18083 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.504837 17961 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:06.542002 18061 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.510764 17687 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.542809 17687 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.543767 18068 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.546087 18068 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:06.546154 15131 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 6, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 6 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.548796 17772 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.549612 17772 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.555074 18012 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.540323 17970 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.541014 17869 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:06.555676 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:06.534837 17991 consensus_meta.cc:287] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.713s	user 0.016s	sys 0.000s
I20260709 13:09:06.559003 15374 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:06.560163 15377 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:06.539745 17659 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:06.575879 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 75283.5us
I20260709 13:09:06.590502 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:06.576088 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46956.5us
I20260709 13:09:06.552985 15131 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:06.555104 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.589282 15374 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:06.488018 18079 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.596820 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.598927 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.599864 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.599895 18083 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.528529 18060 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.601151 15999 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:06.601302 18083 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.602247 18083 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.602715 18060 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.593499 17991 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.588773 17772 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.602152 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:06.606068 18073 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.606375 17842 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:06.607205 17842 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:06.607023 18073 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.607939 15374 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.608392 17842 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.608757 15303 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:06.609581 15374 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.616950 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.591493 15378 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:06.606475 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.540333 18028 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.633286 17876 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.860s	user 0.012s	sys 0.004s
I20260709 13:09:06.608836 18070 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.646381 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:06.648634 15274 leader_election.cc:400] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:06.649317 15274 leader_election.cc:403] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:06.592969 17961 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:09:06.512611 18067 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.594902 18068 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
W20260709 13:09:06.675814 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65759.2us
I20260709 13:09:06.656749 17518 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.684581 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 172339us
I20260709 13:09:06.673561 17876 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:06.658869 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.670414 18014 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:06.689596 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:06.697783 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 71843.6us
I20260709 13:09:06.697665 15227 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:06.650198 18028 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:06.717283 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 110891us
W20260709 13:09:06.723361 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88950.8us
I20260709 13:09:06.698099 17876 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:06.728771 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:06.730793 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:06.731583 18081 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
I20260709 13:09:06.736025 18028 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:06.706040 17801 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.736676 17876 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.736929 17801 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.739975 17801 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.743609 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:06.741008 17890 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:06.740826 17804 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.729318 17869 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.656950 17996 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.749370 17996 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:06.751195 17957 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:09:06.688124 17518 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.722769 17983 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:06.752774 15130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 200) took 21361 ms (client timeout 15000 ms). Trace:
W20260709 13:09:06.757297 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 72455.6us
I20260709 13:09:06.726364 18067 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.761327 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.758845 15231 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:06.707394 17772 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:06.767342 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:06.753955 17677 consensus_queue.cc:1175] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 5 status { last_received { term: 5 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 5 index: 6 } }
W20260709 13:09:06.773475 15273 leader_election.cc:336] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.279s (SENT)
I20260709 13:09:06.774900 15274 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.777141 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:06.781225 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:06.782671 18061 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:06.764780 17983 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:06.782727 18072 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:06.788074 18073 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:06.788239 18072 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:06.788322 17983 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.791205 18072 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:06.791282 15377 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:06.792228 15345 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.779214 18014 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.810851 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:06.815285 15379 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:09:06.782893 18012 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:06.800904 18060 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:06.821465 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 54219.6us
I20260709 13:09:06.798530 18093 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.814497 18014 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.778234 17801 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:06.810688 17493 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:06.824013 18092 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:09:06.812839 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:06.753679 15130 rpcz_store.cc:269] 0709 13:08:45.425830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.426014 (+   184us) service_pool.cc:224] Handling call
0709 13:09:06.745038 (+21319024us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:56.422103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:56.607256 (+185153us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:56.607348 (+    92us) write_op.cc:435] Acquired schema lock
0709 13:08:56.607379 (+    31us) tablet.cc:662] Decoding operations
0709 13:08:56.770585 (+163206us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:56.787636 (+ 17051us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:56.789255 (+  1619us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:08:57.000608 (+211353us) tablet.cc:701] Row locks acquired
0709 13:08:57.000663 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:08:57.000915 (+   252us) write_op.cc:270] Start()
0709 13:08:57.001117 (+   202us) write_op.cc:276] Timestamp: P: 1783602537000822 usec, L: 0
0709 13:08:57.001141 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:57.002107 (+   966us) log.cc:844] Serialized 7176 byte log entry
0709 13:08:57.397730 (+395623us) op_driver.cc:464] REPLICATION: finished
0709 13:08:58.395976 (+998246us) write_op.cc:301] APPLY: starting
0709 13:08:58.396141 (+   165us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:58.396612 (+   471us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:58.396773 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:58.399546 (+  2773us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:58.400076 (+   530us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:08:58.400137 (+    61us) write_op.cc:312] APPLY: finished
0709 13:08:58.400800 (+   663us) log.cc:844] Serialized 125 byte log entry
0709 13:08:58.642319 (+241519us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.648446 (+  6127us) write_op.cc:454] Released schema lock
0709 13:08:58.659331 (+ 10885us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:58.800542 (+141211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.806727 (+  6185us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3160108,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":986516,"apply.run_cpu_time_us":72233,"apply.run_wall_time_us":368876,"num_ops":18,"prepare.queue_time_us":628210,"prepare.run_cpu_time_us":27119,"prepare.run_wall_time_us":829055,"raft.queue_time_us":183647,"raft.run_cpu_time_us":20162,"raft.run_wall_time_us":426159,"replication_time_us":367121,"thread_start_us":738986,"threads_started":5,"wal-append.queue_time_us":542647,"wal-append.run_cpu_time_us":18861,"wal-append.run_wall_time_us":2129569}]]}
W20260709 13:09:06.834177 18087 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:06.839470 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:06.839838 17734 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:06.847141 15231 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:06.822595 18072 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:06.862749 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 101515us
I20260709 13:09:06.783263 18061 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:06.880952 15231 pending_rounds.cc:85] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 6
I20260709 13:09:06.860286 18014 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:06.889777 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 116328us
I20260709 13:09:06.892378 15999 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:09:06.892807 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53421.3us
I20260709 13:09:06.893579 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:06.873474 17493 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.885462 15231 pending_rounds.cc:107] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:06.900086 15231 raft_consensus.cc:2889] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.914844 15376 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:06.883360 18072 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:06.931107 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 173794us
W20260709 13:09:06.940652 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.941409 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.923645 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:06.902959 17493 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:06.946040 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50349.2us
I20260709 13:09:06.904834 18079 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.954967 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:09:06.957239 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.926657 18072 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.936700 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:06.940706 17869 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.965083 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:06.953243 18079 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:06.959514 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:06.959360 17615 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:06.977422 18083 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.985332 18028 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:07.012024 18094 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:09:07.043895 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 96808.6us
W20260709 13:09:07.032779 18099 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:09:06.987646 17869 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.984319 17804 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:06.991509 18073 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.010324 18079 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.058419 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:07.038719 17615 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:07.054880 18074 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.008s
I20260709 13:09:07.012212 17659 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:07.054708 18028 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:07.073040 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 119239us
I20260709 13:09:07.059926 17869 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.088585 15381 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:07.084219 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:07.061007 18073 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:07.091884 15300 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
W20260709 13:09:07.093102 18084 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.362s	user 0.003s	sys 0.000s
I20260709 13:09:07.084036 17804 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 13:09:07.096954 17687 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.003s
I20260709 13:09:07.097474 17687 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:07.103785 17518 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:07.105114 18100 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:09:07.105537 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:07.105631 18061 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.108618 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:07.109337 16000 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.109360 18061 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.063305 17734 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.114302 17734 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:07.114796 17734 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.115558 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:07.119220 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.119115 17876 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.120836 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.124393 18073 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:07.126621 18104 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:09:07.130983 18083 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:07.131831 18083 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.133074 18093 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.134775 18083 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.134863 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:07.135514 17493 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.136891 18093 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:07.137468 18093 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:07.138005 18093 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:07.138389 18090 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.407s	user 0.002s	sys 0.000s
I20260709 13:09:07.141139 17493 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.146086 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.146746 17876 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.148919 15226 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.071761 17615 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.159909 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.086891 18028 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.178020 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:07.182667 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47972.9us
I20260709 13:09:07.158480 17970 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:07.165917 17876 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.186987 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 290968us
I20260709 13:09:07.187408 15231 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:07.192576 15224 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.195843 18111 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.196743 18111 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.177320 17687 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:07.209158 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:07.193553 17876 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.228562 15224 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:07.230979 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.239351 15233 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:07.240061 17876 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.231997 18113 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:07.229406 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:07.191000 17970 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.226171 17801 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.222056 17772 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:07.253106 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:07.257172 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1810) took 1171 ms. Trace:
I20260709 13:09:07.245457 18113 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.245080 18083 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.257601 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.257694 15303 rpcz_store.cc:276] 0709 13:09:06.083118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.083548 (+   430us) service_pool.cc:224] Handling call
0709 13:09:07.254230 (+1170682us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400186ad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:07.254367 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010433280}
I20260709 13:09:07.250453 18111 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.259202 17772 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.255816 17801 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.261309 15999 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:07.266178 15224 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:07.257455 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.267951 18067 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:07.258620 17758 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.787s	user 0.015s	sys 0.003s
I20260709 13:09:07.268812 18072 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.272836 17970 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.273833 17890 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:07.274366 18067 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:07.276117 17869 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.266541 18113 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.278069 16000 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:07.279422 18079 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.280305 18063 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:07.284639 17734 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:07.287478 18086 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.555s	user 0.006s	sys 0.000s
I20260709 13:09:07.296749 18014 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:07.310267 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.315645 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:07.366387 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.343842 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 94045.4us
I20260709 13:09:07.350754 15225 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:07.328492 17983 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:07.370689 17983 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:07.371826 17869 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.372418 18067 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:07.373607 18085 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.641s	user 0.002s	sys 0.000s
I20260709 13:09:07.360603 16004 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.337191 17758 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.377597 15225 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.378441 18014 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.378547 17758 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:07.380020 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.380904 17772 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.342736 17890 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:09:07.363611 18119 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:09:07.358950 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.355880 18076 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:07.368005 17734 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:07.368464 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52934.5us
I20260709 13:09:07.369460 17413 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:07.365895 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 85787.2us
I20260709 13:09:07.376384 15224 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:07.382323 15232 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:07.382511 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.340607 18083 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:07.375205 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.322s (SENT) [suppressed 21 similar messages]
I20260709 13:09:07.360838 18093 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.389339 18076 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:07.396508 15230 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:09:07.397445 18076 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.397454 16000 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:07.398768 18076 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.401064 18079 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:07.401618 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:07.371660 17983 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.405783 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:07.403926 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.410131 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.390820 17909 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:07.391081 17876 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.416806 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:07.417610 15374 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.419034 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:07.419142 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:07.421346 15380 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:07.422933 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:07.423753 15376 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.422711 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:07.426010 15375 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:07.428073 15374 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:07.423462 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:07.441815 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 212532us
I20260709 13:09:07.442852 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:07.443440 15224 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:07.441351 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.420449 17758 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.414130 17909 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:07.455706 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63754.7us
I20260709 13:09:07.404836 18028 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.440071 17493 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.456830 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.456820 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64735.9us
I20260709 13:09:07.457023 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:07.418804 18102 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:07.458978 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76768us
I20260709 13:09:07.462466 15374 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.467631 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:07.468636 15380 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.447708 17649 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:07.475278 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:07.422647 17876 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.478295 16006 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:07.439246 17687 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:07.454056 17983 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.455016 17758 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:07.481541 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:07.485363 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.465262 17772 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.491580 15231 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.461344 17869 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.494344 15229 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:07.494958 15374 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:09:07.495468 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.477033 18118 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:07.473932 17649 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:07.484022 17413 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:07.512880 15373 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.449818 17890 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.474700 17493 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.514966 15377 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.731564 18108 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.608939 15375 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:07.516368 15380 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:09:07.565791 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85746.3us
I20260709 13:09:07.488950 17758 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.540143 15376 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:07.783409 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:07.784628 15229 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:07.736073 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 293306us
W20260709 13:09:07.731422 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 263193us
W20260709 13:09:07.804481 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 321455us
I20260709 13:09:07.515623 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:07.496075 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:09:07.823364 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 341904us
I20260709 13:09:07.825421 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:07.600930 18121 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.167s	user 0.000s	sys 0.002s
I20260709 13:09:07.505985 17772 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.507277 17869 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.835338 18014 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:07.845274 18014 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.842825 17869 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.847770 17869 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.731302 17801 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.833841 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:07.853677 17493 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:07.863265 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:07.571096 18103 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.516232 18083 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:07.579787 18118 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:07.579546 18117 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:07.881292 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.724139 18093 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:07.891218 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.891386 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:07.716513 17909 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.832732 17804 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.597265 18091 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.399s
I20260709 13:09:07.944785 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.855582 17890 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:07.952526 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 166234us
I20260709 13:09:07.914399 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:07.894670 16002 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:07.930471 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50447.5us
W20260709 13:09:07.903265 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.924669 15273 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.860s (SENT)
I20260709 13:09:07.959236 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:07.883915 18108 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:07.960191 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.960927 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.961545 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.962477 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.966952 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.891163 17801 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:07.972707 17801 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.898444 17493 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:07.975817 18028 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:07.976363 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:07.979244 18118 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.983968 17876 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:07.985337 17615 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.814s	user 0.015s	sys 0.000s
I20260709 13:09:07.986014 17615 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.964547 18083 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:07.989035 18083 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.989430 18083 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:07.992910 16001 raft_consensus.cc:2368] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:07.516120 17413 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:07.997097 17615 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:07.999118 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.002862 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.000458 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:08.001475 15230 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:08.005715 15229 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:08.007319 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.913251 18072 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:07.943924 18117 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:07.965461 18108 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.021726 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:08.023311 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:08.010197 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:07.919155 17758 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.914083 18103 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:08.028210 18102 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.001s
I20260709 13:09:08.017735 18135 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:07.953888 17804 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:07.975857 17801 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.021813 18109 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.060607 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:08.063536 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49406.8us
I20260709 13:09:07.879343 17649 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.015775 17493 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.100575 15225 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:08.101329 17493 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.024667 18108 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.022547 17909 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.075747 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:08.110909 15229 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:08.111073 15381 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:09:08.080680 15376 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:08.022228 17772 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.082564 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:08.085484 15382 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.084919 15230 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:08.087152 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:08.052109 18072 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.068899 18102 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:08.092998 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77378.8us
I20260709 13:09:08.093382 17869 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:08.094234 17804 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.095036 18093 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.094647 18117 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.096233 18135 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.084805 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:08.220283 15379 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:08.097868 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:08.221253 15233 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:08.098109 17983 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.007s
I20260709 13:09:08.099040 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:08.099936 17649 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.111119 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:08.235435 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 280631us
W20260709 13:09:08.091431 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.092752 17796 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.063930 18014 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.079774 18109 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.153738 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:08.255551 15373 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.104856 17890 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.144946 17801 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.230950 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:08.231047 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:08.259829 15381 raft_consensus.cc:2410] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:08.213130 18133 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:09:08.129076 15374 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:08.240049 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.259833 15302 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:08.267902 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.244004 15229 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
W20260709 13:09:08.234280 18076 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.000s
I20260709 13:09:08.210784 17869 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.154645 18072 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.284785 18076 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:08.269639 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:08.264030 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:08.272423 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:08.273576 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.165398 18131 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:09:08.275422 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.238031 17804 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.280010 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:08.293802 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 369179us
I20260709 13:09:08.282526 17869 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.283887 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:08.213713 18093 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.287753 15303 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 3.
W20260709 13:09:08.266690 18073 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.141s	user 0.009s	sys 0.008s
W20260709 13:09:08.290589 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59770.9us
I20260709 13:09:08.310184 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.311618 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:08.312036 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:08.312611 15301 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.292747 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:08.296849 15299 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:09:08.301990 15381 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:08.315146 15299 pending_rounds.cc:85] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 2
I20260709 13:09:08.315528 15299 pending_rounds.cc:107] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:08.315819 15299 raft_consensus.cc:2889] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.313829 15307 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.306792 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:08.308842 15273 leader_election.cc:336] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.034s (SENT)
W20260709 13:09:08.291654 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 192750us
I20260709 13:09:08.257555 17796 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.322454 15374 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.269413 18014 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:09:08.295977 18132 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:08.318370 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:08.256151 17772 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:09:08.329766 15381 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.330493 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:08.353441 18093 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:08.353643 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:08.354111 15379 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:08.354303 18093 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.354555 15379 pending_rounds.cc:85] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 2
I20260709 13:09:08.354836 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:08.330945 15305 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:08.299543 18134 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:08.356307 17876 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:08.356738 18134 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:08.356920 18091 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.357245 18134 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.357577 18091 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.358501 18136 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:08.358600 18091 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.359928 18146 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:08.345321 18132 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:08.344591 18113 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.010s
W20260709 13:09:08.361361 16001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 338) took 1477 ms (client timeout 1678 ms). Trace:
I20260709 13:09:08.361508 18132 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.354871 15379 pending_rounds.cc:107] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:08.362906 15379 raft_consensus.cc:2889] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:08.346315 18124 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.765s	user 0.003s	sys 0.003s
I20260709 13:09:08.361544 18113 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:08.366212 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.320130 18073 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.356947 17876 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.368620 18073 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:08.369422 15376 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.369324 17876 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.368860 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 339) took 1090 ms. Trace:
I20260709 13:09:08.349054 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 279) took 1053 ms. Trace:
I20260709 13:09:08.276113 17801 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.364858 18146 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:08.361851 16001 rpcz_store.cc:269] 0709 13:09:06.884407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.885235 (+   828us) service_pool.cc:224] Handling call
0709 13:09:08.361126 (+1475891us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54004f3654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:08.361274 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336616192}
I20260709 13:09:08.372959 18146 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.373301 18072 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:08.374105 17758 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:08.373878 18146 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.346711 15301 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:08.295338 17890 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:09:08.302578 17804 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.350644 18109 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.359159 18136 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.370760 18102 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:08.368647 15224 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:08.349553 18135 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.372244 17991 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:08.381261 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72463.4us
W20260709 13:09:08.392195 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.383469 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:08.425031 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:08.330655 18118 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:08.439982 15301 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.442893 15374 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:08.470163 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.478694 15301 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:09:08.480217 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.431550 15307 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:09:08.430234 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 151722us
I20260709 13:09:08.354810 18093 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.371564 16004 rpcz_store.cc:276] 0709 13:09:07.295588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.301132 (+  5544us) service_pool.cc:224] Handling call
0709 13:09:07.354959 (+ 53827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.376406 (+ 21447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.348756 (+972350us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b540053f2d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:08.348971 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117508352}
I20260709 13:09:08.350699 18083 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.537853 15233 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:08.470134 18146 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:08.547489 15273 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.061s (SENT)
I20260709 13:09:08.550416 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:08.540716 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:08.510455 18109 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.555157 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:08.513228 18118 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:08.548491 18148 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.566346 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.542600 18076 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:08.569651 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:08.492962 18140 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 13:09:08.511793 17991 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.578640 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:08.564103 18113 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.563613 18067 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:08.370841 15999 rpcz_store.cc:276] 0709 13:09:07.278730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.328563 (+ 49833us) service_pool.cc:224] Handling call
0709 13:09:07.367677 (+ 39114us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.376720 (+  9043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.376761 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.377337 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.428555 (+ 51218us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:07.437998 (+  9443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.445983 (+  7985us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.345712 (+899729us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:08.368447 (+ 22735us) raft_consensus.cc:1685] finished
0709 13:09:08.368486 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.368759 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231697664,"thread_start_us":36019,"threads_started":1,"wal-append.queue_time_us":106774}
I20260709 13:09:08.589883 15226 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:08.580960 17772 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:08.595683 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 84383.8us
I20260709 13:09:08.598381 17796 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.598237 18076 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.599257 17991 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:08.603140 15228 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:08.576630 18148 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.585986 18014 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.632743 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:08.636240 15374 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:09:08.674561 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 109149us
I20260709 13:09:08.618659 17758 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.604151 17804 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.611789 18083 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.631527 18067 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:08.583469 18136 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:08.616701 18156 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.210s
I20260709 13:09:08.712808 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:08.843708 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 163390us
I20260709 13:09:08.654922 18142 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:08.698422 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.843542 15303 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:08.838956 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 291503us
I20260709 13:09:08.716477 15378 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:08.714141 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.827515 15227 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:08.857056 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:08.857656 15302 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
W20260709 13:09:08.837790 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 120076us
I20260709 13:09:08.634048 18014 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:08.841121 18067 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:08.764331 17649 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.002s
I20260709 13:09:08.851529 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:08.908691 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:08.717075 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 88558us
W20260709 13:09:08.851913 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.615945 18162 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:08.835875 18163 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
W20260709 13:09:08.845913 15373 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.008s
I20260709 13:09:08.911473 15373 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:08.660384 17991 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:08.902153 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.917188 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.846537 15304 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:08.820015 17801 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:08.765142 17909 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 13:09:08.837170 17914 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:08.909890 15303 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:08.718977 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:08.919870 17914 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:08.710477 18150 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:09:08.862811 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:08.923420 15308 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.863377 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.915778 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.925802 15299 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:08.852937 18148 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:08.929067 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:08.861053 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:08.868192 18093 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:08.915212 18134 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.002s
I20260709 13:09:08.905224 18032 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:08.934826 18012 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:08.935825 18103 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:08.921288 18168 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:08.904428 18142 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.930845 15305 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:08.942286 15378 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:08.942094 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:08.916640 18072 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:09:08.944526 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.819523 17772 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:08.912485 18083 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.946130 15304 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.916529 17991 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:08.948077 15302 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:08.928562 17801 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.685516 18118 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.962740 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:08.949967 17804 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:08.963603 15233 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:08.967955 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.953699 18108 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.005s
I20260709 13:09:08.973141 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:08.979368 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:08.977892 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:08.981089 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52100.9us
W20260709 13:09:08.982008 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:08.983908 17991 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.941269 17649 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:09:08.964807 18083 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.987258 18072 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:08.987782 18072 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:08.982599 18159 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:09:08.988844 18072 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:08.950153 18032 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.990025 18072 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.945298 18148 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:09:09.013863 18148 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:09.014369 18148 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:08.965394 18162 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:09.017990 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1865) took 1062 ms. Trace:
I20260709 13:09:09.018501 15225 rpcz_store.cc:276] 0709 13:09:07.956028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.966685 (+ 10657us) service_pool.cc:224] Handling call
0709 13:09:09.017764 (+1051079us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540007b054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:09.017892 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305499392}
I20260709 13:09:08.959096 18168 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.019883 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:09.021713 15228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1875) took 1644 ms (client timeout 1689 ms). Trace:
I20260709 13:09:09.019999 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.018043 18162 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.022980 18162 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.023607 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:08.979596 18108 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.026986 15231 raft_consensus.cc:2368] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:09:08.970796 17772 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.995278 15374 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:08.949236 18134 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:08.998616 18174 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:08.999606 18093 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:09.028621 15273 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.627s (SENT)
I20260709 13:09:09.052656 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.000625 18142 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:09.001808 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:09.003127 18083 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:09.005661 15233 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:09.007982 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.010776 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1808) took 1594 ms. Trace:
I20260709 13:09:09.011024 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1879) took 1562 ms. Trace:
I20260709 13:09:09.034412 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.035140 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:09.056090 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 48310.8us
I20260709 13:09:09.056030 15224 rpcz_store.cc:276] 0709 13:09:07.448287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.448441 (+   154us) service_pool.cc:224] Handling call
0709 13:09:07.458300 (+  9859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.471937 (+1013637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.010598 (+538661us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54000dded4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:09.010941 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092937088}
I20260709 13:09:09.057801 15348 leader_election.cc:400] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:09.058372 15348 leader_election.cc:403] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:09.022208 15228 rpcz_store.cc:269] 0709 13:09:07.376946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.405432 (+ 28486us) service_pool.cc:224] Handling call
0709 13:09:09.021503 (+1616071us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540043ce54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:09.021644 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963334400}
I20260709 13:09:09.059001 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:09.059894 17649 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:09.060796 18093 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:09.062520 18134 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:09.062083 18093 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.063422 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:09.050879 18116 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:09:09.064527 15378 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:09.064838 18116 consensus_queue.cc:1243] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:09.064977 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.066303 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:08.968062 17801 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.067415 18168 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:09.068902 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:09.069659 17801 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:09.069931 15378 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:09.070852 18109 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.009s
I20260709 13:09:09.039499 15308 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:09.063493 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.074030 18157 raft_consensus.cc:2764] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:09.055624 15382 rpcz_store.cc:276] 0709 13:09:07.415829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.482362 (+ 66533us) service_pool.cc:224] Handling call
0709 13:09:07.494652 (+ 12290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.147803 (+653151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.010424 (+862621us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54003f3254. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:09.010666 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358304640}
I20260709 13:09:09.048305 15232 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:09.015684 18148 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.077226 18148 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.968396 18076 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:09.077905 18076 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:09.028260 18108 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:09.083624 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48573.6us
I20260709 13:09:09.088486 15299 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:08.944875 17914 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.087993 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:09.067438 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.092495 15225 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:09.092561 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:08.998693 18032 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:09.101716 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67428.4us
W20260709 13:09:09.103967 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75397.8us
W20260709 13:09:09.105298 15273 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.637s (SENT)
I20260709 13:09:09.105782 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:08.950414 18014 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.114084 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:09.114212 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:09.092098 18012 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:09.093128 18083 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:09.107633 18146 consensus_meta.cc:287] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.551s	user 0.003s	sys 0.010s
W20260709 13:09:09.122998 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.110965 18157 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:09.116809 17914 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.100926 18161 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.114512 18109 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:09.115043 18174 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:09.150609 18174 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.151070 18174 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.140100 18162 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.155053 18162 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:09.157049 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:09.158119 15374 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:09.161482 18149 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.642s	user 0.003s	sys 0.000s
I20260709 13:09:09.163280 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 402) took 1101 ms. Trace:
I20260709 13:09:09.163853 15380 rpcz_store.cc:276] 0709 13:09:08.061689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.061869 (+   180us) service_pool.cc:224] Handling call
0709 13:09:08.062468 (+   599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.062959 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.062990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.081717 (+ 18727us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.289371 (+207654us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:08.289447 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.289511 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.160805 (+871294us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:09.162852 (+  2047us) raft_consensus.cc:1685] finished
0709 13:09:09.162883 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.163194 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":386,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":12617,"spinlock_wait_cycles":17028992,"thread_start_us":198670,"threads_started":1,"wal-append.queue_time_us":240974}
I20260709 13:09:09.129568 18012 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.143301 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:09.148988 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.130203 17801 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:09.140777 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:09.175848 15225 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:09:09.167178 18157 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:09.146425 18014 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.127238 18076 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:09.370849 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.380192 18140 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.182066 18083 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.353080 18072 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.382371 18140 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.382825 18083 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.383294 18072 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.250960 18079 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.198801 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.385838 15231 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:09.180541 18012 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.387519 15231 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.387739 18157 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.196376 18067 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.385363 18076 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:09.182210 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76947.8us
I20260709 13:09:09.181484 18109 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:09.397994 18109 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:09.379634 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.402266 18072 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:09.182032 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.410146 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:09.410749 18113 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:09.410928 15300 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:09.411247 18113 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.395538 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:09.411639 18113 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:09.403062 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.406411 15308 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:09.409041 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.417618 15308 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:09.419664 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.423906 15231 raft_consensus.cc:1813] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:09:09.425426 18174 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.422792 15300 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:09.423208 15233 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:09.190235 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:09.420728 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 238801us
I20260709 13:09:09.424868 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:09.421113 15308 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:09.423338 18113 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.385448 18079 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.440109 15378 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
W20260709 13:09:09.394374 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 253772us
I20260709 13:09:09.465247 15231 raft_consensus.cc:2410] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:09.461891 15308 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:09.466107 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:09.459357 15273 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.904s (SENT)
I20260709 13:09:09.457520 15225 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.467346 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:09.461484 15301 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.433631 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.196550 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.460206 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.472857 15230 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:09.393481 18063 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.935s	user 0.014s	sys 0.016s
I20260709 13:09:09.477500 15302 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:09:09.478500 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 282119us
I20260709 13:09:09.482301 15305 pending_rounds.cc:85] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 1
I20260709 13:09:09.482540 15299 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:09.482760 15305 pending_rounds.cc:107] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:09.482754 15301 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:09.483292 15305 raft_consensus.cc:2889] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.483742 18127 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:09.484721 18127 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:09.486382 18127 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.490096 18148 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:09.490665 18148 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.491092 18148 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.474885 17801 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:09.493038 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1814) took 1263 ms. Trace:
I20260709 13:09:09.493484 15376 rpcz_store.cc:276] 0709 13:09:08.229889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.230680 (+   791us) service_pool.cc:224] Handling call
0709 13:09:08.236260 (+  5580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.369951 (+133691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.492775 (+1122824us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540027bad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:09.492964 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305772800}
I20260709 13:09:09.495106 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1862) took 1544 ms. Trace:
I20260709 13:09:09.495556 15227 rpcz_store.cc:276] 0709 13:09:07.950560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.000092 (+ 49532us) service_pool.cc:224] Handling call
0709 13:09:08.000450 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.856867 (+856417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.494821 (+637954us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b540009d154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:09.495028 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901377920}
W20260709 13:09:09.503294 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.472954 17758 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.628s	user 0.014s	sys 0.005s
W20260709 13:09:09.518867 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58765.6us
I20260709 13:09:09.476552 15308 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.471967 17413 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.477267 18063 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.023s	user 0.016s	sys 0.018s
W20260709 13:09:09.525338 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 131813us
I20260709 13:09:09.480100 18067 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.532361 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.525840 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.526409 15308 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.464278 18072 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:09:09.535836 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.524415 17869 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:09.521509 18131 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:09.547381 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:09.590592 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44783.4us
W20260709 13:09:09.552771 15273 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.080s (SENT)
I20260709 13:09:09.533666 17758 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:09.556034 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.575346 18113 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:09.597380 18122 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:09.598117 18122 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.582726 15308 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:09.602703 15225 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:09.527550 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:09.574901 18174 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:09.543768 18157 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:09.612622 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59871.5us
I20260709 13:09:09.546856 18091 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:09.616101 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:09.588142 18072 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:09.569535 17869 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:09.613780 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.624219 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.603727 18147 raft_consensus.cc:2764] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:09.535228 17413 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.619463 15225 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:09.621340 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.631187 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.617254 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:09.625183 15273 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.115s (SENT)
I20260709 13:09:09.542665 17876 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:09:09.619668 18091 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.653115 18091 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.653643 18135 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:09.620994 18134 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:09.654352 18135 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.620970 18072 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:09.658718 17413 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:09.658761 16007 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:09.662109 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:09.625897 17869 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.614149 17842 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:09.617865 17493 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:09.654819 18135 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.638242 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1860) took 1692 ms. Trace:
I20260709 13:09:09.633400 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:09.687753 15226 rpcz_store.cc:276] 0709 13:09:07.945617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.945791 (+   174us) service_pool.cc:224] Handling call
0709 13:09:07.946197 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.590369 (+644172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.637903 (+1047534us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54003c1ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:09.638168 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479880448}
I20260709 13:09:09.609494 18131 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:09.692178 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 82793.3us
I20260709 13:09:09.615274 18113 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:09:09.727377 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:09.732092 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.683355 17842 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.661393 18072 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:09.813721 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 188558us
I20260709 13:09:09.768463 18093 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:09.687140 17734 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
W20260709 13:09:09.849083 18189 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:09:09.849684 17734 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:09.850739 18190 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:09:09.850978 17772 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:09.691367 17493 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:09.842927 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72356.6us
W20260709 13:09:09.864316 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.865676 18012 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.841692 18122 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:09.868274 15228 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:09.696218 18174 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:09.871013 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 268762us
W20260709 13:09:09.876236 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 563328us
I20260709 13:09:09.872210 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.831306 17842 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:09.874317 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 201965us
I20260709 13:09:09.878450 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:09.874928 15273 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.596s (SENT)
I20260709 13:09:09.880286 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.837736 18079 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:09.882792 15273 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.212s (SENT)
I20260709 13:09:09.884881 15226 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:09.886610 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:09.893476 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.884948 17772 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:09.891541 18191 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:09:09.883662 18093 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:09.888878 17758 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:09.881460 18031 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:09.893991 18079 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:09.926424 18079 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.927295 18079 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.927712 18194 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:09.929431 18194 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:09.929873 18194 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:09.931445 18194 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.879324 18148 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.898465 18174 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.919559 18118 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:09.924105 17493 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:09.925331 18131 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:09.954507 15345 leader_election.cc:400] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:09:09.957752 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.967461 18194 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.908413 18134 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:09.927754 18093 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.970655 17869 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:09.971808 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:09.975505 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80717.4us
I20260709 13:09:09.979728 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:09.982025 15375 raft_consensus.cc:2376] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8. Re-sending same reply.
I20260709 13:09:09.991747 18148 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:09.986178 18012 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:09.995890 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:10.002821 18012 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:10.004753 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.006085 18148 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:10.005822 17758 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.006718 18148 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:10.023159 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:10.023873 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:10.027889 17876 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:10.028776 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.029134 18012 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.030076 17876 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:10.030714 17876 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:10.007895 18148 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:10.035473 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 157075us
I20260709 13:09:10.039532 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.040761 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.040802 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:10.048448 15273 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.322s (SENT)
I20260709 13:09:10.049216 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.053465 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.015635 18157 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:10.057379 17869 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.059839 15227 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:10.063218 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:10.063705 18174 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.064152 15999 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:10.064996 18076 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.009s
I20260709 13:09:10.040307 17758 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:10.066268 18196 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:10.066982 18196 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:10.067700 18012 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:10.068161 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:10.069506 18012 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:10.069687 18134 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.043970 18161 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:10.045075 18072 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:09:10.077718 18116 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.078007 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.078951 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 236) took 1593 ms. Trace:
I20260709 13:09:10.079425 15307 rpcz_store.cc:276] 0709 13:09:08.485725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.518559 (+ 32834us) service_pool.cc:224] Handling call
0709 13:09:08.518902 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.592723 (+ 73821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.592764 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.592809 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:08.592854 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.078697 (+1485843us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b54002c2c54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:10.078749 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.078887 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166137216}
I20260709 13:09:10.031929 17876 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.082103 18184 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:10.082584 18122 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:10.083546 18122 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:10.083950 18122 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:10.066324 17758 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:10.104262 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55905.6us
W20260709 13:09:10.106789 15273 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.809s (SENT)
I20260709 13:09:10.107314 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.103641 17772 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:10.125770 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.126370 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.067929 18196 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.132151 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.133277 15305 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:10.134393 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.087551 18116 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:10.114780 18153 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.113432 17842 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.147527 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.155573 15299 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.147253 18072 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.154110 18196 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.160741 18072 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.163812 18072 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:10.104638 18157 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:10.164834 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.165863 15305 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:10.166505 18157 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:10.168195 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.168500 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.168942 17842 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.169126 15301 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.169639 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.169986 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.170333 15306 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:10.170693 15302 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:10.171380 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.171636 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.172940 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.174407 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:10.173760 15306 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:10.176474 18116 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:10.176721 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.158983 18122 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:10.178262 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.179001 15306 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:09:10.179419 18122 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.179989 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.180648 15306 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.174518 17869 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.181581 15300 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.128710 18091 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.181283 17869 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:10.185578 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 161811us
I20260709 13:09:10.185922 15302 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:10.173242 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.186547 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:10.187724 15308 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:09:10.191825 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.203652 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.205063 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.218171 15301 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:10.219581 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:10.219453 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:10.220602 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:10.221912 15308 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:09:10.229425 15376 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:10.223788 15380 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:10.233197 15305 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:10.187390 18091 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.244361 15306 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:10.251003 15299 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
W20260709 13:09:10.258126 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.268146 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.268937 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:10.272223 15379 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.272264 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:10.273964 15381 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.173166 18135 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.279462 15300 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:10.287387 15374 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:09:10.293311 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 256549us
I20260709 13:09:10.281322 18127 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:10.215233 17842 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:09:10.306190 15374 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:10.338672 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:10.338703 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.228603 17758 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.340725 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:10.348037 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:10.326898 18091 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:10.354809 15274 leader_election.cc:400] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:09:10.356882 15274 leader_election.cc:403] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:10.357051 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:10.358455 15380 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:10.319118 18079 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.302335 18127 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:10.372033 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:10.335798 18194 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:09:10.345799 18116 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:10.376693 18135 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.386390 18127 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.391487 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:10.394428 15375 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:10.356479 18091 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:10.402513 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:10.403983 15373 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:10.404767 15232 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:10.393115 18206 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:10.442402 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 87847.9us
I20260709 13:09:10.450959 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:10.442657 15225 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:10.443852 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:10.414240 15375 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:10.448731 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 241) took 1594 ms. Trace:
I20260709 13:09:10.454275 15303 rpcz_store.cc:276] 0709 13:09:08.854660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.927918 (+ 73258us) service_pool.cc:224] Handling call
0709 13:09:08.933868 (+  5950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.020684 (+ 86816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.020719 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.020775 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:09.020831 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.448378 (+1427547us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54002fb554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:10.448446 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.448635 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198971264}
I20260709 13:09:10.402482 18203 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:09:10.402961 18109 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:10.469769 18083 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:10.475922 15999 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:10.479842 17991 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.476365 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:10.433507 18195 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:09:10.478262 18202 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:09:10.489260 15273 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 4.454s (SENT)
W20260709 13:09:10.492544 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.497710 15379 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:10.501312 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:10.502350 15999 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:10.462805 18215 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:10.515061 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:10.510540 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77132.9us
I20260709 13:09:10.515975 15226 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:09:10.515229 15199 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:10.520885 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54426.7us
I20260709 13:09:10.522130 18206 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:10.523418 18206 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.526811 16002 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:10.517172 17615 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:09:10.475390 18216 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
W20260709 13:09:10.529493 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44699.4us
I20260709 13:09:10.529505 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:10.476042 17869 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.492601 18136 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:10.542883 15373 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:10.536019 15227 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:10.497344 18116 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:10.537436 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:10.549098 15379 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:10.547465 15375 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:10.499781 18220 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.512821 18215 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:10.486255 17876 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:09:10.474457 18091 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.567703 18215 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.577090 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.588099 15300 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:10.591100 15381 raft_consensus.cc:2410] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:10.593832 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.519150 18083 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:09:10.598388 15273 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.638s (SENT)
I20260709 13:09:10.599179 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.569602 18216 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:10.559412 18220 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:10.603462 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 88306.3us
I20260709 13:09:10.571722 18136 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:10.577701 18217 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:09:10.544899 18222 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:09:10.616210 15974 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:10.579537 18079 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.599817 18148 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.581642 18140 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:10.637512 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.618089 18136 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.615415 18220 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.663400 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.670447 15300 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:10.671963 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:10.687898 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:10.694060 15226 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: [8.8-9.9]
W20260709 13:09:10.695621 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.638289 18153 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:10.713932 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:10.665015 18222 consensus_queue.cc:1243] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:09:10.715289 15233 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:10.636174 18228 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.670800 18136 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.668938 18218 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.712595 18205 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 13:09:10.638906 18148 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.725484 17413 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:10.741951 18230 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:10.711905 18153 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:09:10.724838 18122 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.005s
W20260709 13:09:10.756104 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.770049 15233 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:10.690959 18079 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:09:10.757084 18230 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:10.760843 18225 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.789947 18131 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.758208 17615 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:10.795271 18216 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:09:10.831370 15273 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.971s (SENT)
I20260709 13:09:10.760514 17413 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:10.830894 15304 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:10.835117 15304 pending_rounds.cc:85] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 8
I20260709 13:09:10.835451 15304 pending_rounds.cc:107] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:10.835702 15304 raft_consensus.cc:2889] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.832168 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:10.836658 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.837891 18226 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:09:10.817022 18225 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.850554 17991 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.853224 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1891) took 1835 ms. Trace:
I20260709 13:09:10.853725 15228 rpcz_store.cc:276] 0709 13:09:09.018341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.424740 (+406399us) service_pool.cc:224] Handling call
0709 13:09:09.425276 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.868907 (+443631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.852929 (+984022us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54003c28d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:10.853156 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017793280}
I20260709 13:09:10.755677 18218 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:10.868598 15273 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.994s (SENT)
I20260709 13:09:10.869710 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:10.809623 18230 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.844144 18225 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.916059 17413 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:10.915745 18216 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.866948 18153 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.870622 17772 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.925046 18232 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:09:10.927922 18218 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:10.819099 18131 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:10.867179 18222 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.984560 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:10.985816 15300 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.977840 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1895) took 1112 ms. Trace:
I20260709 13:09:10.989245 15225 rpcz_store.cc:276] 0709 13:09:09.865951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.867606 (+  1655us) service_pool.cc:224] Handling call
0709 13:09:09.881221 (+ 13615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.451966 (+570745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.977513 (+525547us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54000dded4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:10.977759 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290279168}
I20260709 13:09:10.991850 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:10.992687 15306 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:11.001621 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:11.010968 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:11.018699 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 156078us
I20260709 13:09:10.956604 17991 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:10.978675 18223 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.974264 18235 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:10.978922 18156 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.035040 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.036494 17758 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:11.037554 18223 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.050623 18223 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:11.054090 15299 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:11.054677 15299 pending_rounds.cc:85] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 6
I20260709 13:09:11.054929 15299 pending_rounds.cc:107] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:11.055217 15299 raft_consensus.cc:2889] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.988375 18148 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:11.082995 15301 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:11.089108 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 332) took 2626 ms. Trace:
I20260709 13:09:11.090514 15230 rpcz_store.cc:276] 0709 13:09:08.462934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.463072 (+   138us) service_pool.cc:224] Handling call
0709 13:09:08.463477 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.474661 (+1011184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.088629 (+1613968us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002d0d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:11.088997 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320913280}
I20260709 13:09:10.987963 18083 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:11.024868 15300 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:09:11.098943 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 429072us
I20260709 13:09:11.023573 18231 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.100718 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 233903us
I20260709 13:09:10.998656 18222 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:10.988901 17772 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:11.170578 15273 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.225s (SENT)
I20260709 13:09:11.251811 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:11.253356 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82860.5us
W20260709 13:09:11.254210 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.254792 15273 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.717s (SENT)
W20260709 13:09:11.255805 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 150791us
I20260709 13:09:11.257172 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.255475 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.258455 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.089691 18218 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.259732 15301 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:11.273221 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:11.289028 15300 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:11.273034 16007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 468) took 1733 ms. Trace:
I20260709 13:09:11.248834 18231 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:09:11.351022 15273 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.817s (SENT)
I20260709 13:09:11.449762 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.354031 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:11.451792 15300 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:11.262480 17991 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:11.090873 18156 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:11.064585 18235 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:11.360030 18213 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:09:11.322959 16007 rpcz_store.cc:276] 0709 13:09:09.539669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.539799 (+   130us) service_pool.cc:224] Handling call
0709 13:09:09.584834 (+ 45035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.660611 (+ 75777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.262509 (+1601898us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b540053f2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:11.272736 (+ 10227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168824704}
W20260709 13:09:11.445278 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 186888us
I20260709 13:09:11.290681 18161 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.469404 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1843) took 1243 ms. Trace:
I20260709 13:09:11.474722 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:11.499089 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.499435 15300 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.498521 15382 rpcz_store.cc:276] 0709 13:09:10.225782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.225922 (+   140us) service_pool.cc:224] Handling call
0709 13:09:10.268727 (+ 42805us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:10.285158 (+ 16431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.285220 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:10.292713 (+  7493us) log.cc:844] Serialized 52 byte log entry
0709 13:09:10.353010 (+ 60297us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:11.091647 (+738637us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.468713 (+377066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.468839 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.469039 (+   200us) raft_consensus.cc:1685] finished
0709 13:09:11.469060 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.469311 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252351,"prepare.queue_time_us":316148,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":315564,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":7071,"thread_start_us":895208,"threads_started":3,"wal-append.queue_time_us":80571}
I20260709 13:09:11.510731 15300 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:11.288571 18218 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:11.370178 18212 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.473852 18136 consensus_meta.cc:287] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.719s	user 0.014s	sys 0.002s
I20260709 13:09:11.410459 18248 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.518234 15307 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:11.518761 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:11.412497 18223 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.530819 15300 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:11.483652 18232 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:11.504832 17991 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.531816 18136 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.658581 18239 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.659642 18236 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:11.662254 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 310919us
W20260709 13:09:11.689203 15273 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.488s (SENT)
I20260709 13:09:11.659675 18218 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:11.702801 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.710745 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:11.739967 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.691856 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 192861us
I20260709 13:09:11.743549 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:11.743553 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 637915us
I20260709 13:09:11.745707 15382 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:11.685796 18215 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.085s	user 0.016s	sys 0.000s
I20260709 13:09:11.750345 15374 raft_consensus.cc:2368] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6.
I20260709 13:09:11.681537 18148 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:11.753621 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:11.686671 18236 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:11.712430 18220 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.000s	user 0.014s	sys 0.000s
I20260709 13:09:11.760913 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:11.762984 18242 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.348s	user 0.000s	sys 0.000s
W20260709 13:09:11.760957 18230 consensus_meta.cc:287] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.000s
I20260709 13:09:11.710871 18243 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.529688 18212 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.688274 18239 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:11.776669 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:11.791177 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:11.764124 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:11.820266 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70739.2us
I20260709 13:09:11.820621 15305 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:11.832938 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:11.834131 15376 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:11.793534 18241 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:09:11.690356 18131 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:11.838568 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:11.842319 15374 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:11.791800 18258 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.793452 18136 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:11.846406 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:11.851346 15348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.016s	sys 0.017s
W20260709 13:09:11.853261 15348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.016s	sys 0.017s
I20260709 13:09:11.831176 18222 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:11.759280 18218 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:11.837258 18236 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:11.855122 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.857455 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:11.859612 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:11.764585 18148 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:11.539387 18156 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:11.848425 18216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.026s	sys 0.075s
I20260709 13:09:11.864310 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:11.867141 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:11.868162 15382 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:11.830538 18230 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.870152 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:11.873750 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.880645 15273 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.929s (SENT)
I20260709 13:09:11.881335 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.854128 18261 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:11.891947 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:11.893124 15273 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.993s (SENT)
I20260709 13:09:11.894747 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.831040 18220 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.893886 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:11.513314 18161 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:11.893119 18127 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.836759 18243 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:11.854140 18258 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.899504 18266 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:11.917003 18266 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.917384 18266 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:11.917557 18147 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:11.918115 18147 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:11.918653 18208 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:11.922798 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1845) took 1692 ms. Trace:
I20260709 13:09:11.923336 15378 rpcz_store.cc:276] 0709 13:09:10.230000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.230126 (+   126us) service_pool.cc:224] Handling call
0709 13:09:10.230478 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.230975 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:10.583632 (+352657us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b1800385360. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf 00007f2f53b40038
0709 13:09:10.897064 (+313432us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.862439 (+965375us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.865400 (+  2961us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.871882 (+  6482us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:11.873032 (+  1150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.873097 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.922436 (+ 49339us) raft_consensus.cc:1685] finished
0709 13:09:11.922558 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.922719 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":263856,"prepare.queue_time_us":364124,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":4211,"raft.queue_time_us":421568,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":134629,"spinlock_wait_cycles":72837376,"thread_start_us":953382,"threads_started":3,"wal-append.queue_time_us":731328}
I20260709 13:09:11.928499 18222 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:11.908802 16007 raft_consensus.cc:1813] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
W20260709 13:09:11.879019 18216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.027s	sys 0.075s
I20260709 13:09:11.930176 18231 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:11.766554 18215 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.940549 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:11.946336 15307 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:11.942324 16007 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:11.945189 15300 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:11.950933 15376 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:11.905859 18212 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:11.955678 15307 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:11.959357 15300 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:11.908601 18252 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.919056 18208 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.912321 18239 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:11.904223 18230 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:11.914863 18220 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:11.910694 18243 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:11.913229 18256 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:11.964959 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:11.907534 18148 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:11.863715 18218 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:11.967468 15303 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:11.968472 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:11.966794 15376 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:11.978297 15999 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:11.979969 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:11.975570 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:11.981153 16002 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
W20260709 13:09:11.991438 15306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.030s	sys 0.023s
W20260709 13:09:11.991951 15306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.030s	sys 0.023s
I20260709 13:09:11.902150 18127 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:11.969265 18208 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.026317 15307 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:12.023715 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 131850us
I20260709 13:09:12.032317 15307 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:09:11.977219 18113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.135s	user 0.005s	sys 0.020s
I20260709 13:09:12.026948 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:11.919044 18147 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:12.033038 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:12.021133 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:11.969584 18252 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:12.012130 18256 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:12.033344 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:11.965703 18268 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:12.024812 15273 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.116s (SENT)
I20260709 13:09:11.976455 18216 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:11.931433 18261 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:12.064728 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1864) took 1071 ms. Trace:
I20260709 13:09:12.092629 15381 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:12.091851 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:12.893107 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1868) took 1882 ms. Trace:
I20260709 13:09:12.197276 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:12.396765 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:09:12.055260 15347 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.011s	sys 0.023s
I20260709 13:09:12.090617 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:12.890631 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 863725us
I20260709 13:09:12.149184 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1860) took 1166 ms. Trace:
W20260709 13:09:12.969216 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 944363us
I20260709 13:09:12.401145 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1885) took 1729 ms. Trace:
I20260709 13:09:12.969563 15225 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:12.491389 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 251) took 1915 ms. Trace:
I20260709 13:09:12.893555 15302 rpcz_store.cc:276] 0709 13:09:11.011137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.011332 (+   195us) service_pool.cc:224] Handling call
0709 13:09:11.022221 (+ 10889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.259889 (+237668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.259924 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.291245 (+ 31321us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.893188 (+601943us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:11.893233 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.893309 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.062350 (+169041us) raft_consensus.cc:1685] finished
0709 13:09:12.062382 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.893047 (+830665us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30231,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":51,"thread_start_us":722804,"threads_started":2,"wal-append.queue_time_us":604725}
W20260709 13:09:12.492033 15232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1896) took 2496 ms (client timeout 2158 ms). Trace:
I20260709 13:09:12.897017 15306 rpcz_store.cc:276] 0709 13:09:10.993717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.994147 (+   430us) service_pool.cc:224] Handling call
0709 13:09:10.994497 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.288145 (+293648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.288200 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.368632 (+ 80432us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.992438 (+623806us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:11.992496 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.992757 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.064430 (+ 71673us) raft_consensus.cc:1685] finished
0709 13:09:12.064451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.064651 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57614,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":127,"thread_start_us":812910,"threads_started":2,"wal-append.queue_time_us":644208}
I20260709 13:09:12.091301 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:12.279816 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:12.010787 18156 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.393577 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:12.485899 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1866) took 1490 ms. Trace:
I20260709 13:09:12.663740 15129 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 2 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 4 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.019953 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.039444 15381 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:12.971936 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:09:12.779731 15131 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 92) took 24642 ms (client timeout 15000 ms). Trace:
I20260709 13:09:13.039896 15301 rpcz_store.cc:276] 0709 13:09:10.995772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.001211 (+  5439us) service_pool.cc:224] Handling call
0709 13:09:12.485639 (+1484428us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b540025b2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:12.485807 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184460032}
I20260709 13:09:12.375551 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:12.037602 15307 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:12.091933 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:12.982546 16007 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.041750 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.041338 15307 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.050573 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:13.042339 15232 rpcz_store.cc:269] 0709 13:09:09.995330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.995533 (+   203us) service_pool.cc:224] Handling call
0709 13:09:12.491814 (+2496281us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540033ca54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:12.491952 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924600576}
I20260709 13:09:13.039654 15226 rpcz_store.cc:276] 0709 13:09:10.671299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.709528 (+ 38229us) service_pool.cc:224] Handling call
0709 13:09:10.710069 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.710399 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:10.735776 (+ 25377us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.150828 (+1415052us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b1800386f80. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:09:12.400629 (+249801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.400705 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:12.400785 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.400880 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.401062 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24607,"prepare.run_cpu_time_us":221,"prepare.run_wall_time_us":221,"raft.queue_time_us":520,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2485,"spinlock_wait_cycles":10612608,"thread_start_us":248984,"threads_started":1}
I20260709 13:09:13.043570 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:12.309887 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.042192 15380 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:13.043392 15299 rpcz_store.cc:276] 0709 13:09:10.982613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.984872 (+  2259us) service_pool.cc:224] Handling call
0709 13:09:11.024778 (+ 39906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.055795 (+ 31017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.148806 (+1093011us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b540006ccd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:12.149097 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66247552}
I20260709 13:09:13.044206 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:12.900372 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 866961us
I20260709 13:09:13.042405 15381 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:13.044937 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:12.094465 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.045603 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:12.892192 15377 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:13.046149 15381 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:13.046595 15378 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:12.980939 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:13.046931 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:13.047041 15348 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 2.158s (SENT) [suppressed 34 similar messages]
W20260709 13:09:12.408236 18236 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
I20260709 13:09:12.027026 18220 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:12.890264 18113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.057s	user 0.006s	sys 0.021s
I20260709 13:09:12.939078 17758 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.895820 18271 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.056514 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1879) took 1682 ms. Trace:
I20260709 13:09:12.251989 18079 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.122871 18215 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:12.087597 17772 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:12.132669 18032 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:12.974401 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 250) took 2321 ms. Trace:
I20260709 13:09:13.068864 15303 rpcz_store.cc:276] 0709 13:09:10.574547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.574688 (+   141us) service_pool.cc:224] Handling call
0709 13:09:10.575064 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.010723 (+1435659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.097705 (+ 86982us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:12.896245 (+798540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3201629568}
I20260709 13:09:12.981925 15376 raft_consensus.cc:2368] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:09:13.069835 15129 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 6 to 7, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 7 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.071310 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1715) took 1048 ms. Trace:
I20260709 13:09:13.071775 15376 rpcz_store.cc:276] 0709 13:09:12.023126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.032749 (+  9623us) service_pool.cc:224] Handling call
0709 13:09:13.071241 (+1038492us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:13.044632 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.282002 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 78904us
I20260709 13:09:13.047685 15379 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:13.038594 15304 rpcz_store.cc:276] 0709 13:09:10.575671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.575820 (+   149us) service_pool.cc:224] Handling call
0709 13:09:10.576158 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.867624 (+291466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.491131 (+1623507us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400250154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:12.491321 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549323136}
W20260709 13:09:13.042397 15273 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.109s (SENT)
I20260709 13:09:13.074474 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:12.440457 17991 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.051926 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.052402 15382 raft_consensus.cc:2368] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6.
I20260709 13:09:13.052860 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.075433 15303 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:12.039208 18067 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:12.252187 18031 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:12.143952 18108 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.895689 17518 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.161682 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:12.900941 18153 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.057108 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.055401 18220 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.057929 18218 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:12.280310 18251 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:13.057734 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.059096 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1881) took 1588 ms. Trace:
I20260709 13:09:12.577826 18245 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:12.969157 18091 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.113389 17772 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.102479 18220 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:13.084594 18134 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.000s	sys 0.041s
I20260709 13:09:13.066398 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.122254 15380 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:13.122366 15307 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:13.123246 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1875) took 2088 ms. Trace:
I20260709 13:09:13.123337 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.123749 15307 rpcz_store.cc:276] 0709 13:09:11.034468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.967818 (+933350us) service_pool.cc:224] Handling call
0709 13:09:11.981534 (+ 13716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.122911 (+1141377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.123175 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.124604 15380 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:13.066921 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.125716 15377 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:12.685413 18235 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:12.939652 18258 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.076089 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1883) took 1580 ms. Trace:
I20260709 13:09:13.126132 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1886) took 1586 ms. Trace:
I20260709 13:09:13.126451 15303 rpcz_store.cc:276] 0709 13:09:11.495986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.070262 (+1574276us) service_pool.cc:224] Handling call
0709 13:09:13.070602 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.075824 (+  5222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.076030 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.076092 15375 raft_consensus.cc:2410] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:13.126706 15307 rpcz_store.cc:276] 0709 13:09:11.539868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.124871 (+1585003us) service_pool.cc:224] Handling call
0709 13:09:13.125301 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.125673 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.125712 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.125772 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:13.125830 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.125902 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.126048 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.970469 18127 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:12.983331 18136 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:13.060089 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 289) took 1089 ms. Trace:
I20260709 13:09:13.079680 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.145701 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:12.983342 18174 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:12.986567 18083 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:13.090458 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.092613 15378 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:13.092840 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:12.410351 18208 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:12.983124 18268 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:12.364012 17869 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.794s
I20260709 13:09:13.056068 17758 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.097783 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:12.400389 18266 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:13.089042 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46733.1us
I20260709 13:09:13.056919 15301 rpcz_store.cc:276] 0709 13:09:11.374134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.055681 (+1681547us) service_pool.cc:224] Handling call
0709 13:09:13.055977 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.056171 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.056195 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.056242 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:13.056282 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.056359 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.056464 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.087515 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:13.055850 18216 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:13.112879 18245 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:13.039497 15229 raft_consensus.cc:2368] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7.
I20260709 13:09:13.112730 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.104315 15306 rpcz_store.cc:276] 0709 13:09:11.470599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.058041 (+1587442us) service_pool.cc:224] Handling call
0709 13:09:13.058478 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.058695 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.058731 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.058784 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:13.058829 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.058898 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.059020 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.086431 18067 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:13.086812 18108 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.102479 17518 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.088615 17991 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.129469 18251 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.130947 18252 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.080797 18032 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.134064 18256 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.135845 18261 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:13.136484 18140 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:09:13.112586 16001 raft_consensus.cc:2410] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:09:13.139671 18161 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:13.075798 18271 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.141948 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.143975 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.076056 18079 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.146646 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 256) took 1183 ms. Trace:
I20260709 13:09:13.147586 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.148023 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.149663 15379 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:13.093266 18215 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.066388 17493 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:09:13.055806 18236 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.198302 18236 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:13.200855 15374 raft_consensus.cc:2368] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6.
I20260709 13:09:13.153697 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 257) took 1189 ms. Trace:
I20260709 13:09:13.153996 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.164616 18083 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.155586 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:13.164012 15224 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.023s	sys 0.048s
I20260709 13:09:13.165975 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:13.040406 15131 rpcz_store.cc:269] 0709 13:08:48.103050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.110197 (+  7147us) service_pool.cc:224] Handling call
0709 13:09:12.745213 (+24635016us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:06.916452 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:06.988962 (+ 72510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:06.989043 (+    81us) write_op.cc:435] Acquired schema lock
0709 13:09:06.989076 (+    33us) tablet.cc:662] Decoding operations
0709 13:09:06.990156 (+  1080us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:06.990237 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:06.990282 (+    45us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:09:06.991127 (+   845us) tablet.cc:701] Row locks acquired
0709 13:09:06.991183 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:09:06.991374 (+   191us) write_op.cc:270] Start()
0709 13:09:06.991529 (+   155us) write_op.cc:276] Timestamp: P: 1783602546991297 usec, L: 0
0709 13:09:06.991554 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:07.032125 (+ 40571us) log.cc:844] Serialized 2898 byte log entry
0709 13:09:07.307911 (+275786us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b
0709 13:09:08.557981 (+1250070us) op_driver.cc:464] REPLICATION: finished
0709 13:09:09.028217 (+470236us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f5755cef0
0709 13:09:09.165766 (+137549us) write_op.cc:301] APPLY: starting
0709 13:09:09.165889 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:09.166136 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:09.166176 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:09.285566 (+119390us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:09.412450 (+126884us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:09:09.412512 (+    62us) write_op.cc:312] APPLY: finished
0709 13:09:09.412899 (+   387us) log.cc:844] Serialized 59 byte log entry
0709 13:09:09.522260 (+109361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:09.534426 (+ 12166us) write_op.cc:454] Released schema lock
0709 13:09:09.544463 (+ 10037us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:09.594471 (+ 50008us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:09.594512 (+    41us) write_op.cc:454] Released schema lock
0709 13:09:09.993901 (+399389us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2332a 00007f2f53aa8f14 00007f2f53aa8ec3 00007f2f53aa8e38 00007f2f53aa8df3 00007f2f53aa80dc 00007f2f53ad1e16 00007f2f53ab9cbb 00007f2f53aa439d 00007f2f53aa7d75
Metrics: {"mutex_wait_us":533879,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":572476,"apply.run_cpu_time_us":24753,"apply.run_wall_time_us":428683,"num_ops":7,"prepare.queue_time_us":117746,"prepare.run_cpu_time_us":22063,"prepare.run_wall_time_us":457520,"raft.queue_time_us":426345,"raft.run_cpu_time_us":37230,"raft.run_wall_time_us":1559130,"replication_time_us":1527590,"spinlock_wait_cycles":90728320,"thread_start_us":1165892,"threads_started":5,"wal-append.queue_time_us":468030,"wal-append.run_cpu_time_us":32551,"wal-append.run_wall_time_us":3228374}]]}
W20260709 13:09:13.203632 15224 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.023s	sys 0.048s
I20260709 13:09:13.168537 15382 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:13.204631 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.204842 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.205025 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.205552 15375 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:13.205986 15378 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:13.167318 15129 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 3 to 5, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 5 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.170476 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.207991 15377 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:13.171248 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 83814.7us
I20260709 13:09:13.172000 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:13.211726 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:13.172780 15301 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:13.174175 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.090624 18031 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.175962 15381 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:13.178962 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 259) took 1209 ms. Trace:
I20260709 13:09:13.214836 15306 rpcz_store.cc:276] 0709 13:09:11.964555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.172625 (+1208070us) service_pool.cc:224] Handling call
0709 13:09:13.172859 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.173153 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.173184 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.173233 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:13.173280 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.173343 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.173494 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.216267 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:13.216804 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:13.167796 16004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.052s	sys 0.097s
I20260709 13:09:13.173439 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:13.181545 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.167987 17758 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.157202 18136 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:13.186753 15974 leader_election.cc:400] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7.
I20260709 13:09:13.233920 15974 leader_election.cc:403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:13.234273 18136 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:13.234617 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48114.2us
I20260709 13:09:13.235133 18083 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.148941 16000 rpcz_store.cc:276] 0709 13:09:11.970463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.972403 (+  1940us) service_pool.cc:224] Handling call
0709 13:09:13.055173 (+1082770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.188439 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.237244 15232 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:13.189636 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.200225 18079 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.173604 18235 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.192921 15231 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:13.193711 15308 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.238829 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.194494 15303 rpcz_store.cc:276] 0709 13:09:11.963630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.145604 (+1181974us) service_pool.cc:224] Handling call
0709 13:09:13.145989 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.146213 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.146252 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.146307 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:13.146352 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.146438 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.146575 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.157438 18174 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.201525 15307 rpcz_store.cc:276] 0709 13:09:11.963930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.148441 (+1184511us) service_pool.cc:224] Handling call
0709 13:09:13.152897 (+  4456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.153367 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.153394 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.153440 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:13.153476 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.153530 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.153633 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.202397 16006 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:13.143013 18134 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.000s	sys 0.042s
W20260709 13:09:13.167284 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.205237 15382 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:13.213624 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 258) took 1249 ms. Trace:
W20260709 13:09:13.244165 15273 leader_election.cc:336] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.540s (SENT)
I20260709 13:09:13.244840 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:13.244405 15301 rpcz_store.cc:276] 0709 13:09:11.964225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.172236 (+1208011us) service_pool.cc:224] Handling call
0709 13:09:13.172573 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.213372 (+ 40799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.213572 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.244297 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:13.246068 15273 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.207s (SENT)
I20260709 13:09:13.246255 15377 raft_consensus.cc:2410] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:13.217849 15129 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 5 to 6, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 6 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.218660 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.246347 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:13.223317 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.246946 15375 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:13.247291 15374 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:13.224520 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.248107 15378 raft_consensus.cc:2410] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:13.249040 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:13.249408 17518 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.214375 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 476) took 1043 ms. Trace:
I20260709 13:09:13.249847 15378 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:13.225360 15228 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:13.177727 18216 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.226404 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.233194 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.252270 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.252694 15376 raft_consensus.cc:2368] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:09:13.253037 15375 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:13.192313 15373 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:13.253784 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1723) took 1115 ms. Trace:
I20260709 13:09:13.237427 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:13.218971 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:13.222512 16004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.052s	sys 0.097s
I20260709 13:09:13.254240 15373 rpcz_store.cc:276] 0709 13:09:12.138564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.138960 (+   396us) service_pool.cc:224] Handling call
0709 13:09:13.141769 (+1002809us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:09:13.253704 (+111935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191496576}
I20260709 13:09:13.259922 15308 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:13.260874 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.217465 17772 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.250000 16001 rpcz_store.cc:276] 0709 13:09:12.161153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.161327 (+   174us) service_pool.cc:224] Handling call
0709 13:09:13.204646 (+1043319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.250514 18156 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.269143 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.279577 15374 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:13.280715 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.280270 15129 catalog_manager.cc:5697] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 3 to 6, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:13.281431 15382 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:13.203944 18215 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.286964 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:13.262331 18083 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.268492 18252 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:13.298691 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.217882 18127 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:09:13.222456 18236 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:09:13.294171 15376 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:13.293156 15375 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:13.297928 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.302826 15375 pending_rounds.cc:85] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 2
I20260709 13:09:13.298207 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:13.278384 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:13.206387 18245 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.303061 15382 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:13.303107 15375 pending_rounds.cc:107] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:13.325410 15375 raft_consensus.cc:2889] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.325769 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.244639 18067 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.261404 18220 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.328279 18067 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:13.328622 18274 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:09:13.342345 18215 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.337312 15129 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 4 to 5, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 5 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.339339 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:13.358914 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.363353 16007 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:13.364231 16007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 477) took 1162 ms. Trace:
I20260709 13:09:13.364774 16007 rpcz_store.cc:276] 0709 13:09:12.201712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.202014 (+   302us) service_pool.cc:224] Handling call
0709 13:09:13.364150 (+1162136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.368708 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:13.368607 15347 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.005s	user 0.027s	sys 0.049s
I20260709 13:09:13.372983 15129 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 4 to 5, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 5 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.327369 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 475) took 1166 ms. Trace:
W20260709 13:09:13.393265 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 346243us
I20260709 13:09:13.392700 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.395335 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:13.396273 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.343355 18208 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.401157 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.402472 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.362993 18245 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.402530 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:13.410679 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:13.413759 15382 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:13.416883 18215 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.381700 18261 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.381397 18157 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.426187 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.381058 18256 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:13.429991 15129 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 1 to 5, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 5 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.400748 17869 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.404245 18266 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.432246 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.391602 18091 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:13.368886 18233 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7.
I20260709 13:09:13.435694 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.411614 18271 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.434271 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.438320 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.417855 18268 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:13.420722 18083 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.439191 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.433542 18134 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:13.429607 18251 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.413205 18282 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.443524 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 398276us
I20260709 13:09:13.450943 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:13.455657 15300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.023s	sys 0.016s
W20260709 13:09:13.456208 15300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.024s	sys 0.016s
I20260709 13:09:13.417476 18215 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.460011 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.434082 18208 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:09:13.436863 17869 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.432713 18256 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.431938 18157 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.439162 18261 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.442644 18091 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:13.469852 15226 raft_consensus.cc:1217] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Deduplicated request from leader. Original: 3.2->[5.3-5.3]   Dedup: 5.3->[]
W20260709 13:09:13.484532 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 236790us
I20260709 13:09:13.797094 15226 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:13.799310 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:13.592514 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 328807us
W20260709 13:09:13.785594 18287 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.312s	user 0.016s	sys 0.022s
W20260709 13:09:13.725303 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 310388us
I20260709 13:09:13.803937 15226 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:13.723587 18216 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.791875 15382 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:13.753011 18220 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.726184 15129 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 2 to 3, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.792985 18091 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.579756 16006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 478) took 1185 ms. Trace:
I20260709 13:09:13.448295 18083 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:13.783457 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.655382 15308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1867) took 2568 ms (client timeout 2155 ms). Trace:
W20260709 13:09:13.828689 15308 rpcz_store.cc:269] 0709 13:09:11.010242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.010458 (+   216us) service_pool.cc:224] Handling call
0709 13:09:13.578525 (+2568067us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b540033c054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:13.578691 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5017264384}
I20260709 13:09:13.384531 16004 rpcz_store.cc:276] 0709 13:09:12.159602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.159781 (+   179us) service_pool.cc:224] Handling call
0709 13:09:12.160351 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.363777 (+203426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.393781 (+ 30004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.418990 (+ 25209us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.284109 (+865119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:13.288879 (+  4770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.295351 (+  6472us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.300238 (+  4887us) raft_consensus.cc:1685] finished
0709 13:09:13.300256 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.325503 (+ 25247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37098,"raft.queue_time_us":91034,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":117420,"thread_start_us":843039,"threads_started":1,"wal-append.queue_time_us":855318}
I20260709 13:09:13.794654 18261 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:13.585592 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.458395 18032 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.559252 18218 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:13.624284 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.840605 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.797391 15273 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.362s (SENT)
I20260709 13:09:13.551405 15232 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:13.799714 18256 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:13.719575 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 349) took 1539 ms. Trace:
I20260709 13:09:13.573530 17772 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:13.800954 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.478498 18174 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.801640 15373 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:13.802294 15231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 354) took 1427 ms (client timeout 1866 ms). Trace:
W20260709 13:09:13.845322 15231 rpcz_store.cc:269] 0709 13:09:12.375024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.375206 (+   182us) service_pool.cc:224] Handling call
0709 13:09:13.802092 (+1426886us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400312754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:13.802227 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348736256}
I20260709 13:09:13.846884 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:13.527740 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76871.1us
W20260709 13:09:13.598649 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.527235 18274 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:13.821106 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:13.825639 16006 rpcz_store.cc:276] 0709 13:09:12.394472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.394681 (+   209us) service_pool.cc:224] Handling call
0709 13:09:12.891346 (+496665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.241409 (+350063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.579460 (+338051us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540064f5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:13.579678 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714912128}
I20260709 13:09:13.823640 15129 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:13.854720 15226 raft_consensus.cc:2410] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:09:13.834064 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.856840 15231 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:13.857448 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60079.4us
I20260709 13:09:13.862061 15229 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:13.864113 15229 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:13.866391 15129 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 2 to 3, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 3 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.867400 15231 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:13.468549 18282 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.820822 18113 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:09:13.822333 18134 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:09:13.842067 15224 rpcz_store.cc:276] 0709 13:09:12.179885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.180054 (+   169us) service_pool.cc:224] Handling call
0709 13:09:12.197688 (+ 17634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.197940 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:13.204012 (+1006072us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.719093 (+515081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.719167 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:13.719241 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.719336 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.719499 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7480,"prepare.queue_time_us":1020934,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":19943,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":2014,"thread_start_us":1514729,"threads_started":3,"wal-append.queue_time_us":212429}
I20260709 13:09:13.840018 18218 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:13.898733 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.877067 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 90306.6us
I20260709 13:09:13.877708 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:13.826129 17518 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:13.921401 18286 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.868209 18174 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:13.954713 18174 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.957368 18174 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.959448 18282 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.937727 18271 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:09:13.962244 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.963286 15376 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:13.965054 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.966493 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.966719 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.967980 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.969156 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1877) took 2715 ms. Trace:
I20260709 13:09:13.918874 15229 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:13.921041 15231 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:13.972219 15300 rpcz_store.cc:276] 0709 13:09:11.253880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.133201 (+879321us) service_pool.cc:224] Handling call
0709 13:09:12.133693 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.146802 (+ 13109us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:12.399710 (+252908us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.479624 (+1079914us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.725545 (+245921us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.725738 (+   193us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:13.725785 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.725873 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.968915 (+243042us) raft_consensus.cc:1685] finished
0709 13:09:13.968939 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.969092 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22643,"prepare.queue_time_us":1032963,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":35181,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":74048,"thread_start_us":1193314,"threads_started":2,"wal-append.queue_time_us":1379621}
I20260709 13:09:13.974007 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:13.972182 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 137467us
I20260709 13:09:13.935880 15232 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 5: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:13.947300 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 345) took 3288 ms. Trace:
I20260709 13:09:13.878041 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:13.950426 17869 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.854703 17772 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:13.928951 18220 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:13.940301 15224 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:13.975063 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:13.957377 18083 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:13.976071 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:13.977135 18297 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:09:13.915555 18218 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.977151 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:13.980772 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 102794us
W20260709 13:09:13.923358 17758 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.002s
I20260709 13:09:13.983301 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:13.984485 15231 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:09:13.985962 15273 leader_election.cc:336] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.640s (SENT)
I20260709 13:09:13.993659 17518 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.950521 18157 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:13.884538 18293 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:09:13.975410 15227 rpcz_store.cc:276] 0709 13:09:10.658930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.660574 (+  1644us) service_pool.cc:224] Handling call
0709 13:09:10.697187 (+ 36613us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:10.743210 (+ 46023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.743249 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:10.759088 (+ 15839us) log.cc:844] Serialized 52 byte log entry
0709 13:09:12.135668 (+1376580us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b1800439720. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:09:12.411043 (+275375us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:12.905994 (+494951us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.977468 (+ 71474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.977576 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.929895 (+952319us) raft_consensus.cc:1685] finished
0709 13:09:13.947033 (+ 17138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.947232 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61079,"prepare.queue_time_us":833291,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":12110,"raft.queue_time_us":38224,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":67910,"spinlock_wait_cycles":4867328,"thread_start_us":769470,"threads_started":2,"wal-append.queue_time_us":2426692}
I20260709 13:09:14.002022 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1878) took 2641 ms. Trace:
W20260709 13:09:13.983881 18067 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.008s
I20260709 13:09:14.010196 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:13.989602 18307 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:14.017292 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:14.015424 15273 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.679s (SENT)
I20260709 13:09:14.014319 15302 rpcz_store.cc:276] 0709 13:09:11.360579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.056505 (+1695926us) service_pool.cc:224] Handling call
0709 13:09:13.079777 (+ 23272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.581517 (+501740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.581558 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.582125 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.945341 (+363216us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:13.945385 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.945454 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.001560 (+ 56106us) raft_consensus.cc:1685] finished
0709 13:09:14.001701 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.001898 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9262,"raft.queue_time_us":33431,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":846114,"threads_started":2,"wal-append.queue_time_us":386763}
I20260709 13:09:14.019690 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:14.021503 18174 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:14.022756 15273 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.759s (SENT)
W20260709 13:09:14.023602 15273 leader_election.cc:336] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.090s (SENT)
I20260709 13:09:14.024017 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:14.013511 18153 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.003s
I20260709 13:09:14.024904 18282 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:14.025808 15305 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:14.012461 17758 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.027101 18153 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.027966 15377 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:14.028409 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 260) took 1907 ms. Trace:
I20260709 13:09:14.028448 17758 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:14.028829 15303 rpcz_store.cc:276] 0709 13:09:12.120721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.240668 (+1119947us) service_pool.cc:224] Handling call
0709 13:09:13.240937 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.288672 (+ 47735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.288705 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.288743 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:13.288773 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.028146 (+739373us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b54002300d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:14.028187 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.028312 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109357440}
I20260709 13:09:14.030297 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.026404 18206 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.031739 15273 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.433s (SENT)
I20260709 13:09:14.025233 18264 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:14.033854 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:14.034284 15273 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.513s (SENT)
I20260709 13:09:14.034716 15229 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.034973 15379 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:14.035665 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.024070 17991 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:14.036686 15273 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.631s (SENT)
I20260709 13:09:14.019110 18236 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:14.038506 15273 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.924s (SENT)
I20260709 13:09:14.000988 18220 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.046981 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.017392 18083 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:14.055500 18174 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.065016 17991 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.066459 18295 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:13.979933 18286 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.068090 18295 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:14.069164 18286 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.059249 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.069993 15377 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:14.070942 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.071571 15377 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
W20260709 13:09:14.059240 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46015.7us
I20260709 13:09:14.073639 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.074429 15379 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:14.075435 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:14.060672 15381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1735) took 1569 ms (client timeout 1993 ms). Trace:
I20260709 13:09:14.070780 18312 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:14.080361 15381 rpcz_store.cc:269] 0709 13:09:12.491675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.046736 (+555061us) service_pool.cc:224] Handling call
0709 13:09:14.060462 (+1013726us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001b99d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:14.060590 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295370112}
I20260709 13:09:14.080931 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.081316 18312 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.081609 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.081753 16005 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:14.081888 18312 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.082355 15381 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:14.083016 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.084295 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.084813 18031 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:14.066537 17991 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.086676 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:14.088271 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.089303 15377 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:14.032573 18307 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:14.044759 18236 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:14.034497 18264 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:14.101362 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.135452 15303 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:14.097415 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.136293 15374 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:14.137365 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.036211 18227 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:14.040915 18153 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.019069 18271 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:09:14.056671 15273 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.001s (SENT)
I20260709 13:09:14.036063 18206 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.113408 18305 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:14.099654 15381 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:09:14.152226 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91806.3us
I20260709 13:09:14.116158 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.154407 15379 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:09:14.121536 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 350) took 1914 ms. Trace:
I20260709 13:09:14.121941 18312 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.123279 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1885) took 2590 ms. Trace:
I20260709 13:09:14.125172 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:14.125504 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.164772 15375 raft_consensus.cc:2368] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7.
I20260709 13:09:14.129583 18256 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:14.130620 18220 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.168536 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.130805 18307 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.155341 15230 rpcz_store.cc:276] 0709 13:09:12.206744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.207108 (+   364us) service_pool.cc:224] Handling call
0709 13:09:12.207590 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:13.187231 (+979641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.187267 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:13.195764 (+  8497us) log.cc:844] Serialized 52 byte log entry
0709 13:09:13.443236 (+247472us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:13.457693 (+ 14457us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.470360 (+ 12667us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.551519 (+ 81159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.114444 (+562925us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54002d0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:14.114518 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.121154 (+  6636us) raft_consensus.cc:1685] finished
0709 13:09:14.121193 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.121427 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92545,"prepare.queue_time_us":115044,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"raft.queue_time_us":150727,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5264,"spinlock_wait_cycles":2319127424,"thread_start_us":206001,"threads_started":1,"wal-append.queue_time_us":255789}
I20260709 13:09:14.138075 15374 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:14.142892 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:14.173879 15377 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.159224 18174 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:14.161319 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.164042 15228 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.163727 15304 rpcz_store.cc:276] 0709 13:09:11.532784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.074516 (+1541732us) service_pool.cc:224] Handling call
0709 13:09:13.090882 (+ 16366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.443081 (+352199us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:13.794971 (+351890us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.879710 (+ 84739us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.880274 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.917763 (+ 37489us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:13.917799 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.917865 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.122982 (+205117us) raft_consensus.cc:1685] finished
0709 13:09:14.123014 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.123207 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9000,"prepare.queue_time_us":342586,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":25882,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":39213,"thread_start_us":432341,"threads_started":2,"wal-append.queue_time_us":223740}
I20260709 13:09:14.153106 18083 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.158283 17991 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.174182 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.196709 15374 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:09:14.176903 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.139546 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:14.199194 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 142561us
W20260709 13:09:14.199900 15273 leader_election.cc:336] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.216s (SENT)
I20260709 13:09:14.178126 15381 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:14.201370 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.198061 15379 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:14.200284 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.183918 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.175140 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:14.204584 15199 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:14.205614 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51140.5us
I20260709 13:09:14.211776 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:14.213235 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:14.213972 15381 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.217356 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.210345 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:14.224000 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.225328 15228 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:14.227660 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:14.219234 15374 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:14.229198 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.230039 15374 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:14.232522 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.162587 17758 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:09:14.233390 15375 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:14.209475 18174 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.209163 18256 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.239287 18256 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:14.239882 18256 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:14.239976 18227 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:14.240923 18256 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.242033 18315 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:14.242673 18315 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:14.244613 18317 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:14.244855 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.241065 18227 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.164822 18067 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:14.236980 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.243676 18315 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.236829 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.168094 18140 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:09:14.176159 18258 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:09:14.241658 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:14.284937 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.273147 15375 raft_consensus.cc:2410] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:14.176648 18157 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:09:14.251370 15273 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.014s (SENT)
I20260709 13:09:14.287012 15374 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:14.292812 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:14.293311 15273 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.537s (SENT)
W20260709 13:09:14.281589 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.294145 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66630.5us
W20260709 13:09:14.294391 15273 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.184s (SENT)
W20260709 13:09:14.294699 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.289717 15381 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:14.176456 15227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:14.234359 17772 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.294958 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.247602 18083 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.291282 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:14.160097 18305 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.297428 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.293442 15374 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:09:14.283154 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71504.9us
I20260709 13:09:14.253261 18091 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:14.280663 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:14.305061 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.306558 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:14.304308 15273 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.297s (SENT)
I20260709 13:09:14.308389 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.299471 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:14.308502 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.299024 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.310199 15374 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:14.312592 15375 raft_consensus.cc:2410] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:14.313849 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.310976 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.317322 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.318248 15999 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:14.304497 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.311650 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.321214 15374 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:14.292586 18306 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:14.322394 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.298046 18174 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.301604 17493 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:14.340276 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.327261 15375 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:09:14.322536 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.342087 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.342931 15375 raft_consensus.cc:2368] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 4. Current term is 5.
I20260709 13:09:14.215814 18236 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:14.332921 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.322911 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.341789 16008 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:14.345135 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:14.345709 15999 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.346972 15377 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:14.307219 18091 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:14.349048 15379 raft_consensus.cc:2410] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:14.344719 15381 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:14.321054 17772 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:14.355646 15375 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:09:14.358804 15375 pending_rounds.cc:85] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 2
I20260709 13:09:14.365617 15375 pending_rounds.cc:107] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:09:14.365881 15375 raft_consensus.cc:2889] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:14.356626 15377 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:14.367513 15377 pending_rounds.cc:85] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 2
I20260709 13:09:14.368419 15377 pending_rounds.cc:107] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:14.368673 15377 raft_consensus.cc:2889] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:14.369060 15377 pending_rounds.cc:107] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:14.369340 15377 raft_consensus.cc:2889] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:14.216061 18264 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.338953 17493 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.344683 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.346284 17991 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.347419 18306 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:14.408601 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.361469 18271 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:14.412046 18067 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:14.361817 18079 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:14.458544 18067 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:14.412278 17493 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.469123 18157 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:14.455771 18264 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.388495 18321 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:14.470412 18271 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.471087 18215 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.491995 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1882) took 3015 ms. Trace:
I20260709 13:09:14.492568 15299 rpcz_store.cc:276] 0709 13:09:11.477102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.055136 (+1578034us) service_pool.cc:224] Handling call
0709 13:09:13.079439 (+ 24303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.283502 (+204063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.283531 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.283576 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:13.283617 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.491692 (+1208075us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540017a054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:14.491749 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.491928 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468811520}
I20260709 13:09:14.493547 18305 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:14.487627 15305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1887) took 2796 ms (client timeout 1853 ms). Trace:
I20260709 13:09:14.496480 18157 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:14.496889 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1765) took 1112 ms. Trace:
I20260709 13:09:14.492024 15999 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:14.498301 18108 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:14.474659 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 353) took 2189 ms. Trace:
I20260709 13:09:14.475553 17983 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:14.499577 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.499852 17983 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:14.496551 15305 rpcz_store.cc:269] 0709 13:09:11.691429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.845587 (+154158us) service_pool.cc:224] Handling call
0709 13:09:14.487362 (+2641775us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54001856d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:14.487532 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4976423168}
I20260709 13:09:14.500804 17983 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.501783 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1871) took 1085 ms. Trace:
I20260709 13:09:14.502313 15375 rpcz_store.cc:276] 0709 13:09:13.416114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.352474 (+936360us) service_pool.cc:224] Handling call
0709 13:09:14.355113 (+  2639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.388065 (+ 32952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.501556 (+113491us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b54001fe350. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:14.501717 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5261056}
I20260709 13:09:14.504686 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.504819 18261 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:14.505318 18261 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:14.505795 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.506346 18261 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.506850 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.507404 18261 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.507834 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.508654 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.509652 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.510633 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:14.511132 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.489473 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:14.348363 18174 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.397435 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.512068 16007 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:14.472765 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1913) took 1359 ms. Trace:
I20260709 13:09:14.499019 15233 rpcz_store.cc:276] 0709 13:09:12.285382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.285625 (+   243us) service_pool.cc:224] Handling call
0709 13:09:12.415757 (+130132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.232731 (+816974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.232778 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.232836 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:13.232889 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.474383 (+1241494us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540043d354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:14.474440 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.474595 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878223744}
I20260709 13:09:14.497306 15373 rpcz_store.cc:276] 0709 13:09:13.384633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.395047 (+ 10414us) service_pool.cc:224] Handling call
0709 13:09:14.496689 (+1101642us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400003054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:14.496830 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932304256}
I20260709 13:09:14.517599 15229 rpcz_store.cc:276] 0709 13:09:13.113524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.982616 (+869092us) service_pool.cc:224] Handling call
0709 13:09:13.983173 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.035413 (+ 52240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.472455 (+437042us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54000104d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:14.472687 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113847680}
I20260709 13:09:14.518965 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:14.490401 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.522163 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:14.514626 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.497751 18157 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.529225 15379 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:14.490893 18322 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:09:14.516813 15231 raft_consensus.cc:2410] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:14.501809 17983 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.515450 18091 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.564764 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:14.579219 15301 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.571669 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:14.584559 15304 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:14.585078 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1901) took 1531 ms. Trace:
I20260709 13:09:14.572081 15305 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:14.572137 18215 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:14.586249 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.573128 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:14.586930 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.586998 15306 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:14.515865 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.633170 15304 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:09:14.585475 15226 rpcz_store.cc:276] 0709 13:09:13.053852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.866362 (+812510us) service_pool.cc:224] Handling call
0709 13:09:13.866637 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.866851 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:13.885063 (+ 18212us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.194353 (+309290us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b18003935e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:09:14.584223 (+389870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.584296 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:14.584404 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.584489 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.584679 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4047,"prepare.queue_time_us":47793,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":120,"spinlock_wait_cycles":82786560,"thread_start_us":389288,"threads_started":1}
W20260709 13:09:14.641081 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.456051 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.492245 18079 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.605726 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:14.657621 15307 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.588183 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:14.626345 15301 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:14.659708 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 71613us
I20260709 13:09:14.605608 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:14.632412 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1872) took 1215 ms. Trace:
I20260709 13:09:14.588657 15381 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:14.660689 15382 rpcz_store.cc:276] 0709 13:09:13.416576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.418037 (+  1461us) service_pool.cc:224] Handling call
0709 13:09:14.632017 (+1213980us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400224054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:14.632182 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806184832}
I20260709 13:09:14.660137 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:14.663636 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.654798 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:14.664247 15381 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:14.655407 18252 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:14.665743 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:14.590776 18218 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:09:14.613368 16000 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:09:14.564489 18245 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.143s	user 0.015s	sys 0.001s
I20260709 13:09:14.683172 15381 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:14.668738 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:14.684067 15304 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:14.679252 15231 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:14.614457 18157 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.702656 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:14.703461 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.706529 15380 raft_consensus.cc:2410] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:14.703598 15305 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:14.667603 18091 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.667130 18256 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.614006 17758 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:09:14.667582 18174 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.631949 18215 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:14.746302 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.738912 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:14.756101 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:14.757668 16003 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:14.759686 15300 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:14.772432 17758 consensus_queue.cc:1243] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:14.691525 18252 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.681699 17493 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:14.695282 18218 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.787813 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.574075 18306 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.816913 15300 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:14.773969 18215 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.821260 15224 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:14.700860 18067 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:14.840515 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:14.846777 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.850907 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.854936 18218 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:14.814214 17772 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.862327 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.864316 15376 raft_consensus.cc:2410] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:14.874701 15307 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:15.041121 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.092829 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:14.844820 18083 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.015298 17772 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:15.101802 15230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.021s	sys 0.061s
W20260709 13:09:15.195003 15230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.021s	sys 0.062s
W20260709 13:09:15.106609 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.115612 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.112833 15378 raft_consensus.cc:2410] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:09:15.181717 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.182101 15307 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:09:14.844796 17991 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:15.269380 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.314067 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.378163 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.115302 18067 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:15.194463 18140 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.268054 18174 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:15.266919 18083 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:15.402077 17991 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:15.443333 18140 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:15.485167 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.469005 18256 consensus_meta.cc:287] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.004s
W20260709 13:09:15.498747 15303 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.002s	sys 0.005s
W20260709 13:09:15.499270 15300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.025s	sys 0.014s
W20260709 13:09:15.499873 15304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.026s	sys 0.071s
W20260709 13:09:15.518522 15300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.026s	sys 0.014s
I20260709 13:09:15.447973 18174 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:15.535187 15308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.001s	sys 0.026s
W20260709 13:09:15.535715 15308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.001s	sys 0.026s
W20260709 13:09:15.536959 15973 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.014s	sys 0.032s
W20260709 13:09:15.538031 15973 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.014s	sys 0.033s
W20260709 13:09:15.538179 15302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.014s	sys 0.018s
W20260709 13:09:15.538720 15302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.014s	sys 0.018s
W20260709 13:09:15.538529 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 697890us
I20260709 13:09:15.501972 18256 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:15.540818 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.543999 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 444) took 1746 ms. Trace:
W20260709 13:09:15.544032 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.544423 15373 rpcz_store.cc:276] 0709 13:09:13.797645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.543085 (+1745440us) service_pool.cc:224] Handling call
0709 13:09:15.543460 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.543649 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.543678 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.543742 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:15.543790 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.543847 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.543953 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.545504 18328 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.532096 18331 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.773s	user 0.003s	sys 0.000s
I20260709 13:09:15.550406 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 358) took 1264 ms. Trace:
I20260709 13:09:15.562913 15224 rpcz_store.cc:276] 0709 13:09:14.285526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.288047 (+  2521us) service_pool.cc:224] Handling call
0709 13:09:15.550241 (+1262194us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400312754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:15.550356 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151688064}
I20260709 13:09:15.554301 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 442) took 1757 ms. Trace:
I20260709 13:09:15.564626 15374 rpcz_store.cc:276] 0709 13:09:13.797012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.553282 (+1756270us) service_pool.cc:224] Handling call
0709 13:09:15.553669 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.553882 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.553917 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.553984 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:15.554041 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.554109 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.554234 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.529407 17772 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:15.589344 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:15.592612 15374 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:15.594125 18339 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.726s	user 0.001s	sys 0.001s
I20260709 13:09:15.594869 18252 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:15.595609 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:15.595772 18252 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.596971 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:15.597318 17983 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.004s	user 0.010s	sys 0.003s
I20260709 13:09:15.597625 15305 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.596524 18252 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:15.599251 18079 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:15.586244 18335 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.744s	user 0.000s	sys 0.002s
I20260709 13:09:15.555720 17493 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:15.647747 18140 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:15.649179 18140 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:15.649946 18140 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:15.663344 18320 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.313s	user 0.006s	sys 0.016s
W20260709 13:09:15.620417 18334 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:09:15.602838 17772 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:15.567126 18328 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:15.672827 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 397996us
W20260709 13:09:15.702592 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.684608 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:15.721441 15374 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:15.676146 18338 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
I20260709 13:09:15.689729 18083 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:15.705295 17772 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:15.837229 18324 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:15.837920 18324 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:15.839064 18324 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:16.080011 15273 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.005s	sys 0.029s
W20260709 13:09:16.039026 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.005s	sys 0.021s
W20260709 13:09:16.186857 15382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.000s	sys 0.010s
W20260709 13:09:16.230722 15378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.006s	sys 0.006s
I20260709 13:09:16.231377 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1907) took 1595 ms. Trace:
W20260709 13:09:16.232491 15301 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.347s	user 0.016s	sys 0.032s
W20260709 13:09:16.323027 15301 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.479s	user 0.017s	sys 0.033s
W20260709 13:09:16.234341 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.009s	sys 0.017s
W20260709 13:09:16.192369 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.325474 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.009s	sys 0.017s
W20260709 13:09:16.213909 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.914772 18328 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:15.983424 18293 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.245477 18140 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:16.130378 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.050004 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.901477 18348 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:09:15.860752 18157 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.152s	user 0.013s	sys 0.000s
W20260709 13:09:15.901625 18349 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:09:16.332903 18293 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:16.340235 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1906) took 1726 ms. Trace:
I20260709 13:09:16.340768 15304 rpcz_store.cc:276] 0709 13:09:14.614117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.685011 (+ 70894us) service_pool.cc:224] Handling call
0709 13:09:14.715193 (+ 30182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.715638 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.715684 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.726343 (+ 10659us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.517408 (+791065us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:15.517469 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.517573 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.339612 (+822039us) raft_consensus.cc:1685] finished
0709 13:09:16.339657 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.339988 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38240,"raft.queue_time_us":115,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":135,"thread_start_us":790600,"threads_started":1,"wal-append.queue_time_us":980950}
W20260709 13:09:15.861513 18347 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.089s	user 0.000s	sys 0.003s
W20260709 13:09:16.253041 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 547625us
I20260709 13:09:16.035686 15227 raft_consensus.cc:606] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:16.257341 15303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.004s	sys 0.013s
W20260709 13:09:16.258451 18091 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.530s	user 0.018s	sys 0.005s
I20260709 13:09:16.244063 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1901) took 1756 ms. Trace:
I20260709 13:09:15.865095 18206 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:15.907711 18261 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.400s	user 0.019s	sys 0.000s
W20260709 13:09:16.260818 15376 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.008s	sys 0.008s
I20260709 13:09:16.263502 18324 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:16.263384 15974 leader_election.cc:336] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.866s (SENT)
I20260709 13:09:15.937772 18252 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:16.354796 18252 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.355756 18252 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:16.357784 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.358330 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.358644 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.359239 18252 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:15.937048 18346 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:09:16.265350 17772 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:15.900612 18174 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:16.297312 18258 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:16.360497 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 97401.6us
I20260709 13:09:16.360690 18258 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:16.362717 18258 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:15.839986 17991 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:16.305689 18271 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:16.312194 15306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.408s	user 0.001s	sys 0.013s
W20260709 13:09:16.366182 15306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.002s	sys 0.013s
W20260709 13:09:16.309785 15307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.002s	sys 0.009s
W20260709 13:09:16.318602 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.008s	sys 0.029s
W20260709 13:09:16.318740 15378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.007s	sys 0.006s
W20260709 13:09:16.320214 15382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.000s	sys 0.011s
W20260709 13:09:16.319558 15273 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.015s	sys 0.030s
I20260709 13:09:16.322695 15302 rpcz_store.cc:276] 0709 13:09:14.636140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.759626 (+123486us) service_pool.cc:224] Handling call
0709 13:09:14.760514 (+   888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.814621 (+ 54107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.814663 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.844571 (+ 29908us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.539405 (+694834us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:15.539473 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.539566 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.199262 (+659696us) raft_consensus.cc:1685] finished
0709 13:09:16.211423 (+ 12161us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.231023 (+ 19600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43928,"raft.queue_time_us":54391,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":24781,"thread_start_us":682577,"threads_started":1,"wal-append.queue_time_us":996265}
W20260709 13:09:16.321197 15308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.006s	sys 0.006s
W20260709 13:09:16.367632 15308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.007s	sys 0.007s
I20260709 13:09:16.369490 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1895) took 1832 ms. Trace:
I20260709 13:09:16.305944 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:16.340538 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1911) took 1828 ms. Trace:
I20260709 13:09:16.351954 15228 rpcz_store.cc:276] 0709 13:09:14.487730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.488497 (+   767us) service_pool.cc:224] Handling call
0709 13:09:14.488938 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.695748 (+206810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.695789 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.695834 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:14.695880 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.243144 (+1547264us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540043b554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:16.243242 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.243682 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474921728}
W20260709 13:09:16.373688 15376 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.008s	sys 0.009s
I20260709 13:09:16.371074 15230 rpcz_store.cc:276] 0709 13:09:14.512403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.520010 (+  7607us) service_pool.cc:224] Handling call
0709 13:09:14.520323 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:14.520710 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.520738 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.521319 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 13:09:15.275120 (+753801us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:15.275174 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.275257 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.339839 (+1064582us) raft_consensus.cc:1685] finished
0709 13:09:16.339900 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.340272 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":69,"thread_start_us":673759,"threads_started":1,"wal-append.queue_time_us":1186122}
I20260709 13:09:16.375800 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1888) took 2205 ms. Trace:
W20260709 13:09:16.370839 15303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.005s	sys 0.013s
W20260709 13:09:16.379626 15307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.003s	sys 0.010s
I20260709 13:09:16.381760 18157 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:16.385080 18271 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.392557 18206 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:16.341884 18293 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:16.393875 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:16.396840 18271 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.398195 17772 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:16.397660 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1901) took 1830 ms. Trace:
I20260709 13:09:16.332906 18140 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:16.393126 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 293) took 2096 ms. Trace:
I20260709 13:09:16.403820 18206 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.404735 16000 rpcz_store.cc:276] 0709 13:09:14.296803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.301796 (+  4993us) service_pool.cc:224] Handling call
0709 13:09:16.373341 (+2071545us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b540064f5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:16.392808 (+ 19467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194607488}
I20260709 13:09:16.376443 15378 rpcz_store.cc:276] 0709 13:09:14.169908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.519766 (+1349858us) service_pool.cc:224] Handling call
0709 13:09:15.520145 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.530466 (+ 10321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.530515 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:15.538034 (+  7519us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.375051 (+837017us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.375181 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.375305 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.375395 (+    90us) raft_consensus.cc:1685] finished
0709 13:09:16.375409 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.375661 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":13157,"thread_start_us":761455,"threads_started":1,"wal-append.queue_time_us":707554}
I20260709 13:09:16.399267 17772 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:16.423887 18206 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:16.422070 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 1.15336e+06us
I20260709 13:09:16.424219 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1913) took 1709 ms. Trace:
I20260709 13:09:16.432648 15307 rpcz_store.cc:276] 0709 13:09:14.714744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.393432 (+678688us) service_pool.cc:224] Handling call
0709 13:09:15.415431 (+ 21999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.415746 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:15.445748 (+ 30002us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.423327 (+977579us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.423479 (+   152us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:16.423815 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.423932 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.424131 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11996,"prepare.queue_time_us":331621,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":14215,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":194,"thread_start_us":941529,"threads_started":1,"wal-append.queue_time_us":807126}
W20260709 13:09:16.439050 15380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1754) took 3321 ms (client timeout 1994 ms). Trace:
I20260709 13:09:16.421370 18258 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.370173 15308 rpcz_store.cc:276] 0709 13:09:14.537097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.538339 (+  1242us) service_pool.cc:224] Handling call
0709 13:09:14.587558 (+ 49219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.587813 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:14.967249 (+379436us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.368452 (+1401203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.368655 (+   203us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:16.368810 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.368980 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.369368 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":264825,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":112417,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":1749143,"threads_started":3,"wal-append.queue_time_us":885242}
I20260709 13:09:16.390275 18157 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:16.439765 15380 rpcz_store.cc:269] 0709 13:09:13.117552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.147553 (+ 30001us) service_pool.cc:224] Handling call
0709 13:09:16.438345 (+3290792us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003c3a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:16.438749 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3474605952}
I20260709 13:09:16.453027 15304 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:16.461387 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:16.464146 18326 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:16.464457 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1910) took 1783 ms. Trace:
I20260709 13:09:16.465144 18326 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:16.465354 15300 rpcz_store.cc:276] 0709 13:09:14.680961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.817875 (+136914us) service_pool.cc:224] Handling call
0709 13:09:14.818204 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.519863 (+701659us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:15.519890 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:15.530916 (+ 11026us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.308261 (+777345us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:16.316927 (+  8666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.335476 (+ 18549us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.463990 (+128514us) raft_consensus.cc:1685] finished
0709 13:09:16.464010 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.464257 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30329,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":87991,"thread_start_us":863376,"threads_started":2,"wal-append.queue_time_us":716370}
I20260709 13:09:16.469086 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:16.470899 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:16.472636 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.473248 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1889) took 1949 ms. Trace:
I20260709 13:09:16.473783 15299 rpcz_store.cc:276] 0709 13:09:14.523424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.525296 (+  1872us) service_pool.cc:224] Handling call
0709 13:09:14.649212 (+123916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.649770 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.649815 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.662822 (+ 13007us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.843805 (+180983us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:15.192810 (+349005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.192964 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.472683 (+1279719us) raft_consensus.cc:1685] finished
0709 13:09:16.472750 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.473014 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12193,"raft.queue_time_us":1505,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":14521,"thread_start_us":97027,"threads_started":1,"wal-append.queue_time_us":1055845}
I20260709 13:09:16.476156 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:16.462713 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1892) took 1934 ms. Trace:
W20260709 13:09:16.494350 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68863.4us
I20260709 13:09:16.467543 18326 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.504006 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:16.452632 18140 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:16.517207 15380 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:16.518923 15973 leader_election.cc:400] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7.
I20260709 13:09:16.519372 15973 leader_election.cc:403] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.520541 18312 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.521605 18312 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.518942 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:16.525502 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:16.526084 15380 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
W20260709 13:09:16.527983 15273 connection.cc:256] RPC call timeout handler was delayed by -1.1604798380000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260709 13:09:16.528127 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:16.528616 16007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 484) took 2224 ms (client timeout 1954 ms). Trace:
I20260709 13:09:16.529330 18206 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.526434 15378 raft_consensus.cc:2410] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:16.533242 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:16.534132 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:16.533203 18206 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:16.532580 16007 rpcz_store.cc:269] 0709 13:09:14.286355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.287128 (+   773us) service_pool.cc:224] Handling call
0709 13:09:16.486943 (+2199815us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54005b2cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:16.510416 (+ 23473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454299904}
W20260709 13:09:16.529479 15273 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.286s (SENT)
W20260709 13:09:16.537977 18368 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:09:16.535584 15378 raft_consensus.cc:2410] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:16.514752 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1914) took 1789 ms. Trace:
W20260709 13:09:16.531716 18361 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.191s	user 0.001s	sys 0.002s
W20260709 13:09:16.531965 18356 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.177s	user 0.000s	sys 0.003s
I20260709 13:09:16.532423 18283 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.529592 15299 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:16.537930 15380 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:16.518316 15379 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:16.540123 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:16.529994 15305 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.827s	user 0.005s	sys 0.015s
I20260709 13:09:16.534297 16000 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.549010 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1878) took 2467 ms. Trace:
I20260709 13:09:16.547792 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1918) took 1067 ms. Trace:
I20260709 13:09:16.554136 15299 rpcz_store.cc:276] 0709 13:09:15.480472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.476013 (+995541us) service_pool.cc:224] Handling call
0709 13:09:16.514780 (+ 38767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.543543 (+ 28763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.547670 (+  4127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:16.540592 15302 rpcz_store.cc:276] 0709 13:09:14.720645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.367714 (+1647069us) service_pool.cc:224] Handling call
0709 13:09:16.368528 (+   814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.369232 (+   704us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:16.369848 (+   616us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.509145 (+139297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.509198 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:16.509252 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.509325 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.509467 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35139,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":2331,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":2640,"thread_start_us":137623,"threads_started":1}
W20260709 13:09:16.552011 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.480962 15303 rpcz_store.cc:276] 0709 13:09:14.527231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.530514 (+  3283us) service_pool.cc:224] Handling call
0709 13:09:14.586860 (+ 56346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.587106 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:15.499611 (+912505us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.461056 (+961445us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.461375 (+   319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.461462 (+    87us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:16.461622 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.461760 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.462032 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73029,"prepare.queue_time_us":251426,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":97,"raft.queue_time_us":36349,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":11484,"thread_start_us":1699789,"threads_started":2,"wal-append.queue_time_us":822161}
I20260709 13:09:16.556954 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:16.553735 15379 rpcz_store.cc:276] 0709 13:09:14.076797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.508467 (+2431670us) service_pool.cc:224] Handling call
0709 13:09:16.517674 (+  9207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.543770 (+ 26096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.543960 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:16.545977 17772 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:16.558858 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 441) took 2703 ms. Trace:
I20260709 13:09:16.560258 18375 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.562525 18091 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:16.564608 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:16.564924 18067 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.151s	user 0.028s	sys 0.007s
I20260709 13:09:16.551614 18271 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:16.565646 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1920) took 1083 ms. Trace:
I20260709 13:09:16.566174 15380 raft_consensus.cc:2410] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:16.566339 15308 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
W20260709 13:09:16.567219 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63655.8us
I20260709 13:09:16.529861 18157 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:16.568555 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:16.558774 15305 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:16.565747 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1886) took 2479 ms. Trace:
I20260709 13:09:16.609241 15303 rpcz_store.cc:276] 0709 13:09:15.482477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.563594 (+1081117us) service_pool.cc:224] Handling call
0709 13:09:16.564168 (+   574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.564836 (+   668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.564880 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.564974 (+    94us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:16.565012 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.565079 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.565548 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:16.607219 15377 rpcz_store.cc:276] 0709 13:09:13.796764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.364646 (+2567882us) service_pool.cc:224] Handling call
0709 13:09:16.424937 (+ 60291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.492678 (+ 67741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.492726 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.497429 (+  4703us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:16.497502 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.497587 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.499848 (+  2261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:16.614591 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 58477.8us
I20260709 13:09:16.399715 15306 rpcz_store.cc:276] 0709 13:09:14.567830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.587862 (+ 20032us) service_pool.cc:224] Handling call
0709 13:09:14.588158 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.588495 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:14.780716 (+192221us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.396927 (+1616211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.397054 (+   127us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:16.397186 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.397327 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.397589 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26700,"prepare.queue_time_us":264443,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":19772,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":220,"thread_start_us":1685510,"threads_started":2,"wal-append.queue_time_us":1584855}
W20260709 13:09:16.619995 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.560374 18326 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.628012 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 1921) took 1139 ms. Trace:
W20260709 13:09:16.620172 15273 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.333s (SENT)
I20260709 13:09:16.628474 15305 rpcz_store.cc:276] 0709 13:09:15.483441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.596732 (+113291us) service_pool.cc:224] Handling call
0709 13:09:16.615239 (+1018507us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:16.632261 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 46802.4us
I20260709 13:09:16.632524 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:16.636513 15300 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:16.638257 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1916) took 1163 ms. Trace:
I20260709 13:09:16.641498 15300 rpcz_store.cc:276] 0709 13:09:15.475315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.468205 (+992890us) service_pool.cc:224] Handling call
0709 13:09:16.559496 (+ 91291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.637037 (+ 77541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.638185 (+  1148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:16.634075 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:16.649075 15379 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:16.644608 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1919) took 1163 ms. Trace:
I20260709 13:09:16.650707 15304 rpcz_store.cc:276] 0709 13:09:15.481486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.560998 (+1079512us) service_pool.cc:224] Handling call
0709 13:09:16.561621 (+   623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.562174 (+   553us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:16.562707 (+   533us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.637489 (+ 74782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.637546 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.643104 (+  5558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.643201 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.643407 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5010,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":7520,"thread_start_us":70201,"threads_started":1}
I20260709 13:09:16.565688 18308 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:16.610481 15382 rpcz_store.cc:276] 0709 13:09:14.079264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.705632 (+626368us) service_pool.cc:224] Handling call
0709 13:09:14.830407 (+124775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.847480 (+ 17073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.847513 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.863682 (+ 16169us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.612473 (+748791us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b18003fd1e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:09:16.374919 (+762446us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.375016 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.375129 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.540183 (+165054us) raft_consensus.cc:1685] finished
0709 13:09:16.540206 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.559040 (+ 18834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140285,"raft.queue_time_us":17396,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":152431,"spinlock_wait_cycles":21420800,"thread_start_us":760326,"threads_started":1,"wal-append.queue_time_us":1328959}
I20260709 13:09:16.663825 18377 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:16.664501 18380 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.636389 18375 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:16.668742 18380 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:16.638293 18324 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.676237 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 160986us
I20260709 13:09:16.669786 18380 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.680737 15381 raft_consensus.cc:2410] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:09:16.681450 18363 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.227s	user 0.000s	sys 0.005s
I20260709 13:09:16.682585 18372 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7.
I20260709 13:09:16.683748 18261 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.684504 18308 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:16.679217 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1887) took 2551 ms. Trace:
I20260709 13:09:16.688777 18362 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:16.701499 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.696476 15374 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:16.723281 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 75846.5us
I20260709 13:09:16.726974 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1907) took 1119 ms. Trace:
I20260709 13:09:16.661432 17772 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:16.740849 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 168682us
I20260709 13:09:16.719257 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:16.733919 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 104859us
W20260709 13:09:16.735285 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.735944 18032 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.736780 18344 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.877s	user 0.008s	sys 0.000s
I20260709 13:09:16.736931 18295 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:16.693920 18377 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.644331 18283 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.684505 18261 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.739723 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:16.678725 18324 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.724298 15380 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:09:16.727764 15374 rpcz_store.cc:276] 0709 13:09:15.599094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.722555 (+123461us) service_pool.cc:224] Handling call
0709 13:09:16.708768 (+986213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:16.707047 18308 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:16.690474 15376 rpcz_store.cc:276] 0709 13:09:14.127579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.267797 (+1140218us) service_pool.cc:224] Handling call
0709 13:09:15.408808 (+141011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.409155 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:16.392015 (+982860us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.620767 (+228752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.630135 (+  9368us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:16.656506 (+ 26371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.662739 (+  6233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.679149 (+ 16410us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5664,"prepare.queue_time_us":873363,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":1550,"raft.queue_time_us":32563,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":14031,"thread_start_us":1061542,"threads_started":2,"wal-append.queue_time_us":224170}
W20260709 13:09:16.773269 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.779531 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.783951 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.781911 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 102872us
I20260709 13:09:16.763680 18295 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.781118 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1891) took 2468 ms. Trace:
I20260709 13:09:16.791585 15380 rpcz_store.cc:276] 0709 13:09:14.312704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.632519 (+2319815us) service_pool.cc:224] Handling call
0709 13:09:16.667054 (+ 34535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.780736 (+113682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.781023 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:16.795152 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56622.5us
W20260709 13:09:16.798910 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.799315 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85470.4us
I20260709 13:09:16.773674 18375 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:16.794700 18295 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:16.812314 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72758.7us
I20260709 13:09:16.813620 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:16.815078 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:16.804699 18091 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:16.835866 18308 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:16.829897 15273 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.389s (SENT)
I20260709 13:09:16.810302 18312 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:16.837513 18067 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.839735 18308 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:16.820459 17772 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:16.850931 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50507.6us
I20260709 13:09:16.804679 18032 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:16.848052 18308 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.867949 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:16.850368 18067 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.893144 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:16.895609 18067 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:16.866838 18396 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:16.876627 18376 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 13:09:16.882906 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:16.887712 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:16.917582 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55322.8us
W20260709 13:09:16.920642 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.920864 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.930819 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.931775 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.931900 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:16.933274 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1795) took 2717 ms. Trace:
I20260709 13:09:16.934110 18032 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:16.934468 18174 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:16.937400 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 132618us
I20260709 13:09:16.937354 15378 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:16.942162 18312 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.942842 18312 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:16.943348 18312 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.935964 17772 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:16.937163 18324 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:16.935670 18174 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:16.949575 18380 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:16.933754 15373 rpcz_store.cc:276] 0709 13:09:14.215333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.545569 (+1330236us) service_pool.cc:224] Handling call
0709 13:09:15.545784 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.339003 (+793219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:16.339085 (+    82us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.339185 (+   100us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:16.339233 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.932744 (+593511us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540023f0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:16.932802 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.933070 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9733,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":30690,"spinlock_wait_cycles":1821963520}
I20260709 13:09:16.936669 18283 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:16.957267 18366 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.576s	user 0.003s	sys 0.003s
I20260709 13:09:16.956105 16000 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:09:16.957468 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 109899us
I20260709 13:09:16.958173 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:16.958905 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:16.919409 18266 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:16.965116 18376 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:16.915108 18396 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:17.020757 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 204521us
I20260709 13:09:17.026610 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1912) took 2509 ms. Trace:
I20260709 13:09:17.032895 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.020414 18266 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.046876 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1894) took 2648 ms. Trace:
I20260709 13:09:17.055271 15382 rpcz_store.cc:276] 0709 13:09:14.397605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.665719 (+2268114us) service_pool.cc:224] Handling call
0709 13:09:16.748597 (+ 82878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.820774 (+ 72177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:16.873863 (+ 53089us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.043731 (+169868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.044082 (+   351us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.044239 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.044606 (+   367us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.045907 (+  1301us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123589,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":6783,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":169,"thread_start_us":175055,"threads_started":2}
W20260709 13:09:17.055223 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 120927us
I20260709 13:09:17.026474 18391 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.031374 15232 rpcz_store.cc:276] 0709 13:09:14.512672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.521879 (+  9207us) service_pool.cc:224] Handling call
0709 13:09:14.574851 (+ 52972us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.575358 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.575401 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.593115 (+ 17714us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.866906 (+273791us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:14.866969 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.867227 (+   258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.660796 (+1793569us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:16.940100 (+279304us) raft_consensus.cc:1685] finished
0709 13:09:16.940122 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.021552 (+ 81430us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1783,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":20855,"spinlock_wait_cycles":3059968,"thread_start_us":188887,"threads_started":1,"wal-append.queue_time_us":1129312}
I20260709 13:09:17.073499 15373 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:17.064667 18266 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.084368 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:17.041546 18324 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:17.097173 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.071003 18377 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.070657 18391 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:17.107749 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58251.4us
I20260709 13:09:17.098050 15382 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
W20260709 13:09:17.114320 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45446.8us
I20260709 13:09:17.115540 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.115482 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1897) took 2466 ms. Trace:
I20260709 13:09:17.116544 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.120185 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1895) took 2707 ms. Trace:
I20260709 13:09:17.116719 15380 rpcz_store.cc:276] 0709 13:09:14.649065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.792826 (+2143761us) service_pool.cc:224] Handling call
0709 13:09:16.821555 (+ 28729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.834163 (+ 12608us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:16.967172 (+133009us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.115138 (+147966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.115203 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:17.115253 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.115312 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.115423 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24332,"prepare.queue_time_us":122583,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"thread_start_us":152774,"threads_started":2}
I20260709 13:09:17.101025 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.112056 18391 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.121464 15374 rpcz_store.cc:276] 0709 13:09:14.412672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.780949 (+2368277us) service_pool.cc:224] Handling call
0709 13:09:16.823943 (+ 42994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.863023 (+ 39080us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:17.020582 (+157559us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.119784 (+ 99202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.119857 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:17.119906 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.119969 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.120109 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13687,"prepare.queue_time_us":91639,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8976,"thread_start_us":147218,"threads_started":2}
I20260709 13:09:17.133283 15373 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:17.133922 18174 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.094646 18295 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.137198 15228 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:17.138782 15232 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:17.139371 18295 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.120491 17772 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:17.140789 16000 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:17.142012 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.145273 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:17.146270 17772 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.146348 18227 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.149168 18227 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.149906 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.151820 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.152644 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.153218 15229 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:17.154675 18324 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.155779 18206 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.156716 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.157014 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.158269 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.158705 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1905) took 2556 ms. Trace:
I20260709 13:09:17.159238 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59848 (request call id 20) took 3015 ms. Trace:
I20260709 13:09:17.159677 15227 rpcz_store.cc:276] 0709 13:09:14.143695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.144194 (+   499us) service_pool.cc:224] Handling call
0709 13:09:17.158888 (+3014694us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540007a154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b20853 00007f2f58aee60a 00007f2f520747d4 00007f2f52074762 00007f2f52074691 00007f2f5207460c 00007f2f520738c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:17.159101 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4001170304}
I20260709 13:09:17.161024 18398 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:17.164656 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.145319 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.165701 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:17.166025 16003 raft_consensus.cc:1813] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:09:17.166837 16003 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:17.167132 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.133271 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:17.168722 18389 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:17.145658 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.146955 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.164477 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.157220 18324 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:17.151912 16005 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:17.176322 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.168258 15229 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:17.153118 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.272482 15374 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
W20260709 13:09:17.254676 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.261153 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 139638us
W20260709 13:09:17.285281 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.171022 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.283828 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.172778 15224 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:09:17.229637 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.217805 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:17.286648 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.278999 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:17.292634 15380 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.176424 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.290649 16005 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:17.298174 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:17.298635 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.298914 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:17.133656 18392 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 13:09:17.303840 15382 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
W20260709 13:09:17.304280 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.306205 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77544.3us
I20260709 13:09:17.159245 15301 rpcz_store.cc:276] 0709 13:09:14.601890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.665491 (+ 63601us) service_pool.cc:224] Handling call
0709 13:09:14.666088 (+   597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.815812 (+149724us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:16.324373 (+1508561us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.508201 (+183828us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.524835 (+ 16634us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.524976 (+   141us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:16.525008 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.525102 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.158413 (+633311us) raft_consensus.cc:1685] finished
0709 13:09:17.158431 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.158600 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121225,"prepare.queue_time_us":37616,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":120719,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":24418,"thread_start_us":1641798,"threads_started":2,"wal-append.queue_time_us":247787}
I20260709 13:09:17.313583 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.310345 15304 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:09:17.316900 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.152123 18227 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:17.314548 15229 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:17.327901 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.329535 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.324640 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:17.331200 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 118753us
I20260709 13:09:17.332849 18384 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:17.342155 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:17.347499 15377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.043s	sys 0.079s
W20260709 13:09:17.347929 15377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.043s	sys 0.079s
I20260709 13:09:17.348258 15380 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:17.348151 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.341521 18328 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.350752 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:17.354475 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.209245 18408 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:17.270140 18295 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:09:17.178674 18091 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.165s
W20260709 13:09:17.363945 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.366281 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 200943us
I20260709 13:09:17.366369 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1899) took 2640 ms. Trace:
I20260709 13:09:17.370262 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.368842 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1896) took 2763 ms. Trace:
I20260709 13:09:17.376098 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.374789 15373 rpcz_store.cc:276] 0709 13:09:14.726054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.134227 (+2408173us) service_pool.cc:224] Handling call
0709 13:09:17.134659 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.135277 (+   618us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:17.135932 (+   655us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.365977 (+230045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.366041 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.366097 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.366165 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.366305 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10615,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":12856,"thread_start_us":180181,"threads_started":1}
I20260709 13:09:17.346979 18384 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.375842 18397 raft_consensus.cc:2764] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:17.374809 15376 rpcz_store.cc:276] 0709 13:09:14.605164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.794945 (+2189781us) service_pool.cc:224] Handling call
0709 13:09:16.838420 (+ 43475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.865875 (+ 27455us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:17.084236 (+218361us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.325865 (+241629us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.345592 (+ 19727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.345686 (+    94us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:17.368334 (+ 22648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.368550 (+   216us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.368779 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58736,"prepare.queue_time_us":91401,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":92,"raft.queue_time_us":43232,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":13934,"thread_start_us":354739,"threads_started":2}
I20260709 13:09:17.381575 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:17.382591 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.383960 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.354517 18328 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.380594 15303 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
W20260709 13:09:17.392493 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93644us
W20260709 13:09:17.392767 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 45471.7us
I20260709 13:09:17.373442 18380 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.396459 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.397053 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.402634 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.404909 17772 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:17.405200 18405 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.381867 18384 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:17.428625 18367 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.988s	user 0.003s	sys 0.001s
I20260709 13:09:17.428186 18266 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.409389 18389 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.431782 18389 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.423475 18405 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.432296 18389 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.433527 18236 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.386268 18402 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:17.435279 16005 raft_consensus.cc:2368] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9.
I20260709 13:09:17.411404 18317 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.446270 18317 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.446861 18317 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.447146 18402 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:17.444051 18271 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:09:17.448680 18402 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.450076 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1915) took 2721 ms. Trace:
W20260709 13:09:17.452598 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.452858 15373 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:17.412667 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1901) took 2577 ms. Trace:
I20260709 13:09:17.454665 15382 rpcz_store.cc:276] 0709 13:09:14.822847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.344081 (+2521234us) service_pool.cc:224] Handling call
0709 13:09:17.381153 (+ 37072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.400078 (+ 18925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.400113 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.400172 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.400208 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.400287 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.400459 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.409463 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:17.450713 15307 rpcz_store.cc:276] 0709 13:09:14.728490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.439326 (+1710836us) service_pool.cc:224] Handling call
0709 13:09:16.439912 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.449408 (+  9496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.449447 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.553505 (+104058us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.771819 (+218314us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.771888 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.772056 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.449731 (+677675us) raft_consensus.cc:1685] finished
0709 13:09:17.449763 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.449986 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3444,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":19304,"thread_start_us":141597,"threads_started":1,"wal-append.queue_time_us":188108}
I20260709 13:09:17.460321 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:17.460459 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47337.7us
I20260709 13:09:17.133749 18396 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.413645 18067 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:17.400599 18408 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.409065 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1889) took 3193 ms. Trace:
I20260709 13:09:17.431965 18266 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.390895 18328 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.416812 18140 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:17.459599 15308 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:17.464175 15229 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:17.453851 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1903) took 1920 ms. Trace:
I20260709 13:09:17.452056 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.414547 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.472822 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1904) took 1939 ms. Trace:
I20260709 13:09:17.483453 15373 rpcz_store.cc:276] 0709 13:09:15.533569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.385182 (+1851613us) service_pool.cc:224] Handling call
0709 13:09:17.408929 (+ 23747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.453441 (+ 44512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.453767 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.484010 15376 rpcz_store.cc:276] 0709 13:09:15.533864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.391304 (+1857440us) service_pool.cc:224] Handling call
0709 13:09:17.410033 (+ 18729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.463322 (+ 53289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.463365 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.472391 (+  9026us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.472451 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.472538 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.472730 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:17.482748 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.460832 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:17.488437 15233 raft_consensus.cc:2410] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:09:17.471890 15377 rpcz_store.cc:276] 0709 13:09:14.215596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.620430 (+2404834us) service_pool.cc:224] Handling call
0709 13:09:16.656910 (+ 36480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.695397 (+ 38487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.695451 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.792015 (+ 96564us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.348557 (+556542us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.348625 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.348709 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.408762 (+ 60053us) raft_consensus.cc:1685] finished
0709 13:09:17.408786 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.409002 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18155,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":48261,"thread_start_us":527754,"threads_started":1,"wal-append.queue_time_us":596575}
W20260709 13:09:17.491197 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 100489us
I20260709 13:09:17.494326 15377 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:17.494644 18113 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:17.495085 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1905) took 1961 ms. Trace:
I20260709 13:09:17.496678 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:17.498786 18261 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:17.499378 18324 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.499938 18324 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.502283 18324 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:17.505621 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45419.4us
I20260709 13:09:17.507014 18385 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:17.507691 18385 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:17.509630 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 1898) took 2839 ms. Trace:
I20260709 13:09:17.510036 15381 rpcz_store.cc:276] 0709 13:09:14.670318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.705440 (+ 35122us) service_pool.cc:224] Handling call
0709 13:09:17.509362 (+2803922us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b540027b5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:17.509559 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4191596800}
I20260709 13:09:17.510407 18405 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.511484 15302 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:17.511835 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:17.513337 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 103183us
I20260709 13:09:17.510450 15375 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:17.514773 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.517206 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.518802 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.519142 15299 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:17.519934 15307 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:17.520318 15303 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.507946 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1810) took 1265 ms. Trace:
I20260709 13:09:17.525656 15378 rpcz_store.cc:276] 0709 13:09:16.242681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.539796 (+297115us) service_pool.cc:224] Handling call
0709 13:09:17.507673 (+967877us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54003f2354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:17.507853 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903075200}
I20260709 13:09:17.520848 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.522281 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.522547 18377 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.523008 15301 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.495579 15382 rpcz_store.cc:276] 0709 13:09:15.534145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.488553 (+1954408us) service_pool.cc:224] Handling call
0709 13:09:17.493802 (+  5249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.494658 (+   856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.494692 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.494755 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:17.494809 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.494871 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.495004 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432}
W20260709 13:09:17.477471 18308 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.576s	user 0.015s	sys 0.000s
I20260709 13:09:17.533597 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.530375 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1789) took 3471 ms. Trace:
I20260709 13:09:17.492533 18032 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.514879 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.542526 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.543601 15305 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:17.535804 15375 rpcz_store.cc:276] 0709 13:09:14.058776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.704222 (+2645446us) service_pool.cc:224] Handling call
0709 13:09:17.510013 (+805791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.515590 (+  5577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.529980 (+ 14390us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b540027b5d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:17.530272 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822991616}
I20260709 13:09:17.548152 15308 raft_consensus.cc:2410] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:17.531944 18385 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.532089 18377 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:17.549978 15273 connection.cc:256] RPC call timeout handler was delayed by -1.0601504999999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:09:17.551143 15273 connection.cc:256] RPC call timeout handler was delayed by -1.0241505000000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:09:17.551702 15376 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:09:17.552244 15376 pending_rounds.cc:85] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:09:17.540413 18032 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:17.553541 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.557117 15232 raft_consensus.cc:2368] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:17.555590 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.552627 15376 pending_rounds.cc:107] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:09:17.559249 15376 raft_consensus.cc:2889] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.559316 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1902) took 2026 ms. Trace:
I20260709 13:09:17.559965 15380 rpcz_store.cc:276] 0709 13:09:15.533153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.354477 (+1821324us) service_pool.cc:224] Handling call
0709 13:09:17.504091 (+149614us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:09:17.531499 (+ 27408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.556157 (+ 24658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.556204 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.559007 (+  2803us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:17.559062 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.559128 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.559255 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6424960}
I20260709 13:09:17.557873 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1900) took 2743 ms. Trace:
I20260709 13:09:17.552163 18377 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:17.562870 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.563216 18326 consensus_meta.cc:287] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.925s	user 0.017s	sys 0.000s
I20260709 13:09:17.557601 18032 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.585654 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.588977 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1908) took 1982 ms. Trace:
I20260709 13:09:17.590113 18408 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:17.568146 18419 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
W20260709 13:09:17.590617 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 75828.8us
I20260709 13:09:17.591059 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:17.561882 15374 rpcz_store.cc:276] 0709 13:09:14.814907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.320620 (+2505713us) service_pool.cc:224] Handling call
0709 13:09:17.374076 (+ 53456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.397215 (+ 23139us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:17.397638 (+   423us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.553007 (+155369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.553067 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:17.557536 (+  4469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.557630 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.557805 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2366,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":3161,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4084,"thread_start_us":126970,"threads_started":1}
I20260709 13:09:17.556445 18405 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:17.593331 16007 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:17.593154 18405 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.595676 18405 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.560823 18140 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.574899 18391 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.576596 15302 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:17.590378 16001 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.538949 18308 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.563711 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.564586 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1909) took 1957 ms. Trace:
I20260709 13:09:17.592952 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.589548 15373 rpcz_store.cc:276] 0709 13:09:15.607162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.485728 (+1878566us) service_pool.cc:224] Handling call
0709 13:09:17.546164 (+ 60436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.588489 (+ 42325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.588529 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:17.588627 (+    98us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:17.588679 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.588759 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.588900 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81920}
I20260709 13:09:17.603574 15376 rpcz_store.cc:276] 0709 13:09:15.607615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.486515 (+1878900us) service_pool.cc:224] Handling call
0709 13:09:17.546166 (+ 59651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.564288 (+ 18122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.564540 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53376}
I20260709 13:09:17.608230 18308 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:17.609066 15230 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:17.612488 15227 raft_consensus.cc:2368] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:17.613971 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:17.615196 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:17.621760 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:17.603689 18312 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.007s
I20260709 13:09:17.626669 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.632534 18326 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:17.632699 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:17.633927 18415 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.185s	user 0.000s	sys 0.002s
I20260709 13:09:17.634321 18266 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:17.635478 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:17.636770 18258 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:17.637194 18258 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.637424 18369 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.637540 18258 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:17.626178 18372 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.641014 18372 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.641443 18372 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.626557 18227 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:17.638038 18369 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.645991 16004 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:17.650103 18369 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:17.650482 15227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:17.651638 15227 raft_consensus.cc:606] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:17.596887 18328 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.653383 16002 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.624845 18308 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:17.660007 18227 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:17.661401 18227 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.665127 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.665745 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 492) took 1196 ms. Trace:
I20260709 13:09:17.666082 18312 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.668829 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:17.671025 15231 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.671219 15348 leader_election.cc:400] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9.
I20260709 13:09:17.671536 15348 leader_election.cc:403] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:17.666117 15226 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
W20260709 13:09:17.647933 15273 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.103s (SENT)
I20260709 13:09:17.683132 18067 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:17.685335 18391 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:17.660080 18308 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:17.686421 18308 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:17.688450 18326 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9.
I20260709 13:09:17.689059 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:17.689926 15380 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.690061 18389 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.687455 18308 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.695837 18308 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.696789 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:17.697247 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 104499us
I20260709 13:09:17.697608 15378 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.700307 18383 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:17.700834 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:17.701608 18384 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.702605 18383 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:17.705250 18283 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:17.657140 18328 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.707427 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.714042 18405 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:17.709558 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:17.710597 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.734679 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:17.736765 15382 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:17.741847 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.742884 15227 raft_consensus.cc:2410] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:17.663935 18032 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.666255 16004 rpcz_store.cc:276] 0709 13:09:16.469146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.469951 (+   805us) service_pool.cc:224] Handling call
0709 13:09:17.665578 (+1195627us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54004182d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:17.665686 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700360704}
I20260709 13:09:17.745944 18032 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.748839 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.751133 18140 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.737264 15382 pending_rounds.cc:85] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 2
I20260709 13:09:17.755120 15382 pending_rounds.cc:107] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:17.755412 15382 raft_consensus.cc:2889] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.756654 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.760725 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:17.762588 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52261.5us
W20260709 13:09:17.760933 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.765019 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.761682 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.765168 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1893) took 3407 ms. Trace:
W20260709 13:09:17.767895 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.773126 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63672.2us
I20260709 13:09:17.778988 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.780844 18397 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:17.696036 18258 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.785486 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.767619 15379 rpcz_store.cc:276] 0709 13:09:14.358244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.650126 (+2291882us) service_pool.cc:224] Handling call
0709 13:09:16.694194 (+ 44068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.749109 (+ 54915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.749150 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.135171 (+386021us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b480012d158. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:09:17.612902 (+477731us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b2c00083318. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:09:17.613488 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.732680 (+119192us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:17.732714 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.733540 (+   826us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.764960 (+ 31420us) raft_consensus.cc:1685] finished
0709 13:09:17.764977 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.765113 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10723,"raft.run_cpu_time_us":5794,"raft.run_wall_time_us":397888,"spinlock_wait_cycles":53216896,"thread_start_us":118792,"threads_started":1,"wal-append.queue_time_us":138726}
I20260709 13:09:17.798343 18397 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:17.799021 18397 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.800884 18326 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:17.801229 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:17.802228 18326 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:17.802640 18326 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:17.793697 18140 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.803856 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:17.739176 18384 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:17.817202 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.819650 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:17.821550 15376 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:17.818269 15377 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:17.820643 15382 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:17.825263 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.724835 18271 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:09:17.830533 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:17.831226 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.792847 18369 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.777575 18405 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:17.839273 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:17.844290 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:17.844767 15377 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.849386 15379 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:17.853518 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 205625us
I20260709 13:09:17.852151 15308 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:17.837579 18369 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.868088 18258 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:17.871413 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:17.872928 15302 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.873116 15380 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
W20260709 13:09:17.905560 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.843760 18389 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:17.892834 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.877942 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:17.922487 15231 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:17.869086 18362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.014s	sys 0.021s
I20260709 13:09:17.804265 18326 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:17.941955 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.941496 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:17.956460 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.874406 18067 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:17.936764 18362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.014s	sys 0.021s
I20260709 13:09:17.877446 18385 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:17.948218 18258 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.969406 16000 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:17.970435 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.970350 18388 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:17.976703 18377 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:17.985322 15379 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:09:17.989285 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47925.8us
I20260709 13:09:17.949465 18261 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:18.012305 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:17.876252 18369 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.017660 15227 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:18.013916 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 252946us
I20260709 13:09:17.875550 18405 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.036440 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:18.037134 15379 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.011983 18412 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:18.041726 15381 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:18.048822 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.049942 15378 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:18.053941 18385 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:18.033798 18261 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.013301 18388 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:18.034194 17772 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.010061 18258 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:18.036041 18317 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.002s
I20260709 13:09:18.068300 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:18.069519 15377 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:18.060657 17772 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.101431 15379 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:18.102378 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:18.107507 15274 leader_election.cc:400] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:18.107972 15274 leader_election.cc:403] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:18.078656 18258 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:18.104317 17772 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:18.164955 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 426601us
I20260709 13:09:18.073640 18433 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:09:18.169385 15302 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:18.080030 18317 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.175215 18355 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.175884 18355 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:18.181066 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 100609us
W20260709 13:09:18.184088 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68969.1us
W20260709 13:09:18.181056 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 73744.6us
I20260709 13:09:18.152325 18427 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.189822 15274 leader_election.cc:400] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:18.077320 18388 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.203251 15274 leader_election.cc:403] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:18.213739 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:18.221858 18355 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.223634 18355 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.227041 18447 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.234906 18317 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:18.206072 18261 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:18.209669 18442 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:09:18.238610 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.239599 18431 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:18.240638 18377 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:18.190405 18140 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.201617 18362 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.250128 15233 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:18.250967 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:18.253662 16004 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:18.256053 15231 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:18.257198 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:18.246030 18372 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.604s	user 0.016s	sys 0.000s
I20260709 13:09:18.279995 18405 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:18.256953 18377 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:18.282114 18377 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:18.263264 18113 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:09:18.277107 18372 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.291642 18440 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:18.293040 18397 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.293843 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:18.294399 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.307344 15302 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:18.280665 18398 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.310402 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:18.311410 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:18.318369 15227 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:18.300420 18372 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:18.308542 15306 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:18.322844 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:18.323592 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.317934 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59447.1us
I20260709 13:09:18.320261 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:18.323822 15300 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:18.299057 18377 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:18.334611 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:18.334543 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:18.335597 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:18.336313 18113 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:18.272166 17772 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.346089 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.338574 16001 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 9: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:18.352138 15303 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:18.364308 18261 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.364960 18261 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.365217 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.366299 15301 raft_consensus.cc:2368] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9.
I20260709 13:09:18.367412 18261 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:18.369650 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.369318 18377 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.370016 17772 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:18.367467 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.371732 15302 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:18.371642 15301 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.370229 15307 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.360059 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:18.357713 18434 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:09:18.384783 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.384858 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:18.386837 15300 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:18.370783 18377 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.381675 18441 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:18.394338 18441 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.382155 18398 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:18.421090 18398 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.350492 18384 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:18.379405 18091 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:18.396727 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.397416 18113 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:18.398530 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 63034.8us
I20260709 13:09:18.436756 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:18.399149 18383 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.402220 18441 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:18.405017 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:18.413245 18412 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.419445 18312 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:18.348238 18397 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:18.426162 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:18.448760 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43833.7us
I20260709 13:09:18.450316 15374 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.451242 15198 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:18.423403 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:18.428678 15307 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:18.454314 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.434425 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:18.437759 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48019.8us
W20260709 13:09:18.439232 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.459369 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:09:18.461467 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.462881 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:18.464447 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:18.436190 18113 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:18.449461 18449 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:18.439877 18383 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:18.449561 18412 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.477892 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:18.479732 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:18.443120 18385 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.453943 18283 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.489012 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.490382 15308 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.493400 16000 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:18.494593 18283 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.487412 18383 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:18.495465 18446 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:09:18.495770 18308 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:18.495077 18283 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.486390 18227 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:18.501255 18227 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:18.502363 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:18.503026 15376 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.502884 18227 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.505462 15379 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 13:09:18.511384 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.473418 18317 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.526057 18317 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.526463 18317 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.528277 15377 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:18.529668 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:18.473150 18091 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:18.536547 18218 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:18.529094 18385 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:18.537940 18385 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.539585 18324 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:18.540481 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:18.541134 15382 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:18.542343 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:18.543730 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:18.546236 18295 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:18.462532 18433 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:09:18.516932 18326 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.548709 18433 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:18.549300 18433 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:18.550499 18433 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.475435 18372 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.552762 18372 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:18.553696 18372 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:18.517637 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58404.7us
I20260709 13:09:18.518141 18293 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.556922 18218 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:18.557214 18293 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:18.558066 18218 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.519188 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:18.559157 15375 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.518592 15373 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:18.561565 15373 pending_rounds.cc:85] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 3
I20260709 13:09:18.561833 15373 pending_rounds.cc:107] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:18.562067 15373 raft_consensus.cc:2889] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.442778 18448 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.539691 18427 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.558153 18293 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:18.512885 15273 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.577s (SENT)
W20260709 13:09:18.564330 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.521023 15374 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:18.572707 15377 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:09:18.630270 15376 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:18.727746 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:18.753839 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:18.775360 15229 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:18.632839 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.776448 15377 pending_rounds.cc:85] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
W20260709 13:09:18.776676 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.626888 15382 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:18.728502 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:18.729333 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:18.626881 15375 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:18.776937 15377 pending_rounds.cc:107] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:09:18.783318 15377 raft_consensus.cc:2889] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.778452 15381 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:18.777503 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:18.572687 15301 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:18.793195 15225 raft_consensus.cc:2368] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:18.680657 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:18.629987 15373 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:18.658718 15308 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:09:18.804068 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 275103us
I20260709 13:09:18.805310 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:18.719630 18443 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.494s	user 0.005s	sys 0.000s
W20260709 13:09:18.820602 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.644675 18369 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.618s	user 0.016s	sys 0.001s
I20260709 13:09:18.570676 18448 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.612425 18362 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:18.540522 18324 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:18.836287 15378 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:18.614355 18433 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.619967 18447 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:18.763098 15307 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:09:18.843827 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 331036us
I20260709 13:09:18.852108 18369 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.854509 18369 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:18.813413 18408 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:18.847244 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:18.857991 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52834.6us
W20260709 13:09:18.869728 15345 connection.cc:256] RPC call timeout handler was delayed by -4.8854017029999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:09:18.870285 15345 connection.cc:256] RPC call timeout handler was delayed by -4.8764017029999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:09:18.870646 15345 connection.cc:256] RPC call timeout handler was delayed by -4.8737017029999379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:09:18.870936 15345 connection.cc:256] RPC call timeout handler was delayed by -4.852101702999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1589s for a response
W20260709 13:09:18.871236 15345 connection.cc:256] RPC call timeout handler was delayed by -4.8476017029998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:09:18.871697 15345 connection.cc:256] RPC call timeout handler was delayed by -4.8206017029999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 13:09:18.872248 15345 connection.cc:256] RPC call timeout handler was delayed by -4.77380170299989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:09:18.882186 15345 connection.cc:256] RPC call timeout handler was delayed by -4.7621017029999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:09:18.882576 15345 connection.cc:256] RPC call timeout handler was delayed by -4.6748017029999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:09:18.882895 15345 connection.cc:256] RPC call timeout handler was delayed by -4.5866017029999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:09:18.883219 15345 connection.cc:256] RPC call timeout handler was delayed by -4.5344017029999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 13:09:18.883517 15345 connection.cc:256] RPC call timeout handler was delayed by -4.5146017029999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:09:18.883831 15345 connection.cc:256] RPC call timeout handler was delayed by -4.50470170299991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:09:18.884141 15345 connection.cc:256] RPC call timeout handler was delayed by -4.4174017029999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:09:18.896517 15345 connection.cc:256] RPC call timeout handler was delayed by -4.3526017029998911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:09:18.897024 15345 connection.cc:256] RPC call timeout handler was delayed by -4.3400017029999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:09:18.897418 15345 connection.cc:256] RPC call timeout handler was delayed by -4.3076017029999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 13:09:18.897814 15345 connection.cc:256] RPC call timeout handler was delayed by -4.2599017029999686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 13:09:18.898180 15345 connection.cc:256] RPC call timeout handler was delayed by -4.0277017029999342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2505s for a response
I20260709 13:09:18.846587 18448 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:18.905926 15273 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.617s (SENT)
I20260709 13:09:18.909174 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:18.909067 15232 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:18.910332 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:18.910972 15302 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.837314 18383 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:18.925741 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:18.926448 15228 raft_consensus.cc:606] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:18.926501 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:18.905918 18369 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:18.932447 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63373.3us
I20260709 13:09:18.915635 18398 raft_consensus.cc:2764] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:18.939160 15196 leader_election.cc:400] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9.
I20260709 13:09:18.915798 18447 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:18.949862 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.950253 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:18.950996 15228 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:18.956655 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61562.9us
W20260709 13:09:18.956948 18458 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:09:18.957405 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.727s (SENT) [suppressed 37 similar messages]
I20260709 13:09:18.964020 18091 raft_consensus.cc:993] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:09:18.969336 18460 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:09:18.971823 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57723.3us
I20260709 13:09:18.972983 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:18.949190 18437 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:18.936746 18369 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:18.967478 18456 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:09:18.971714 18383 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:18.974313 18398 raft_consensus.cc:1081] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:09:19.008966 15303 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:19.011818 15299 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:18.983800 18457 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:19.013163 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72619.4us
I20260709 13:09:18.949318 18324 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:18.987396 18283 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.023247 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:19.026336 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:19.029387 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72019.9us
W20260709 13:09:19.034128 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.038022 18412 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.529s	user 0.003s	sys 0.007s
I20260709 13:09:19.038408 18283 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:19.039983 15299 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:19.041580 15299 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:19.081296 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:19.082633 15301 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:19.084538 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55303.1us
I20260709 13:09:19.086926 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:19.046484 18459 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:19.079006 18457 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.100525 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:19.100577 18326 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.002s
I20260709 13:09:19.103549 18480 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:19.105226 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.107158 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92720.6us
I20260709 13:09:19.083539 18293 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.103982 18355 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.880s	user 0.008s	sys 0.008s
I20260709 13:09:19.038529 18412 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:19.110491 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 190229us
I20260709 13:09:19.116312 15302 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:19.110119 18473 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:19.123378 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.154345 15379 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:19.160562 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47090.4us
I20260709 13:09:19.133585 18480 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:19.161708 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.162115 18480 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.163728 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:19.164790 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47968us
W20260709 13:09:19.172749 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.133294 18459 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:19.187065 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:19.188011 15302 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:19.189038 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:19.140121 18369 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:19.193104 15273 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.877s (SENT)
I20260709 13:09:19.117538 18293 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:19.199396 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.178300 18326 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.169844 18473 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:19.154246 18091 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:09:19.190831 18437 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.201503 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:19.182665 18457 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.224720 15302 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:19.225914 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:19.232275 15304 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:19.177521 18398 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:09:19.223255 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:19.243176 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79661.8us
I20260709 13:09:19.259087 15228 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:19.224174 18437 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:19.276324 15299 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:19.222452 18408 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:19.278736 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 85654.6us
I20260709 13:09:19.301659 18293 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:19.364703 15304 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:19.365554 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:19.364836 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:19.302701 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.367674 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.305598 18484 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:09:19.315374 18459 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:19.316601 18468 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:09:19.319661 15274 leader_election.cc:400] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:19.324928 16000 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:19.328986 16004 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:19.329756 18412 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:19.279462 18437 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:19.334260 18317 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.807s	user 0.011s	sys 0.003s
I20260709 13:09:19.350401 18473 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:19.353108 15301 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:19.201157 18476 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:09:19.355414 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:19.400285 15225 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:19.370373 15302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:09:19.360926 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:19.363476 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:19.401465 15303 raft_consensus.cc:2368] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8.
I20260709 13:09:19.365751 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:19.367578 15273 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.223s (SENT)
W20260709 13:09:19.313122 18485 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:09:19.304783 18486 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:09:19.366370 16006 raft_consensus.cc:2368] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8.
I20260709 13:09:19.373867 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:19.368081 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 183143us
I20260709 13:09:19.381928 15274 leader_election.cc:403] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:19.383903 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.386073 16002 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.393465 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1940) took 1043 ms. Trace:
I20260709 13:09:19.407476 15300 rpcz_store.cc:276] 0709 13:09:18.349989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.388553 (+ 38564us) service_pool.cc:224] Handling call
0709 13:09:18.388976 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:18.442546 (+ 53570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.442585 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:18.522437 (+ 79852us) log.cc:844] Serialized 52 byte log entry
0709 13:09:18.898899 (+376462us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:18.913448 (+ 14549us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.913670 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.913750 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.393236 (+479486us) raft_consensus.cc:1685] finished
0709 13:09:19.393259 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.393404 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46991,"prepare.queue_time_us":16223,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":60634,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":18648,"thread_start_us":243010,"threads_started":1,"wal-append.queue_time_us":442664}
I20260709 13:09:19.410509 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.401093 15302 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:19.411957 15302 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.402068 15308 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.372745 18408 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:19.405897 18317 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.417666 18408 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.419883 18317 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:19.422302 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54741.6us
I20260709 13:09:19.429999 18377 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:19.416173 18412 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:19.437837 18113 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:19.439414 18113 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.437915 18412 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:19.441699 18412 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:19.410247 18258 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:19.441115 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 121608us
I20260709 13:09:19.455904 15302 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.441756 18362 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
W20260709 13:09:19.452280 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46620.6us
I20260709 13:09:19.473143 18495 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.477895 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:19.478647 15225 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:19.478986 15225 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:19.479818 15225 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.480950 15225 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:19.486784 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.490443 15308 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:19.503715 15302 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:19.504719 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:19.503497 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 145397us
I20260709 13:09:19.515334 15381 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:19.522047 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:19.522924 15374 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.515808 15381 pending_rounds.cc:85] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 3
I20260709 13:09:19.525672 15381 pending_rounds.cc:107] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:19.526005 15381 raft_consensus.cc:2889] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.537129 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:19.538097 15380 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.533515 15199 leader_election.cc:400] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8.
I20260709 13:09:19.542582 15199 leader_election.cc:403] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:19.552134 15374 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:19.606989 18447 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.689384 15128 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:19.722101 18447 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:19.702468 18437 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:19.665508 18433 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.004s
I20260709 13:09:19.723860 15379 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:19.558487 18448 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 13:09:19.725001 18437 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:19.687542 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.633355 18408 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:19.552907 18492 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:19.566835 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.609064 15225 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:19.733026 15380 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:19.696108 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:19.689858 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.722918 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:19.649106 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.753517 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.753984 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.671968 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 139576us
I20260709 13:09:19.753540 15374 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:19.755101 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.650584 15233 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:19.754254 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.737509 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:19.757225 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.757362 15301 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.627043 15382 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:19.758298 15382 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:19.628403 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.765045 15382 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.752601 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:19.723363 15128 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 4 to 7, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 7 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.772061 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:19.772928 15228 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:19.761082 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.558039 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:19.756270 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:19.532850 18397 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.582180 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:19.725085 18447 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:19.724896 18448 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:19.799115 15374 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:19.769923 18465 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:19.769799 18326 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:19.910073 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 135499us
I20260709 13:09:19.569555 18317 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8.
W20260709 13:09:19.897869 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 339917us
I20260709 13:09:19.914654 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:19.899210 15307 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:19.535051 18383 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.281s
I20260709 13:09:19.887941 15301 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:19.907582 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 383799us
I20260709 13:09:19.922176 15305 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:19.884040 18397 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:19.902561 18362 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:19.927894 15374 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:19.605206 18218 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.304s
W20260709 13:09:19.940719 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.897742 18258 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:09:19.907893 18494 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:19.915251 18437 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.912882 18293 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:19.948763 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 175715us
I20260709 13:09:19.946918 15128 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 4 to 5, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 5 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:19.920148 18465 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:19.945453 16001 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:19.939901 18377 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.954649 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:19.940511 18397 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.909873 18457 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:19.952630 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:20.012136 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65831.6us
I20260709 13:09:19.944933 18362 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:09:19.988924 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.945062 18369 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:19.950243 18385 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:20.028398 15129 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 193) took 24891 ms (client timeout 15000 ms). Trace:
I20260709 13:09:20.001073 18388 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.023975 15128 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 4 to 7, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 7 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.925235 18326 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:19.980456 18293 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:20.053426 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.069167 15196 leader_election.cc:400] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8.
W20260709 13:09:20.053069 18513 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:09:20.064160 15128 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.028000 18317 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:20.046599 18457 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.098966 18457 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:20.099613 18457 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.031435 18369 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:20.075053 15273 leader_election.cc:336] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.501s (SENT)
I20260709 13:09:20.046897 18494 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:20.104692 18369 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.104859 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:20.105307 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1937) took 1756 ms. Trace:
I20260709 13:09:20.105603 18494 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:20.105887 15305 rpcz_store.cc:276] 0709 13:09:18.348601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.435646 (+ 87045us) service_pool.cc:224] Handling call
0709 13:09:18.443075 (+  7429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.922652 (+1479577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.104749 (+182097us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540026bbd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:20.105221 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3400987520}
I20260709 13:09:20.077342 18218 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:09:20.052696 18385 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:20.109869 18385 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:20.023555 18377 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:20.086256 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 138882us
W20260709 13:09:20.086778 18113 consensus_meta.cc:287] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.004s
I20260709 13:09:20.082368 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:20.088744 18362 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:20.089867 18488 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:20.091295 18293 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:20.108610 18447 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.131935 15232 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:20.132759 15232 pending_rounds.cc:85] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 7
I20260709 13:09:20.133230 15232 pending_rounds.cc:107] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:20.133637 15232 raft_consensus.cc:2889] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.135141 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:20.141782 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:20.028887 15129 rpcz_store.cc:269] 0709 13:08:55.198358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.206675 (+  8317us) service_pool.cc:224] Handling call
0709 13:09:20.014362 (+24807687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:14.106716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:14.291234 (+184518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:14.296497 (+  5263us) write_op.cc:435] Acquired schema lock
0709 13:09:14.302653 (+  6156us) tablet.cc:662] Decoding operations
0709 13:09:14.711559 (+408906us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:14.719992 (+  8433us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:14.727600 (+  7608us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:14.856328 (+128728us) tablet.cc:701] Row locks acquired
0709 13:09:14.856372 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:09:14.856582 (+   210us) write_op.cc:270] Start()
0709 13:09:14.856734 (+   152us) write_op.cc:276] Timestamp: P: 1783602554856516 usec, L: 0
0709 13:09:14.856751 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:09:15.425256 (+568505us) log.cc:844] Serialized 4417 byte log entry
0709 13:09:16.476425 (+1051169us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:16.680962 (+204537us) op_driver.cc:464] REPLICATION: finished
0709 13:09:16.839396 (+158434us) write_op.cc:301] APPLY: starting
0709 13:09:16.857249 (+ 17853us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:16.936033 (+ 78784us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:16.936081 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:16.937986 (+  1905us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:16.938501 (+   515us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:09:16.938581 (+    80us) write_op.cc:312] APPLY: finished
0709 13:09:17.083379 (+144798us) log.cc:844] Serialized 83 byte log entry
0709 13:09:17.114243 (+ 30864us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.154402 (+ 40159us) write_op.cc:454] Released schema lock
0709 13:09:17.154500 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:17.155112 (+   612us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.155142 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":160088,"reported_tablets":37,"spinlock_wait_cycles":514688,"child_traces":[["op",{"apply.queue_time_us":107800,"apply.run_cpu_time_us":7774,"apply.run_wall_time_us":344771,"num_ops":11,"prepare.queue_time_us":114953,"prepare.run_cpu_time_us":73742,"prepare.run_wall_time_us":1746403,"raft.queue_time_us":55626,"raft.run_cpu_time_us":19212,"raft.run_wall_time_us":69664,"replication_time_us":1823970,"spinlock_wait_cycles":58552704,"thread_start_us":519196,"threads_started":4,"wal-append.queue_time_us":928968,"wal-append.run_cpu_time_us":21548,"wal-append.run_wall_time_us":1803733}]]}
I20260709 13:09:20.129568 18475 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:20.117039 18408 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:20.128089 18488 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:20.168689 15128 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:20.161161 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 408619us
I20260709 13:09:20.160205 18517 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:20.178663 18517 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:20.179085 18517 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.179174 18475 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:20.180409 18475 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:20.185070 18512 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:09:20.184522 18408 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:20.186887 18473 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:20.187279 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:20.188876 18473 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.189445 18473 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:20.189149 18433 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:20.190699 18433 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:20.190929 15303 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:20.191103 18433 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:20.192273 15304 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:20.192502 15305 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:20.200309 15273 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.713s (SENT)
I20260709 13:09:20.200953 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:20.169863 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 255292us
W20260709 13:09:20.206174 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71179.5us
I20260709 13:09:20.206929 15128 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 4, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 4 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.161634 18377 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:20.216177 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:20.198257 16001 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:20.217097 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 460875us
I20260709 13:09:20.221179 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:20.227437 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:20.229066 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:20.124853 18465 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:20.192041 18433 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:20.206611 18457 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:20.340104 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 127279us
I20260709 13:09:20.233072 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:20.431210 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 670490us
W20260709 13:09:20.432437 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 254580us
W20260709 13:09:20.433673 15273 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.730s (SENT)
I20260709 13:09:20.434625 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:20.197754 18473 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:20.327966 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.339864 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.275939 15302 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.010s
W20260709 13:09:20.445902 15302 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.016s	sys 0.017s
I20260709 13:09:20.438597 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:20.332728 15128 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 4 to 7, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:20.210120 18258 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:09:20.484992 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46598.1us
W20260709 13:09:20.486533 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.481634 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 167058us
I20260709 13:09:20.442515 18515 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.423861 18308 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:20.521510 18483 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:20.438664 18408 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:20.405267 18488 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:20.271443 18519 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.268s
I20260709 13:09:20.339366 18518 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.250s
W20260709 13:09:20.581810 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48676.6us
W20260709 13:09:20.646839 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 214550us
W20260709 13:09:20.646463 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 212836us
W20260709 13:09:20.635478 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.601845 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.648592 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 123104us
W20260709 13:09:20.646229 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 154208us
I20260709 13:09:20.497151 15128 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 2 to 3, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:20.654459 15273 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.804s (SENT)
I20260709 13:09:20.655045 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:20.656786 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 158227us
I20260709 13:09:20.661067 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:20.666352 15128 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.686291 15301 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:20.545943 18308 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:20.622648 18258 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.630700 18408 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:20.791414 18408 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:20.794384 18408 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:20.736867 15128 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.583509 18494 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 13:09:20.752552 18520 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:09:20.753791 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 100254us
W20260709 13:09:20.769935 18529 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:09:20.770263 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 550726us
W20260709 13:09:20.771173 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 116744us
W20260709 13:09:20.814960 15273 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.809s (SENT)
I20260709 13:09:20.501366 18522 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.227s
I20260709 13:09:20.532085 18475 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.207s
I20260709 13:09:20.785953 18457 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:20.664021 18495 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.807242 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1966) took 1078 ms. Trace:
I20260709 13:09:20.580049 18266 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:09:20.668689 18388 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.656523 18218 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:09:20.664151 18326 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:20.815480 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:20.740871 18377 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:20.853737 15228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.032s	sys 0.031s
W20260709 13:09:20.866562 15228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.032s	sys 0.031s
I20260709 13:09:20.868651 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:20.871488 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 162368us
I20260709 13:09:20.874816 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:20.875847 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:20.888659 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 234664us
I20260709 13:09:20.795672 18308 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:20.915109 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 249146us
I20260709 13:09:20.877926 18515 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.918102 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:20.921372 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:20.922387 15308 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:09:20.923781 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 108855us
W20260709 13:09:20.927930 15273 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.163s (SENT)
I20260709 13:09:20.928675 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:20.892328 18447 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.932668 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:20.937193 15305 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:09:20.939285 18549 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:09:20.884541 18541 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.940593 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:20.947806 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.040796 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.861588 18495 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:20.918805 18448 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:20.668876 18383 consensus_queue.cc:1175] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 7 status { last_received { term: 3 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: [6.5-6.5]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:09:21.068217 18542 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:09:21.068735 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 138715us
I20260709 13:09:21.072175 18326 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.075937 18091 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:21.036664 18377 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.035542 18308 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:21.136132 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.945493 18548 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.042659 18541 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:21.141286 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 205274us
I20260709 13:09:21.137156 18457 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.151392 18457 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:21.153568 15308 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:21.154004 18457 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:21.155458 18556 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:21.155927 16006 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:21.156792 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 226777us
W20260709 13:09:21.169381 18547 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:09:21.185937 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:21.098008 18397 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.090s	user 0.015s	sys 0.000s
I20260709 13:09:21.199105 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:21.195336 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46194.3us
I20260709 13:09:21.205947 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:21.161339 18541 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:21.197273 18369 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.086s	user 0.013s	sys 0.006s
I20260709 13:09:21.147936 18377 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:21.204289 18517 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.025s	user 0.009s	sys 0.006s
W20260709 13:09:21.220067 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.294302 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.212381 18448 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:21.302402 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60984.9us
I20260709 13:09:21.215035 18515 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.225134 18558 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.329782 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1991) took 1109 ms. Trace:
W20260709 13:09:21.321870 15373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.011s	sys 0.019s
I20260709 13:09:21.208823 18494 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
W20260709 13:09:21.321921 15306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.009s	sys 0.021s
I20260709 13:09:21.247478 18369 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:21.380070 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51879.7us
I20260709 13:09:21.201017 18397 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:21.300770 18457 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:21.321806 18473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.004s	sys 0.029s
W20260709 13:09:21.385087 15306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.013s	sys 0.025s
I20260709 13:09:21.331084 15303 rpcz_store.cc:276] 0709 13:09:20.220954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.221167 (+   213us) service_pool.cc:224] Handling call
0709 13:09:20.330994 (+109827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.413252 (+ 82258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.413305 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.434114 (+ 20809us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.839587 (+405473us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:20.839669 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.839783 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.329265 (+489482us) raft_consensus.cc:1685] finished
0709 13:09:21.329302 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.329678 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63623,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":6882,"thread_start_us":307381,"threads_started":1,"wal-append.queue_time_us":463283}
W20260709 13:09:21.385530 15373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.014s	sys 0.025s
I20260709 13:09:21.403215 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1961) took 1896 ms. Trace:
I20260709 13:09:21.291924 18517 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:21.406447 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1989) took 1190 ms. Trace:
I20260709 13:09:21.409226 15231 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:21.412149 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 226307us
I20260709 13:09:21.409539 15306 rpcz_store.cc:276] 0709 13:09:20.215623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.215772 (+   149us) service_pool.cc:224] Handling call
0709 13:09:20.218728 (+  2956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.218917 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:20.487022 (+268105us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.401068 (+914046us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.401165 (+    97us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:21.401243 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.401351 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.406345 (+  4994us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172580,"prepare.queue_time_us":298277,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":145,"thread_start_us":900442,"threads_started":2}
I20260709 13:09:21.403805 15373 rpcz_store.cc:276] 0709 13:09:19.506788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.511063 (+  4275us) service_pool.cc:224] Handling call
0709 13:09:19.511473 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.511742 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:19.759971 (+248229us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.402643 (+1642672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.402724 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:21.402813 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.402917 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.403110 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185235,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":306251,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":46789,"spinlock_wait_cycles":83840,"thread_start_us":1764543,"threads_started":3,"wal-append.queue_time_us":755355}
I20260709 13:09:21.413775 15375 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:21.415767 15225 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:21.397899 18473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.004s	sys 0.029s
I20260709 13:09:21.418221 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:21.379267 18091 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:09:21.427417 15373 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:21.434927 15377 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:21.438231 15373 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:21.438609 15379 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:21.387657 18553 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.178s
I20260709 13:09:21.448556 15374 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:21.427589 16000 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:21.446216 18258 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.465297 15374 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:21.417032 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:21.400899 18457 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:21.417292 18448 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:09:21.448841 18555 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.493600 15374 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:21.687826 18369 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:21.621285 18377 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:21.727340 18546 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:21.782706 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 363496us
W20260709 13:09:21.494478 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.842374 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.872324 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.494482 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92002.3us
W20260709 13:09:21.772487 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 353223us
W20260709 13:09:21.836651 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.837548 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:21.514638 18545 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:21.622958 18561 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:21.628242 16001 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:09:21.517475 18544 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.320s	user 0.001s	sys 0.001s
I20260709 13:09:21.836542 18397 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:21.875697 15376 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:21.516945 18557 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:09:21.518577 18385 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:21.889650 18385 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:21.890730 18385 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:21.621737 18517 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:21.886448 16006 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:09:21.842116 18555 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:21.874699 18218 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:21.586690 18388 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.296s
I20260709 13:09:21.877815 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 510) took 1833 ms. Trace:
I20260709 13:09:21.878103 18572 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:21.874361 18546 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:21.894085 18385 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.881342 18545 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:21.905606 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.897935 18218 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:21.906351 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.910152 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.910547 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.910851 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.911407 18218 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:21.908520 18572 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:21.911484 18567 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:21.913451 18517 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:21.914059 18572 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:21.914259 18517 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:21.918816 18377 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.920897 18377 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:21.926616 18517 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:21.904726 18541 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.665s	user 0.015s	sys 0.000s
I20260709 13:09:21.921090 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:21.937422 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:21.939947 18308 consensus_meta.cc:287] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.003s
I20260709 13:09:21.907110 18473 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.943982 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:21.908234 16000 rpcz_store.cc:276] 0709 13:09:20.043185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.047625 (+  4440us) service_pool.cc:224] Handling call
0709 13:09:20.081089 (+ 33464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.461640 (+1380551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.841920 (+380280us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54004edc54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:21.875755 (+ 33835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3045933440}
I20260709 13:09:21.950044 18473 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:21.951191 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:21.952805 18572 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.953060 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:21.953943 15303 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:21.954704 18457 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:21.929263 18541 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:21.957942 18541 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:21.958461 18473 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:21.959758 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1944) took 1905 ms. Trace:
I20260709 13:09:21.960295 15228 rpcz_store.cc:276] 0709 13:09:20.065369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.066773 (+  1404us) service_pool.cc:224] Handling call
0709 13:09:20.067279 (+   506us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:20.078200 (+ 10921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.078242 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:20.113995 (+ 35753us) log.cc:844] Serialized 52 byte log entry
0709 13:09:20.867953 (+753958us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:20.868003 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.868130 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.959474 (+1091344us) raft_consensus.cc:1685] finished
0709 13:09:21.959508 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.959678 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158,"raft.queue_time_us":4168,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":3920,"thread_start_us":753306,"threads_started":1,"wal-append.queue_time_us":949121}
I20260709 13:09:21.963907 18495 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:21.944667 18517 raft_consensus.cc:2764] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:09:21.967556 18433 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.967806 18555 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:21.972151 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:21.941449 18527 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:21.987246 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:21.996778 15225 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:21.991820 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.009136 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:22.013157 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 48910.8us
I20260709 13:09:22.020141 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:22.020756 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:22.027439 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76339.4us
I20260709 13:09:22.028668 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.026876 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.014391 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.053539 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:22.073877 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.074828 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:22.099025 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:22.068755 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.111817 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:22.113130 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.052047 18541 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:22.118279 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.123597 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.125012 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:22.126791 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48627.8us
W20260709 13:09:22.128054 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51160.5us
I20260709 13:09:22.077214 18579 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.026688 18227 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:09:22.013528 18527 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:22.126442 16004 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:09:22.123416 18574 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:09:22.139220 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.122473 18572 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:22.134147 18457 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.160537 18505 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.158674 16004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 307) took 1300 ms (client timeout 1561 ms). Trace:
I20260709 13:09:22.161302 18505 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:22.162106 16004 rpcz_store.cc:269] 0709 13:09:20.858021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.860437 (+  2416us) service_pool.cc:224] Handling call
0709 13:09:21.991609 (+1131172us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b5800003c98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:09:22.157734 (+166125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9820928}
W20260709 13:09:22.166311 18543 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.391s	user 0.006s	sys 0.004s
I20260709 13:09:22.168584 18527 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:22.170953 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.175288 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.152159 18581 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:22.222818 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 133261us
I20260709 13:09:22.156715 18541 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:22.227870 18572 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:22.196169 18408 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.237437 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:22.157186 18457 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.238454 15225 raft_consensus.cc:606] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:22.239003 15374 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:22.225308 18581 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:22.246863 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.230239 18266 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.269646 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.271034 15374 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:22.278419 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 118144us
I20260709 13:09:22.285494 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1969) took 2552 ms. Trace:
I20260709 13:09:22.286446 15300 rpcz_store.cc:276] 0709 13:09:19.733212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.733350 (+   138us) service_pool.cc:224] Handling call
0709 13:09:19.794454 (+ 61104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.900707 (+106253us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:20.104143 (+203436us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800335b60. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf 00007f2f53b40038
0709 13:09:20.216841 (+112698us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.460775 (+1243934us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b1800335b60. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287
0709 13:09:21.692250 (+231475us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.693042 (+   792us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.736735 (+ 43693us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.737043 (+   308us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:21.737103 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.740726 (+  3623us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.165473 (+424747us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:22.285114 (+119641us) raft_consensus.cc:1685] finished
0709 13:09:22.285160 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.285394 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1793,"prepare.queue_time_us":993402,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":106,"raft.queue_time_us":76644,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":26565,"spinlock_wait_cycles":114191488,"thread_start_us":765296,"threads_started":4,"wal-append.queue_time_us":444721}
I20260709 13:09:22.296458 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.240108 18408 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.312969 18581 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:22.315328 18581 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:22.317050 18562 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.317626 18562 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:22.317764 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.318104 18562 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:22.319171 18544 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:09:22.319272 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.320175 15378 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.320442 18572 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.320967 18572 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:22.321408 18572 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.321317 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.323064 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:22.323664 18568 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:22.324685 18505 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.324571 18495 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:22.325544 18295 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:22.326740 18495 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:22.326792 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.320205 18517 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:22.328156 15378 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:22.329092 18218 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.329691 18218 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.331795 15378 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.331903 18218 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.334414 18592 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:22.338336 18592 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:22.337646 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.339610 18517 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:22.340088 18517 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:22.340636 18517 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.340870 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:22.339491 18592 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:22.333743 18579 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:22.344717 15233 raft_consensus.cc:2410] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:22.348098 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.342155 18457 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:22.342505 15378 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:22.362190 18562 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.328145 18295 raft_consensus.cc:993] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:09:22.407469 15230 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:22.407648 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:22.254375 18266 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:22.425359 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49517.3us
I20260709 13:09:22.431756 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:22.441045 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.442204 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.440429 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:22.303846 18385 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:09:22.449620 15231 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:22.428733 18457 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:22.453606 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 112661us
I20260709 13:09:22.460191 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.462273 15382 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.444926 18295 raft_consensus.cc:1081] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:09:22.430864 15230 raft_consensus.cc:2955] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:22.419350 18572 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.430322 18433 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:09:20.852890 15302 rpcz_store.cc:276] 0709 13:09:19.728820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.728968 (+   148us) service_pool.cc:224] Handling call
0709 13:09:19.729225 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.729412 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:20.446864 (+717452us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.806333 (+359469us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.806587 (+   254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.806645 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:20.806718 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.806806 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.807184 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":702224,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":841,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":36626,"spinlock_wait_cycles":13839744,"thread_start_us":1075349,"threads_started":2}
I20260709 13:09:22.449095 18218 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:09:22.447934 18505 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:09:22.541414 18552 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.543985 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93136.2us
I20260709 13:09:22.558347 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:22.560186 15382 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:22.561069 15382 pending_rounds.cc:85] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 3
I20260709 13:09:22.561776 15382 pending_rounds.cc:107] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:22.562256 15382 raft_consensus.cc:2889] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:22.536377 18457 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.578562 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 118509us
I20260709 13:09:22.581084 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:22.583876 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1965) took 2957 ms. Trace:
I20260709 13:09:22.584444 15382 rpcz_store.cc:276] 0709 13:09:19.617642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.617976 (+   334us) service_pool.cc:224] Handling call
0709 13:09:19.626923 (+  8947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.461662 (+2834739us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400183920. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a9ba1d 00007f2f53a821a4 00007f2f53b04447 00007f2f53b1cfe7 00007f2f53b1e7de 00007f2f53b28b49 00007f2f53b29416 00007f2f53b25d8f 00007f2f53b2583e 00007f2f58aea419
0709 13:09:22.573992 (+112330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.575222 (+  1230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316953984}
I20260709 13:09:22.542258 18552 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.561251 18295 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:22.566139 18437 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.538285 18585 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.170s
I20260709 13:09:22.602658 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 1972) took 1203 ms. Trace:
I20260709 13:09:22.587114 18527 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:09:22.603397 15381 rpcz_store.cc:276] 0709 13:09:21.399608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.401887 (+  2279us) service_pool.cc:224] Handling call
0709 13:09:21.424786 (+ 22899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.875400 (+450614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.875431 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.875478 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:21.875540 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.602272 (+726732us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540014c8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:22.602350 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.602562 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035712384}
I20260709 13:09:22.593385 18295 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:22.575567 18583 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 13:09:22.608868 18572 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:22.608239 18295 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.611207 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.610780 18295 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.597512 18385 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.585816 18457 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.624096 18408 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.630934 18585 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:22.633183 18437 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:22.635739 18562 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:22.657413 18593 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:09:22.669130 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 1997) took 1920 ms. Trace:
I20260709 13:09:22.669687 15301 rpcz_store.cc:276] 0709 13:09:20.748699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.748938 (+   239us) service_pool.cc:224] Handling call
0709 13:09:20.749273 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.881714 (+132441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.881765 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.881826 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:20.881889 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.668796 (+1786907us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54003e1cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:22.668856 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.669046 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303697664}
I20260709 13:09:22.672735 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.668037 18377 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:22.653379 18437 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:22.678166 18437 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.694010 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.646930 18585 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:22.652833 18266 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:22.704273 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.704807 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.705641 15375 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:22.705652 15381 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:22.698828 18377 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.705837 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.709153 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:22.708102 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.709998 15379 raft_consensus.cc:2410] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:22.710461 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:22.667994 18457 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:22.696795 18597 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 13:09:22.715337 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:22.713294 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:22.720741 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:22.721354 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.722924 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.701694 18585 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.699151 18408 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:22.722056 15379 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:09:22.725993 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 143880us
I20260709 13:09:22.731930 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.732805 15379 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:22.681571 18517 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.717801 18377 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.742095 18377 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.743162 18377 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.743763 18377 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.746397 18377 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.737829 18408 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.785277 18552 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.787776 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.803081 18517 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:22.806998 18585 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:22.807910 18546 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.809633 18408 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:22.811195 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.811514 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:22.812937 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 81545.3us
W20260709 13:09:22.800374 15273 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.563s (SENT)
I20260709 13:09:22.818694 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.819235 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.821568 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.822340 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.823632 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.823994 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.824471 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.825451 18615 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:22.827169 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.828761 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.831341 18437 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:22.832077 18522 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:22.787830 18528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.952s	user 0.012s	sys 0.018s
I20260709 13:09:22.837204 18295 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:22.840731 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.850832 15381 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:22.851193 15382 raft_consensus.cc:2368] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:22.865810 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.851676 15376 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:22.852309 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.853561 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.852826 15375 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:22.850523 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50268.3us
I20260709 13:09:22.852639 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.867219 15380 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:22.868032 15273 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.669s (SENT)
I20260709 13:09:22.868510 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.864673 15379 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:09:22.873611 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:22.874375 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.860836 18615 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.877208 18615 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:22.881204 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.882587 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.883615 15380 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:22.885195 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.886368 15379 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:22.887858 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.889639 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:22.882930 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:22.891253 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.891829 15381 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:22.862354 18528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.087s	user 0.012s	sys 0.019s
I20260709 13:09:22.838332 18585 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:22.897277 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.860847 18408 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.898243 15374 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:22.898731 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:22.899081 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.899521 15224 raft_consensus.cc:606] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:22.898857 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.899542 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.900858 15382 raft_consensus.cc:2368] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:22.904484 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.905542 15374 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:22.905695 15380 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:22.906117 15378 raft_consensus.cc:2410] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:22.907857 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.929025 15379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
I20260709 13:09:22.864297 18546 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:22.930212 15379 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.903251 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:22.937577 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47386 (request call id 82) took 16332 ms. Trace:
I20260709 13:09:22.938228 15230 rpcz_store.cc:276] 0709 13:09:06.605218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.629320 (+ 24102us) service_pool.cc:224] Handling call
0709 13:09:07.146628 (+517308us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b54004c02a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa3520 00007f2f53b2cb42 00007f2f53b2b800 00007f2f53b249fa 00007f2f58aec4c9 00007f2f52068c54 00007f2f52068be2 00007f2f52068b11 00007f2f52068a8c 00007f2f52067d42
0709 13:09:07.158941 (+ 12313us) log.cc:844] Serialized 501 byte log entry
0709 13:09:07.363630 (+204689us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b1800482320. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53a7fb0b 00007f2f53b04b63 00007f2f53b2c752 00007f2f53b249fa
0709 13:09:22.937429 (+15573799us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140409,"raft.queue_time_us":150400,"raft.run_cpu_time_us":1634,"raft.run_wall_time_us":13889,"spinlock_wait_cycles":110052096,"thread_start_us":49896,"threads_started":1,"wal-append.queue_time_us":86141,"wal-append.run_cpu_time_us":4320,"wal-append.run_wall_time_us":1154705}
I20260709 13:09:22.934343 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.940125 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:22.940285 15374 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:22.935114 15379 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.890635 18377 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:22.943575 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dc5a1ea32aef45d1b6e1ff8b0718d178 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:22.944969 18437 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:22.951644 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:22.952921 15375 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:22.960846 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:22.961799 15300 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:09:22.960063 18113 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:22.970803 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:22.979255 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 97238.5us
I20260709 13:09:22.979832 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:22.980188 15273 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.727s (SENT)
I20260709 13:09:22.980809 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:22.988719 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:23.025315 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45145.2us
W20260709 13:09:23.026362 15273 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.565s (SENT)
I20260709 13:09:23.026970 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:23.028160 18617 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:23.029804 15273 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.568s (SENT)
I20260709 13:09:23.033716 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:23.019279 15379 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:09:23.035331 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 46701.9us
I20260709 13:09:23.039443 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:23.002544 18447 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.003084 18377 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:22.960932 18546 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:22.998904 18408 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.051661 15379 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:23.053501 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:23.059998 15273 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.781s (SENT)
I20260709 13:09:23.060614 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:23.054514 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:23.036512 18617 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.055932 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:23.063508 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:23.081395 15273 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.316s (SENT)
I20260709 13:09:23.079411 18447 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.088543 18609 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:23.089665 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:23.080585 18465 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:23.100733 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.103962 15379 raft_consensus.cc:2410] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:23.105926 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.107550 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.089229 18609 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:23.122220 15273 connection.cc:256] RPC call timeout handler was delayed by -1.4521251740000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:09:23.092439 18447 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:23.130497 15273 connection.cc:256] RPC call timeout handler was delayed by -1.4285134140000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24430000000000002s for a response
I20260709 13:09:23.134917 18377 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:23.135394 18617 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.135596 18377 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.135950 18617 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.138108 18617 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:23.132207 18408 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.139590 18408 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.142675 18408 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:23.145750 18619 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:09:23.153338 18546 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:23.109519 18465 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.155042 18465 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:23.166951 18618 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:09:23.172883 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.088562 18601 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:09:23.174456 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.175978 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.177127 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.177837 15378 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:23.178540 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.179113 15378 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:23.179894 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:23.180330 15378 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.131590 18609 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.189990 18377 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:23.194868 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.201025 15306 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:23.167022 18488 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.206467 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:23.208837 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.211035 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.211347 18496 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:23.213532 18496 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:23.214375 18496 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.215639 18496 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.229717 15379 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:23.245002 15374 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:23.265560 15378 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:23.266237 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.269747 15303 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:09:23.273114 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.274613 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.275190 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.275864 15303 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:23.276825 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.275470 15378 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:23.282204 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.285161 15374 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:23.298470 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.312674 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.337285 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.311614 15302 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:23.354295 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.357748 15374 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:23.358955 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:23.367085 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.370514 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:23.379364 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:23.383749 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.384647 15374 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:23.405238 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.406687 15374 raft_consensus.cc:2410] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:23.381155 18546 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:23.421227 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.421456 15273 connection.cc:256] RPC call timeout handler was delayed by -1.3215071200000921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 13:09:23.426723 15273 connection.cc:256] RPC call timeout handler was delayed by -1.3103440950000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25510000000000005s for a response
W20260709 13:09:23.427601 15273 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.724s (SENT)
I20260709 13:09:23.429126 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:23.430019 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.392004 18541 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:23.437669 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:23.443066 15273 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.858s (SENT)
I20260709 13:09:23.443725 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:23.445050 15374 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:23.424908 18629 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:09:23.474237 15273 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.865s (SENT)
I20260709 13:09:23.474869 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:23.434226 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:23.477747 15306 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:23.480615 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:23.470417 18627 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:09:23.480005 18377 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.470043 18447 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.481932 15374 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:23.487095 15273 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.891s (SENT)
I20260709 13:09:23.497213 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:23.483130 18625 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:09:23.434602 18546 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.524978 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 294) took 2316 ms. Trace:
I20260709 13:09:23.525648 15305 rpcz_store.cc:276] 0709 13:09:21.208835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.516753 (+2307918us) service_pool.cc:224] Handling call
0709 13:09:23.524313 (+  7560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.524552 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.524581 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.524626 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.524659 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.524727 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.524893 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.452700 18541 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:23.539081 15307 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:23.542176 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2000) took 2465 ms. Trace:
I20260709 13:09:23.542656 15307 rpcz_store.cc:276] 0709 13:09:21.077038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.530627 (+2453589us) service_pool.cc:224] Handling call
0709 13:09:23.531035 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.539698 (+  8663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.542088 (+  2390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.510167 18433 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:23.545817 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:23.548606 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.552191 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 295) took 2326 ms. Trace:
I20260709 13:09:23.554793 15307 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:23.555253 15299 rpcz_store.cc:276] 0709 13:09:21.226070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.535764 (+2309694us) service_pool.cc:224] Handling call
0709 13:09:23.551460 (+ 15696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.551718 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.551768 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.551832 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:23.551893 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.551968 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.552105 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.565665 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.567087 15307 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:23.538030 18377 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.566767 15299 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:23.570936 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 1948) took 3348 ms. Trace:
W20260709 13:09:23.572788 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.577437 15226 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:23.579815 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:23.581066 18628 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:09:23.583568 18626 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:09:23.609902 15233 rpcz_store.cc:276] 0709 13:09:20.215526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.215772 (+   246us) service_pool.cc:224] Handling call
0709 13:09:23.560803 (+3345031us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54002e2a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:23.563371 (+  2568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4887901952}
I20260709 13:09:23.613574 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.586170 18541 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:23.588944 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:23.596834 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.603705 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:23.607242 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.561738 18632 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.608932 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.621732 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:23.602576 18465 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:23.623021 15373 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:23.543682 18609 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.628132 15373 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.628013 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:23.629305 16000 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:23.563542 18433 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:23.637811 15376 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:23.640036 15227 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:23.632308 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:23.675796 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 188735us
W20260709 13:09:23.676656 15273 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.933s (SENT)
I20260709 13:09:23.677126 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:23.680465 15273 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.966s (SENT)
I20260709 13:09:23.682716 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:23.635516 18113 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:23.664901 18377 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.671945 18483 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.706643 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72123.2us
I20260709 13:09:23.712052 15375 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:23.714501 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70332.7us
I20260709 13:09:23.720677 15382 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.707461 18630 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.706554 18641 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.714246 18113 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.709313 18640 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.717901 18496 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:09:23.739130 18461 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:23.767839 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48752.9us
I20260709 13:09:23.729749 18377 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:23.759140 18541 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:23.791414 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:23.766079 18440 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:23.818938 18377 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:23.829708 18433 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:23.831874 15299 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:23.735399 18483 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:23.835654 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 44350.7us
I20260709 13:09:23.776916 18461 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:23.769963 18601 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:23.769069 18640 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:23.858996 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 515) took 1806 ms. Trace:
I20260709 13:09:23.813764 18546 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:23.859512 15999 rpcz_store.cc:276] 0709 13:09:22.052229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.052415 (+   186us) service_pool.cc:224] Handling call
0709 13:09:22.069450 (+ 17035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.073236 (+  3786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.073268 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.593487 (+1520219us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b2c00012a88. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:09:23.593990 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.736837 (+142847us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:23.743133 (+  6296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.743503 (+   370us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.856847 (+113344us) raft_consensus.cc:1685] finished
0709 13:09:23.856870 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.858792 (+  1922us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2731,"raft.queue_time_us":4031,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":13444,"spinlock_wait_cycles":9589120,"thread_start_us":142361,"threads_started":1,"wal-append.queue_time_us":221346}
I20260709 13:09:23.861300 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:23.862380 16007 raft_consensus.cc:2410] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:23.863449 15374 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:23.859095 18461 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.864953 18461 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.867372 18266 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:23.867870 18266 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:23.869328 18465 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:23.876965 15374 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:23.833611 18541 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:23.848315 18377 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:23.858340 18624 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:23.889179 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:23.893822 15305 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.897783 18545 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:23.900281 18433 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:23.900828 18433 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:23.901746 18433 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:23.887841 18293 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:09:23.905879 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 403) took 1628 ms. Trace:
I20260709 13:09:23.906360 15231 rpcz_store.cc:276] 0709 13:09:22.277403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.277657 (+   254us) service_pool.cc:224] Handling call
0709 13:09:22.278180 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.451452 (+173272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.905581 (+1454129us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540012f7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:23.905805 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393083264}
I20260709 13:09:23.910742 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2016) took 1003 ms. Trace:
W20260709 13:09:23.891014 18638 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.255s	user 0.001s	sys 0.001s
W20260709 13:09:23.926138 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 238466us
W20260709 13:09:23.927054 15273 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.098s (SENT)
W20260709 13:09:23.928076 15273 leader_election.cc:336] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.161s (SENT)
I20260709 13:09:23.914039 15381 rpcz_store.cc:276] 0709 13:09:22.907553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.644687 (+737134us) service_pool.cc:224] Handling call
0709 13:09:23.645422 (+   735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.646105 (+   683us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:23.715588 (+ 69483us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.910396 (+194808us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.910452 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:23.910505 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.910571 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.910684 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2774,"prepare.queue_time_us":61090,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":5135,"raft.queue_time_us":118130,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":241198,"threads_started":3,"wal-append.queue_time_us":142078}
I20260709 13:09:23.928519 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:23.929961 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.930341 15273 connection.cc:256] RPC call timeout handler was delayed by -1.0803831650000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27480000000000004s for a response
W20260709 13:09:23.908227 18637 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.273s	user 0.000s	sys 0.002s
I20260709 13:09:23.935530 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.938864 15300 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:23.939785 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:23.941998 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 164281us
I20260709 13:09:23.945629 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:23.946568 15999 raft_consensus.cc:2368] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
I20260709 13:09:23.949198 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.949673 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:23.950662 15307 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.894121 18609 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:23.957039 18554 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:23.944149 18266 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.933562 18362 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:23.980715 18362 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:23.933219 18545 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.985498 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:23.985245 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:23.947911 18645 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.112s	user 0.006s	sys 0.000s
I20260709 13:09:23.970286 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.001047 15300 raft_consensus.cc:2410] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:23.972672 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.001533 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:23.975705 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.002943 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:23.963372 18554 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:23.944322 18377 raft_consensus.cc:476] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:23.987735 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:24.004616 18554 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:24.005532 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:23.986050 18266 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.006141 18554 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.006912 18483 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:23.983518 18362 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:23.994633 18541 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:23.975577 18644 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:24.003044 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.014070 15308 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:24.015372 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:24.015911 18609 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.016458 18609 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.016806 18609 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.018208 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.019553 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.020687 18552 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.020764 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 407) took 1614 ms. Trace:
I20260709 13:09:24.021729 15227 rpcz_store.cc:276] 0709 13:09:22.406478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.407266 (+   788us) service_pool.cc:224] Handling call
0709 13:09:24.020582 (+1613316us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400359dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:24.020679 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2807756672}
I20260709 13:09:23.960688 15305 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:24.023564 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.024694 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.024879 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:24.025444 15300 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:09:24.024830 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.033950 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.025511 15377 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.027894 18312 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:24.003209 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.015059 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.026576 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.036284 15305 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:24.050390 15308 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:24.050750 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:23.988646 15307 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:24.051390 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.052475 15307 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:24.032333 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:24.012113 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.065809 15308 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:24.070015 18654 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.071692 18552 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:24.071992 18555 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:24.072721 18555 consensus_queue.cc:1243] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:09:24.077409 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.077643 18312 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.078848 18494 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:24.078485 18312 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.079504 18494 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.081454 18312 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:24.082306 18518 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.082860 18518 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.086920 18518 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:24.088290 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.089011 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:24.092393 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:24.089564 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:24.098699 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:24.100091 15375 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.100801 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:24.064666 18615 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:24.119200 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.119511 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:24.121277 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.113947 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:24.122284 15378 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:24.122354 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:24.120225 15305 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:24.117782 18494 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:24.127480 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.128255 15308 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.129917 15377 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:24.132650 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2018) took 1167 ms. Trace:
I20260709 13:09:24.133141 15377 rpcz_store.cc:276] 0709 13:09:22.965756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.024582 (+1058826us) service_pool.cc:224] Handling call
0709 13:09:24.132577 (+107995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.136965 15380 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:24.138640 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:24.111523 18583 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.156898 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:24.158092 15229 raft_consensus.cc:2368] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:24.125460 18488 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:09:24.160250 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.162107 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2015) took 1256 ms. Trace:
I20260709 13:09:24.165297 15373 rpcz_store.cc:276] 0709 13:09:22.905262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.642967 (+737705us) service_pool.cc:224] Handling call
0709 13:09:23.643468 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.643804 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:23.646919 (+  3115us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.018743 (+371824us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b180035ecc0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:09:24.159987 (+141244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.160065 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.160148 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.160249 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.162025 (+  1776us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2667,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3891,"spinlock_wait_cycles":42263424,"thread_start_us":140890,"threads_started":1}
I20260709 13:09:24.165391 15300 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:24.168960 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.180042 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.180962 15300 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.149484 18583 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:24.178443 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:24.202343 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:24.196230 15308 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:24.149490 18113 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.154663 18641 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:09:24.175873 18461 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:24.214223 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65178.9us
I20260709 13:09:24.217366 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:24.213101 15375 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:24.191403 18545 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.200634 18312 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.197139 18505 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:24.229344 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 90847.1us
I20260709 13:09:24.231365 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.198480 18583 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.237610 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:24.241349 18113 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:24.222157 18641 consensus_queue.cc:1243] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:24.253885 15308 raft_consensus.cc:1217] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-8.6]   Dedup: 3.3->[5.4-8.6]
W20260709 13:09:24.257198 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.257464 15308 pending_rounds.cc:85] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 3
I20260709 13:09:24.257854 15308 pending_rounds.cc:107] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:09:24.258116 15308 raft_consensus.cc:2889] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:24.234337 18312 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.234014 18505 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.278339 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:24.282894 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51654.7us
I20260709 13:09:24.284305 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.289950 15973 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:09:24.293002 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54439.5us
I20260709 13:09:24.231207 18461 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.260942 18546 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.282624 18312 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.329214 18546 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.314648 18670 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:24.337246 18663 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:24.292851 18505 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:24.339594 15274 leader_election.cc:400] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
I20260709 13:09:24.363371 15274 leader_election.cc:403] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:24.341529 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.366603 15300 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:24.367154 15305 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
W20260709 13:09:24.357875 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 73713us
I20260709 13:09:24.379701 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:24.380482 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:24.366348 18662 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:09:24.383502 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:24.384747 15229 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:24.388211 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:24.391815 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.396575 15348 leader_election.cc:400] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:24.397022 15348 leader_election.cc:403] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:24.399715 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:24.411574 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.528s (SENT) [suppressed 29 similar messages]
I20260709 13:09:24.416628 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.379074 18670 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:24.418821 18670 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.429201 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.431406 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:24.431726 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:24.376571 18682 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
W20260709 13:09:24.433923 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48713.3us
I20260709 13:09:24.394935 18520 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.413744 18572 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.455528 18326 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.455113 18520 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.500151 18461 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:24.413360 18632 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:24.402997 18677 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.441522 15229 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
W20260709 13:09:24.565382 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 136274us
W20260709 13:09:24.565869 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 153538us
I20260709 13:09:24.564592 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:24.573541 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.582221 18541 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:24.585559 18541 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:24.563128 18671 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
W20260709 13:09:24.570946 18609 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.547s	user 0.017s	sys 0.003s
W20260709 13:09:24.579106 18266 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.572s	user 0.020s	sys 0.003s
W20260709 13:09:24.571429 18665 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.250s	user 0.003s	sys 0.000s
I20260709 13:09:24.558511 18641 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.590838 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.570358 18520 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.557916 18326 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:24.597141 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:24.631503 15224 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:24.630039 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.609738 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.586957 18461 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:24.592190 18682 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.596468 18632 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.621484 18659 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:24.621606 18677 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:24.598069 18609 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.629521 18541 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:24.703447 15199 connection.cc:256] RPC call timeout handler was delayed by -1.057099911000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 13:09:24.639962 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 238053us
I20260709 13:09:24.642009 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.718932 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:24.723245 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:24.648164 15226 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:24.648910 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:24.633430 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 251406us
I20260709 13:09:24.619917 15233 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:24.663219 15231 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
W20260709 13:09:24.726516 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84633.9us
I20260709 13:09:24.727828 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.692991 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:24.729615 15228 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:09:24.628175 18433 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.595502 18687 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.697149 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:24.636260 18326 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.588158 18583 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.701864 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:24.724371 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 274955us
I20260709 13:09:24.712990 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:24.698596 18558 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:09:24.644325 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:24.755924 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 135622us
I20260709 13:09:24.697429 18677 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:24.714200 18461 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:24.721906 18682 raft_consensus.cc:2764] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:24.760313 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:24.766474 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.721290 18690 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.762462 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:24.700376 18659 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:24.762650 18685 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.745353 18113 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.721783 18519 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:09:24.777189 15225 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:24.768308 18677 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.823429 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:24.824102 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:24.824240 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:24.826133 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:24.825803 18461 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:24.817289 18113 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:24.768452 18541 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:24.833015 15378 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:24.832829 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:24.798454 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:24.845254 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2024) took 1462 ms. Trace:
I20260709 13:09:24.849733 15306 rpcz_store.cc:276] 0709 13:09:23.383109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.484715 (+101606us) service_pool.cc:224] Handling call
0709 13:09:23.486668 (+  1953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.521227 (+ 34559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.521262 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.521313 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.521354 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.844927 (+1323573us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b540017a554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:24.844995 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.845174 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78880512}
I20260709 13:09:24.839404 18362 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:24.891127 18640 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:24.892478 18505 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.516s	user 0.016s	sys 0.000s
I20260709 13:09:24.893524 18505 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:24.895927 18113 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:24.845218 18541 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:24.897297 18541 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.897704 18505 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:24.920822 15224 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
W20260709 13:09:24.918394 18688 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.205s	user 0.002s	sys 0.000s
I20260709 13:09:24.933161 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:24.979818 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:24.983458 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 253286us
W20260709 13:09:24.990155 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 245699us
I20260709 13:09:24.998672 15227 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
W20260709 13:09:25.001032 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74157us
W20260709 13:09:24.990648 18694 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.094s	user 0.004s	sys 0.000s
I20260709 13:09:25.010174 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:24.982857 18519 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:25.041517 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 254972us
W20260709 13:09:25.091184 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77699.7us
I20260709 13:09:25.043655 15348 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:25.098331 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 335990us
I20260709 13:09:25.099386 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:25.125128 18266 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:25.126688 18266 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:25.127121 18266 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:25.021466 18609 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:25.101799 18682 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.987929 18520 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.146572 18677 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.148666 15306 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:25.153861 15345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.012s	sys 0.008s
W20260709 13:09:25.113523 18662 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.712s	user 0.004s	sys 0.002s
I20260709 13:09:25.099679 18583 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:25.183920 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.173530 15345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.012s	sys 0.008s
I20260709 13:09:25.178294 15999 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:25.156791 18488 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.088251 18519 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.272807 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 299) took 2398 ms. Trace:
W20260709 13:09:25.279143 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46781.6us
W20260709 13:09:25.293164 18326 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.002s
I20260709 13:09:25.297065 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:25.294939 18488 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:25.296403 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 156941us
I20260709 13:09:25.310456 18682 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.290046 15301 rpcz_store.cc:276] 0709 13:09:22.874685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.874955 (+   270us) service_pool.cc:224] Handling call
0709 13:09:22.875431 (+   476us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:22.875963 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:23.998549 (+1122586us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b18003127c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf
0709 13:09:23.998740 (+   191us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.102332 (+103592us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:24.107217 (+  4885us) log.cc:844] Serialized 52 byte log entry
0709 13:09:24.107419 (+   202us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.107752 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.108086 (+   334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.108169 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.337117 (+228948us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b18003127c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:09:25.089983 (+752866us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b24001c8818. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a7809d 00007f2f536aa10e 00007f2f536c188c 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221
0709 13:09:25.272543 (+182560us) raft_consensus.cc:1685] finished
0709 13:09:25.272568 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.272738 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111032,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":103,"raft.queue_time_us":4711,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":30938,"spinlock_wait_cycles":56458752,"thread_start_us":128919,"threads_started":2,"wal-append.queue_time_us":175767}
I20260709 13:09:25.178932 18687 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:25.180920 18572 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.621s	user 0.014s	sys 0.001s
I20260709 13:09:25.297284 18326 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.314002 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:25.225524 18659 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:25.128368 18266 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:25.274547 18312 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.907s	user 0.012s	sys 0.003s
I20260709 13:09:25.306061 18630 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.166489 18654 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.141s
W20260709 13:09:25.264781 18615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.040s	sys 0.041s
W20260709 13:09:25.269693 18696 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:09:25.334625 18707 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:25.338140 15380 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:25.192754 18617 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.219549 18690 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.350049 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:09:25.299114 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.357455 15379 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:25.365029 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 265763us
I20260709 13:09:25.400300 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:25.404807 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:25.406642 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:25.335376 18572 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:25.351078 18554 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.346990 18659 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.353713 18630 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.422605 18488 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:25.423105 18326 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:25.335554 18687 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.427112 18687 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:25.407383 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:25.430457 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:25.413257 18682 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:25.337451 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 293889us
I20260709 13:09:25.409274 18679 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.434126 18708 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.435009 18708 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.423122 18630 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.437193 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2046) took 1309 ms. Trace:
I20260709 13:09:25.441813 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:25.443454 18687 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:25.449198 18519 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:25.421800 18659 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.452116 18659 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:25.452996 18679 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.433532 18682 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.458758 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:25.459874 16004 raft_consensus.cc:2368] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11.
I20260709 13:09:25.418910 18461 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.437628 15308 rpcz_store.cc:276] 0709 13:09:24.127319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.219066 (+ 91747us) service_pool.cc:224] Handling call
0709 13:09:24.249785 (+ 30719us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:09:24.382219 (+132434us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:24.432306 (+ 50087us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.102361 (+670055us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:25.277919 (+175558us) log.cc:844] Serialized 78 byte log entry
0709 13:09:25.278170 (+   251us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:25.278483 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.435636 (+157153us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18003cf760. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f536dcd70 00007f2f536d0293 00007f2f536c5cea 00007f2f536c623a 00007f2f53b30a2a 00007f2f53b400bf 00007f2f53b40038
0709 13:09:25.436157 (+   521us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.436484 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.436773 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.436880 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.436931 (+    51us) raft_consensus.cc:1685] finished
0709 13:09:25.436948 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.437120 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":428379,"prepare.queue_time_us":72131,"prepare.run_cpu_time_us":272,"prepare.run_wall_time_us":275,"raft.queue_time_us":369621,"raft.run_cpu_time_us":661,"raft.run_wall_time_us":17335,"spinlock_wait_cycles":27219328,"thread_start_us":480870,"threads_started":2,"wal-append.queue_time_us":554680}
I20260709 13:09:25.470546 15379 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:25.389317 18266 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.352596 18312 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.477001 15348 leader_election.cc:400] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11.
I20260709 13:09:25.479740 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:25.480273 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:25.482990 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:25.485183 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:25.474053 15375 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:25.491215 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:25.519445 15348 leader_election.cc:403] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.521023 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:25.409399 18707 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:25.517844 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 96751.7us
I20260709 13:09:25.387912 18617 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.528956 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:25.529183 18495 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:25.554566 18707 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.552047 18617 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:25.394358 18690 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:25.560245 18641 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.930s	user 0.009s	sys 0.006s
I20260709 13:09:25.573446 18641 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.532524 15229 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:25.493887 18630 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.536968 18677 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:25.537508 18708 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:25.546818 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:25.530517 18700 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:09:25.569211 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1961) took 1291 ms. Trace:
I20260709 13:09:25.724020 15227 rpcz_store.cc:276] 0709 13:09:24.277799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.278004 (+   205us) service_pool.cc:224] Handling call
0709 13:09:25.568957 (+1290953us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003ffcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:25.569120 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558639360}
I20260709 13:09:25.524528 15305 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.587984 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 111231us
I20260709 13:09:25.531611 18312 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:25.729521 18520 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:25.562573 18541 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.665s	user 0.014s	sys 0.000s
I20260709 13:09:25.722368 15299 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.741449 18541 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.743229 15378 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:25.656788 18702 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11.
W20260709 13:09:25.748292 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 201613us
I20260709 13:09:25.757208 18659 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.758705 18630 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:25.758266 18659 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.761741 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:25.762723 15380 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:25.762993 18659 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:25.776759 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:25.777133 15305 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:25.777685 15377 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:25.790355 18690 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:25.803704 18541 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:25.807093 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:25.767385 18312 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:25.809652 18312 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:25.812027 18630 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.812912 18630 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.815713 18630 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:25.811218 18312 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.826825 18630 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:25.827517 18630 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:25.842795 18520 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:25.844738 18520 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:25.844031 15118 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:25.845311 18520 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:25.846122 15373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.038s	sys 0.045s
W20260709 13:09:25.846506 15373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.038s	sys 0.045s
W20260709 13:09:25.856880 18640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.022s	sys 0.050s
I20260709 13:09:25.858976 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2040) took 1038 ms. Trace:
I20260709 13:09:25.859829 15373 rpcz_store.cc:276] 0709 13:09:24.820716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.843263 (+ 22547us) service_pool.cc:224] Handling call
0709 13:09:24.843756 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.844268 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:25.222940 (+378672us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.858139 (+635199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.858378 (+   239us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:25.858467 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.858567 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.858875 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":426749,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":2608,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":142,"thread_start_us":941459,"threads_started":2}
I20260709 13:09:25.878186 18719 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:25.879268 18719 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.880532 18716 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:25.881273 18683 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.134s	user 0.000s	sys 0.018s
I20260709 13:09:25.881450 18716 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.884881 18719 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:25.894080 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 320759us
I20260709 13:09:25.846971 18520 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:25.902776 18520 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.921485 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2041) took 1100 ms. Trace:
I20260709 13:09:25.952087 15375 rpcz_store.cc:276] 0709 13:09:24.821138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.823065 (+  1927us) service_pool.cc:224] Handling call
0709 13:09:25.921131 (+1098066us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540023dcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:25.921326 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363117568}
W20260709 13:09:25.965225 15999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 525) took 1268 ms (client timeout 1612 ms). Trace:
W20260709 13:09:25.966053 15999 rpcz_store.cc:269] 0709 13:09:24.697000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.697161 (+   161us) service_pool.cc:224] Handling call
0709 13:09:25.964788 (+1267627us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54005b2cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:25.965082 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040114560}
W20260709 13:09:25.994022 15229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 415) took 1392 ms (client timeout 1693 ms). Trace:
W20260709 13:09:25.994758 15229 rpcz_store.cc:269] 0709 13:09:24.601788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.603741 (+  1953us) service_pool.cc:224] Handling call
0709 13:09:25.993608 (+1389867us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540043d354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:25.993879 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852467456}
I20260709 13:09:26.026278 18113 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:26.027094 18113 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:26.028944 18113 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.031044 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:26.042562 18684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.009s
W20260709 13:09:26.043277 18684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.000s	sys 0.010s
W20260709 13:09:26.052915 18615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.008s	sys 0.023s
W20260709 13:09:26.053710 18615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.008s	sys 0.023s
W20260709 13:09:26.057183 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.017s	sys 0.014s
W20260709 13:09:26.057468 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.058416 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.017s	sys 0.014s
W20260709 13:09:26.078800 15346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.016s	sys 0.011s
W20260709 13:09:26.079618 15346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.016s	sys 0.011s
I20260709 13:09:26.081229 18541 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:26.081961 18712 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:26.081967 18541 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.082880 18712 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.086984 18712 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:26.128639 18685 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:26.123466 18494 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:26.158432 18685 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.161502 18518 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:26.158864 18494 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:26.082118 15197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.007s	sys 0.024s
W20260709 13:09:26.165419 15197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.009s	sys 0.025s
I20260709 13:09:26.165643 15299 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:26.123521 18483 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.172752 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.175540 15305 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.180909 15302 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:09:26.149883 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.088189 18527 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.021s
I20260709 13:09:26.201599 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:09:26.183236 18266 consensus_meta.cc:287] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.002s
I20260709 13:09:26.164669 18113 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:26.154973 18697 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.791s	user 0.006s	sys 0.013s
W20260709 13:09:26.167471 18583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.009s	sys 0.007s
I20260709 13:09:26.228107 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:26.268154 15307 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.232237 18718 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:26.232633 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:26.154593 18541 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:26.153425 18716 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:26.259997 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 210726us
I20260709 13:09:26.234884 18689 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:26.250828 15304 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:09:26.222013 18527 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.020s	sys 0.028s
I20260709 13:09:26.221869 18698 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:09:26.265892 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98668.9us
I20260709 13:09:26.174433 18685 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:26.276330 15199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.006s	sys 0.008s
I20260709 13:09:26.187713 18483 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.153961 18630 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:26.309705 15199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.007s	sys 0.008s
W20260709 13:09:26.321744 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 915137us
I20260709 13:09:26.322824 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:26.275326 18583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.014s	sys 0.011s
I20260709 13:09:26.331323 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:26.333063 15225 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:26.314494 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.316566 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:26.334862 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:26.325153 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.326326 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:26.342190 15306 raft_consensus.cc:2368] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:26.338943 15303 raft_consensus.cc:2376] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:09:26.345082 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:26.354091 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.301402 18494 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:26.386435 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.296977 18396 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:26.347862 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:26.389058 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:26.391285 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 68610.5us
I20260709 13:09:26.404645 15199 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:26.394407 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:26.396064 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.406427 15303 raft_consensus.cc:2376] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:09:26.407141 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:26.317490 18433 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:26.415537 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:26.326709 18712 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.305737 18689 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:26.421404 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2054) took 1868 ms. Trace:
I20260709 13:09:26.384691 15304 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:26.428646 18689 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:26.430953 18712 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.343438 18715 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:26.412056 15302 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.413841 15307 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:26.414211 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:26.405012 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:26.449008 15231 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:26.281967 18718 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.418051 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:26.421886 15300 rpcz_store.cc:276] 0709 13:09:24.552966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.626733 (+ 73767us) service_pool.cc:224] Handling call
0709 13:09:24.627333 (+   600us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:24.628028 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.628058 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:24.647781 (+ 19723us) log.cc:844] Serialized 52 byte log entry
0709 13:09:25.043323 (+395542us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:25.112708 (+ 69385us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.826229 (+713521us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18003cf520. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287
0709 13:09:25.826476 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.826561 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.998814 (+172253us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:26.421112 (+422298us) raft_consensus.cc:1685] finished
0709 13:09:26.421142 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.421320 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68252,"prepare.queue_time_us":69404,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":221896,"raft.run_cpu_time_us":1294,"raft.run_wall_time_us":34643,"spinlock_wait_cycles":45910656,"thread_start_us":561973,"threads_started":2,"wal-append.queue_time_us":581042}
I20260709 13:09:26.419312 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:26.447796 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.447647 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:26.479146 18721 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:09:26.594420 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.969182 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:26.977768 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:26.978515 15377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.005s	sys 0.010s
I20260709 13:09:27.053109 18630 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:27.131959 15377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.006s	sys 0.011s
I20260709 13:09:26.978974 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:26.579005 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.959122 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 508814us
I20260709 13:09:26.416908 18396 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:26.435263 18433 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.150588 18519 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:26.901832 18312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.004s	sys 0.009s
W20260709 13:09:27.153033 18312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.329s	user 0.005s	sys 0.009s
I20260709 13:09:27.152225 18388 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:26.488373 18715 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.157933 18718 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:26.441045 18720 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.160390 18720 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.159020 18718 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:26.416374 18494 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.979702 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:27.037364 18654 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.037782 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:27.045492 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 745719us
I20260709 13:09:27.047397 18728 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.056658 18685 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.227682 18685 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.045655 15229 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:27.059690 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:27.234138 18685 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.235565 18685 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.236675 18685 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.151634 18519 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:27.032361 15305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.003s	sys 0.013s
I20260709 13:09:27.158986 18715 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:27.171746 18718 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.174156 18396 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.175933 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:27.177587 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:27.185580 18630 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:27.281116 15305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.005s	sys 0.013s
I20260709 13:09:27.187805 18433 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.170553 15231 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:27.199407 18712 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:27.203030 15299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1758) took 1720 ms (client timeout 1674 ms). Trace:
W20260709 13:09:27.221730 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.163920 18720 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.224617 15226 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:27.275642 15376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.020s	sys 0.026s
W20260709 13:09:27.333520 15376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.021s	sys 0.026s
I20260709 13:09:27.295149 18715 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:27.365010 18745 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:27.366660 18745 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.373210 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2055) took 1590 ms. Trace:
I20260709 13:09:27.373700 15377 rpcz_store.cc:276] 0709 13:09:25.782502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.782726 (+   224us) service_pool.cc:224] Handling call
0709 13:09:25.785932 (+  3206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.786255 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:26.164519 (+378264us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.372113 (+1207594us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.372461 (+   348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.372593 (+   132us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:27.372709 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.372909 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.373122 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1732,"prepare.queue_time_us":10110,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":1507944,"threads_started":3}
I20260709 13:09:27.372741 18715 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:27.288481 15299 rpcz_store.cc:269] 0709 13:09:25.482329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.482523 (+   194us) service_pool.cc:224] Handling call
0709 13:09:27.202380 (+1719857us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b54003e3ad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:27.202685 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120493824}
W20260709 13:09:27.402240 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.023s	sys 0.039s
W20260709 13:09:27.402976 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.023s	sys 0.039s
W20260709 13:09:27.403439 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 1.01968e+06us
W20260709 13:09:27.404052 15224 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.954s	user 0.006s	sys 0.039s
I20260709 13:09:27.425309 15224 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:27.426288 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1968) took 1008 ms. Trace:
I20260709 13:09:27.426946 15224 rpcz_store.cc:276] 0709 13:09:26.417586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.417742 (+   156us) service_pool.cc:224] Handling call
0709 13:09:27.426129 (+1008387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.422344 18396 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.423375 18433 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.403966 18734 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.994s	user 0.001s	sys 0.005s
I20260709 13:09:27.343290 18712 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.414512 18685 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.465368 18728 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:27.466456 18654 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.467770 18494 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.469990 18745 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.498333 18745 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.499233 18745 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.471127 18467 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:27.500555 18718 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.500831 18467 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:27.501510 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52265.2us
I20260709 13:09:27.480158 18750 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.503283 18750 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.472512 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:27.504803 18712 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.504993 18728 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.508030 18527 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.508814 18527 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.509259 18527 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.509434 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:27.473942 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 1969) took 1024 ms. Trace:
I20260709 13:09:27.474408 18715 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.512923 18685 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:27.512822 15228 rpcz_store.cc:276] 0709 13:09:26.449022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.449158 (+   136us) service_pool.cc:224] Handling call
0709 13:09:27.045247 (+596089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.154802 (+109555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.154840 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.154891 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:27.154933 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.473387 (+318454us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400284bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:27.473439 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.473662 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250534656}
I20260709 13:09:27.514827 18689 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:27.508013 15198 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:27.515627 18689 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.518074 18312 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:27.518710 18312 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.519169 18312 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.521966 15379 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:27.499264 18630 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.502250 18467 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.525051 18467 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.526489 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 1983) took 1124 ms. Trace:
I20260709 13:09:27.533516 18519 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.537385 18630 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.450531 18483 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.539021 18630 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.405920 18720 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.542558 18720 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.548612 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:27.494853 18654 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:27.496155 18396 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.496604 18494 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.548939 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:27.518309 18743 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
I20260709 13:09:27.494690 18754 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.559788 18558 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:27.560845 18754 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.562151 18558 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:27.562768 18558 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:27.476246 15302 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:27.527084 15225 rpcz_store.cc:276] 0709 13:09:26.401462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.404609 (+  3147us) service_pool.cc:224] Handling call
0709 13:09:26.405115 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.160429 (+755314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.160501 (+    72us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.160592 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:27.160678 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.525973 (+365295us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54000e79d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:27.526026 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.526233 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735364352}
W20260709 13:09:27.585359 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.608367 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:27.513906 18685 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.565721 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:27.629956 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1767) took 1236 ms. Trace:
I20260709 13:09:27.624822 18712 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:27.634133 18750 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.636168 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:27.637406 18715 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.637912 16004 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:27.638373 18715 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.643690 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:27.639897 18739 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.262s	user 0.005s	sys 0.001s
I20260709 13:09:27.630524 15302 rpcz_store.cc:276] 0709 13:09:26.393666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.394166 (+   500us) service_pool.cc:224] Handling call
0709 13:09:27.614088 (+1219922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.564275 18558 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.667593 18754 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.608774 18745 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:27.671885 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70305.7us
I20260709 13:09:27.559800 18433 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.643244 18519 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.661593 18654 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:27.699898 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 331) took 1205 ms. Trace:
I20260709 13:09:27.700645 15304 rpcz_store.cc:276] 0709 13:09:26.475676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.969003 (+493327us) service_pool.cc:224] Handling call
0709 13:09:26.972023 (+  3020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.360191 (+388168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.360239 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.386341 (+ 26102us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:27.386406 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.663612 (+277206us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54002c2c54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:27.663684 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.668247 (+  4563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728817920}
W20260709 13:09:27.702003 18520 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.798s	user 0.015s	sys 0.021s
I20260709 13:09:27.703076 18518 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:09:27.704530 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:27.706130 15378 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:27.706977 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:27.709309 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:27.710319 15382 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:27.710580 18433 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.711136 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:27.711961 15230 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:27.712215 18293 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.712836 18293 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.714221 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:27.715122 15375 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:27.711328 18433 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:27.721403 18720 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.721696 18433 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.722805 18396 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.725353 18685 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.725463 18689 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.726385 18715 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:27.732575 18113 consensus_meta.cc:287] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.415s	user 0.021s	sys 0.011s
I20260709 13:09:27.694983 18728 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.673558 18630 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:27.735208 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 220838us
I20260709 13:09:27.745980 15226 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:27.735625 18754 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.686918 18750 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:27.750774 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 221202us
I20260709 13:09:27.756906 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:27.757841 15231 raft_consensus.cc:2376] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6. Re-sending same reply.
I20260709 13:09:27.780800 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:27.781750 15128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 93) took 20789 ms (client timeout 15000 ms). Trace:
I20260709 13:09:27.782392 18754 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.793437 15225 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:27.792194 15227 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:27.788255 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:27.754983 18718 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:27.779990 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77412.9us
I20260709 13:09:27.823141 18555 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.823750 18555 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:27.824158 18555 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.791735 18745 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.792256 18750 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.825676 18312 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.791426 18558 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.829186 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:27.832219 18718 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.789495 18744 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:09:27.839871 18718 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.830731 18723 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:09:27.832535 18745 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.843693 18754 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.844486 18745 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.845829 18745 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.849684 15230 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:27.852476 18312 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.852767 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:27.844497 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:27.850198 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61495.5us
I20260709 13:09:27.862262 18745 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.818987 18685 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.864655 18685 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:27.865003 18396 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:27.866990 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:27.867532 18685 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:27.868423 18657 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:27.869027 18657 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:27.870082 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:27.871385 18654 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:27.871711 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:27.872002 18723 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:27.872500 18723 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:27.872920 18723 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.873059 18293 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.840790 18718 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.876586 18744 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.877238 18744 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:27.876868 18718 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.870247 18657 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.878448 18744 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.879184 18657 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.879825 18718 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.800155 18720 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.880914 18720 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.791635 18494 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.882923 15127 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 5 to 7, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 7 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.886390 15304 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:27.889256 18654 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:27.891100 18654 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:27.893646 18750 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.895704 18756 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.896517 18756 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.903409 18756 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:27.908555 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:09:27.909958 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54258us
I20260709 13:09:27.814064 18630 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:27.918730 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.919878 15127 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:09:27.937397 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65791.7us
I20260709 13:09:27.951522 15375 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:09:27.782301 15128 rpcz_store.cc:269] 0709 13:09:06.892673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.902117 (+  9444us) service_pool.cc:224] Handling call
0709 13:09:27.671347 (+20769230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:21.851908 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:21.853093 (+  1185us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:21.853181 (+    88us) write_op.cc:435] Acquired schema lock
0709 13:09:21.853219 (+    38us) tablet.cc:662] Decoding operations
0709 13:09:21.855545 (+  2326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:21.855722 (+   177us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:21.855771 (+    49us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:21.857371 (+  1600us) tablet.cc:701] Row locks acquired
0709 13:09:21.857445 (+    74us) write_op.cc:260] PREPARE: finished
0709 13:09:21.857729 (+   284us) write_op.cc:270] Start()
0709 13:09:21.857905 (+   176us) write_op.cc:276] Timestamp: P: 1783602561857625 usec, L: 0
0709 13:09:21.857933 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:09:21.859085 (+  1152us) log.cc:844] Serialized 4367 byte log entry
0709 13:09:22.160711 (+301626us) op_driver.cc:464] REPLICATION: finished
0709 13:09:22.216631 (+ 55920us) write_op.cc:301] APPLY: starting
0709 13:09:22.216761 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:22.217141 (+   380us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:22.217307 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:22.219179 (+  1872us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:22.219642 (+   463us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:09:22.219723 (+    81us) write_op.cc:312] APPLY: finished
0709 13:09:22.220225 (+   502us) log.cc:844] Serialized 83 byte log entry
0709 13:09:22.220523 (+   298us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:22.220793 (+   270us) write_op.cc:454] Released schema lock
0709 13:09:22.220875 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:22.221517 (+   642us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:22.221574 (+    57us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1279025,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":55492,"apply.run_cpu_time_us":4856,"apply.run_wall_time_us":4856,"num_ops":11,"prepare.queue_time_us":413197,"prepare.run_cpu_time_us":19670,"prepare.run_wall_time_us":196490,"raft.queue_time_us":98824,"raft.run_cpu_time_us":20366,"raft.run_wall_time_us":57203,"replication_time_us":302564,"thread_start_us":642479,"threads_started":4,"wal-append.queue_time_us":196380,"wal-append.run_cpu_time_us":39062,"wal-append.run_wall_time_us":1166070}]]}
I20260709 13:09:27.952720 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:27.953323 18750 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:27.957629 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 322) took 1748 ms. Trace:
I20260709 13:09:27.930966 18396 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.921077 18745 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.967198 18113 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:27.945247 18744 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.936970 18433 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:27.967849 15127 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 5 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:27.916086 18723 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.911983 18555 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.979776 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 1972) took 1002 ms. Trace:
I20260709 13:09:27.981890 15226 rpcz_store.cc:276] 0709 13:09:26.977766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.978096 (+   330us) service_pool.cc:224] Handling call
0709 13:09:27.979425 (+1001329us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b54002d0d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:27.979669 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196177792}
I20260709 13:09:27.917038 18630 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:27.988454 15224 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.981112 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:27.993839 15381 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:27.993471 15127 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:27.994313 18722 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:09:27.995455 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:27.996428 15302 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:27.996680 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:27.993474 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65489.5us
I20260709 13:09:28.004812 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:27.972218 18113 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.007120 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:27.998070 15127 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 1 to 3, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 3 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.961562 15305 rpcz_store.cc:276] 0709 13:09:26.188965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.189923 (+   958us) service_pool.cc:224] Handling call
0709 13:09:26.190217 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.190432 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:27.360759 (+1170327us) log.cc:844] Serialized 14 byte log entry
0709 13:09:27.745853 (+385094us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.764996 (+ 19143us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:27.815209 (+ 50213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.849159 (+ 33950us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.936782 (+ 87623us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36132,"prepare.queue_time_us":1690971,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":55039,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":7600,"thread_start_us":1300940,"threads_started":2,"wal-append.queue_time_us":424915}
I20260709 13:09:27.971892 18396 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.031177 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.010126 18113 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.035455 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.036976 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.041817 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:28.044708 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 149355us
I20260709 13:09:28.045145 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:28.042630 15227 raft_consensus.cc:2376] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8. Re-sending same reply.
I20260709 13:09:28.050195 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.053396 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:28.056711 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.056711 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.059574 15381 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:28.059577 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.056890 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:28.017233 18750 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.064810 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.063673 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:28.059701 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.064147 18293 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:28.066196 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.064658 15233 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:28.061348 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:28.067662 15227 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:28.074678 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.071223 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:28.075860 18752 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:28.075930 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.077811 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.087002 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.089124 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.092638 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:28.073608 18527 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.003s
I20260709 13:09:28.101325 15379 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:28.111306 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.111191 15382 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:28.073402 18293 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.113974 15377 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:28.076287 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.112126 15305 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:28.126673 15225 raft_consensus.cc:2393] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:28.130048 15224 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:28.132786 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.134325 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.118649 18293 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.148056 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67798.3us
I20260709 13:09:28.079909 18715 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:28.150043 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 105001us
I20260709 13:09:28.157509 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.158841 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.148164 18712 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:28.165313 18747 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:09:28.165609 18615 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:28.166203 18750 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.140676 18630 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.167241 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:28.148021 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.169301 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.167526 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.167403 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 533) took 1937 ms. Trace:
I20260709 13:09:28.169111 18715 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.173110 15127 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 7, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 7 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.170411 18757 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.156s
W20260709 13:09:28.182180 18732 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:28.182214 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:28.183833 15381 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.111162 18527 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.186563 18527 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.188609 18761 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.189723 18761 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.192462 18749 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.193070 18749 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:28.193816 15381 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:28.195334 18753 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.196874 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:28.197621 15232 raft_consensus.cc:2376] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11. Re-sending same reply.
I20260709 13:09:28.188727 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.200639 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.201643 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.202322 15229 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:28.204839 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.205668 15304 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:28.206027 18751 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:28.207067 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.207841 15303 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:28.208453 18760 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:28.209990 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.211221 15305 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:28.170852 15376 rpcz_store.cc:276] 0709 13:09:26.229795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.230288 (+   493us) service_pool.cc:224] Handling call
0709 13:09:26.232768 (+  2480us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:26.280853 (+ 48085us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:26.280888 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:26.291192 (+ 10304us) log.cc:844] Serialized 52 byte log entry
0709 13:09:27.465091 (+1173899us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:27.465199 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.465320 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.167107 (+701787us) raft_consensus.cc:1685] finished
0709 13:09:28.167136 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.167333 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49359,"raft.queue_time_us":51990,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":13537,"thread_start_us":992930,"threads_started":1,"wal-append.queue_time_us":1510896}
I20260709 13:09:28.076768 18752 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.206864 18751 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.229468 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:28.230582 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:28.132143 18720 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:28.241771 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.242800 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.244820 15305 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:28.246618 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.242555 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.248167 18715 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:28.248955 18715 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:28.249284 15274 connection.cc:256] RPC call timeout handler was delayed by -1.0308270970000422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
I20260709 13:09:28.249800 18752 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:28.249832 15274 connection.cc:256] RPC call timeout handler was delayed by -1.0110270970000101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 13:09:28.243486 15127 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 5 to 6, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 6 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.244956 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:28.251487 18761 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:28.263229 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 96098.2us
I20260709 13:09:28.235857 18657 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:28.277001 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.277310 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.178269 18712 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:09:28.242767 18723 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.294845 16006 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:28.289783 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:28.269017 18527 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:28.298115 15198 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:28.313721 18615 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:28.317687 18615 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:28.263470 18555 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.277369 18657 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.239238 18689 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:09:28.309600 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:28.323644 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:28.326151 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 131431us
I20260709 13:09:28.291342 18396 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.335263 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:28.318178 18615 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.337299 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.340929 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.315083 18527 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.342135 15376 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.342916 15228 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
W20260709 13:09:28.344089 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 228013us
I20260709 13:09:28.343863 15305 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.333077 18657 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.362709 15232 raft_consensus.cc:1813] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:09:28.322671 18759 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:28.364522 15232 raft_consensus.cc:2368] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:28.338300 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.377278 18715 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:28.384630 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 70848.7us
I20260709 13:09:28.384488 18757 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:28.340044 18753 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:28.386754 18753 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:28.356686 18527 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.345686 18722 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:28.406276 18722 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:28.407579 18722 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.361307 18518 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:28.377367 18763 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:09:28.422771 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:28.400025 16000 raft_consensus.cc:1813] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:09:28.364054 18749 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:28.420821 18558 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:28.434975 15127 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:09:28.432318 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62956.5us
I20260709 13:09:28.452497 16000 raft_consensus.cc:2368] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:28.454150 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.458942 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:28.496403 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:28.472774 15376 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:28.499873 15306 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:28.443038 18558 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:28.479125 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 199573us
W20260709 13:09:28.486959 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.506279 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:28.513959 18751 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:28.477257 18293 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:28.513461 18558 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:28.535622 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61112.7us
W20260709 13:09:28.540551 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 102247us
I20260709 13:09:28.543970 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:28.557803 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:28.559201 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:28.568787 15306 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:28.561208 18558 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:28.563925 18113 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
W20260709 13:09:28.613178 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46292us
I20260709 13:09:28.613451 18113 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.616482 18113 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.617326 18293 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:28.618356 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47961.1us
I20260709 13:09:28.540383 18630 raft_consensus.cc:2764] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:28.629487 15229 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:28.619906 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:28.566383 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:28.639837 15305 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:28.637460 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 64721.7us
I20260709 13:09:28.641167 16004 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:28.571251 18467 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.653264 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:28.655119 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:28.645612 18768 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:09:28.661091 15302 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:28.663727 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 365724us
I20260709 13:09:28.649782 18757 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.657096 18751 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.786000 15300 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:28.739702 18519 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.802415 18757 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:28.659199 18630 raft_consensus.cc:2764] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:09:28.738993 18778 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
I20260709 13:09:28.751240 18749 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.751209 18759 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:28.730020 18615 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.629220 18766 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:09:28.753646 18777 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:09:28.737393 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 215616us
W20260709 13:09:28.722950 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 45898.2us
W20260709 13:09:28.733544 18776 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:28.788494 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:28.800187 18744 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.796s	user 0.007s	sys 0.007s
W20260709 13:09:28.718255 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43720us
I20260709 13:09:28.816648 18519 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:28.814610 15302 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:28.804934 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 81888.2us
I20260709 13:09:28.821889 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:28.839975 15306 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.843039 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:28.829319 18759 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.856964 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.849802 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.886180 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.933251 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:28.933351 15228 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
W20260709 13:09:28.922315 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.934775 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 394074us
I20260709 13:09:28.931249 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:28.936275 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:28.936467 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 215284us
I20260709 13:09:28.843619 18749 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:28.947575 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:28.858072 18761 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:28.947594 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 104654us
I20260709 13:09:28.951550 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:28.954818 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:28.955617 15377 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.955927 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:28.957697 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:28.960871 15381 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:28.963348 18519 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.885492 18781 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.966512 18615 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.954857 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:28.979919 15376 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.955022 18266 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:28.989219 15377 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:28.989902 18266 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:28.990983 18752 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.991133 18266 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:28.983105 18781 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:28.998620 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59095us
I20260709 13:09:29.001983 18752 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:29.002420 15273 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.000s (SENT)
I20260709 13:09:29.007499 15306 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:28.984282 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:28.987083 18757 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:28.885519 18527 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:29.019016 18527 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:29.020017 15224 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:29.022121 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:29.047300 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65463.9us
W20260709 13:09:29.059553 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 75407.7us
I20260709 13:09:29.060616 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:29.060806 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:29.044312 18722 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:29.076056 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:29.077077 15375 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.059607 18749 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.046590 18751 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:29.054469 18657 consensus_meta.cc:287] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.005s
I20260709 13:09:29.083202 18654 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:29.096242 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 106435us
I20260709 13:09:29.097277 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:29.107908 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:29.109339 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:29.110070 15226 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:09:29.107592 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:29.114622 15231 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:29.115988 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.118492 15376 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:29.119797 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.124584 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:29.088477 18751 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:29.130987 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.104664 18722 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:29.132725 15974 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.095854 18781 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.143390 16004 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:29.159478 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 201880us
I20260709 13:09:29.152943 18775 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:29.106642 18744 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:29.095129 18657 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:29.167804 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48102.5us
I20260709 13:09:29.164316 15230 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:29.132884 18751 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.162709 15375 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:29.160733 18775 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:29.148160 18689 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.136677 18784 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.153777 18558 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:29.161481 18785 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:09:29.177219 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.157197 18723 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.179044 18775 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.198149 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.205111 18744 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:09:29.211475 18657 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.201102 18793 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:29.212749 18793 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:29.173353 18722 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.213177 18791 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.189971 18784 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.213972 18791 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:29.214432 18784 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.214648 18791 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.194084 18558 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.233448 18759 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.202216 18723 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:29.170558 18781 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:29.252432 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 75319.5us
I20260709 13:09:29.213182 18793 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.257512 18494 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:29.257408 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:29.258538 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:29.262221 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:29.262413 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 84682.9us
I20260709 13:09:29.264546 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.236128 18558 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.234552 18753 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.271076 18781 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.268042 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.277133 15381 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.197412 18788 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:09:29.243269 18761 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.251430 18723 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.324753 15274 leader_election.cc:400] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:29.325280 15274 leader_election.cc:403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:29.327821 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:29.329547 18800 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:29.329895 18761 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.318796 18630 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.332732 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:29.343626 15382 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.347098 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:29.347177 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:29.295531 18494 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:29.349076 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:29.350996 15376 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:29.316323 18773 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.356317 15232 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:29.359771 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:29.345237 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.366119 18266 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:29.366909 18266 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:29.339712 18630 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.373363 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.358743 18773 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.368602 18729 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.399102 15381 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:29.383646 18630 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.405408 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:29.413558 18266 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:29.416667 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79399.3us
I20260709 13:09:29.419091 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.398602 18773 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:29.440029 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66757.3us
I20260709 13:09:29.440873 15274 leader_election.cc:400] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:29.411163 18728 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:09:29.437686 18788 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:29.436931 18759 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:29.458455 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63645.9us
I20260709 13:09:29.468315 18798 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.404057 18729 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:29.482930 18775 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.460671 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:29.462237 18802 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:29.456956 18752 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.511885 18775 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:29.459827 18788 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:29.524238 15231 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
W20260709 13:09:29.531656 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 119047us
W20260709 13:09:29.530701 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 4.028s (SENT) [suppressed 49 similar messages]
I20260709 13:09:29.535275 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.475983 18784 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:29.524655 18795 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:09:29.539435 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:09:29.539674 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 144777us
W20260709 13:09:29.543900 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 124937us
I20260709 13:09:29.552120 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:29.554896 15381 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:29.565033 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.501368 18494 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.576612 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:29.548292 18759 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.547880 18807 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.569331 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:29.570672 18729 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.584404 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.532080 18791 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:29.604132 15382 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:29.617623 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:29.562011 18808 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:29.623579 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:29.623961 15306 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:29.630537 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:29.631451 15307 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:29.583876 18752 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:29.634011 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 90622.4us
W20260709 13:09:29.634152 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 69222us
I20260709 13:09:29.634680 15299 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.610330 18615 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:29.646770 15381 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:29.613485 18807 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:29.665357 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:29.672492 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54740.3us
I20260709 13:09:29.666595 15301 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:29.678660 15345 leader_election.cc:400] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:29.574436 18793 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:29.670245 18751 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:29.684564 18808 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:29.568310 18788 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:09:29.694832 18797 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
I20260709 13:09:29.717645 18784 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.676250 18615 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:29.731208 15299 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:09:29.736724 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 98865.5us
I20260709 13:09:29.751194 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:29.753113 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79728.3us
I20260709 13:09:29.765080 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.759609 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:29.700845 18558 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.674038 18807 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.784933 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:29.803447 15230 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.809134 18615 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:29.758268 18808 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:29.786783 18761 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:29.788288 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:29.789976 18791 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:29.784253 18814 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:09:29.821017 18793 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.779443 18752 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.811121 18773 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:29.840756 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 79540.6us
I20260709 13:09:29.842756 18773 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.845057 15233 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:29.785175 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47104.4us
I20260709 13:09:29.829708 15230 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:29.809582 18807 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:29.778231 18751 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:29.855369 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:29.896242 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45851.3us
I20260709 13:09:29.896698 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:29.897764 15230 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.847671 18630 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:29.898628 16004 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:29.861281 18816 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:29.900642 18630 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:09:29.901449 18723 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.009s
I20260709 13:09:29.903057 15302 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:29.904523 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.901942 18723 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:29.860845 18293 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:29.922714 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72435.5us
I20260709 13:09:29.912621 18630 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:29.911774 18784 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.859802 18519 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:09:29.915846 18558 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.936673 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.945273 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.922499 18293 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:29.938100 18784 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.932616 18527 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.931241 18827 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:29.953984 18812 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.954598 18826 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:29.964498 18826 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.922986 18266 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:09:30.003171 15224 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:29.970279 15230 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:09:29.980680 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:29.972524 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:30.045975 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:30.046758 15232 raft_consensus.cc:2368] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:30.001040 15231 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:29.956589 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:30.044981 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:30.051335 16007 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:30.052472 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:30.053905 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:29.967320 18826 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:29.953315 18824 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.059430 15227 raft_consensus.cc:2368] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:29.957461 18433 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:30.001437 18798 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:30.060029 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 103583us
I20260709 13:09:29.957130 18527 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.059291 18812 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.960063 18827 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:29.954929 18723 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:29.956982 18822 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:09:29.957050 18784 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:30.070293 18583 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.070022 18293 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.073912 18433 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.093433 18433 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:30.096948 18830 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:09:30.103886 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.105301 18813 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:30.075376 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 166226us
I20260709 13:09:30.075666 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:30.108417 15225 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:30.081457 18822 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:30.109375 18822 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:30.076210 18527 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.083303 18827 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:30.113962 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:30.085420 15273 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.652s (SENT)
I20260709 13:09:30.086558 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:30.058279 18793 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:09:30.078447 18751 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:09:30.086232 18833 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:09:30.071390 18826 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:30.073699 18824 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.108232 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:30.128901 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51736.1us
I20260709 13:09:30.129913 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:30.130398 18824 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:30.107668 15227 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:30.107936 15974 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:29.952304 18630 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.084098 15226 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:30.107627 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.121025 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:30.114821 15225 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:30.139742 15304 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:30.126592 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:30.128072 18827 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:30.130752 18793 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:30.134985 18723 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:30.135077 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.154024 15274 leader_election.cc:400] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:30.135833 18567 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:30.110603 18822 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.131572 18813 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.134883 18826 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:30.149130 18827 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:30.165364 18793 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.165647 18826 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:30.167831 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60293.3us
I20260709 13:09:30.169026 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.170053 18567 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:30.170360 18812 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.171154 18567 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.173854 15228 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:30.174542 18630 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:30.174396 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.176365 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.154440 15274 leader_election.cc:403] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.159029 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:30.176927 18527 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.159914 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:30.178257 15375 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.178457 18630 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:30.179500 18527 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:30.177775 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.160625 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:30.180521 18723 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:30.181245 15274 leader_election.cc:400] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:30.181613 15274 leader_election.cc:403] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.181553 18723 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.182158 18788 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.182440 18812 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.183161 18812 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:30.184190 18812 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.186548 18822 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.189352 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.191908 18494 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.161306 18798 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:30.150234 18729 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:30.162312 18751 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.163643 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:30.163424 18433 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.165759 18827 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.160811 18819 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.192998 18749 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.195003 15380 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:30.163350 15378 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:30.142252 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:30.200713 15375 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:30.231599 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 89510.8us
I20260709 13:09:30.232301 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.210673 15376 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 4.
I20260709 13:09:30.168015 18793 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:30.226678 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:30.227941 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.164505 18813 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:30.194794 16000 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:30.234241 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.247176 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:30.209304 18824 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.213265 18630 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.240705 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:30.228703 18729 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:30.229537 18749 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:30.263474 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.258809 18723 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.271783 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:30.273885 15299 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:30.302027 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.302448 18518 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:30.266719 18749 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:30.305603 18786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.022s	sys 0.010s
W20260709 13:09:30.306073 18786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.022s	sys 0.011s
I20260709 13:09:30.307358 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:30.303788 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43506.2us
I20260709 13:09:30.322225 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:30.317668 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44011.2us
I20260709 13:09:30.323094 15300 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.324605 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:30.266055 18804 raft_consensus.cc:2764] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:09:30.325841 15375 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.334923 18809 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.335469 18809 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.335988 18809 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.302987 18518 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:30.342978 18518 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.344002 18825 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:30.344650 18825 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:30.345727 18825 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.347115 18825 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:30.348699 18838 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:09:30.351610 18729 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.359437 15375 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:09:30.361255 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:30.363157 15375 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:30.367113 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:30.377043 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53662.1us
I20260709 13:09:30.379320 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.386861 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:30.387879 15375 raft_consensus.cc:2368] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
I20260709 13:09:30.241724 18819 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.437270 18433 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:30.440224 18775 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:30.440749 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.441533 15375 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:30.442601 16000 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:30.443944 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 246564us
I20260709 13:09:30.449306 15299 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:30.457840 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:30.492865 15305 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.456166 18804 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:09:30.459264 18779 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:30.499078 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:30.461922 15302 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:30.471005 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:30.474680 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:30.480760 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:30.482187 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.482585 15306 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:30.406019 18744 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:30.399513 18518 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.366475 18813 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:30.501573 18803 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:30.518005 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.528990 15382 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:09:30.505604 18826 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.518075 18828 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:30.543303 15305 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:30.544831 15382 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:30.554823 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:30.508827 18793 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:30.531311 18744 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:30.568125 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.531500 18804 consensus_queue.cc:1243] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer 5c70ddb5aae14b059dc90fd40125b034 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:09:30.587101 15273 leader_election.cc:336] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.567s (SENT)
I20260709 13:09:30.587736 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:30.577417 18744 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.545113 18813 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.552481 18828 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:30.600136 18851 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:09:30.599879 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45131.6us
I20260709 13:09:30.600732 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:30.600979 18842 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:09:30.624256 15228 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:30.602042 15226 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:30.600005 18815 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.608855 18798 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.643486 18567 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:30.555079 18722 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:09:30.610807 18809 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:30.650231 18809 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:30.611862 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.538455 18723 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:09:30.601433 18836 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.663192 18836 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.630846 15308 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:30.634788 18815 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:30.588860 18812 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:09:30.639479 18819 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:30.663791 18836 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.701289 18836 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:30.703061 18798 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:30.705619 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 197959us
I20260709 13:09:30.614521 18793 consensus_queue.cc:1243] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:30.713434 15300 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:30.734470 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.740723 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:30.741541 15378 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.715108 18752 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:30.747557 18752 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.750932 18752 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:30.748415 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:30.752148 18815 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.753829 18828 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:30.755275 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.757153 15378 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:30.757350 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:30.774693 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 187624us
I20260709 13:09:30.780359 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.783042 15378 raft_consensus.cc:2368] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
W20260709 13:09:30.776381 18630 consensus_meta.cc:287] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.000s
W20260709 13:09:30.796388 15273 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.659s (SENT)
W20260709 13:09:30.800393 18788 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.004s
I20260709 13:09:30.801046 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.802939 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.805073 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.806411 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.809175 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:30.810173 15378 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:30.811693 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.812628 15373 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:30.791419 18630 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
W20260709 13:09:30.829327 15273 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.670s (SENT)
I20260709 13:09:30.831076 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.847167 15305 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.847723 15305 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:09:30.855445 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.854112 15305 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:30.872802 15226 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:30.855214 18854 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.880004 15227 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:30.881083 15307 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:30.913033 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:30.928933 18848 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:09:30.941090 18853 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:30.951181 15305 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:30.951506 18824 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.002s
I20260709 13:09:30.952497 18824 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.957247 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.958089 15373 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:30.963798 15305 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:30.958946 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:30.960021 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:30.997479 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 168216us
W20260709 13:09:30.998281 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.998852 15273 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.725s (SENT)
I20260709 13:09:31.000309 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:31.001091 15379 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.975271 15380 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:31.005620 15382 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:30.999274 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:30.955821 18827 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:31.019438 15273 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.504s (SENT)
I20260709 13:09:31.088785 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.022063 18824 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:31.025475 18749 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.005s
W20260709 13:09:31.088553 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73627.2us
I20260709 13:09:31.026575 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:31.097332 15304 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.028048 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.028818 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.029944 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.031013 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:31.099005 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 85076.8us
I20260709 13:09:31.099720 15377 raft_consensus.cc:2368] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:31.035329 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:31.037350 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.100621 15225 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.041833 15374 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:31.047053 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.031872 18816 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:31.048823 18813 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:31.007226 18788 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.004942 18388 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:09:31.091578 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79748.3us
I20260709 13:09:30.996482 18804 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:31.109606 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 90209.1us
W20260709 13:09:31.124929 15273 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.593s (SENT)
I20260709 13:09:31.125628 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.110769 18824 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.111879 18749 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:31.111938 15381 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:31.118018 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.122303 15373 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:31.122939 15380 raft_consensus.cc:2368] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
W20260709 13:09:31.133294 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 119751us
I20260709 13:09:31.135329 15379 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:31.133610 15373 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:31.141264 15273 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.606s (SENT)
W20260709 13:09:31.142645 15273 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.760s (SENT)
I20260709 13:09:31.143234 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:31.150873 15273 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.782s (SENT)
I20260709 13:09:31.151636 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.154424 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:31.156950 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.145081 15373 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:31.159499 15373 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.137205 18813 consensus_queue.cc:1243] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:31.140493 18836 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:31.181348 15273 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.909s (SENT)
I20260709 13:09:31.182267 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.185539 15380 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:09:31.154057 18854 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:31.131557 18804 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:31.190318 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.132738 18788 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:31.165074 18825 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.175678 18728 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:31.207132 15273 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.709s (SENT)
I20260709 13:09:31.210345 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:31.211570 15273 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.715s (SENT)
I20260709 13:09:31.168176 18722 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:31.195785 18630 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:31.212489 15273 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.919s (SENT)
W20260709 13:09:31.231387 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.204133 18863 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:31.228883 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.219460 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:31.242633 15273 leader_election.cc:336] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.096s (SENT)
I20260709 13:09:31.236773 18863 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:31.217676 18728 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:31.219543 18784 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:09:31.215472 18836 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.264240 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.244774 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:31.262341 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63351.7us
I20260709 13:09:31.301832 15373 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:09:31.302356 15373 pending_rounds.cc:85] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 7
W20260709 13:09:31.305404 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 131919us
I20260709 13:09:31.308997 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:31.319975 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.261917 18775 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.349740 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.351018 15378 raft_consensus.cc:2410] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:09:31.353065 18858 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:09:31.254479 18728 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:31.358595 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.359407 15382 raft_consensus.cc:1813] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:09:31.359934 15382 raft_consensus.cc:2368] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 10.
I20260709 13:09:31.253796 18863 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:31.360522 18266 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:31.360864 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.361727 18863 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.302614 15373 pending_rounds.cc:107] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:31.362341 15373 raft_consensus.cc:2889] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:31.364933 18749 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:31.366297 18788 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:09:31.367197 18751 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:09:31.367792 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.369431 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:31.370069 18826 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:31.370924 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.373968 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:31.383569 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.431578 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.433044 15380 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:31.440864 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.441746 15378 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:31.462543 15225 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
W20260709 13:09:31.442919 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 341233us
I20260709 13:09:31.464264 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.464282 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:31.296854 18630 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:31.470041 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.469102 15304 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:31.472922 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:31.477620 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 117294us
W20260709 13:09:31.482627 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 240033us
I20260709 13:09:31.462194 18520 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.486642 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.487643 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.476405 18757 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:31.488967 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.467778 18810 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.493623 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:31.497713 15375 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:31.475296 18433 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.521039 18433 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:31.521914 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.523247 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.523615 18433 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:31.524955 18804 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:31.525519 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:31.461953 18775 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:31.532783 15303 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:31.487708 15273 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.152s (SENT)
I20260709 13:09:31.498715 18520 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:31.544553 15308 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:09:31.546741 18520 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:31.547698 16007 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:31.543749 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.505669 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.531929 18775 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:31.506829 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.507709 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.508549 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.509320 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.510349 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.518390 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:31.518944 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.502350 16000 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:31.505870 18757 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:31.578652 18757 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:31.579950 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.581128 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.582489 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.583431 15374 raft_consensus.cc:2368] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:31.584491 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.553421 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:31.585949 15302 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:31.587744 15373 raft_consensus.cc:2368] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:31.588863 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:31.590230 15300 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
W20260709 13:09:31.592618 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 401235us
I20260709 13:09:31.585451 18875 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:09:31.596484 18630 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.499765 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:31.554638 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:31.557826 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.559024 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:31.576978 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.549583 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:31.606679 15375 raft_consensus.cc:2368] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:31.621248 15380 raft_consensus.cc:2368] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6.
I20260709 13:09:31.604943 15233 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:09:31.632247 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:31.633522 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 431425us
I20260709 13:09:31.687781 18388 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:31.657509 16004 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:31.657823 18863 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:31.736642 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.658317 18527 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:09:31.763579 18863 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:31.767169 18863 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:31.783353 18827 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.686s	user 0.015s	sys 0.000s
I20260709 13:09:31.784710 15299 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:31.785760 18836 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.786397 18836 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:31.839215 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 351528us
W20260709 13:09:31.832978 18861 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:31.756907 18583 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
W20260709 13:09:31.840310 15273 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.226s (SENT)
I20260709 13:09:31.853070 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.841275 18863 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:31.871101 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:31.871244 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 239133us
W20260709 13:09:31.877290 15273 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.532s (SENT)
I20260709 13:09:31.878001 15273 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:31.873880 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 276658us
I20260709 13:09:31.881592 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:31.883886 15273 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.364s (SENT)
I20260709 13:09:31.884490 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:31.871899 18827 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.899250 18875 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:31.899881 18875 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.883747 18863 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:31.886128 18874 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:31.904707 18810 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.909042 18810 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:31.911561 18810 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:31.900319 18875 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.915400 15307 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:31.906754 18863 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:31.906970 18723 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:31.917979 18723 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.918392 18723 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.882791 18630 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.907534 18874 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.921139 18874 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.921501 15308 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:31.926764 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:31.945159 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:31.950634 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:31.951836 15226 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
W20260709 13:09:31.958184 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.960453 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 78946.4us
I20260709 13:09:31.892773 18815 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.969869 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78910.4us
I20260709 13:09:31.961265 18630 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.982779 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:31.990612 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:31.997848 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:31.998720 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:31.975389 18827 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:32.013093 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:32.017330 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 133482us
W20260709 13:09:32.021660 15273 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.576s (SENT)
I20260709 13:09:32.022282 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:32.023798 15273 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.588s (SENT)
I20260709 13:09:31.978986 18870 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:31.979509 18527 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:09:32.007359 18751 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.034621 18870 consensus_queue.cc:1243] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:31.983567 18815 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.029155 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:32.065626 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49258.3us
I20260709 13:09:32.040472 18751 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.040848 18630 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.074656 18630 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:32.070870 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.057155 18583 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:09:32.019794 18827 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.081375 18827 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:32.082201 15300 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:32.059652 18520 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:32.072630 15226 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:32.084779 18520 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:32.086663 18888 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:09:32.095952 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.101182 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.107106 18815 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:32.116626 18751 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.124259 18852 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.124961 18852 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.127430 18852 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:32.119464 18836 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:32.128364 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:32.134004 15273 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.192s (SENT)
I20260709 13:09:32.134608 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:32.135700 18875 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.138659 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:32.139830 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.141090 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:32.141916 15375 raft_consensus.cc:2368] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:32.143955 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:32.146652 15273 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.205s (SENT)
I20260709 13:09:32.147409 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:32.140542 15381 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:32.149722 15380 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:32.155318 15380 pending_rounds.cc:85] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 3
I20260709 13:09:32.144734 15375 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:32.155669 15380 pending_rounds.cc:107] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:32.149645 15378 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:32.156034 15380 raft_consensus.cc:2889] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:32.161808 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:32.162963 16007 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:09:32.164628 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.149266 18899 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:32.169473 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:32.170257 15377 raft_consensus.cc:2368] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:32.171128 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.172847 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.173672 15378 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:32.174506 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.174772 15374 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:32.176316 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.177750 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.178881 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.181766 15373 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:32.182183 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.175992 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:32.186107 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 165547us
I20260709 13:09:32.180228 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.150758 18836 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.189960 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.194164 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.188917 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:32.196924 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.197788 15378 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:32.200274 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:32.200088 15273 leader_election.cc:336] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.814s (SENT)
I20260709 13:09:32.201273 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:32.201040 15377 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:32.205358 18827 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.209447 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.165913 18874 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.213120 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.212189 18875 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:32.203155 18293 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.230387 18293 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.230989 18293 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.232565 18751 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:32.234581 15379 raft_consensus.cc:2368] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
I20260709 13:09:32.234895 18723 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.237308 15380 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:09:32.239816 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.239249 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.242869 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:32.249178 15273 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.307s (SENT)
I20260709 13:09:32.249528 18899 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:32.249949 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:32.250242 18899 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.251417 18827 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:32.247632 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:32.256644 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 198022us
I20260709 13:09:32.273927 18815 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:32.276060 18723 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:32.276656 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2161) took 2024 ms. Trace:
I20260709 13:09:32.277724 15299 rpcz_store.cc:276] 0709 13:09:30.251935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.484864 (+232929us) service_pool.cc:224] Handling call
0709 13:09:30.514816 (+ 29952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.785356 (+1270540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.276319 (+490963us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540025a3d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:32.276579 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2919502080}
I20260709 13:09:32.293452 15380 raft_consensus.cc:2368] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:32.316660 18852 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.317544 18852 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.237731 18874 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:32.272017 18520 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:32.348112 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.348762 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:32.372943 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:32.373965 16007 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.339731 18827 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.374827 18827 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.382602 18899 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:32.396103 16007 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:32.383523 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:32.384532 15273 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.893s (SENT)
I20260709 13:09:32.384948 15304 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:32.398926 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:32.399168 15226 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:32.386983 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:32.391379 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.393807 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:32.401942 15299 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.394685 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:32.403752 15273 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.948s (SENT)
I20260709 13:09:32.406416 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:32.407361 15375 raft_consensus.cc:2368] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:32.403214 15382 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:32.414062 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.414738 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:32.410248 15273 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.948s (SENT)
I20260709 13:09:32.415977 18825 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:32.417308 18825 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.379871 18827 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:32.416486 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:32.423909 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:32.420876 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:32.411764 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:32.421334 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:32.430979 15273 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.983s (SENT)
I20260709 13:09:32.400880 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:32.431691 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:32.432960 15233 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:32.436491 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.408834 18899 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.446135 15226 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:32.454186 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:32.455276 15299 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:32.456770 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:32.432024 18827 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:32.474510 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.410565 18880 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:09:32.483345 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:32.432046 18900 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:32.473773 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:32.443547 18836 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:32.489526 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.490350 15305 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:32.484723 15382 raft_consensus.cc:2368] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
I20260709 13:09:32.493558 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.494964 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:32.506911 15374 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:32.496380 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:32.505887 15373 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:32.494277 16004 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:32.540719 18749 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:32.541492 18749 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.545159 18749 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:32.545794 18728 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.546504 18728 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.547009 18728 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.549599 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:32.549063 15130 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.551676 18822 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:32.552273 18822 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:32.553269 18822 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.574286 18773 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:32.581662 18872 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:32.583189 18872 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:32.584659 18657 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:32.585111 18657 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:32.586107 18657 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.588421 18872 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:32.589139 18872 consensus_queue.cc:1243] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:32.590441 15233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:32.591284 15233 raft_consensus.cc:606] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:32.591688 15233 raft_consensus.cc:614] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:32.493494 18899 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.554383 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:32.610193 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55882.4us
W20260709 13:09:32.555588 18906 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:09:32.558346 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 468) took 1247 ms. Trace:
I20260709 13:09:32.561904 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:32.626215 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.562731 15305 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:32.595739 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:32.604513 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.554224 18809 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:32.651084 15302 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:32.651678 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.656064 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.607287 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.638758 18825 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:32.624717 15228 rpcz_store.cc:276] 0709 13:09:31.310844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.312620 (+  1776us) service_pool.cc:224] Handling call
0709 13:09:31.463277 (+150657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.470691 (+  7414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.470725 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.117332 (+646607us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b2c000014c8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:09:32.118040 (+   708us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.225120 (+107080us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.225174 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.225258 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.558006 (+332748us) raft_consensus.cc:1685] finished
0709 13:09:32.558030 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.558275 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3617,"raft.queue_time_us":13845,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":2479,"spinlock_wait_cycles":10491264,"thread_start_us":98835,"threads_started":1,"wal-append.queue_time_us":388242}
I20260709 13:09:32.652200 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:32.654429 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.633451 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.661274 15130 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:32.665779 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:32.521519 18879 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:09:32.610181 18819 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:32.611330 18751 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:32.677090 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.627559 18784 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:32.681732 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 172658us
I20260709 13:09:32.654753 18863 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:32.736752 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.740355 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:32.741285 15228 raft_consensus.cc:606] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:32.741705 15228 raft_consensus.cc:614] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:32.643819 18899 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.753142 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:32.759549 18852 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:32.768471 15130 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.715030 18819 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:32.775174 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:32.783162 15130 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.722780 18751 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:32.780841 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:32.789146 15306 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.822921 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:32.827669 15228 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:32.830315 15127 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 192) took 28755 ms (client timeout 15000 ms). Trace:
I20260709 13:09:32.734787 18863 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.786857 18912 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.846550 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:32.797549 18875 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:32.856006 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.795919 15130 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 8, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:32.867313 18909 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:32.868358 18819 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:32.873332 18293 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.642s	user 0.015s	sys 0.001s
I20260709 13:09:32.873960 18293 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.800746 18494 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:09:32.875874 18863 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:32.857461 18728 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:32.834057 18911 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:32.877180 18912 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.893817 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:32.827160 18852 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:32.921717 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.922971 15299 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
W20260709 13:09:32.926472 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.805205 18751 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:32.860138 15130 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 6 to 7, term changed from 5 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68), VOTER 841138f50ace4746978e72d7f13878de (127.13.196.66) evicted. New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.936726 15233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:32.981796 15233 raft_consensus.cc:606] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
W20260709 13:09:32.984790 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 49714.4us
I20260709 13:09:32.994115 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.993552 15130 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:32.995651 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:32.934587 18903 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.447s	user 0.002s	sys 0.000s
W20260709 13:09:32.832201 15127 rpcz_store.cc:269] 0709 13:09:04.102142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.265364 (+163222us) service_pool.cc:224] Handling call
0709 13:09:32.830181 (+28564817us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:29.022740 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:29.044653 (+ 21913us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:29.055289 (+ 10636us) write_op.cc:435] Acquired schema lock
0709 13:09:29.061267 (+  5978us) tablet.cc:662] Decoding operations
0709 13:09:29.186270 (+125003us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:29.203902 (+ 17632us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:29.208643 (+  4741us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:29.269553 (+ 60910us) tablet.cc:701] Row locks acquired
0709 13:09:29.269614 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:09:29.269844 (+   230us) write_op.cc:270] Start()
0709 13:09:29.270025 (+   181us) write_op.cc:276] Timestamp: P: 1783602569269769 usec, L: 0
0709 13:09:29.270050 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:29.417572 (+147522us) log.cc:844] Serialized 3253 byte log entry
0709 13:09:30.107968 (+690396us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b
0709 13:09:30.656990 (+549022us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b21e28 00007f2f5755c581 00007f2f5755bd58 00007f2f575609f1 00007f2f575609a9 00007f2f57560939 00007f2f57560901 00007f2f5755fb2d 000000000038f354 000000000038f199
0709 13:09:30.934015 (+277025us) op_driver.cc:464] REPLICATION: finished
0709 13:09:31.239429 (+305414us) write_op.cc:301] APPLY: starting
0709 13:09:31.280962 (+ 41533us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:31.376605 (+ 95643us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:31.376664 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:31.437661 (+ 60997us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:31.438166 (+   505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:09:31.438240 (+    74us) write_op.cc:312] APPLY: finished
0709 13:09:31.438788 (+   548us) log.cc:844] Serialized 65 byte log entry
0709 13:09:31.439082 (+   294us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:31.439275 (+   193us) write_op.cc:454] Released schema lock
0709 13:09:31.439361 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:31.439967 (+   606us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:31.440013 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":720203,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":259030,"apply.run_cpu_time_us":5103,"apply.run_wall_time_us":222180,"num_ops":8,"prepare.queue_time_us":296509,"prepare.run_cpu_time_us":46563,"prepare.run_wall_time_us":1634588,"raft.queue_time_us":161841,"raft.run_cpu_time_us":23977,"raft.run_wall_time_us":365610,"replication_time_us":1558642,"spinlock_wait_cycles":35606784,"thread_start_us":1209426,"threads_started":4,"wal-append.queue_time_us":841727,"wal-append.run_cpu_time_us":12246,"wal-append.run_wall_time_us":2257730}]]}
I20260709 13:09:32.954511 16000 raft_consensus.cc:2368] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
W20260709 13:09:32.984805 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.996752 15130 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.045778 15130 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.036679 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:32.940171 15273 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.036s (SENT)
I20260709 13:09:33.049974 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.049660 15130 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.052896 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.053290 15130 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.055363 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:33.054730 18913 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.930544 18852 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.061903 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:33.074117 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.008234 18266 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:33.089251 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:33.072886 15304 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:33.031366 18825 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.037128 18630 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.093135 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:32.907413 18911 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.105160 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:33.132263 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:33.133633 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2160) took 1001 ms. Trace:
I20260709 13:09:33.148046 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:33.059866 18827 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:33.154117 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.145180 15376 rpcz_store.cc:276] 0709 13:09:32.131945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.134730 (+  2785us) service_pool.cc:224] Handling call
0709 13:09:32.135124 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:32.135626 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.135655 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:32.136315 (+   660us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.342404 (+206089us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:32.458949 (+116545us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.479006 (+ 20057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.479099 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.133307 (+654208us) raft_consensus.cc:1685] finished
0709 13:09:33.133338 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.133560 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127375,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":17563,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":11250,"thread_start_us":261924,"threads_started":2,"wal-append.queue_time_us":290462}
I20260709 13:09:33.069670 18863 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.092752 18293 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.164707 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:33.183411 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 243293us
I20260709 13:09:33.183260 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:33.135421 18915 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:09:33.187564 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.123603 18836 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.188544 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:33.211915 15304 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:09:33.158838 18887 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:33.137774 18899 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:33.231088 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:33.156932 18918 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.124737 18825 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.125222 18630 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.258291 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.108952 18266 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:33.274382 15302 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:33.279027 15226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:33.315203 15226 raft_consensus.cc:606] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:33.280498 18836 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.274797 15304 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:33.309221 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:33.316836 15306 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.321731 18918 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.186533 18827 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.198272 18863 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:33.345856 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60583.8us
I20260709 13:09:33.318351 18728 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:33.322463 18918 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.101516 18913 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.327623 18836 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:33.392302 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.376267 18751 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:33.410681 15228 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.581s	user 0.014s	sys 0.000s
I20260709 13:09:33.417474 15228 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
W20260709 13:09:33.419189 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 219709us
I20260709 13:09:33.419927 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:33.420524 15273 leader_election.cc:336] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.381s (SENT)
I20260709 13:09:33.421049 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.438257 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:33.439011 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 386172us
I20260709 13:09:33.445590 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.437395 15382 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:33.447979 15379 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.436372 15380 pending_rounds.cc:85] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:09:33.451494 15380 pending_rounds.cc:107] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:33.451891 15380 raft_consensus.cc:2889] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.454087 18926 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.488591 15374 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:09:33.473090 18924 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:09:33.495596 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75112.9us
I20260709 13:09:33.499293 15306 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:33.520665 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 75336.7us
I20260709 13:09:33.522251 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.478302 18925 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:33.526750 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.501140 18852 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:33.544024 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.517810 18929 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.544155 15375 pending_rounds.cc:85] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:09:33.551291 15375 pending_rounds.cc:107] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:09:33.551646 15375 raft_consensus.cc:2889] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.555687 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:33.556769 16006 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:33.540593 18927 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.544468 18936 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.578768 18937 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.579735 18937 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.580026 18266 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:33.583201 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.593956 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:33.594861 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.600534 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:33.607357 15379 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:33.575726 18863 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.597165 18825 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:33.559406 18929 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.600502 18899 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.626394 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.617787 18918 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.577497 18927 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.635965 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:33.641438 18934 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:09:33.623395 18913 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.621119 18827 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:33.666205 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:33.666780 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 140134us
I20260709 13:09:33.667744 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:09:33.678916 18932 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:09:33.679844 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:33.686911 18941 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:33.687873 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:09:33.688591 18935 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 13:09:33.689517 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.690580 18946 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.691529 18946 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.672763 18899 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:33.674232 18827 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.713357 18827 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.714252 18827 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.674701 18825 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.696053 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.717171 18749 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.696319 18899 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.717698 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.717970 18899 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.718643 18749 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.719226 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.721632 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.721868 18912 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.723574 18946 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:33.724139 18946 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.724686 18946 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:33.727375 18943 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:33.728401 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:33.728147 18943 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.730671 18943 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.691890 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:33.732307 15226 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:33.732424 18943 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:33.733155 18943 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:33.733563 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.734805 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:33.700224 18907 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.902s	user 0.008s	sys 0.000s
I20260709 13:09:33.736131 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.736316 18943 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:33.736707 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 594) took 1586 ms. Trace:
I20260709 13:09:33.738600 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.737319 15381 rpcz_store.cc:276] 0709 13:09:32.150150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.160567 (+ 10417us) service_pool.cc:224] Handling call
0709 13:09:32.160882 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.167420 (+  6538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.167478 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.386802 (+219324us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b2c00083318. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:09:32.387384 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.456823 (+ 69439us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.456884 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.456982 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.699566 (+1242584us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b2400204068. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a7809d 00007f2f536aa10e 00007f2f536c188c 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221
0709 13:09:33.736407 (+ 36841us) raft_consensus.cc:1685] finished
0709 13:09:33.736441 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.736628 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6118,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"spinlock_wait_cycles":102169344,"thread_start_us":68393,"threads_started":1,"wal-append.queue_time_us":346635}
I20260709 13:09:33.740929 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.743945 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:33.740061 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.687911 18941 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.698320 18949 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:33.702057 18929 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:33.702251 18922 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.294s	user 0.000s	sys 0.002s
W20260709 13:09:33.703548 18923 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.292s	user 0.000s	sys 0.003s
I20260709 13:09:33.704370 18927 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:33.705444 18928 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:09:33.757568 18827 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:33.708925 18911 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.727697 18583 raft_consensus.cc:993] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:09:33.759471 18583 raft_consensus.cc:1081] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:09:33.750579 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.762322 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.696714 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.765982 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.783504 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:33.785946 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 89300.8us
I20260709 13:09:33.787523 15273 leader_election.cc:400] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:09:33.789122 15273 leader_election.cc:400] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:33.790457 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:33.797441 18827 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.797309 18911 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:33.848215 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57904.4us
I20260709 13:09:33.852696 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:33.853892 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 232808us
I20260709 13:09:33.863248 18749 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.891340 18827 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:33.894966 18825 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.855530 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:33.896096 18917 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.548s	user 0.000s	sys 0.002s
I20260709 13:09:33.897177 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2243) took 1147 ms. Trace:
I20260709 13:09:33.849968 18949 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.856123 18911 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:33.904748 18630 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:33.906287 18836 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:33.907379 18946 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:33.953253 18630 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.912598 16006 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:33.895357 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:33.916266 18900 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:33.920717 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.846817 18925 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:33.921710 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.921859 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.922744 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.959429 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:33.923487 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:33.929893 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.930514 15274 leader_election.cc:400] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:09:33.960646 15274 leader_election.cc:403] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:33.931048 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:33.936978 15302 rpcz_store.cc:276] 0709 13:09:32.749499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.749843 (+   344us) service_pool.cc:224] Handling call
0709 13:09:33.273930 (+524087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.314444 (+ 40514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.896856 (+582412us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b5400129b50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:33.897078 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204332416}
W20260709 13:09:33.938974 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83539.8us
I20260709 13:09:33.963481 15273 leader_election.cc:400] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
I20260709 13:09:33.963976 15273 leader_election.cc:403] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:33.965723 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:33.974005 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 43618.8us
I20260709 13:09:33.979600 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:33.982956 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:33.985067 15305 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:33.985219 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.918889 18827 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:33.995711 15305 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:33.934072 18899 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.016793 18946 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:33.991854 18729 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:33.996004 18615 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:34.025251 18925 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:33.989755 18836 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.993518 18825 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:09:34.035329 18949 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:34.078836 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.086669 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2223) took 1607 ms. Trace:
I20260709 13:09:33.992725 18900 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:34.096771 15303 rpcz_store.cc:276] 0709 13:09:32.479315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.480456 (+  1141us) service_pool.cc:224] Handling call
0709 13:09:32.504042 (+ 23586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.515606 (+ 11564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.515640 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.612648 (+ 97008us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.897053 (+284405us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:32.897102 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.897181 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.895316 (+998135us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:34.070745 (+175429us) raft_consensus.cc:1685] finished
0709 13:09:34.070768 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.086565 (+ 15797us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4959,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":8821,"spinlock_wait_cycles":24742272,"thread_start_us":213164,"threads_started":1,"wal-append.queue_time_us":570661}
I20260709 13:09:34.109589 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1792) took 1240 ms. Trace:
I20260709 13:09:34.110244 15307 rpcz_store.cc:276] 0709 13:09:32.869588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.251526 (+381938us) service_pool.cc:224] Handling call
0709 13:09:33.323920 (+ 72394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:33.339590 (+ 15670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.339646 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:33.368702 (+ 29056us) log.cc:844] Serialized 52 byte log entry
0709 13:09:33.578222 (+209520us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:33.586436 (+  8214us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.687843 (+101407us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:33.942185 (+254342us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.095972 (+153787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.096161 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.109286 (+ 13125us) raft_consensus.cc:1685] finished
0709 13:09:34.109315 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.109521 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22527,"prepare.queue_time_us":4613,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":46355,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":48605,"spinlock_wait_cycles":5409152,"thread_start_us":656112,"threads_started":3,"wal-append.queue_time_us":195357}
I20260709 13:09:34.095937 18946 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.096287 18926 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.078054 18949 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.095326 18941 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:34.133811 18899 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:34.137486 18920 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.699s	user 0.003s	sys 0.001s
I20260709 13:09:34.105999 18518 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.141991 18827 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:34.085547 18953 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.045058 18615 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:34.153916 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.169039 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 186218us
I20260709 13:09:34.101693 18567 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:09:34.185006 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:34.188751 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127219us
W20260709 13:09:34.180390 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.190757 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.158309 18949 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.152801 18926 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.210237 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.214579 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.215126 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:34.216114 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.216634 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.216820 15303 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:34.217543 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.217885 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:34.190130 18952 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:34.179370 18953 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.223205 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.189849 18518 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:34.227705 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.215828 18966 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.167505 18941 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:34.230075 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.234099 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.210101 18899 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:34.237694 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 137425us
I20260709 13:09:34.218655 18963 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.243044 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.247226 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2233) took 1717 ms. Trace:
I20260709 13:09:34.233150 18827 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.252411 18827 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.253249 18827 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.228951 18953 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.248018 15301 rpcz_store.cc:276] 0709 13:09:32.531851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.565097 (+ 33246us) service_pool.cc:224] Handling call
0709 13:09:32.565477 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.611952 (+ 46475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.611985 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.662492 (+ 50507us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.942813 (+280321us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:32.942865 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.942966 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.136773 (+1193807us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:34.237727 (+100954us) raft_consensus.cc:1685] finished
0709 13:09:34.237759 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.247133 (+  9374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46035,"raft.queue_time_us":46587,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12434,"spinlock_wait_cycles":186114816,"thread_start_us":209835,"threads_started":1,"wal-append.queue_time_us":682128}
I20260709 13:09:34.225997 18926 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.246608 18946 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.246845 18911 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:34.235743 18966 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.294030 15304 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:34.240402 18899 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.313443 18900 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:34.255172 18963 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.316531 18963 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.253943 18827 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.317745 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.319021 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:34.321534 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:34.321699 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.318662 15301 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:34.322438 15303 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
W20260709 13:09:34.323258 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80364.1us
I20260709 13:09:34.325292 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.327767 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.330538 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.331946 15376 raft_consensus.cc:2410] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:34.331998 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:34.333729 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.338284 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.339314 15374 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:34.340942 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:34.341792 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.349157 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.350445 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:34.353832 15299 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:34.355823 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:34.358210 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.362432 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.363199 15300 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:34.371129 18964 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.371954 18964 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.374585 18964 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.362092 18911 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.378863 15301 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:34.381232 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.382953 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:34.388019 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.390986 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.393246 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:34.392189 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.390865 15373 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:34.397503 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:34.361970 18963 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.401762 18963 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.363360 18941 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:34.397349 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:34.405598 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.406631 15301 raft_consensus.cc:2410] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:34.407529 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.389938 18900 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.408432 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:34.408967 18900 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.409621 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:34.412317 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.422780 15306 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:34.421424 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:34.423920 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:34.415014 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.437799 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45811.1us
W20260709 13:09:34.445654 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 103928us
I20260709 13:09:34.447139 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.439774 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.413640 18964 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:34.452026 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.452734 18950 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.459407 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.450877 18927 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.469739 18911 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.475039 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.477700 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.498378 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:34.494416 18941 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.494693 18925 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.501736 18927 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.510989 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.497763 18518 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:34.503538 18963 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:34.521332 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 157655us
I20260709 13:09:34.522666 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.467028 18964 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:34.533497 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:34.543713 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:34.554220 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43602.8us
I20260709 13:09:34.555584 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.557498 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.559269 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:34.561565 15232 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:34.550347 15302 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:09:34.532892 18941 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.531898 18615 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:34.537591 18822 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:34.535122 18518 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.589494 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.606287 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.563112 18925 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.609792 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.565310 18946 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.612504 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:34.610556 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70383.1us
I20260709 13:09:34.621510 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.608784 18963 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.613889 18749 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.624568 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.607486 18822 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:34.609375 15308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:09:34.609047 18941 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.615120 18852 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:34.617175 18827 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.622623 18925 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:34.651113 18976 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:34.676172 18927 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.652576 18964 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:34.653404 18822 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:34.655247 18986 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:34.628575 18946 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.666406 18949 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.636893 18852 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.633188 18963 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:34.688573 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 95442.2us
I20260709 13:09:34.700982 15308 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:34.701740 15308 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.694597 18852 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:34.703613 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 86808.7us
W20260709 13:09:34.702610 18836 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.003s
I20260709 13:09:34.711114 18981 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:34.713670 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 89203us
I20260709 13:09:34.721941 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.726300 18949 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.727013 18266 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:34.728662 18836 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8.
I20260709 13:09:34.733180 18946 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.733757 18946 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.734200 18946 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.740433 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.743474 15307 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:34.744298 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:34.747324 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 128776us
I20260709 13:09:34.748790 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.750345 18941 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.744935 18927 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.751760 18927 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.752329 18657 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.754040 18963 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.752403 18927 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.751648 18966 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.766942 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:34.751101 18941 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.770618 18941 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:34.777164 18953 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.009s
I20260709 13:09:34.777684 18953 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.782064 18946 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.787089 18900 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.780158 18953 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.790222 18911 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.794777 18911 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.795472 18911 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.791106 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:09:34.792923 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44268.9us
I20260709 13:09:34.817353 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.793542 18899 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.820595 18899 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.821290 18899 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.824921 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.855123 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.865767 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.870045 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.854995 18819 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.855279 18925 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.858865 15308 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.857764 18950 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.870810 18749 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.867794 18953 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.937471 18899 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:34.939419 18946 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:34.923141 18900 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.941196 18941 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:34.880458 18819 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.882637 18925 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.886279 18991 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:34.992082 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 173645us
W20260709 13:09:34.994175 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 92670.7us
W20260709 13:09:34.996295 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.973544 18819 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.969513 18950 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:34.926362 18953 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:35.000767 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 130886us
I20260709 13:09:34.975170 18925 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.009927 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:34.992935 18991 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:34.972061 18900 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.024310 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:35.017691 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 194172us
I20260709 13:09:35.033546 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:35.035035 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:35.049007 18630 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.053479 15232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:35.054412 15232 raft_consensus.cc:606] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:35.054842 15232 raft_consensus.cc:614] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:35.054970 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.046901 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:35.062695 18630 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.063493 15374 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.065569 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:35.016273 18991 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.072302 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:35.080492 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:35.027243 18899 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.012415 18927 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.086875 18966 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.087350 18630 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.087556 18583 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:35.110203 18927 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:35.115036 18953 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:35.039810 19006 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.126740 18900 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:35.130386 18852 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.050590 18926 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:35.136402 18982 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:09:35.098412 15231 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:35.098814 18941 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:35.144398 18729 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.145067 18729 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.170403 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2039) took 1248 ms. Trace:
I20260709 13:09:35.170931 15231 rpcz_store.cc:276] 0709 13:09:33.921479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.921594 (+   115us) service_pool.cc:224] Handling call
0709 13:09:35.170111 (+1248517us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003c19d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:35.170273 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618323840}
I20260709 13:09:35.173875 18852 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:35.175434 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 383704us
I20260709 13:09:35.176908 15198 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:35.085655 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:35.186408 15374 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.197456 15377 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:35.198557 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 113168us
I20260709 13:09:35.199736 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:35.214236 18991 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.219777 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:35.235031 18991 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:35.101591 18925 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.237803 18988 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:35.239480 18872 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.179181 18911 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.240130 18872 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:35.240147 18925 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:35.242138 18911 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:35.241601 18872 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.214357 18926 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:35.247398 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 248451us
I20260709 13:09:35.248090 15375 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:35.250828 15378 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:35.243724 18872 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.247028 18977 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:09:35.221028 18990 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.221436 18900 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.220258 18953 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.278750 18953 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:35.282159 18953 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:35.283651 18989 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:35.285146 18989 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.285430 18583 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:35.285630 18989 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:35.286116 18583 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:35.286779 18989 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.288115 18989 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.275079 19008 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:09:35.290679 19008 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:35.291389 19008 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:35.292945 19008 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.287338 18583 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.309018 15299 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.276993 18900 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:35.325497 15303 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.254926 18978 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:35.330816 18900 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.355008 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:35.360057 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.361353 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.362044 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.362421 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.363554 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.367692 15232 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:35.355558 18583 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.329097 18819 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:35.357924 19008 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.416826 15302 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:35.418792 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.428710 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.356133 18808 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:35.435899 15303 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:35.436458 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.428782 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:35.386075 19007 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:09:35.452234 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.456413 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.457475 15308 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:35.433490 18657 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.439587 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 223802us
I20260709 13:09:35.435457 18926 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:35.471882 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.450937 18808 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:35.480556 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.481897 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.492928 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.501194 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.460091 18985 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:09:35.524789 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.528195 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:35.528772 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:35.531428 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.981s (SENT) [suppressed 27 similar messages]
W20260709 13:09:35.532490 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 264879us
I20260709 13:09:35.538146 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.538439 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:35.497189 18946 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:35.473062 18657 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:35.502856 19011 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:35.548032 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:35.565158 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:35.567193 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:35.482892 18926 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.515622 18911 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:35.605278 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:35.587560 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:35.670054 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:35.672307 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.673594 15303 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:35.700364 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.702515 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.673224 15375 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:35.716472 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:35.717715 15231 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.718154 15231 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:35.720279 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:35.719159 15231 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.748238 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.757694 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.669165 18946 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:35.795166 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 263765us
I20260709 13:09:35.709353 18911 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.799600 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:35.602953 19011 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:35.787993 15375 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:35.803992 15231 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.766955 18953 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.748548 18852 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:09:35.832976 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.785094 18819 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:35.834950 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:35.835879 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 367130us
I20260709 13:09:35.816533 15376 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
W20260709 13:09:35.837625 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 248120us
I20260709 13:09:35.861678 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.834120 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:35.863277 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.863878 15374 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.861651 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.868043 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:35.870692 15379 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:35.886520 19012 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.866894 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:35.856930 19013 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
W20260709 13:09:35.973515 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80846.9us
I20260709 13:09:35.889714 15375 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:35.890822 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:35.836400 18953 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.004733 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:36.005990 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:36.007576 19027 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:09:36.008701 18926 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:36.009568 19026 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:09:36.027222 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:36.028813 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:36.029428 15380 raft_consensus.cc:1813] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Handling vote request from an unknown peer 841138f50ace4746978e72d7f13878de
I20260709 13:09:36.029966 15380 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:36.030884 18911 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.031658 18911 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:36.012979 18872 consensus_meta.cc:287] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.008s
I20260709 13:09:36.010035 18852 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:35.997298 18998 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:09:35.882395 18925 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.042217 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:36.042217 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:36.041904 15228 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:35.887219 19012 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.008855 18657 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:35.983428 18808 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:36.032290 18729 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:36.203003 18946 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:36.027326 18953 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.020658 19011 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:35.981006 19009 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 13:09:36.078297 18926 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.153301 19012 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.997490 18985 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.221s
W20260709 13:09:36.271116 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.034s	sys 0.026s
W20260709 13:09:36.271984 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.034s	sys 0.026s
W20260709 13:09:36.273139 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 552951us
I20260709 13:09:36.278060 15231 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:36.032231 18911 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:36.204238 18998 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:36.289529 15374 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:36.305970 18985 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:36.306727 18985 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:36.152578 18852 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:36.292165 19034 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:09:36.351824 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:36.369863 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:36.295305 18998 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:36.426721 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57016.8us
W20260709 13:09:36.428289 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 76726.9us
W20260709 13:09:36.457999 15381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.019s	sys 0.057s
W20260709 13:09:36.460142 15381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.020s	sys 0.057s
I20260709 13:09:36.463116 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2215) took 1295 ms. Trace:
I20260709 13:09:36.280803 18926 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:36.468532 15381 rpcz_store.cc:276] 0709 13:09:35.168089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.168258 (+   169us) service_pool.cc:224] Handling call
0709 13:09:35.173787 (+  5529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.174113 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:35.465595 (+291482us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.462652 (+997057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.462735 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:36.462808 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.462901 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.463049 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42251,"prepare.queue_time_us":126528,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2545,"raft.queue_time_us":35580,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":6114,"thread_start_us":1204580,"threads_started":3,"wal-append.queue_time_us":551081}
W20260709 13:09:36.458308 19008 consensus_meta.cc:287] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.002s	user 0.010s	sys 0.005s
I20260709 13:09:36.307946 18985 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:36.481964 15345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.011s	sys 0.035s
W20260709 13:09:36.489090 15345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.011s	sys 0.035s
W20260709 13:09:36.491307 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 656435us
I20260709 13:09:36.466074 19011 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.505898 15224 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
W20260709 13:09:36.483255 18954 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.015s	sys 0.057s
W20260709 13:09:36.484794 18989 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.195s	user 0.015s	sys 0.002s
W20260709 13:09:36.512629 15306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.012s	sys 0.013s
W20260709 13:09:36.515189 15373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.030s	sys 0.117s
W20260709 13:09:36.515465 15306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.013s	sys 0.013s
W20260709 13:09:36.516956 15373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.030s	sys 0.117s
W20260709 13:09:36.518184 15346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.004s	sys 0.023s
W20260709 13:09:36.509330 18954 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.016s	sys 0.058s
W20260709 13:09:36.521127 15971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.019s
W20260709 13:09:36.505695 16004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.020s	sys 0.052s
W20260709 13:09:36.522774 15346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.004s	sys 0.023s
W20260709 13:09:36.529258 15971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.003s	sys 0.020s
I20260709 13:09:36.521147 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2221) took 1331 ms. Trace:
W20260709 13:09:36.533239 15974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.000s	sys 0.029s
W20260709 13:09:36.533641 15974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.000s	sys 0.029s
W20260709 13:09:36.535521 15377 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.000s	sys 0.028s
I20260709 13:09:36.533466 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 631) took 1047 ms. Trace:
I20260709 13:09:36.522020 19011 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:36.542286 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2293) took 1150 ms. Trace:
I20260709 13:09:36.542892 15307 rpcz_store.cc:276] 0709 13:09:35.391958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.392118 (+   160us) service_pool.cc:224] Handling call
0709 13:09:35.420449 (+ 28331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:35.421051 (+   602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.421097 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:35.435948 (+ 14851us) log.cc:844] Serialized 52 byte log entry
0709 13:09:35.744641 (+308693us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:35.744687 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.744755 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.541885 (+797130us) raft_consensus.cc:1685] finished
0709 13:09:36.541921 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.542188 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1582,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":13864,"thread_start_us":269691,"threads_started":1,"wal-append.queue_time_us":729869}
W20260709 13:09:36.538908 15377 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.000s	sys 0.029s
I20260709 13:09:36.520416 18985 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.537451 15375 rpcz_store.cc:276] 0709 13:09:35.485909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.073071 (+587162us) service_pool.cc:224] Handling call
0709 13:09:36.073580 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.362783 (+289203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.362838 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.362904 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:36.362956 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.533173 (+170217us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54003f2854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:36.533236 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.533399 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664151296}
W20260709 13:09:36.544845 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.530622 16004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.020s	sys 0.053s
W20260709 13:09:36.551223 15347 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.015s	sys 0.015s
I20260709 13:09:36.537817 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:36.531919 15373 rpcz_store.cc:276] 0709 13:09:35.189891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.190042 (+   151us) service_pool.cc:224] Handling call
0709 13:09:35.190418 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.190701 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:35.487877 (+297176us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.520676 (+1032799us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.520742 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:36.520799 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.520903 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.521073 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34170,"prepare.queue_time_us":125083,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":22135,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":24164,"thread_start_us":1267778,"threads_started":3,"wal-append.queue_time_us":806940}
I20260709 13:09:36.546286 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2224) took 1329 ms. Trace:
W20260709 13:09:36.552294 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.010s	sys 0.014s
W20260709 13:09:36.556303 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.010s	sys 0.014s
W20260709 13:09:36.556814 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 554736us
I20260709 13:09:36.556499 15377 rpcz_store.cc:276] 0709 13:09:35.216652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.216782 (+   130us) service_pool.cc:224] Handling call
0709 13:09:35.217161 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.217443 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:35.488292 (+270849us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.545710 (+1057418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.545792 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:36.545894 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.546006 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.546201 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33347,"prepare.queue_time_us":228764,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2899,"raft.queue_time_us":181989,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":1281848,"threads_started":3,"wal-append.queue_time_us":820735}
W20260709 13:09:36.553767 15347 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.015s	sys 0.015s
W20260709 13:09:36.562197 19036 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:09:36.555276 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:36.581243 15227 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:36.534824 18946 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:36.630712 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47452.8us
W20260709 13:09:36.531193 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 639245us
W20260709 13:09:36.563623 19037 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:09:36.564814 18990 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:09:36.638358 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.036s	sys 0.056s
I20260709 13:09:36.657696 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2056) took 1136 ms. Trace:
I20260709 13:09:36.516152 18998 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:36.660409 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.036s	sys 0.056s
I20260709 13:09:36.562873 19011 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:36.666555 19039 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:09:36.635775 19008 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:36.667953 18925 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.668679 18925 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.669031 18926 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:36.669680 18926 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.670198 18926 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.671051 18925 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.660493 15224 rpcz_store.cc:276] 0709 13:09:35.521516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.521968 (+   452us) service_pool.cc:224] Handling call
0709 13:09:36.657325 (+1135357us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54002e2f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:36.657578 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244777216}
I20260709 13:09:36.671610 18925 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:36.660296 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:36.668151 19029 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:36.578943 15120 maintenance_manager.cc:419] P 476e7efc84e541a3bd0f38661ad40403: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033356
I20260709 13:09:36.658778 18946 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.549952 18954 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:36.678508 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46567.9us
I20260709 13:09:36.632642 19045 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.687158 15273 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.009s	sys 0.025s
W20260709 13:09:36.690227 15273 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.009s	sys 0.025s
I20260709 13:09:36.672168 18925 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:36.681778 15972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.043s	sys 0.030s
I20260709 13:09:36.688216 19048 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:09:36.690855 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 754062us
W20260709 13:09:36.693434 15972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.044s	sys 0.030s
I20260709 13:09:36.697290 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2040) took 1336 ms. Trace:
I20260709 13:09:36.705170 19046 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.706136 19046 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.706874 19046 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.709370 18996 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:36.709918 18996 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:36.702996 15227 rpcz_store.cc:276] 0709 13:09:35.360949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.361089 (+   140us) service_pool.cc:224] Handling call
0709 13:09:36.696991 (+1335902us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540033ca54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:36.697188 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2655140224}
I20260709 13:09:36.681492 19022 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.735181 18583 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.302s	user 0.015s	sys 0.000s
I20260709 13:09:36.690428 18911 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:36.737178 18911 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.737805 18911 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.698899 19045 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.741513 18852 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:36.742977 19045 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.743666 19045 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.743186 19022 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:36.745709 15230 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:36.746682 19022 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.747057 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2043) took 1385 ms. Trace:
I20260709 13:09:36.747552 15230 rpcz_store.cc:276] 0709 13:09:35.362009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.362129 (+   120us) service_pool.cc:224] Handling call
0709 13:09:36.746843 (+1384714us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54000dded4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:36.746979 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3157479296}
I20260709 13:09:36.749358 18946 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.689164 18954 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:36.750844 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76519us
I20260709 13:09:36.710873 18996 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:36.756290 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 71713.5us
I20260709 13:09:36.773505 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:36.775285 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:36.740222 18911 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.778019 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2208) took 1719 ms. Trace:
W20260709 13:09:36.779419 19038 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.302s	user 0.010s	sys 0.000s
I20260709 13:09:36.778661 15382 rpcz_store.cc:276] 0709 13:09:35.058909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.059034 (+   125us) service_pool.cc:224] Handling call
0709 13:09:35.059341 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.378529 (+319188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.378564 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.379544 (+   980us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.837115 (+457571us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:35.837178 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.837251 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.777747 (+940496us) raft_consensus.cc:1685] finished
0709 13:09:36.777774 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.777947 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29408,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":714632,"threads_started":2,"wal-append.queue_time_us":1142885}
I20260709 13:09:36.782652 18998 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:36.788480 15271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.000s	sys 0.049s
W20260709 13:09:36.791677 15271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.000s	sys 0.050s
I20260709 13:09:36.752008 19045 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.769857 18926 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:36.769723 19012 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.817132 19046 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.819813 18925 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:36.820387 15378 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:36.806743 18900 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.443s	user 0.019s	sys 0.009s
I20260709 13:09:36.825259 18900 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.825292 16000 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:36.826936 15302 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:36.819844 19012 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.809442 19045 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.837037 18808 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:36.837530 18808 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:36.838505 19045 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.723721 19048 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.853263 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:36.843031 15272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.005s	sys 0.056s
W20260709 13:09:36.856825 15272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.006s	sys 0.056s
I20260709 13:09:36.838476 18808 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.871218 18954 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.843081 19001 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:36.874454 19001 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:36.882157 18988 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:36.882449 18981 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:36.883056 18988 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:36.886379 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2296) took 1491 ms. Trace:
I20260709 13:09:36.886848 19048 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.887271 18988 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:36.846910 18926 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.886907 15302 rpcz_store.cc:276] 0709 13:09:35.395363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.435137 (+ 39774us) service_pool.cc:224] Handling call
0709 13:09:35.435500 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.828968 (+1393468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.886081 (+ 57113us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002125d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:36.886299 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198933888}
W20260709 13:09:36.911285 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 451349us
I20260709 13:09:36.899367 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:36.921859 16000 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:36.920663 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:36.934810 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.940168 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:36.949268 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:36.949088 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:36.961616 18953 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.718s	user 0.014s	sys 0.000s
I20260709 13:09:36.962297 18953 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:36.963116 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 407920us
I20260709 13:09:36.955629 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:36.974546 19048 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:36.888295 18981 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:36.982326 15382 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.982363 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:36.982491 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 630) took 1498 ms. Trace:
I20260709 13:09:36.988742 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:36.990454 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:36.985500 15380 rpcz_store.cc:276] 0709 13:09:35.485560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.031516 (+545956us) service_pool.cc:224] Handling call
0709 13:09:36.031810 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.460975 (+429165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.461012 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.461071 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:36.461111 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.982195 (+521084us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54001abdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:36.982248 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.982423 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986320128}
I20260709 13:09:36.993135 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:36.975404 19048 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:36.995445 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.001819 15224 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:36.996172 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:36.997059 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:36.998673 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:36.999131 15377 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.999686 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.007149 18953 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.007284 19058 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.008170 19058 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.009615 19048 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:36.977631 18900 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:36.980026 19045 raft_consensus.cc:476] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:36.981858 18925 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.022887 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:37.023532 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43759.6us
I20260709 13:09:37.026083 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.027933 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.028756 15225 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:37.030864 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.040570 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.038482 19048 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.046306 19048 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.046736 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:37.048879 19051 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:37.019299 19014 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.050484 19052 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.050655 19051 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.051220 19052 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.051373 19051 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.051977 19064 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.052529 18852 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.052654 19064 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.053130 18852 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:37.054508 15378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2000) took 1543 ms (client timeout 2015 ms). Trace:
W20260709 13:09:37.054955 15378 rpcz_store.cc:269] 0709 13:09:35.511352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.005628 (+494276us) service_pool.cc:224] Handling call
0709 13:09:37.054229 (+1048601us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b540027bad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:37.054407 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818552576}
I20260709 13:09:37.055517 18852 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:37.055701 19062 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.056320 19062 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.057783 18911 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:37.058416 18911 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:37.058754 19062 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.059386 19062 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:37.059834 19062 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.018698 19059 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.027640 18925 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.063786 19059 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.064889 19012 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.048208 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:37.059456 18911 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.082955 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:37.050228 19014 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.052219 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2295) took 1659 ms. Trace:
I20260709 13:09:37.025149 19045 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.065616 19012 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.043323 19058 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.076493 18981 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.067420 18900 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:37.079263 19001 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.080088 19048 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:37.079941 18781 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:37.103538 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.056119 18852 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.097630 15306 rpcz_store.cc:276] 0709 13:09:35.392797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.393887 (+  1090us) service_pool.cc:224] Handling call
0709 13:09:35.394296 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.394626 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:35.836600 (+441974us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.051657 (+1215057us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b180045b320. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287
0709 13:09:37.051795 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:37.051865 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:37.051927 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.052007 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.052154 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12832,"prepare.queue_time_us":1111992,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":436149,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":25765,"spinlock_wait_cycles":4992768,"thread_start_us":1515905,"threads_started":3,"wal-append.queue_time_us":971723}
W20260709 13:09:37.097186 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 141664us
I20260709 13:09:37.060259 19062 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.044745 18953 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.135066 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.140683 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:37.141564 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:37.142412 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.140609 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.144990 15226 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:37.145898 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.084210 19064 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:37.152750 15382 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:37.147275 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.147781 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.149482 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.150139 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:37.143148 16006 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:37.095189 19046 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:37.092522 18925 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:37.154305 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.110946 18946 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:37.156574 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.125247 19058 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.155779 19065 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.177317 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.190812 15227 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:09:37.170423 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.184911 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.179373 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.186947 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.144622 19023 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.196902 15229 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:37.205389 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.212282 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:37.216285 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:37.218062 15303 raft_consensus.cc:2410] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:37.221314 15379 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.213574 15301 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:37.136678 18657 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:09:37.167027 18946 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.163975 19071 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.172097 19045 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.166599 19043 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.181668 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 563) took 1612 ms. Trace:
I20260709 13:09:37.228106 15373 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.179986 19064 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.182922 19059 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.180305 19046 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:37.247648 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.254194 15373 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:37.248705 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.254549 19046 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.201939 19065 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.159332 18953 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.257687 19065 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.198874 19058 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.258479 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:37.158836 18852 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.259832 19058 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.244535 19045 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.261981 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.262491 19052 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.262732 19045 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.201582 19074 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.272842 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.265309 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.222993 19023 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.259599 18953 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.251781 19009 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:37.232831 18946 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.224264 19069 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.243680 19071 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.361968 19082 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.362694 19082 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.364061 19071 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.364660 19068 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.369297 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.316143 19077 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.267323 19043 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.359797 19059 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:37.398943 19060 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.162s	user 0.010s	sys 0.010s
I20260709 13:09:37.345518 18900 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:37.317166 19074 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.388270 19041 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:37.396046 18808 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.367043 19075 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.398386 19051 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.397311 19014 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:37.420859 19047 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:09:37.421463 19012 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:37.366557 19069 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.399299 19082 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.435137 19059 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.442178 19075 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.396500 19068 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.450583 19043 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.417845 19077 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.460776 19059 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.460947 19069 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.461660 19062 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.462312 19077 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.463605 19062 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.452099 19075 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:37.456465 19078 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.141s	user 0.000s	sys 0.005s
I20260709 13:09:37.457700 19074 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.467552 19068 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.521840 15129 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.531342 15129 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:37.533823 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.546041 15129 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:37.549103 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 236293us
I20260709 13:09:37.550158 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.550271 15129 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:37.552030 15224 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
W20260709 13:09:37.536389 15130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 94) took 11438 ms (client timeout 15000 ms). Trace:
I20260709 13:09:37.368852 15306 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:09:37.552249 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.553956 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:37.577430 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.557294 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.568953 15304 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:37.563671 15300 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.583079 18852 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:37.439397 19041 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.592182 18985 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:37.597133 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.597393 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:37.606544 18822 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.607982 18822 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.612360 19069 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.613716 19069 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.617441 19074 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.618809 19074 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.241019 16004 rpcz_store.cc:276] 0709 13:09:35.548844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.549988 (+  1144us) service_pool.cc:224] Handling call
0709 13:09:35.733811 (+183823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.756086 (+ 22275us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:35.804683 (+ 48597us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.835734 (+1031051us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180045d9c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf 00007f2f53b40038
0709 13:09:37.039075 (+203341us) log.cc:844] Serialized 14 byte log entry
0709 13:09:37.099266 (+ 60191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:37.116919 (+ 17653us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:37.120387 (+  3468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.144730 (+ 24343us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.161530 (+ 16800us) inbound_call.cc:177] Queueing success response
0709 13:09:37.245308 (+ 83778us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b180045d9c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
Metrics: {"mutex_wait_us":51497,"prepare.queue_time_us":547197,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":101,"raft.queue_time_us":71016,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":35385,"spinlock_wait_cycles":30455424,"thread_start_us":918802,"threads_started":2,"wal-append.queue_time_us":865227}
I20260709 13:09:37.625651 19077 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.626818 19077 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.607316 18900 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.633966 19075 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:37.634856 19074 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.635210 19075 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.642424 19069 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.644958 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:37.600697 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:37.612315 18822 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.677978 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.682879 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.683092 19062 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.684020 19062 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.684520 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:37.682955 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:37.735986 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 152723us
I20260709 13:09:37.736236 18852 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:37.736933 18852 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:37.737530 18852 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.737939 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:37.599858 15130 rpcz_store.cc:269] 0709 13:09:26.097687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.098196 (+   509us) service_pool.cc:224] Handling call
0709 13:09:27.209630 (+1111434us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5400381728. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59d18331 00007f2f59d133fc 00007f2f598e51b4 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:37.536053 (+10326423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:33.549996 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:33.642578 (+ 92582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:33.665295 (+ 22717us) write_op.cc:435] Acquired schema lock
0709 13:09:33.668210 (+  2915us) tablet.cc:662] Decoding operations
0709 13:09:33.706049 (+ 37839us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:33.706123 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:33.706155 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:33.707665 (+  1510us) tablet.cc:701] Row locks acquired
0709 13:09:33.707698 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:09:33.707933 (+   235us) write_op.cc:270] Start()
0709 13:09:33.708112 (+   179us) write_op.cc:276] Timestamp: P: 1783602573707868 usec, L: 0
0709 13:09:33.708147 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:09:33.756079 (+ 47932us) log.cc:844] Serialized 4430 byte log entry
0709 13:09:34.027622 (+271543us) op_driver.cc:464] REPLICATION: finished
0709 13:09:34.409037 (+381415us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2332a 00007f2f53aa8f14 00007f2f53aa8ec3 00007f2f53aa8e38 00007f2f53aa8df3 00007f2f53aa80dc 00007f2f53ad1e16 00007f2f53ab9cbb 00007f2f53aa439d 00007f2f53aa7d75
0709 13:09:34.456917 (+ 47880us) write_op.cc:301] APPLY: starting
0709 13:09:34.459590 (+  2673us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:34.505192 (+ 45602us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:34.507552 (+  2360us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:34.665946 (+158394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:34.666405 (+   459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:09:34.666482 (+    77us) write_op.cc:312] APPLY: finished
0709 13:09:34.667060 (+   578us) log.cc:844] Serialized 83 byte log entry
0709 13:09:34.667305 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:34.667492 (+   187us) write_op.cc:454] Released schema lock
0709 13:09:34.667550 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:34.668117 (+   567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:34.668152 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":450573,"reported_tablets":20,"spinlock_wait_cycles":58114816,"child_traces":[["op",{"apply.queue_time_us":349551,"apply.run_cpu_time_us":6864,"apply.run_wall_time_us":225822,"num_ops":11,"prepare.queue_time_us":198770,"prepare.run_cpu_time_us":12021,"prepare.run_wall_time_us":304409,"raft.queue_time_us":137673,"raft.run_cpu_time_us":31050,"raft.run_wall_time_us":460971,"replication_time_us":277671,"spinlock_wait_cycles":10410240,"thread_start_us":367957,"threads_started":4,"wal-append.queue_time_us":44637,"wal-append.run_cpu_time_us":22610,"wal-append.run_wall_time_us":1872239}]]}
I20260709 13:09:37.761148 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:37.793349 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55703.5us
I20260709 13:09:37.772578 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.788197 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.743763 19023 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.803829 19009 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:37.804131 19045 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:37.804756 19009 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:37.804996 19045 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.805730 19045 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.728128 18985 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:09:37.806753 19009 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.807607 18985 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:37.808084 18985 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:37.809720 15230 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:37.809608 18985 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.770305 19041 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.815404 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:37.815416 18996 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.816740 19062 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.761206 19068 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.778716 15274 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:37.730289 19083 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:37.836099 18875 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:37.836891 18875 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:37.813838 19075 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:37.761077 18852 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.760952 15129 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.818393 19068 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:37.840979 19083 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.851119 15380 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:37.861364 16000 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:37.861567 19009 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.862352 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.864379 15379 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:37.865679 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:37.864493 19087 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.368s	user 0.004s	sys 0.012s
I20260709 13:09:37.864442 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.870354 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:37.870899 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:37.873598 18852 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:37.874732 15129 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.877276 15129 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 8, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.859025 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.879715 15129 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:37.886935 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48695.6us
I20260709 13:09:37.894761 19071 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:37.896061 18981 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.897188 19083 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:37.891224 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 113733us
I20260709 13:09:37.903030 18729 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:37.903724 18729 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:37.905117 18729 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:37.906878 18729 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.905738 19068 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:37.882706 18985 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.909343 18615 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:37.916129 18615 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.916687 18615 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.880227 19077 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.922463 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:37.923928 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.931272 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.932408 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.932771 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.932986 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.933285 15373 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:37.933764 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.944243 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:37.946806 15374 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:37.955360 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.939780 15129 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 6, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.968181 18875 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:37.969811 18875 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:37.988961 19068 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:37.989600 19068 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.990000 19068 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:37.995201 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:37.997519 15376 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:38.000861 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:38.014708 19014 consensus_queue.cc:1175] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:09:38.016855 15380 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:38.022249 18900 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:38.022547 19077 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:38.023165 18900 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:38.023384 19077 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:38.025508 18527 consensus_queue.cc:1175] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5c70ddb5aae14b059dc90fd40125b034" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:38.026242 19077 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:37.985590 18981 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.026531 18900 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:38.042541 15374 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:38.039649 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:38.003165 15129 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 4, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.049572 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:38.049877 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46164.9us
W20260709 13:09:38.060312 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 189642us
I20260709 13:09:38.067198 15129 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:38.069765 15129 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 8, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.071915 15129 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.047962 19071 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:38.045378 19075 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:38.100711 19071 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:38.095108 15300 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:38.050350 18981 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.103927 19071 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:38.122994 15129 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.125694 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:09:38.137633 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 168193us
I20260709 13:09:38.139894 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:38.150766 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71092.5us
W20260709 13:09:38.150810 18946 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.743s	user 0.003s	sys 0.016s
I20260709 13:09:38.129736 19068 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:38.148052 19045 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.150892 19075 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:38.184005 18808 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:38.189646 15304 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:38.182204 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:38.199183 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:38.213056 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49110.8us
I20260709 13:09:38.214567 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:38.195757 19092 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:09:38.178102 15129 catalog_manager.cc:5697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 7, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.233019 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.173848 18946 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:38.222424 19095 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:09:38.246361 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.247398 15225 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:38.217460 19083 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:38.256701 18946 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:38.257825 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.264246 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.248751 19046 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:38.264959 15378 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:38.269611 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 180136us
W20260709 13:09:38.270601 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.271212 19046 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.275910 19046 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.280776 18981 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:38.290081 19045 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:38.290555 19075 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:38.295466 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.295746 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.296188 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.299614 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.301057 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.301762 15228 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
W20260709 13:09:38.304411 15378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2239) took 1205 ms (client timeout 1601 ms). Trace:
I20260709 13:09:38.304840 19063 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.304921 15378 rpcz_store.cc:269] 0709 13:09:37.098765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.098976 (+   211us) service_pool.cc:224] Handling call
0709 13:09:38.304029 (+1205053us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400224054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:38.304237 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565802368}
I20260709 13:09:38.305608 19063 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.320951 19068 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:38.322343 19096 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:09:38.323596 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:38.325551 15129 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 7, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.342979 15129 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.328584 19045 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:38.354111 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.354398 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:38.356211 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.357940 18388 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:38.359258 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 113497us
I20260709 13:09:38.360541 15129 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:38.365319 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 94779.9us
I20260709 13:09:38.373013 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:38.373272 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:38.375845 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.379696 15129 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.385504 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:38.384531 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.388736 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.390213 15225 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:38.381938 18980 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:38.396560 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.386343 19063 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:38.398869 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.403307 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.411655 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.412282 18615 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.414908 18615 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:38.417520 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.419229 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.419551 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.420686 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.420948 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.421362 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.422277 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.422731 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.423528 15303 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:38.424829 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.427013 18996 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:38.420971 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.428536 18996 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:38.428997 18996 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:38.430056 18996 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.396977 19083 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:38.431648 18822 consensus_queue.cc:1175] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 7 status { last_received { term: 7 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 4 } }
I20260709 13:09:38.380772 18946 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:38.431668 18996 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:38.454239 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 71448.7us
W20260709 13:09:38.456108 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91773.3us
I20260709 13:09:38.465802 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:38.474033 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 71684.6us
I20260709 13:09:38.476791 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.481527 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.482285 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:38.482376 15233 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:09:38.438177 15129 catalog_manager.cc:5697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 6, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.488826 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.483466 18981 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:09:38.489392 18822 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.490238 18822 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:38.490823 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:38.473748 18729 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.566s	user 0.014s	sys 0.002s
I20260709 13:09:38.490512 18981 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:38.496836 15232 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.490728 18822 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.503050 15225 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:38.502871 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:38.501354 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:38.504091 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:38.504530 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:38.523669 15233 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:38.507041 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:38.508409 18875 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:38.523017 15226 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:38.534323 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.542479 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.542529 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.546988 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.549547 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.551358 19032 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.552428 19032 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.552744 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.555554 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.557545 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.528668 18981 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:38.561331 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:38.561861 18981 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.567967 15228 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
W20260709 13:09:38.581017 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80226.5us
W20260709 13:09:38.582783 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 75883us
I20260709 13:09:38.580652 19046 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.584223 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.582095 15129 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.594556 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.595012 15302 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:38.603466 15232 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:38.610378 19046 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:38.615396 19083 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.619599 19083 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.623556 19083 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:38.564301 18981 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.634404 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.635560 15232 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:38.652104 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:38.638855 18875 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.639190 18729 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:38.640528 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:38.642081 19099 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:38.643931 15291 tablet_service.cc:1558] Processing DeleteTablet for tablet dc5a1ea32aef45d1b6e1ff8b0718d178 with delete_type TABLET_DATA_TOMBSTONED (TS 841138f50ace4746978e72d7f13878de not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53964
W20260709 13:09:38.649582 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67538.7us
I20260709 13:09:38.650375 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:38.671290 15308 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.672580 15231 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:38.654873 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.631075 15129 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 5, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.669075 15224 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.669898 18729 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.701285 15129 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 6, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.667958 18875 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:38.699257 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.685452 19083 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.723511 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.723564 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:38.722097 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.709721 18729 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:38.719744 19045 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:09:38.734985 18925 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.742250 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.742913 15308 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:38.749185 15129 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.713068 18875 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.757725 15224 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:38.763304 15129 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.769676 15129 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 5, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 5 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.724136 19083 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:38.712110 19046 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:38.774818 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:38.791193 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.759390 19075 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:38.757452 19068 raft_consensus.cc:2764] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:09:38.758126 18925 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.774026 18985 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.785288 19083 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.785313 18527 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:38.819162 15129 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 3 to 6, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:38.822448 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107515us
I20260709 13:09:38.794016 19032 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:38.826411 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 98266.3us
I20260709 13:09:38.797049 19075 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:38.802352 18925 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:38.831328 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 145139us
I20260709 13:09:38.840241 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.849917 19045 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:38.850649 19045 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:38.851645 15376 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:38.799564 19046 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.838495 19075 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.880110 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.881245 15300 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:38.884044 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:38.885142 15373 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:38.888484 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:38.875723 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.867197 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:38.810374 18985 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.903475 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.941449 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.944802 19115 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:38.879274 18822 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:38.959218 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:38.899049 19045 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:38.962214 19063 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:38.924821 19112 tablet_replica.cc:333] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:09:38.910270 19068 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.973520 15229 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:38.975796 18822 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:38.990981 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:38.992331 15299 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:39.003278 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.004657 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.004944 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:39.005981 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.006239 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:39.006862 15302 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:39.007182 15305 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:39.007740 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:39.008576 15302 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:39.008945 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:39.011617 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.008090 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:38.985183 19068 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.017213 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.018121 15302 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:39.020691 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.025981 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.026306 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:39.031265 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 136840us
I20260709 13:09:39.033789 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.036615 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:39.035568 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.001255 19117 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.039054 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.039054 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:39.042163 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.046168 15303 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:39.028990 19068 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.057724 15306 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.058149 18925 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.066465 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:39.067479 15224 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:39.060951 15299 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:38.999218 19063 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.066607 15302 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:09:39.073297 15305 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.080556 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.125420 15382 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:39.130733 18925 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:39.134364 18729 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.074309 19120 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.136508 15227 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:39.124579 19122 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:39.087523 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:39.146991 15306 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:09:39.148713 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 96725.1us
I20260709 13:09:39.046353 18808 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:09:39.124619 19032 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.155469 19063 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:39.141213 18822 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.188499 15301 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.192471 19046 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:39.151590 19120 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:39.152041 18985 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:39.064450 19117 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.160528 19122 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:39.188052 19116 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:39.201471 19032 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:39.242033 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.202821 18822 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.242449 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:39.245605 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 174548us
I20260709 13:09:39.251550 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:39.253791 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:39.254582 15224 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:39.260998 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.263372 15299 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:39.264478 19056 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:09:39.268778 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:39.269488 19125 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.270171 19127 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.270766 19127 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.272377 19126 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.269590 15229 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:39.274791 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54207.1us
I20260709 13:09:39.273253 19126 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.270596 19125 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.277381 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:39.285754 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.290774 15303 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.262745 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:39.250102 18729 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:39.294015 18875 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.005s
I20260709 13:09:39.278774 19023 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.311561 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:39.321915 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91645.8us
W20260709 13:09:39.337978 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 253611us
W20260709 13:09:39.326866 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 90835us
I20260709 13:09:39.323467 19128 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:39.372011 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55081.3us
I20260709 13:09:39.321697 18875 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:39.379562 18875 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:39.380488 15232 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:39.381279 19124 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:09:39.380492 19118 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.382019 19118 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.382457 19083 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.005s
I20260709 13:09:39.382985 19083 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.384195 19133 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.384708 19117 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:39.384892 19133 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.386107 15378 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:39.387485 19133 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:39.382484 19118 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.389736 19083 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:39.391413 18822 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:39.397859 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:39.410830 15303 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:39.340173 19116 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:39.413564 15225 raft_consensus.cc:2368] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:09:39.415416 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:39.416795 15228 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:39.418479 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.415587 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:39.419348 18925 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.419768 18925 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.419827 15224 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:39.420215 18925 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.421305 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.316612 19032 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.424430 19083 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.425172 19083 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.425772 19083 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:39.430279 15345 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.981s (SENT)
I20260709 13:09:39.430897 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:39.434693 19116 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.436059 19083 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.438432 15348 leader_election.cc:400] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:09:39.438562 19126 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:39.438994 15348 leader_election.cc:403] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:09:39.440469 19083 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:39.341048 19122 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.445113 15301 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:39.451234 15229 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:39.464710 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:39.290822 19120 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.373824 19128 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.482375 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:39.495215 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127356us
I20260709 13:09:39.495404 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:39.507139 15229 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.477440 15305 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:09:39.474007 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 134817us
I20260709 13:09:39.512197 19129 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.513797 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:39.481645 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 226153us
W20260709 13:09:39.484683 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 76180.7us
I20260709 13:09:39.388288 19133 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.463685 19046 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.484444 19117 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.531257 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:39.531978 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 282138us
I20260709 13:09:39.472290 18946 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.532361 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:39.494661 19125 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:39.532042 15301 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:39.511083 19099 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.611195 19109 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.611902 19109 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:39.612329 19109 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.606906 19046 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.617424 19046 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.513230 19083 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.510254 19128 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.624521 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:39.634430 15304 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.559854 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:39.569003 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:39.630097 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:39.626652 15229 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:39.635921 15307 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:39.636207 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67373.8us
W20260709 13:09:39.538386 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 226925us
I20260709 13:09:39.639329 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:39.733852 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:39.794178 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 261919us
I20260709 13:09:39.795133 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:39.603758 19133 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:39.800392 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 161138us
I20260709 13:09:39.804401 19148 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.813164 19150 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.814674 18808 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.821473 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:39.792666 19083 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:39.910620 19083 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.575264 18946 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:39.922163 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 127081us
I20260709 13:09:39.536206 19068 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.906234 19148 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.939150 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:39.633555 19099 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:39.905861 18981 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:39.956185 15307 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:39.965209 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:40.035696 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 214343us
I20260709 13:09:40.044932 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.046231 19140 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.046656 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.047616 19140 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.048224 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.049827 19140 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:39.959582 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.033792 15304 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:39.901762 19045 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:40.052014 19045 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:40.053332 19045 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.054555 19140 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:40.055557 19125 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.058866 19129 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:40.059342 19129 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:40.056702 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:40.055814 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 96402.4us
I20260709 13:09:40.060473 19129 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.062114 19129 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.062912 19125 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.074841 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.076594 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.061709 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:39.974159 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:39.924819 19126 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.097457 19140 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:40.101159 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 462739us
I20260709 13:09:40.101343 19140 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:39.960804 19137 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.961637 19148 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.097062 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:40.107175 19139 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:09:40.108043 19133 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:40.082512 19142 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.434s	user 0.005s	sys 0.006s
W20260709 13:09:40.105588 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 43896.6us
I20260709 13:09:40.126144 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:40.083643 19136 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
W20260709 13:09:40.086206 18925 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
W20260709 13:09:40.083364 19023 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.761s	user 0.004s	sys 0.007s
I20260709 13:09:40.134867 19126 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.043799 18981 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:40.082212 19132 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.143929 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.144887 19132 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.146986 18981 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.148699 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:40.149176 18981 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:40.117050 19109 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.006s
I20260709 13:09:40.150094 19109 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:40.112169 19075 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.188s	user 0.010s	sys 0.006s
I20260709 13:09:40.082873 19141 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.165174 15231 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:40.130527 19143 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.221s	user 0.000s	sys 0.002s
I20260709 13:09:40.081995 19129 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.137004 15304 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:40.137574 19157 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:09:40.137955 19099 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.117405 19140 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.175770 19128 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.147756 19132 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.127678 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.195196 15225 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:40.152189 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.122525 19125 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.157276 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.157788 19109 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.158118 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.200160 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:40.144893 18946 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:39.963115 19150 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.138718 19023 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.176757 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:40.178287 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:40.183331 19118 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.794s	user 0.014s	sys 0.000s
I20260709 13:09:40.183180 19160 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:40.192108 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 110441us
I20260709 13:09:40.195940 19068 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.199358 15228 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:40.201560 15231 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.218511 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:40.198123 19153 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:40.211899 15379 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:40.173040 19075 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.213759 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:40.276757 15227 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:09:40.281203 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67717.3us
I20260709 13:09:40.142112 18925 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.210963 19150 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.223176 19122 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:40.278221 19153 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:40.199760 19148 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
W20260709 13:09:40.308482 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 90098.5us
I20260709 13:09:40.310105 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.288923 19083 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:40.290120 18980 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:40.287525 19129 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:40.341207 15231 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:40.331008 18980 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:40.341253 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 169063us
I20260709 13:09:40.342226 18980 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.280611 19118 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:40.359804 19117 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.004s
I20260709 13:09:40.361162 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.363435 18925 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.340476 19068 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.364837 19046 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.334720 19122 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.348265 18388 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:40.368975 19153 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.372370 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.372705 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:40.375172 19075 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.379856 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.387027 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:40.405843 19075 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:40.406298 19075 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:40.406399 15225 raft_consensus.cc:2368] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:40.389040 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:40.407226 15224 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.407418 19075 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.410909 15348 leader_election.cc:400] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:40.411330 15348 leader_election.cc:403] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:40.412196 18946 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.412990 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:40.413992 15228 raft_consensus.cc:2368] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:09:40.330580 19083 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:40.415143 19083 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.402623 19129 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:40.420646 19129 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:40.421218 19129 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.427013 15274 leader_election.cc:400] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:09:40.427728 15274 leader_election.cc:403] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:40.428076 18946 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:40.428681 19160 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.447962 19129 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.450723 19129 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.451818 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:40.455085 19160 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:09:40.462431 15224 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:40.396822 19117 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:09:40.400628 18388 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:40.465950 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:40.468258 15345 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.522s (SENT)
I20260709 13:09:40.468914 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.464252 19147 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.470055 19147 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:40.470458 18946 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:40.471158 18946 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:40.471168 19147 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.478185 19112 raft_consensus.cc:2243] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:40.479426 19112 raft_consensus.cc:2272] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:40.459415 19128 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.400267 19148 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:09:40.400096 19045 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 13:09:40.497843 15345 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.541s (SENT)
I20260709 13:09:40.499809 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.504875 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.484807 19153 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.525128 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:40.526100 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:40.533980 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 185921us
I20260709 13:09:40.508044 19063 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.526819 19160 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:40.507333 18388 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.462872 19083 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.546916 19121 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.548650 18388 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.550748 19122 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:40.484841 19110 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:40.551997 19160 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.552714 19110 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.559751 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.560628 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:40.561429 15303 raft_consensus.cc:2368] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:09:40.561554 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.562225 15308 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:40.562244 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:40.562937 15303 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.563882 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.563257 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.564666 15306 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:40.572841 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.573688 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.578630 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:40.535018 19046 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:40.579088 15378 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:09:40.580042 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.579459 15302 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.580969 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.579262 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.582098 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.584297 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.588511 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:40.588748 15301 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:40.589745 15228 raft_consensus.cc:2393] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:40.554768 19160 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.594007 15304 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:40.595176 15308 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:40.588222 19075 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.472239 18946 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.599627 19112 ts_tablet_manager.cc:1916] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:40.600840 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:40.605576 15308 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:40.606094 15308 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:40.608098 15305 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:40.579806 19109 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:40.620911 15228 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:40.639168 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 141374us
I20260709 13:09:40.643014 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:40.584200 19046 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:40.635246 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:40.638052 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.645331 15305 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.567656 18980 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.612380 15308 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.649196 15308 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:40.653443 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.656176 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:40.656961 15299 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:40.662457 16004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:09:40.663686 16004 raft_consensus.cc:606] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:40.668380 16004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:09:40.668938 19118 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.669318 16004 raft_consensus.cc:606] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:40.672183 19046 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.673563 19046 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.644887 19109 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.682413 19140 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.685460 19083 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.691844 18980 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.704524 15305 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:40.621152 19127 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:40.752074 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:40.755960 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 113089us
I20260709 13:09:40.743274 15300 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:40.759761 19156 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:40.771660 19166 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.187s	user 0.002s	sys 0.000s
I20260709 13:09:40.791464 19110 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:40.801334 19102 raft_consensus.cc:993] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:09:40.802018 19102 raft_consensus.cc:1081] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:09:40.805253 15379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:52412
I20260709 13:09:40.806098 15379 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.806532 15379 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.819988 15379 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.827206 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:40.827657 15379 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:40.828025 16004 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:40.828668 16004 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:40.830255 16004 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.832594 16004 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:40.834681 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.857611 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.856145 16004 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:40.862238 18981 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.862948 18981 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:40.864585 19109 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:40.867189 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:40.869445 18925 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:40.869999 18925 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:40.870923 18925 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.876175 15374 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:40.867259 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:40.890326 15226 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:40.893730 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:40.894703 15230 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.909240 19152 raft_consensus.cc:993] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:09:40.910045 19102 raft_consensus.cc:1081] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:09:40.912096 15228 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:40.912550 15307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:09:40.913130 15307 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.913492 15307 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.914502 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:40.916633 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:40.920099 18981 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.922683 15307 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.927762 19140 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:40.934376 15307 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:40.936811 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:40.937566 16004 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:40.937963 16004 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:40.939074 16004 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.940641 16004 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.954351 19119 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.955233 19119 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:40.974885 15303 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:41.006273 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.007824 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:41.008595 15224 raft_consensus.cc:606] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
W20260709 13:09:40.989131 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 230488us
I20260709 13:09:41.041237 15304 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:41.058210 15224 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:41.059630 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43696.6us
W20260709 13:09:41.064079 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 95576.4us
W20260709 13:09:41.074431 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.097208 15302 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:09:41.098084 15302 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:41.106909 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.171348 15130 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 9 to 11, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 11 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.174955 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.176774 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:41.053074 19120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.103s	sys 0.235s
I20260709 13:09:41.180249 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.181082 15380 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:41.182909 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:41.111881 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61750us
I20260709 13:09:41.188846 15130 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 9, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:41.116900 16006 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:41.126070 16004 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:09:41.140314 19117 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:09:41.122084 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.116194 19156 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:09:41.149355 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:41.197497 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.198113 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:41.150183 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.153836 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.199805 15300 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:41.200207 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.200749 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.201432 15300 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:41.191061 15130 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 10, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:41.202275 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.154101 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:41.203853 15299 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.155889 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.204603 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.204836 15305 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:41.156705 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.156616 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:41.158174 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.207101 15306 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:41.207149 15301 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:41.160418 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.208945 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:41.169729 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:41.109506 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47980.3us
I20260709 13:09:41.203564 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:41.101354 19147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.096s	sys 0.205s
I20260709 13:09:41.178076 15304 raft_consensus.cc:2368] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:09:41.179877 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.187376 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.065383 15974 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.191063 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:41.191368 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.195631 15307 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
W20260709 13:09:41.180843 19120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.103s	sys 0.235s
I20260709 13:09:41.214747 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:41.227734 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:41.232699 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.233824 15379 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:41.235532 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.227941 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.238559 15305 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:41.242071 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.215852 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:41.246248 15379 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:41.245591 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:41.247592 15230 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:41.249157 15224 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:41.252146 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.252488 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.253099 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.253448 19099 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:41.254698 19099 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:41.255014 19099 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:41.256434 19132 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:41.257150 19140 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:41.257440 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.258117 15373 raft_consensus.cc:2376] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7. Re-sending same reply.
I20260709 13:09:41.258697 15231 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:09:41.259440 19068 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.005s
I20260709 13:09:41.259924 19068 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:41.260878 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 195624us
I20260709 13:09:41.263386 19016 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.273614 15130 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.276865 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.280268 15130 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.252648 15377 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:41.244020 19147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.097s	sys 0.209s
I20260709 13:09:41.285512 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.290066 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:41.291168 15231 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.290066 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:41.293612 15382 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:41.256884 19132 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:41.288554 15299 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:41.306020 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.308060 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:41.308480 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:41.309387 15230 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.290164 19009 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:41.283315 19119 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:41.312830 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:41.311249 19132 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.321753 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.255911 19099 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:41.329890 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.332655 19149 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:41.332763 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.333480 19156 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:41.334726 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.335216 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:41.340667 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:41.348975 15380 raft_consensus.cc:2368] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
W20260709 13:09:41.349982 18388 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.801s	user 0.014s	sys 0.002s
I20260709 13:09:41.352708 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.353885 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.351715 16007 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:41.347620 15379 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:41.357306 15382 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:41.357704 15377 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:41.358880 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:41.316839 19120 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:09:41.316577 19129 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:41.364233 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:41.345978 18946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.014s
I20260709 13:09:41.361622 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.334302 19009 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:41.368975 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:41.340394 19149 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:41.371186 18946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.014s	sys 0.014s
W20260709 13:09:41.378924 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.370721 15231 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:41.360898 19117 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:41.389436 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:41.389467 15230 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
W20260709 13:09:41.397114 15226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.033s	sys 0.038s
W20260709 13:09:41.397583 15226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.033s	sys 0.038s
I20260709 13:09:41.439033 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:41.453611 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:41.400466 18925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.014s	sys 0.023s
I20260709 13:09:41.467754 19120 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:41.467351 19045 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:41.441624 19117 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:41.469339 18925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.014s	sys 0.024s
I20260709 13:09:41.478077 19127 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.476377 19120 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:41.499708 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.009s	sys 0.011s
W20260709 13:09:41.489928 19173 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:09:41.469942 19009 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:41.478938 19045 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:41.470559 19149 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:41.503515 19129 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.504920 19120 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:41.508203 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.010s	sys 0.012s
W20260709 13:09:41.515892 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 863611us
I20260709 13:09:41.518167 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:41.520356 15130 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 9 to 11, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 11 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.522774 15130 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 10, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:09:41.542598 15225 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:41.548475 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 252650us
I20260709 13:09:41.560232 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:41.559547 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 271283us
W20260709 13:09:41.544898 19174 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
W20260709 13:09:41.570392 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 338930us
I20260709 13:09:41.538985 19141 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:41.537909 19140 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:41.512465 19129 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:41.562399 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:41.508795 19117 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:41.579929 15374 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:41.544546 19122 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:41.552076 19109 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.592952 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 266822us
W20260709 13:09:41.628656 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 175167us
W20260709 13:09:41.630555 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.633781 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60687.1us
W20260709 13:09:41.635670 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 73296.6us
I20260709 13:09:41.638026 19129 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:41.637481 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.594985 19141 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:41.640583 19141 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.592212 18981 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:09:41.626299 19122 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:41.642309 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.645174 19152 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.645885 19152 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:41.646382 19122 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:41.648874 19176 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:09:41.655479 19184 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:41.658686 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:41.658865 19184 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:41.660459 19184 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:41.664559 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83514.9us
I20260709 13:09:41.665561 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:41.655212 19140 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:41.667766 15345 leader_election.cc:400] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:09:41.669199 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:41.672106 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.673843 19180 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.674579 19180 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:41.676414 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:41.654775 19152 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:41.625591 19109 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:41.705485 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63641.6us
I20260709 13:09:41.705772 19196 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.707847 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.675559 19045 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:41.689299 19156 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:41.735489 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.733330 19196 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.737313 19196 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.737946 19180 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:41.738729 19180 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:41.739393 19180 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:41.741155 19109 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:41.741639 19196 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.722872 19156 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:41.749938 19099 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:41.777287 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53227.8us
I20260709 13:09:41.778340 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:41.779793 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:41.765888 19156 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.766968 19122 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:41.787377 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:41.789709 19189 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.791978 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:41.764770 19192 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:41.809945 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 144488us
I20260709 13:09:41.810986 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:41.808744 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 171946us
I20260709 13:09:41.801578 19122 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:41.832930 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:41.806596 19192 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:41.834360 19132 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.509s	user 0.016s	sys 0.000s
I20260709 13:09:41.849094 19122 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.852927 19192 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.865399 19180 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:41.863914 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72127.3us
I20260709 13:09:41.872881 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.834478 19175 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.847280 19109 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.845780 19191 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:41.884166 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:41.893573 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:41.907881 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.878448 19132 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:41.926697 19188 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.196s	user 0.001s	sys 0.001s
I20260709 13:09:41.926450 19190 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:41.887661 19127 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:41.986340 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 278609us
I20260709 13:09:41.953495 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.906039 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.899958 18875 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:41.956867 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:41.894258 19112 ts_tablet_manager.cc:1929] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
W20260709 13:09:41.959118 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.899744 19202 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:09:41.895339 19184 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.993541 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:41.991640 15307 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:41.996168 15229 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:41.996434 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:42.005903 19207 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:42.006747 19207 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:42.007128 19120 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:42.007305 19207 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.008913 19184 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:42.014050 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 114416us
I20260709 13:09:42.016171 19112 log.cc:1199] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 841138f50ace4746978e72d7f13878de: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/wals/dc5a1ea32aef45d1b6e1ff8b0718d178
I20260709 13:09:42.006735 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:09:42.018293 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 170153us
I20260709 13:09:41.986465 19127 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:42.031354 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44061.6us
I20260709 13:09:42.029628 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:42.014027 19179 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.409s	user 0.003s	sys 0.000s
I20260709 13:09:42.041144 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.031773 19205 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:42.037985 19127 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.073493 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.042989 19184 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:42.045511 19189 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:42.057896 19205 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.057853 19140 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.079459 19141 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.063472 19180 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:42.095852 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57281.5us
I20260709 13:09:42.086462 19112 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53964 (request call id 0) took 3443 ms. Trace:
I20260709 13:09:42.080202 18875 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:42.109598 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.081856 19190 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.115240 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.115258 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.116775 19194 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:42.117372 19204 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:42.118430 18875 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.119570 19194 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:42.122406 19194 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:42.122926 19194 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.110705 19112 rpcz_store.cc:276] 0709 13:09:38.643002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.643527 (+   525us) service_pool.cc:224] Handling call
0709 13:09:38.817147 (+173620us) ts_tablet_manager.cc:1151] Deleting tablet dc5a1ea32aef45d1b6e1ff8b0718d178
0709 13:09:38.837620 (+ 20473us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:41.155082 (+2317462us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:41.886089 (+731007us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:42.086341 (+200252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1220346,"tablet-delete.queue_time_us":117772,"thread_start_us":77989,"threads_started":1}
I20260709 13:09:42.127995 19190 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.128175 19132 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:42.130722 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:42.120859 19122 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.131899 19120 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.120859 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.134469 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.137131 19122 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:42.137861 19182 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.141810 19182 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:42.142490 19182 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.146909 19182 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:42.138973 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:42.149354 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.152110 15233 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:42.096596 19205 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.154100 19182 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.112854 19140 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:42.163424 19127 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.102306 19189 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:42.186436 19189 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.187529 19127 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:42.167894 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2118) took 1223 ms. Trace:
I20260709 13:09:42.169049 15232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:09:42.188798 15232 raft_consensus.cc:606] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:42.171008 19156 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.191275 15226 rpcz_store.cc:276] 0709 13:09:40.892871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.893048 (+   177us) service_pool.cc:224] Handling call
0709 13:09:40.893533 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.894055 (+   522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.894105 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.894779 (+   674us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.438834 (+544055us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:41.438879 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.438950 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.012986 (+574036us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:42.098051 (+ 85065us) raft_consensus.cc:1685] finished
0709 13:09:42.098106 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.115700 (+ 17594us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11262,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":106779392,"thread_start_us":510994,"threads_started":1,"wal-append.queue_time_us":647134}
I20260709 13:09:42.193809 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:42.195138 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:42.197060 15378 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.201426 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:42.202281 16007 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:42.204488 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:42.205755 19200 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:42.206225 19200 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.206593 19200 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.208812 19193 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.209417 19193 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:42.127071 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet dc5a1ea32aef45d1b6e1ff8b0718d178 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
W20260709 13:09:42.211509 15115 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 84621us
I20260709 13:09:42.211823 19193 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:42.171339 19194 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.173022 19120 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.213798 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:42.240659 16007 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:42.241021 19182 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:42.241638 19182 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.246378 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:42.176417 19141 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:42.176573 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.163514 19140 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:42.177212 19199 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.180608 19192 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.174248 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.190256 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:42.253161 15376 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.214643 15130 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:42.226032 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.255005 15378 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.256214 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:42.256588 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:42.244079 19182 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:42.271765 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:42.263973 19192 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:42.275751 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:42.324115 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:42.327024 15379 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.267526 19180 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.270541 19122 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:42.276834 19193 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:42.264433 19207 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:42.353487 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 176979us
W20260709 13:09:42.500653 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 225897us
I20260709 13:09:42.547935 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:42.548878 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 374716us
I20260709 13:09:42.549765 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.474572 15379 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:42.345937 19129 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.024s	sys 0.013s
I20260709 13:09:42.365548 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:42.343663 19141 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.349403 19099 consensus_meta.cc:287] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.566s	user 0.013s	sys 0.001s
W20260709 13:09:42.506534 19177 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.902s	user 0.003s	sys 0.005s
I20260709 13:09:42.697099 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:42.488552 19156 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:42.554219 19129 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.050s	sys 0.054s
I20260709 13:09:42.550082 19193 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.717933 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:42.744948 15380 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:42.354095 19045 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:42.752437 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 202721us
I20260709 13:09:42.776801 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.561039 19196 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:42.721246 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 460385us
I20260709 13:09:42.790553 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:42.791577 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:42.791647 15302 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:09:42.743000 19180 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.805660 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:42.803676 15225 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:42.554580 19122 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:42.777621 19193 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:42.821156 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 263826us
I20260709 13:09:42.775653 19045 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:42.694291 19141 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.784323 19199 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:42.786193 19194 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:42.838142 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.811003 19183 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:42.852222 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:42.852581 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.835007 19045 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:42.851449 19056 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.969065 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:42.826130 19180 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:42.831822 19068 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 13:09:42.868794 19199 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:42.900297 19183 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.048535 19141 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:43.048831 16007 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:43.051380 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47822.4us
W20260709 13:09:43.052894 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 261468us
I20260709 13:09:43.063376 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:43.085649 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 527212us
I20260709 13:09:43.086877 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:42.967422 19056 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:42.998636 19099 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:09:43.070036 19181 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.148986 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85749.3us
I20260709 13:09:43.173811 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:43.165091 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51984.4us
I20260709 13:09:43.061663 19226 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:43.117451 19196 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.117081 19194 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:43.175576 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.135762 19056 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:43.096179 19219 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:43.147655 19207 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:43.151645 18925 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:43.167824 19182 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.144789 19102 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:43.181998 19224 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:09:43.216814 15345 leader_election.cc:400] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:09:43.222047 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.178218 19226 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.184532 19196 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:43.172847 19181 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:43.274132 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 98674.3us
I20260709 13:09:43.267051 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:43.281888 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.195215 19229 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:43.281929 15225 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
W20260709 13:09:43.288291 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64214.3us
W20260709 13:09:43.232197 19191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.038s	sys 0.035s
I20260709 13:09:43.241200 19226 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.296452 15374 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:43.257844 19189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.004s	sys 0.024s
I20260709 13:09:43.296958 19222 raft_consensus.cc:2764] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:43.315394 19226 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.227319 19207 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.298440 15974 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:43.221508 19102 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:43.348014 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49698.6us
I20260709 13:09:43.273723 19099 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:43.308763 19196 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:43.350513 19189 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.352517 19189 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.353034 19189 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.353457 19102 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:43.354122 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72338.5us
I20260709 13:09:43.354529 19195 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:43.354943 19195 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.355005 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.355432 19195 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.353488 19189 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.355901 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:43.358168 19205 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.202s	user 0.008s	sys 0.006s
W20260709 13:09:43.275501 19214 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:09:43.276188 19218 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
W20260709 13:09:43.311702 19120 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.072s	user 0.009s	sys 0.003s
I20260709 13:09:43.277293 19180 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:43.316043 19200 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.109s	user 0.007s	sys 0.005s
I20260709 13:09:43.259013 19220 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:43.317022 19181 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:43.271451 19199 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:43.185997 19227 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:09:43.191208 19194 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:43.324740 19182 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.286824 19229 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:43.430119 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75189.6us
I20260709 13:09:43.431486 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:43.359313 19149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.694s	user 0.012s	sys 0.039s
W20260709 13:09:43.349166 19191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.038s	sys 0.036s
I20260709 13:09:43.350487 19099 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:43.439761 15348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.030s	sys 0.109s
W20260709 13:09:43.440229 15348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.031s	sys 0.109s
W20260709 13:09:43.443153 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 605106us
I20260709 13:09:43.366024 19196 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.336825 19045 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.472276 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.432792 19180 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:43.435638 19149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.778s	user 0.012s	sys 0.039s
I20260709 13:09:43.358780 19205 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.375994 19120 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.376289 19220 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.449147 19183 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:43.471439 19236 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.483295 19242 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:43.486070 19045 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:43.488549 19199 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.437189 19182 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.489606 19109 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:43.489902 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:43.490379 19232 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.491636 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:43.497356 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54121.4us
W20260709 13:09:43.506887 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.504547 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2318) took 1291 ms. Trace:
W20260709 13:09:43.377660 19190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.025s	sys 0.038s
W20260709 13:09:43.432689 19127 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.004s	sys 0.015s
W20260709 13:09:43.513607 15346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.015s	sys 0.011s
W20260709 13:09:43.472400 19193 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.003s
W20260709 13:09:43.521868 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.018s
W20260709 13:09:43.677259 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.018s
W20260709 13:09:43.677738 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 691976us
I20260709 13:09:43.679808 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.434945 19229 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.383088 19200 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:43.624711 15375 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:43.634009 15233 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.003s	sys 0.018s
W20260709 13:09:43.690985 15233 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.003s	sys 0.019s
W20260709 13:09:43.691718 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 393827us
I20260709 13:09:43.442482 19207 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.508755 19196 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:43.520618 19220 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.639835 15302 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:43.641788 15228 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:43.625524 19156 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:43.642076 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.246s (SENT) [suppressed 40 similar messages]
W20260709 13:09:43.696163 19190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.033s	sys 0.038s
I20260709 13:09:43.646188 19226 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:43.588207 19221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.008s	sys 0.037s
I20260709 13:09:43.687072 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:43.688793 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:43.502110 19195 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:43.799803 16004 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:43.800068 15303 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:09:43.800555 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 120192us
W20260709 13:09:43.692210 15346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.017s	sys 0.014s
I20260709 13:09:43.694891 19191 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.680825 15377 rpcz_store.cc:276] 0709 13:09:42.212924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.214202 (+  1278us) service_pool.cc:224] Handling call
0709 13:09:42.244664 (+ 30462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.245111 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.245146 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.245677 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.450301 (+204624us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:42.450352 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.450434 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.504115 (+1053681us) raft_consensus.cc:1685] finished
0709 13:09:43.504141 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.504428 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56644,"raft.queue_time_us":13015,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6050,"thread_start_us":204190,"threads_started":1,"wal-append.queue_time_us":535105}
I20260709 13:09:43.701449 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:43.821771 15308 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.702381 16006 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:43.703068 15306 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:43.703706 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.037s	sys 0.058s
I20260709 13:09:43.713168 16007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:40990
W20260709 13:09:43.823603 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.038s	sys 0.058s
I20260709 13:09:43.622803 19199 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:43.740667 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 249797us
I20260709 13:09:43.783469 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:43.712939 19245 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.646733 19130 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.690477 19232 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.526116 19099 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:43.823959 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 1.02934e+06us
W20260709 13:09:43.696118 19127 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.008s	sys 0.017s
I20260709 13:09:43.703745 19180 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.800696 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:43.617331 19242 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:43.837069 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 157349us
W20260709 13:09:43.845319 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 202934us
I20260709 13:09:43.690351 19193 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:43.865108 15304 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:43.868745 19207 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:43.800305 19221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.009s	sys 0.037s
I20260709 13:09:43.588832 19236 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:43.922739 19228 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.664s	user 0.000s	sys 0.016s
I20260709 13:09:43.924692 19236 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:43.880043 16007 raft_consensus.cc:606] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:09:43.926083 19122 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:43.927302 19254 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.888059 15302 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.796208 19129 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.925498 19236 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:09:43.929096 19237 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:09:43.929716 19256 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.877321 19130 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:43.896730 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:43.935813 15303 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:43.898451 19182 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:43.862987 19191 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.906044 19199 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:43.791092 19156 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.864323 19245 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:43.907660 19200 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:43.891985 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.926203 16007 raft_consensus.cc:614] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:43.927934 19254 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.928993 19122 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.797066 19196 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:43.939746 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 117773us
I20260709 13:09:43.944960 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2145) took 1108 ms. Trace:
I20260709 13:09:43.950385 15303 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:43.956429 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:43.930294 19256 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:43.961249 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69358.4us
I20260709 13:09:43.977770 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:43.951334 19129 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:43.979213 19221 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.928118 19222 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:43.886085 15308 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:43.975804 15233 rpcz_store.cc:276] 0709 13:09:42.836287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.836508 (+   221us) service_pool.cc:224] Handling call
0709 13:09:42.867919 (+ 31411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.868433 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:43.698740 (+830307us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.944483 (+245743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:43.944555 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:43.944607 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.944707 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.944885 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1089973,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":54,"thread_start_us":980232,"threads_started":3}
I20260709 13:09:43.979859 19221 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:43.960566 19099 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.937377 19207 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:43.896055 19180 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:43.924049 19189 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 13:09:43.976879 15304 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:44.010318 15273 leader_election.cc:400] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:09:44.014154 15273 leader_election.cc:403] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:09:43.973917 19199 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:44.014159 15308 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:43.964205 19196 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:43.982664 19194 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:44.038851 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 159431us
I20260709 13:09:43.980756 19122 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.024853 19102 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:44.060221 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50070.9us
I20260709 13:09:44.022608 19199 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:43.979276 19129 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.022771 19182 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:09:44.023136 19205 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:44.068318 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 198307us
I20260709 13:09:44.071045 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.035804 19232 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.068810 15302 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:44.036775 19190 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.072733 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.019582 19119 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:09:44.081642 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.016227 19189 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.051555 19236 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:44.083444 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.084708 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.095079 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.095965 15303 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:44.095894 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.088377 19232 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.064507 19256 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:44.079594 19241 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.454s	user 0.002s	sys 0.000s
I20260709 13:09:44.082571 19194 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.064682 19130 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.064502 19252 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.101081 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.106178 19234 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.098459 18980 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:44.070771 19199 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.106542 19195 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.089843 19236 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:44.118088 15999 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:44.088991 19257 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:44.120435 19129 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:44.109223 19182 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.112829 19222 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:44.112174 19261 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.070140 19102 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.085183 19190 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.146438 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.122175 18980 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.150180 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.121729 19117 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.155014 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.070063 19196 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.120492 19122 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.160442 15999 raft_consensus.cc:2410] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:09:44.162111 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77492.1us
I20260709 13:09:44.142684 19222 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:44.168743 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 157746us
W20260709 13:09:44.166775 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58839.8us
I20260709 13:09:44.147328 19193 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:44.154460 19256 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:44.178784 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 450) took 1381 ms. Trace:
W20260709 13:09:44.168444 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47045.7us
I20260709 13:09:44.158429 18980 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.185132 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:44.183110 15307 rpcz_store.cc:276] 0709 13:09:42.785937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.786676 (+   739us) service_pool.cc:224] Handling call
0709 13:09:42.787158 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.787487 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.787529 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.812793 (+ 25264us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.258087 (+445294us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:43.258140 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.258228 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.167317 (+909089us) raft_consensus.cc:1685] finished
0709 13:09:44.167347 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.167567 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":406488,"threads_started":1,"wal-append.queue_time_us":626082}
I20260709 13:09:44.190164 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.124498 19234 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.197921 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.199524 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.200748 15227 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:44.176631 19222 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.213078 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.212733 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.214406 15376 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:44.182900 19196 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.205804 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.205309 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:44.218130 19255 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:09:44.210841 15230 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:44.187186 19242 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.211134 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:44.182304 19245 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.208958 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:44.187601 19256 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:44.215922 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.228475 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.229365 15229 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:44.229323 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.219592 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.209457 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.220108 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.230330 15307 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.226573 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.162041 19117 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.222816 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:44.231511 15378 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:44.231925 15382 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.232884 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:44.227326 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 44385.4us
I20260709 13:09:44.227437 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:44.220499 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.235700 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.230633 15376 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:44.238989 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.239334 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.239637 15305 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.240585 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.241753 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.242002 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:44.242784 15380 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.242887 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:44.243832 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.245085 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.212687 19207 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:44.248679 15373 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:09:44.150893 19261 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.255791 15382 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:44.257308 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.258419 15382 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:44.237903 19102 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.259104 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.260715 19272 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.261652 19205 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.260422 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.287202 15233 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:44.247184 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 151428us
I20260709 13:09:44.263195 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.264171 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.265412 19207 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:44.266132 19140 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:44.267967 19269 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.269142 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.270318 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:44.272439 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.317163 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.317770 15231 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:44.272632 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:44.257797 19242 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:44.277848 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:44.278667 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.279362 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:44.280638 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.326928 16004 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.293565 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.295054 19120 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:44.238358 19195 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.336721 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:44.306188 15305 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:44.298794 19257 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.292893 19272 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.338168 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.319530 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.340912 15307 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.341472 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.343911 15305 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.273375 19253 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.320876 15274 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:44.320957 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50740.4us
I20260709 13:09:44.291849 15380 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:44.172971 19236 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.329167 15373 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:44.329033 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.285746 19254 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.298448 19252 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.310163 15229 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:44.345052 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.361359 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.364920 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.336964 19129 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.366195 15229 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:44.370586 15273 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:44.366426 16004 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:44.332176 19120 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:44.372169 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:44.372427 15231 raft_consensus.cc:2393] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:44.370669 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.376600 15304 raft_consensus.cc:2368] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:44.377480 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.378021 15304 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:09:44.378772 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.379355 15304 raft_consensus.cc:2368] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:44.364764 19234 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.381469 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:44.350670 19185 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.382167 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.396468 15307 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:44.328939 19207 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:44.337320 19242 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:44.340737 19272 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.396731 15304 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.362663 19232 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.398274 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.405233 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.408669 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.407873 18980 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.410032 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:44.343400 19195 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.351984 19243 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:44.400872 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.363454 19257 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:44.388458 15305 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:44.403216 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:44.374445 19182 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:44.407518 15307 raft_consensus.cc:2376] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9. Re-sending same reply.
I20260709 13:09:44.380486 19205 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.374656 19129 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.326506 19256 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.381112 19194 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:44.453284 19276 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:09:44.471796 19220 consensus_meta.cc:287] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.668s	user 0.005s	sys 0.005s
W20260709 13:09:44.421564 19258 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.208s	user 0.001s	sys 0.001s
I20260709 13:09:44.422302 19192 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:44.412592 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:44.549850 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 169564us
I20260709 13:09:44.360836 19252 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.429126 19120 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.404708 19140 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:44.423467 19234 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.532994 19129 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.450917 18980 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.467299 19242 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.351763 19253 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.454538 16006 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.468261 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.607811 15305 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.452726 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:44.395587 19185 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:44.446496 15304 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:44.462018 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.612967 15232 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:44.613199 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.477959 15231 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.418238 19232 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:44.418108 15345 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.984s (SENT)
W20260709 13:09:44.454334 19277 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:44.539330 15225 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:44.412864 19283 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:44.420970 19273 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.546185 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.421097 19117 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.458880 19068 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:44.550726 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:44.658365 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:44.658821 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 108172us
I20260709 13:09:44.553155 15227 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:44.455654 19221 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.454380 19195 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:44.466007 19229 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.004s
W20260709 13:09:44.552815 19099 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.542s	user 0.015s	sys 0.000s
W20260709 13:09:44.579584 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 198855us
I20260709 13:09:44.401897 19190 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.613202 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.604099 19234 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.559393 16001 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:09:44.630426 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 212331us
I20260709 13:09:44.635070 19267 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:44.636520 19285 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:09:44.574028 19140 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.672237 19207 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:44.641317 19199 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260709 13:09:44.765911 19199 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.767113 19236 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.768290 19199 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.646354 19232 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:44.423131 19275 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.241s
I20260709 13:09:44.606094 19120 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:44.652254 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.653594 15305 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:44.779117 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.780023 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:44.781414 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.573310 19192 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:44.659157 15307 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:44.674714 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2150) took 1203 ms. Trace:
I20260709 13:09:44.736900 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:44.617147 19185 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.656105 19283 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.659667 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:44.795706 19183 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:44.796069 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 136501us
I20260709 13:09:44.797096 19283 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.797720 19283 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:44.799081 19283 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:44.799527 19283 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:44.758355 19221 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.800673 19221 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.803041 16006 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:44.803944 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.752436 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.804934 19140 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.805648 19140 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.806573 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.807479 19275 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:44.807952 19275 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:44.808940 19275 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.807798 16007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40990 (request call id 2) took 1164 ms. Trace:
I20260709 13:09:44.812278 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.813248 15301 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
W20260709 13:09:44.754974 15345 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 3.076s (SENT)
I20260709 13:09:44.813686 19129 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:44.814564 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59632.8us
I20260709 13:09:44.814949 15301 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:44.815475 15308 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:44.757829 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.756469 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.553987 19220 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.674022 19068 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:44.682708 19191 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.769905 15300 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:44.820317 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.751834 19229 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.762651 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.772682 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.686116 19252 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.822841 19229 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:44.823490 19252 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:44.823421 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:44.825169 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62600.3us
I20260709 13:09:44.770694 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.765312 19234 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:44.803190 16001 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:44.820461 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:44.853286 15380 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:44.823642 19229 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:44.826032 15306 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.826798 15308 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:44.782400 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:44.762305 19207 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:44.745720 15231 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:44.829315 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.833438 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:44.789929 15228 rpcz_store.cc:276] 0709 13:09:43.471756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.472460 (+   704us) service_pool.cc:224] Handling call
0709 13:09:43.489777 (+ 17317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.716805 (+227028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.674401 (+957596us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54003598d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:44.674633 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228172160}
I20260709 13:09:44.782202 15305 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:44.840051 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 103620us
W20260709 13:09:44.773754 19196 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.002s
I20260709 13:09:44.843546 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.844321 15374 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:44.812949 16007 rpcz_store.cc:276] 0709 13:09:43.669695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.687861 (+ 18166us) service_pool.cc:224] Handling call
0709 13:09:44.807572 (+1119711us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b540064e954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b20853 00007f2f58aee60a 00007f2f520747d4 00007f2f52074762 00007f2f52074691 00007f2f5207460c 00007f2f520738c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:44.807689 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129204992}
I20260709 13:09:44.852029 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:44.767753 19272 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.826839 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.808954 19253 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:44.916152 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 89408.8us
W20260709 13:09:44.916311 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 94492.8us
I20260709 13:09:44.917129 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.917708 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:44.863067 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80740.5us
I20260709 13:09:44.851107 19278 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.863083 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:44.864634 19099 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:44.865368 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:44.865548 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2334) took 2449 ms. Trace:
I20260709 13:09:44.866381 15382 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:44.867316 15303 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:44.852427 19274 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.868705 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:44.869169 19185 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.824486 19068 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.872663 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.851640 19219 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.779556 19261 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:44.824834 19191 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:44.877619 19275 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.879626 19220 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.880465 19221 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:44.806286 19283 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:44.882719 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.883694 19129 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:44.914023 15373 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.918433 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:09:44.970638 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52280.6us
I20260709 13:09:44.971480 15345 leader_election.cc:400] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:44.972474 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:44.973719 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:44.876199 19222 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.652s	user 0.005s	sys 0.004s
I20260709 13:09:44.977875 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.913403 19229 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:44.981065 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:44.860667 19245 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:44.933528 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:44.931706 15307 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.951985 19234 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:44.931562 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.991848 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:44.992152 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 60660.9us
I20260709 13:09:44.944192 15375 rpcz_store.cc:276] 0709 13:09:42.416260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.552681 (+136421us) service_pool.cc:224] Handling call
0709 13:09:42.699602 (+146921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.690601 (+990999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.865267 (+1174666us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54001a9fd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:44.865451 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126856576}
I20260709 13:09:44.887516 19207 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.659271 19273 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.943648 15308 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:44.963867 15305 pending_rounds.cc:85] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 4
I20260709 13:09:44.965196 15306 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:44.999686 15307 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:44.958858 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:45.001784 15307 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:44.980207 19190 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:44.931625 19279 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.940697 19231 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:44.942655 19196 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:44.929148 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:44.988529 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:44.956681 19099 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.995337 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:44.995471 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:44.928963 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.005889 15306 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:45.007862 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:45.008167 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.009337 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:45.000449 15305 pending_rounds.cc:107] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:09:44.990059 19221 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:45.018843 15305 raft_consensus.cc:2889] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.990283 19253 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:44.987437 19129 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.037757 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:45.012651 19099 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.001026 19245 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:45.052145 15376 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:45.043735 15303 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:44.964479 19274 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.978703 19191 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:44.953351 19278 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.018790 19045 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.041102 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.109264 15374 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:09:45.005851 19190 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.060035 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:45.099556 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:44.990415 19254 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:09:45.101377 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.054853 19234 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:45.060595 19265 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:45.011014 19283 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.997943 19240 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:09:44.994261 19286 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:09:45.096282 19186 raft_consensus.cc:2764] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:45.110896 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.113067 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:45.133402 15376 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.985913 19222 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:45.117807 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57861.5us
I20260709 13:09:45.138451 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:45.119971 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.121899 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.123057 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.140693 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.078029 19272 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.059212 19273 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.036541 19242 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.072551 19287 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:45.026733 19231 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:44.978134 19219 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.079520 19185 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.004508 19252 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:45.100903 19253 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:45.145965 15230 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:45.015288 19279 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.178493 15382 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:45.125258 19234 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.150964 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:45.152298 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.997359 19192 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.108043 19117 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.116618 19190 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:45.060369 19284 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:09:45.117273 19238 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.086007 19129 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.053036 19226 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:09:45.146688 19229 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.149847 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.255441 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:45.255870 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 166199us
I20260709 13:09:45.170408 15304 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:45.176589 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1920) took 1001 ms. Trace:
I20260709 13:09:45.167111 15380 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:45.243553 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:45.246954 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:09:45.167984 19298 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:45.145396 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:45.162458 19293 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:45.180065 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.112803 19280 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.213s
I20260709 13:09:45.266762 16003 raft_consensus.cc:2368] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9.
I20260709 13:09:45.256656 15303 rpcz_store.cc:276] 0709 13:09:44.175015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.984827 (+809812us) service_pool.cc:224] Handling call
0709 13:09:45.008894 (+ 24067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.086579 (+ 77685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.176260 (+ 89681us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54001874d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:45.176525 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57112960}
I20260709 13:09:45.164448 19274 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.239555 19234 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.160048 19242 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:45.156952 19265 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.170380 19219 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.170190 19191 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.241300 19180 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.159466 19292 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:45.175575 19279 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.169975 19222 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.278227 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:45.299263 15228 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:45.248559 19227 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.337004 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:45.325171 15303 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:45.167716 19287 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.273928 19045 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.172405 19253 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.276952 19290 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:45.305425 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:45.341097 15376 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:45.348325 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.340197 15303 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:45.168949 19245 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:45.343582 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66527.8us
I20260709 13:09:45.316130 19254 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.266474 19117 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.305028 19232 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:45.303905 19242 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.332577 19272 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:45.353315 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 581) took 1080 ms. Trace:
I20260709 13:09:45.354503 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:45.366142 15226 rpcz_store.cc:276] 0709 13:09:44.273427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.273609 (+   182us) service_pool.cc:224] Handling call
0709 13:09:44.274002 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.323429 (+ 49427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.323486 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.323553 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:44.323604 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.353081 (+1029477us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b5400312754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:45.353135 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.353253 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112928512}
I20260709 13:09:45.367285 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.368041 15376 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:45.352417 15374 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:45.368945 15231 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:45.168529 19231 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:45.328095 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 306726us
I20260709 13:09:45.336158 19219 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.338406 19180 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.299393 19221 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:45.330919 19273 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:45.369100 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.370270 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:45.327116 19292 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:45.354930 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:45.446729 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 91914.4us
I20260709 13:09:45.373338 19265 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.374467 19310 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:45.376185 19296 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:45.360138 19185 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.359719 19279 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:45.377035 19299 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:09:45.359141 19290 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.463692 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1916) took 1289 ms. Trace:
I20260709 13:09:45.464197 15299 rpcz_store.cc:276] 0709 13:09:44.173910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.871778 (+697868us) service_pool.cc:224] Handling call
0709 13:09:44.872092 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:44.872552 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.872586 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:44.873159 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.987453 (+114294us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:44.987617 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.987741 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.463379 (+475638us) raft_consensus.cc:1685] finished
0709 13:09:45.463408 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.463615 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4897,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":128,"thread_start_us":113784,"threads_started":1,"wal-append.queue_time_us":257669}
W20260709 13:09:45.384464 19236 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.002s
I20260709 13:09:45.345834 19147 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:45.354661 19045 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.390328 19287 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.265134 19238 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.351438 19240 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.468595 19240 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:45.469038 19045 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.469180 19240 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.303462 19267 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:09:45.336229 19280 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:45.410198 15306 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.449932 19292 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.437791 19180 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.409047 19278 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.409441 19272 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.443264 15376 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:45.449999 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:45.494485 19156 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:45.348696 19227 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:45.450968 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80816.3us
I20260709 13:09:45.402067 19226 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:45.462162 19185 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:45.454079 19195 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.398654 19219 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.372217 19200 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:09:45.437327 15373 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:45.485278 19193 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:45.529619 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.544818 15376 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:45.545984 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.465842 19290 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.530905 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:45.572311 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:45.396930 19254 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.369954 19232 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.552513 15375 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.587172 19306 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.587795 19306 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:45.589296 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:45.588297 19306 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.558967 16006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 594) took 1281 ms. Trace:
I20260709 13:09:45.591040 16006 rpcz_store.cc:276] 0709 13:09:44.277332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.277504 (+   172us) service_pool.cc:224] Handling call
0709 13:09:45.558547 (+1281043us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54004182d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:45.558810 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296551808}
I20260709 13:09:45.600786 19231 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.601997 15376 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:45.601706 19231 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.604147 19200 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.527199 19185 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.569343 19256 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.454564 19273 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.577744 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:45.490624 19191 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:09:45.582360 19266 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:45.586128 19254 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:45.605458 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 209366us
W20260709 13:09:45.561395 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 155772us
I20260709 13:09:45.604743 19200 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.605811 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:45.538448 19262 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.611141 19231 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:45.546308 19238 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:45.635869 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 243612us
I20260709 13:09:45.639159 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.653049 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.650928 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:45.656193 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50531.1us
I20260709 13:09:45.617720 19261 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:45.641835 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:45.659690 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:45.672605 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.625443 19193 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.689806 19193 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.626983 19266 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.635262 19200 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.678561 19307 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:45.675055 19286 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:09:45.676196 19221 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:45.680985 19305 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:09:45.681316 19303 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 13:09:45.682467 19302 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:45.634874 19129 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:45.700567 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47406.7us
I20260709 13:09:45.706198 19261 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.716049 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.661226 19280 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:45.717890 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 267982us
I20260709 13:09:45.725144 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.759107 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:45.730830 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61318.7us
W20260709 13:09:45.702955 19311 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:09:45.648675 19229 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 13:09:45.736580 19099 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.000s
I20260709 13:09:45.743018 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.752816 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:45.711388 15348 leader_election.cc:400] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9.
I20260709 13:09:45.654476 19253 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:09:45.696882 19317 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:45.697507 19267 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:09:45.781407 19232 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.781721 19267 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:45.782148 19267 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.783082 19267 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:45.751982 19207 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.002s
I20260709 13:09:45.765475 19205 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:45.787338 19205 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.788370 19189 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:45.796525 19207 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.797276 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:45.796133 19231 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:45.798915 19231 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:45.798987 19207 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.799942 19231 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.772897 19280 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.803397 19280 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.754709 19117 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.769357 19219 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.806493 19227 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.807786 19273 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.810045 19231 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.769618 19266 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.821781 19180 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.822314 19266 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.822166 19261 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.696233 19242 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.824514 19278 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:45.824996 19267 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.825192 19278 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:45.826084 19242 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.807847 19147 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:45.827283 19147 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.776840 15348 leader_election.cc:403] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:45.777889 19235 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:45.815197 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62457.9us
I20260709 13:09:45.815831 19322 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:45.816695 19283 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.004s
I20260709 13:09:45.818859 19286 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:45.820569 19226 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:45.779865 19099 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.824589 19275 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:45.831125 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 119980us
I20260709 13:09:45.761654 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:45.769063 19240 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:45.845920 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 170325us
I20260709 13:09:45.884462 16000 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:45.848081 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.860780 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:45.873132 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.858374 15226 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:45.845463 19229 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9.
I20260709 13:09:45.799975 19234 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.936990 19234 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:45.843489 19235 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.893456 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.894743 19284 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.938259 19284 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.938962 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.940323 19328 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:45.940820 19328 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.941449 19284 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.897408 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.941764 19328 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.942961 19220 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:45.903359 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.945698 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.946117 19272 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.907773 19185 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.949419 16006 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:45.950804 19185 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.954072 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1909) took 1784 ms. Trace:
I20260709 13:09:45.954406 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1917) took 1780 ms. Trace:
I20260709 13:09:45.956473 19196 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:45.957195 19196 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.897967 19109 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:45.904796 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.906839 19240 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:45.958770 19109 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.909252 16007 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:45.959525 19196 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.909746 19292 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.909300 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:45.912736 15231 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:09:45.904470 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.902132 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.914141 19212 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:45.960184 19196 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.962365 19212 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:45.963069 19196 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.965775 19196 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:45.966192 16004 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:09:45.913792 19099 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:45.923588 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 162027us
I20260709 13:09:45.924000 19303 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:45.881726 19275 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:45.954990 15305 rpcz_store.cc:276] 0709 13:09:44.174196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.931870 (+757674us) service_pool.cc:224] Handling call
0709 13:09:44.963639 (+ 31769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.031927 (+ 68288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.031981 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.032893 (+   912us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.403800 (+370907us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.441498 (+ 37698us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.953925 (+512427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.954034 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.954172 (+   138us) raft_consensus.cc:1685] finished
0709 13:09:45.954207 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.954349 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":512062,"prepare.queue_time_us":4902,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":512446,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":370355,"threads_started":1,"wal-append.queue_time_us":504689}
I20260709 13:09:45.926180 19306 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.855857 19286 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:45.934728 19190 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.669s	user 0.013s	sys 0.000s
I20260709 13:09:45.938490 19235 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.943280 19328 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.921792 19200 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.973304 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:45.940265 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.925336 19242 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.976136 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:45.982494 16001 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:45.982625 19207 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.982846 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 185692us
I20260709 13:09:45.956511 19289 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.983366 19273 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:45.978435 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 165913us
I20260709 13:09:45.985013 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:45.916230 19205 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.972915 19317 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.005199 15226 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:45.973840 19303 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:46.006604 19256 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:46.011616 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:46.012706 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:46.013481 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.014000 15232 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:46.014333 15376 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.014955 19240 raft_consensus.cc:2764] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:45.973610 19192 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:46.003042 19190 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.058784 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:46.059433 15299 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:45.973510 19109 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:46.007390 15348 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.019137 15300 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:46.020778 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:46.021831 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:45.972291 19232 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.025929 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.024865 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:46.068732 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:46.069511 16008 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:45.983407 19275 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.042953 15305 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.043784 15228 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:09:45.954566 15301 rpcz_store.cc:276] 0709 13:09:44.169826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.815904 (+646078us) service_pool.cc:224] Handling call
0709 13:09:44.816219 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.836962 (+ 20743us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:45.114984 (+278022us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.396830 (+281846us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.930842 (+534012us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b1800327040. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:09:45.953489 (+ 22647us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b1800327040. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:09:45.953673 (+   184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.953722 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:45.953775 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.953873 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.954001 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11596,"prepare.queue_time_us":349336,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":12434,"raft.queue_time_us":569399,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":204,"spinlock_wait_cycles":44359296,"thread_start_us":531495,"threads_started":2,"wal-append.queue_time_us":430644}
I20260709 13:09:46.034842 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:46.043018 15307 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:46.040627 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:46.057371 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:46.022154 19284 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:46.066951 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 59700.4us
I20260709 13:09:46.024232 15306 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:46.069893 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:45.998373 19286 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.019377 19242 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:45.974327 19278 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.050462 19099 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
W20260709 13:09:46.184098 15129 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 201) took 22976 ms (client timeout 15000 ms). Trace:
W20260709 13:09:46.184670 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 158819us
I20260709 13:09:46.199693 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.149799 15377 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:46.200680 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 160149us
I20260709 13:09:46.153368 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 464) took 1537 ms. Trace:
I20260709 13:09:46.158844 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:46.155949 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:46.070858 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:46.201905 15302 rpcz_store.cc:276] 0709 13:09:44.616482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.071734 (+455252us) service_pool.cc:224] Handling call
0709 13:09:45.072129 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.099054 (+ 26925us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:45.336850 (+237796us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.829215 (+492365us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b18002f70a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:09:46.152777 (+323562us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.152876 (+    99us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:46.152950 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.153065 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.153274 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72324,"prepare.queue_time_us":201055,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":73433,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"spinlock_wait_cycles":12422912,"thread_start_us":466002,"threads_started":2,"wal-append.queue_time_us":816344}
I20260709 13:09:46.211735 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:46.185129 19335 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:09:46.058091 19303 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.069542 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.072422 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:46.068717 19273 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:46.203084 19284 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.221108 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:46.224294 15376 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:46.187027 19289 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:46.223299 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 159318us
W20260709 13:09:46.250967 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 181505us
I20260709 13:09:46.236912 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:46.219801 19109 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.064929 19192 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:09:46.279055 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58073.6us
I20260709 13:09:46.241276 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:46.090991 19220 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.280756 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:46.149375 19337 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:46.140466 19196 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.203837 19235 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.246414 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:46.199282 15129 rpcz_store.cc:269] 0709 13:09:23.208159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.212680 (+  4521us) service_pool.cc:224] Handling call
0709 13:09:24.518461 (+1305781us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b5400260110. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a02640 00007f2f598d9b76 00007f2f599e3c3e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:46.183915 (+21665454us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:39.793155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:40.104369 (+311214us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:40.121415 (+ 17046us) write_op.cc:435] Acquired schema lock
0709 13:09:40.123857 (+  2442us) tablet.cc:662] Decoding operations
0709 13:09:40.138109 (+ 14252us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:40.138200 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:40.138235 (+    35us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:09:40.187384 (+ 49149us) tablet.cc:701] Row locks acquired
0709 13:09:40.187441 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:09:40.187654 (+   213us) write_op.cc:270] Start()
0709 13:09:40.187783 (+   129us) write_op.cc:276] Timestamp: P: 1783602580187558 usec, L: 0
0709 13:09:40.187798 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:09:40.204858 (+ 17060us) log.cc:844] Serialized 10617 byte log entry
0709 13:09:40.342521 (+137663us) op_driver.cc:464] REPLICATION: finished
0709 13:09:40.506655 (+164134us) write_op.cc:301] APPLY: starting
0709 13:09:40.506788 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:40.519564 (+ 12776us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:40.574291 (+ 54727us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:40.750567 (+176276us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b1800357880. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53aa3190 00007f2f53a9cae7 00007f2f53a9bdd9
0709 13:09:40.960331 (+209764us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:41.023752 (+ 63421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=54
0709 13:09:41.023837 (+    85us) write_op.cc:312] APPLY: finished
0709 13:09:41.024829 (+   992us) log.cc:844] Serialized 182 byte log entry
0709 13:09:41.130843 (+106014us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:41.161640 (+ 30797us) write_op.cc:454] Released schema lock
0709 13:09:41.161751 (+   111us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:41.246244 (+ 84493us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:41.268465 (+ 22221us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1396671,"reported_tablets":53,"spinlock_wait_cycles":77676416,"child_traces":[["op",{"apply.queue_time_us":163760,"apply.run_cpu_time_us":17615,"apply.run_wall_time_us":677889,"num_ops":27,"prepare.queue_time_us":275257,"prepare.run_cpu_time_us":20287,"prepare.run_wall_time_us":667225,"raft.queue_time_us":91220,"raft.run_cpu_time_us":55419,"raft.run_wall_time_us":120986,"replication_time_us":154515,"spinlock_wait_cycles":13491456,"thread_start_us":390763,"threads_started":4,"wal-append.queue_time_us":40545,"wal-append.run_cpu_time_us":77436,"wal-append.run_wall_time_us":1785620}]]}
I20260709 13:09:46.209707 19280 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:46.043357 19207 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.189286 19212 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:46.225087 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:46.249039 19292 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:46.229566 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:46.219471 19068 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:46.221755 19240 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:46.219481 19147 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:46.251648 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.239984 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:46.141006 19232 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.291054 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:46.258991 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.262581 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.057322 19317 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.209194 19193 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:09:46.251727 15382 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:09:46.320005 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 262149us
I20260709 13:09:46.293432 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:46.323192 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 71630.1us
I20260709 13:09:46.339706 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.341958 19256 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:46.326512 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:46.328510 19336 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:46.342520 19256 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:46.277139 19191 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:09:46.343343 19232 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:46.343643 19256 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.329234 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:46.273799 19252 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:46.284169 19275 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.330148 19254 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:46.347051 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.330264 19337 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.317241 19280 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:46.282635 19290 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.295871 19109 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.373332 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:46.298419 19180 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:46.228822 19238 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.320278 19284 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.361999 15224 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:46.344839 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:46.330717 19207 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:46.363662 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.346468 19286 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.344077 19232 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:46.364113 19306 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:46.358352 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65016.4us
I20260709 13:09:46.345589 19220 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:46.351809 19341 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:46.371505 19280 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.351862 16001 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:46.347174 19274 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:09:46.414705 19333 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:09:46.344157 19191 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:09:46.491588 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:46.345983 19326 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:09:46.429282 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:46.492935 15304 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:46.413755 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:46.496093 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 175585us
W20260709 13:09:46.497120 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83473.4us
I20260709 13:09:46.497921 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.400669 19205 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:46.501195 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:46.395042 19290 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:46.357342 19196 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.416327 19190 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:46.511091 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:46.388652 19180 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:46.405856 19238 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:46.445101 19338 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.070s	user 0.006s	sys 0.000s
W20260709 13:09:46.481980 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72943.6us
I20260709 13:09:46.393489 19273 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.454335 19220 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:46.510282 15225 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:46.484283 19274 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:47.705245 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2137) took 1196 ms. Trace:
I20260709 13:09:47.705749 15225 rpcz_store.cc:276] 0709 13:09:46.509003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.509217 (+   214us) service_pool.cc:224] Handling call
0709 13:09:46.509701 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.704793 (+1195092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.705163 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.463907 19240 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:09:46.499536 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:46.518937 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:48.294489 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2425) took 1943 ms. Trace:
I20260709 13:09:48.295127 15300 rpcz_store.cc:276] 0709 13:09:46.350545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.350706 (+   161us) service_pool.cc:224] Handling call
0709 13:09:46.351104 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.351541 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:46.505247 (+153706us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.259212 (+1753965us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.261204 (+  1992us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.261467 (+   263us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:48.261507 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.261659 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.293924 (+ 32265us) raft_consensus.cc:1685] finished
0709 13:09:48.293957 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.294241 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8083,"prepare.queue_time_us":240021,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":67,"raft.queue_time_us":54050,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":218,"spinlock_wait_cycles":13026048,"thread_start_us":154431,"threads_started":2,"wal-append.queue_time_us":1758331}
I20260709 13:09:48.297523 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2428) took 1861 ms. Trace:
I20260709 13:09:48.297981 19361 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:47.883137 15303 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:48.299913 19261 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.300923 19261 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:48.299180 19361 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:48.303313 19266 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:46.522245 15304 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:09:48.410538 15304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2427) took 1991 ms (client timeout 1845 ms). Trace:
I20260709 13:09:47.717983 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2346) took 2873 ms. Trace:
W20260709 13:09:48.089474 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.097504 15307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.595s	user 0.031s	sys 0.021s
W20260709 13:09:48.413312 15307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.911s	user 0.032s	sys 0.021s
I20260709 13:09:48.415112 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2424) took 2345 ms. Trace:
I20260709 13:09:48.190546 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2190) took 2179 ms. Trace:
I20260709 13:09:48.416556 15229 rpcz_store.cc:276] 0709 13:09:46.010559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.013073 (+  2514us) service_pool.cc:224] Handling call
0709 13:09:46.014723 (+  1650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.039637 (+ 24914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.039673 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.040239 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.215051 (+174812us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.215113 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.215198 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.189717 (+1974519us) raft_consensus.cc:1685] finished
0709 13:09:48.189765 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.190253 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25289,"raft.queue_time_us":25753,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13946,"thread_start_us":172305,"threads_started":1,"wal-append.queue_time_us":252466,"wal-append.run_cpu_time_us":8728,"wal-append.run_wall_time_us":1306043}
I20260709 13:09:48.192271 15230 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:48.231195 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 471) took 2163 ms. Trace:
W20260709 13:09:48.411134 15304 rpcz_store.cc:269] 0709 13:09:46.418936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.428901 (+  9965us) service_pool.cc:224] Handling call
0709 13:09:48.410256 (+1981355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:48.433856 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:48.434387 19068 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:46.539958 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:46.560540 16008 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:48.307621 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 1.80785e+06us
W20260709 13:09:48.311084 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 1.79196e+06us
I20260709 13:09:48.266191 19099 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:48.317145 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2184) took 2539 ms. Trace:
I20260709 13:09:46.520605 19129 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:48.369910 15119 maintenance_manager.cc:643] P 476e7efc84e541a3bd0f38661ad40403: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 11.665s	user 0.246s	sys 0.154s Metrics: {"bytes_written":30648,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":593092,"dirs.run_cpu_time_us":639,"dirs.run_wall_time_us":112800,"drs_written":1,"lbm_read_time_us":51028,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":2,"lbm_write_time_us":603417,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":13,"lbm_writes_lt_1ms":18,"mutex_wait_us":4935,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":386992,"threads_started":2,"update_count":34,"wal-append.queue_time_us":44336}
I20260709 13:09:49.476789 15120 maintenance_manager.cc:419] P 476e7efc84e541a3bd0f38661ad40403: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7818 bytes on disk
W20260709 13:09:48.473076 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.351732 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47387.7us
I20260709 13:09:48.582010 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:48.443863 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:48.498149 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:49.523887 15229 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:49.524503 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2139) took 1030 ms. Trace:
I20260709 13:09:49.524843 15229 rpcz_store.cc:276] 0709 13:09:48.494170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.497576 (+  3406us) service_pool.cc:224] Handling call
0709 13:09:49.524401 (+1026825us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:48.537873 15230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2136) took 2465 ms (client timeout 2859 ms). Trace:
W20260709 13:09:48.607616 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45935.7us
I20260709 13:09:48.314035 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2418) took 2292 ms. Trace:
I20260709 13:09:49.530782 15303 rpcz_store.cc:276] 0709 13:09:46.021659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.022122 (+   463us) service_pool.cc:224] Handling call
0709 13:09:46.055658 (+ 33536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.299674 (+2244016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.313429 (+ 13755us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54003e2bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:48.313800 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4201915648}
I20260709 13:09:48.298203 15306 rpcz_store.cc:276] 0709 13:09:46.436323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.295762 (+1859439us) service_pool.cc:224] Handling call
0709 13:09:48.296424 (+   662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.296869 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.296909 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.296990 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:48.297023 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.297104 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.297288 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.538646 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:49.539661 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2447) took 1093 ms. Trace:
I20260709 13:09:48.424597 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:48.422406 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:48.403221 15301 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:49.543828 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2431) took 3026 ms. Trace:
I20260709 13:09:48.406857 15302 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.435271 15304 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:48.242504 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2426) took 1847 ms. Trace:
I20260709 13:09:48.603124 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:48.415726 15307 rpcz_store.cc:276] 0709 13:09:46.069730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.390319 (+320589us) service_pool.cc:224] Handling call
0709 13:09:46.411614 (+ 21295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.411929 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:46.501899 (+ 89970us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.414243 (+1912344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.414386 (+   143us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:48.414542 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.414671 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.415010 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196592,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":14429,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":190,"thread_start_us":1982923,"threads_started":2,"wal-append.queue_time_us":163090,"wal-append.run_cpu_time_us":1867,"wal-append.run_wall_time_us":1001870}
I20260709 13:09:48.420550 15308 rpcz_store.cc:276] 0709 13:09:46.067249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.227496 (+2160247us) service_pool.cc:224] Handling call
0709 13:09:48.229197 (+  1701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.229879 (+   682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.229906 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.229969 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:48.230114 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.230211 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.230387 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.156299 15228 rpcz_store.cc:276] 0709 13:09:45.777199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.777387 (+   188us) service_pool.cc:224] Handling call
0709 13:09:45.777827 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.205119 (+427292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.316155 (+2111036us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400384d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:48.316891 (+   736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610850560}
W20260709 13:09:49.271641 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.004s	sys 0.016s
I20260709 13:09:49.274621 19380 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:48.455981 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.248970 15347 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.839s	user 0.015s	sys 0.022s
W20260709 13:09:49.567101 15347 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.157s	user 0.019s	sys 0.022s
W20260709 13:09:48.452522 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 1.92072e+06us
I20260709 13:09:48.413035 15377 rpcz_store.cc:276] 0709 13:09:44.845059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.968917 (+123858us) service_pool.cc:224] Handling call
0709 13:09:44.993377 (+ 24460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.218380 (+1225003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.717627 (+1499247us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540027b5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:47.717900 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2658947456}
I20260709 13:09:49.570601 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:48.573485 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 2.03334e+06us
I20260709 13:09:49.572480 19368 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:49.574146 19306 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:48.643432 19099 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:48.461097 19068 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:49.590075 19068 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.591617 19099 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:49.593137 19068 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:46.601516 19109 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:46.581477 19147 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:48.245095 19183 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:49.599082 19183 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:47.647022 19192 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:46.621874 19196 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:47.987069 19200 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:46.504092 19207 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:49.602386 15198 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:48.502808 19221 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:49.607088 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:46.526027 19180 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.610018 19183 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:48.455016 19190 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:46.597005 19231 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.751s	user 0.014s	sys 0.000s
I20260709 13:09:46.645494 19238 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:46.490221 19242 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:48.243563 19265 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:49.649271 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47151.6us
I20260709 13:09:49.668331 19265 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.669796 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:49.672515 19200 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:49.673702 19200 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:46.504390 19232 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:49.256506 19240 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:49.722501 19240 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:49.723636 19240 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.725234 19240 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.252945 19245 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.461594 19252 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.730651 19252 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.729669 19245 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:47.998301 19278 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.733389 19232 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:48.514096 19261 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:48.578436 19266 consensus_queue.cc:1243] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:46.644443 19303 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.742650 19303 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:49.744372 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:49.745471 19365 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:49.745535 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:49.746206 19365 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:49.746661 19242 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:46.640447 19328 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.642s	user 0.016s	sys 0.000s
I20260709 13:09:49.749698 15233 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.751397 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 600) took 3408 ms. Trace:
I20260709 13:09:47.307862 19332 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.754688 19332 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.757309 15226 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:49.759352 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2192) took 3409 ms. Trace:
I20260709 13:09:46.618191 19337 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.762151 19366 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.763186 19366 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:48.052122 19339 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.581465 19342 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:49.765889 19339 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.767350 19342 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.767978 16001 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:46.870146 19345 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.770399 19345 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:48.330914 19361 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.773700 19361 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.369886 19363 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:48.356856 19364 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:48.439282 19367 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:09:49.786285 19364 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:48.481016 19371 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:49.789995 19371 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.791805 19368 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.792568 19368 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:48.375566 19256 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.305339 19272 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:47.705507 19274 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:46.667635 19280 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:46.661906 19284 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.618287 19289 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.481338 19372 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.812287 19372 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.814065 15224 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:46.618953 19290 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:48.515929 19376 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:48.513024 19374 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:49.824564 19376 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.825435 19374 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:48.647166 19378 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.828785 19378 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:48.513924 19375 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:46.504819 19310 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:49.832281 19375 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.833442 19310 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:49.834631 15300 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:49.835919 15300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2432) took 1439 ms (client timeout 1540 ms). Trace:
I20260709 13:09:49.316956 19317 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:46.490744 19336 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:48.574417 19340 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.475093 19369 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.474231 19370 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.845753 19370 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:48.618821 19377 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.874938 19274 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.875535 15375 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:49.875197 19377 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.875854 19245 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.835546 19310 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.877578 19310 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.878450 19370 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:49.383790 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0715060579999545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:09:49.880645 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0517060579999225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 13:09:49.881019 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0112060579999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 13:09:49.881944 19377 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.881916 19368 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.443760 19129 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:49.482426 15119 maintenance_manager.cc:643] P 476e7efc84e541a3bd0f38661ad40403: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":434,"lbm_reads_lt_1ms":4}
I20260709 13:09:49.514698 15130 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 95) took 11108 ms. Trace:
W20260709 13:09:49.515961 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.527566 15230 rpcz_store.cc:269] 0709 13:09:46.071946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.072086 (+   140us) service_pool.cc:224] Handling call
0709 13:09:48.537482 (+2465396us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540009cc54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:48.537739 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4479532928}
I20260709 13:09:49.522184 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 603) took 1081 ms. Trace:
I20260709 13:09:49.533768 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:49.534718 15403 debug-util.cc:398] Leaking SignalData structure 0x7b08001c58e0 after lost signal to thread 14100
I20260709 13:09:49.544266 15301 rpcz_store.cc:276] 0709 13:09:46.517644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.518192 (+   548us) service_pool.cc:224] Handling call
0709 13:09:48.402342 (+1884150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.543485 (+1141143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.543762 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.559528 15305 rpcz_store.cc:276] 0709 13:09:46.394556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.394823 (+   267us) service_pool.cc:224] Handling call
0709 13:09:46.395274 (+   451us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:46.491473 (+ 96199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.491512 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:46.505252 (+ 13740us) log.cc:844] Serialized 52 byte log entry
0709 13:09:48.241253 (+1736001us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:48.241356 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.241536 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.241602 (+    66us) raft_consensus.cc:1685] finished
0709 13:09:48.241623 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.242207 (+   584us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18493,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"spinlock_wait_cycles":371968,"thread_start_us":113844,"threads_started":2,"wal-append.queue_time_us":1718868,"wal-append.run_cpu_time_us":4011,"wal-append.run_wall_time_us":1018329}
I20260709 13:09:49.561771 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2439) took 1134 ms. Trace:
I20260709 13:09:49.562951 15227 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:49.562201 19380 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:49.561820 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.004s	sys 0.017s
I20260709 13:09:49.564530 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:49.540000 15306 rpcz_store.cc:276] 0709 13:09:48.446560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.538255 (+1091695us) service_pool.cc:224] Handling call
0709 13:09:49.539576 (+  1321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.572088 19349 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.571177 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 359) took 2058 ms. Trace:
I20260709 13:09:49.576623 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:49.578320 19348 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:49.914412 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:49.914755 19366 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.915515 15382 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:49.916036 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:49.888468 15130 rpcz_store.cc:276] 0709 13:09:38.406200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.406550 (+   350us) service_pool.cc:224] Handling call
0709 13:09:49.514390 (+11107840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:44.161293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:44.333238 (+171945us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:44.337075 (+  3837us) write_op.cc:435] Acquired schema lock
0709 13:09:44.339525 (+  2450us) tablet.cc:662] Decoding operations
0709 13:09:44.736934 (+397409us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:44.753313 (+ 16379us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:44.759835 (+  6522us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:44.865048 (+105213us) tablet.cc:701] Row locks acquired
0709 13:09:44.865103 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:09:44.865319 (+   216us) write_op.cc:270] Start()
0709 13:09:44.865466 (+   147us) write_op.cc:276] Timestamp: P: 1783602584865242 usec, L: 0
0709 13:09:44.865507 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:09:44.869568 (+  4061us) log.cc:844] Serialized 3218 byte log entry
0709 13:09:45.576251 (+706683us) op_driver.cc:464] REPLICATION: finished
0709 13:09:45.665265 (+ 89014us) write_op.cc:301] APPLY: starting
0709 13:09:45.665367 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:45.666298 (+   931us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:45.666454 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:46.141508 (+475054us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:46.209615 (+ 68107us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=1,mrs_lookups=16
0709 13:09:46.217838 (+  8223us) write_op.cc:312] APPLY: finished
0709 13:09:46.305461 (+ 87623us) log.cc:844] Serialized 113 byte log entry
0709 13:09:46.315509 (+ 10048us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:46.354138 (+ 38629us) write_op.cc:454] Released schema lock
0709 13:09:46.368917 (+ 14779us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:46.413019 (+ 44102us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:46.417646 (+  4627us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2519905,"reported_tablets":11,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":88641,"apply.run_cpu_time_us":22483,"apply.run_wall_time_us":737733,"cfile_cache_hit":14,"cfile_cache_hit_bytes":14616,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":1,"lbm_read_time_us":1284,"lbm_reads_lt_1ms":8,"num_ops":8,"prepare.queue_time_us":350770,"prepare.run_cpu_time_us":53928,"prepare.run_wall_time_us":971195,"raft.queue_time_us":200382,"raft.run_cpu_time_us":9183,"raft.run_wall_time_us":89174,"replication_time_us":710534,"spinlock_wait_cycles":37760,"thread_start_us":798614,"threads_started":4,"wal-append.queue_time_us":466506,"wal-append.run_cpu_time_us":14896,"wal-append.run_wall_time_us":1968943}]]}
I20260709 13:09:49.917064 15306 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:49.917729 19368 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:49.918010 15306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2443) took 1472 ms (client timeout 1953 ms). Trace:
W20260709 13:09:49.918694 15306 rpcz_store.cc:269] 0709 13:09:48.445189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.915612 (+1470423us) service_pool.cc:224] Handling call
0709 13:09:49.917878 (+  2266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.918641 19368 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.580166 19306 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:49.920992 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:49.688627 15971 leader_election.cc:336] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.543s (SENT)
W20260709 13:09:49.924751 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 236330us
I20260709 13:09:49.581758 19326 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.926873 19326 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.928658 19289 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:49.928864 19337 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:49.929528 19289 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.930431 19371 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.930004 19337 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.593341 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:49.546103 15273 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50774 dropped due to backpressure: service queue is full with 50 items [suppressed 3 similar messages]
I20260709 13:09:49.932612 19272 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:49.933090 16002 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:49.933401 19272 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:46.622408 19220 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.606957 19221 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.938791 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:49.939221 19289 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:49.941183 19289 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:49.941747 19370 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:49.609131 16004 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:09:49.634418 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56549.6us
I20260709 13:09:49.636396 15302 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:09:49.949424 15302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2430) took 3461 ms (client timeout 1752 ms). Trace:
W20260709 13:09:49.635453 15974 connection.cc:256] RPC call timeout handler was delayed by -1.6541068860000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 13:09:49.949613 19374 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:09:49.949862 15302 rpcz_store.cc:269] 0709 13:09:46.487781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.488372 (+   591us) service_pool.cc:224] Handling call
0709 13:09:49.949136 (+3460764us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540026bbd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:49.949328 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4401831808}
I20260709 13:09:49.641858 19384 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.951315 19384 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.655333 19183 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.662297 19190 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:49.671797 19265 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.682524 15131 catalog_manager.cc:5697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 2 to 6, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 6 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:49.688851 19200 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:49.702514 19180 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.720963 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2140) took 1219 ms. Trace:
W20260709 13:09:49.720969 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69977.2us
I20260709 13:09:49.734361 19232 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.738240 19238 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.747468 19242 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.748004 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:49.771885 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 605) took 1254 ms. Trace:
I20260709 13:09:49.774549 19361 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.783468 19363 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.798846 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 601) took 1359 ms. Trace:
I20260709 13:09:49.798442 19365 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:49.801040 19387 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.759892 15226 rpcz_store.cc:276] 0709 13:09:46.349691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.349878 (+   187us) service_pool.cc:224] Handling call
0709 13:09:46.350268 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.758013 (+3407745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.758897 (+   884us) spinlock_profiling.cc:243] Waited 3.41 s on lock 0x7b54003c1ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:49.759251 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7833259904}
I20260709 13:09:49.819854 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2141) took 1238 ms. Trace:
W20260709 13:09:49.836383 15300 rpcz_store.cc:269] 0709 13:09:48.396987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.421872 (+ 24885us) service_pool.cc:224] Handling call
0709 13:09:49.835713 (+1413841us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001860d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:49.835856 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673022336}
I20260709 13:09:49.752221 15233 rpcz_store.cc:276] 0709 13:09:46.343182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.345000 (+  1818us) service_pool.cc:224] Handling call
0709 13:09:46.345361 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.750354 (+3404993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.751014 (+   660us) spinlock_profiling.cc:243] Waited 3.4 s on lock 0x7b540012f7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:49.751314 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7827881344}
I20260709 13:09:49.843261 19369 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:49.876891 19336 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:49.506090 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.885375 15230 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:49.885916 15303 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:49.887079 15403 debug-util.cc:398] Leaking SignalData structure 0x7b08003516e0 after lost signal to thread 15165
I20260709 13:09:49.888173 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2142) took 1299 ms. Trace:
I20260709 13:09:49.887522 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:49.887686 15304 rpcz_store.cc:276] 0709 13:09:48.427712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.433216 (+  5504us) service_pool.cc:224] Handling call
0709 13:09:49.561684 (+1128468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.883414 19129 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.886626 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:09:49.889590 15196 connection.cc:256] RPC call timeout handler was delayed by -1.0643243340000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:09:49.885541 15225 rpcz_store.cc:276] 0709 13:09:48.440611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.443072 (+  2461us) service_pool.cc:224] Handling call
0709 13:09:49.522073 (+1079001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.887854 16000 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.890110 15299 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:09:49.886770 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:49.908191 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:49.909549 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:49.909847 15308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 478) took 1343 ms (client timeout 1543 ms). Trace:
I20260709 13:09:49.910302 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:49.911188 15307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2448) took 1464 ms (client timeout 1667 ms). Trace:
I20260709 13:09:49.911880 19380 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.906495 16008 rpcz_store.cc:276] 0709 13:09:46.512309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.524436 (+ 12127us) service_pool.cc:224] Handling call
0709 13:09:46.556287 (+ 31851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.570591 (+2014304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.570954 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.917187 19372 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.921741 19306 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.029161 19306 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.030542 16002 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:50.032805 19339 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.034981 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.036185 19380 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.922878 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.036988 19380 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:50.037285 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.037974 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.038235 15375 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:49.579567 19226 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:50.039299 15301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 482) took 1462 ms (client timeout 1543 ms). Trace:
I20260709 13:09:50.039541 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.025952 15224 rpcz_store.cc:276] 0709 13:09:48.581121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.581395 (+   274us) service_pool.cc:224] Handling call
0709 13:09:49.819488 (+1238093us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001c7354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:49.819755 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673658240}
I20260709 13:09:49.924006 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.580523 19254 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:50.041302 19254 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.043819 19254 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:49.882622 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5781607029999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27930000000000005s for a response
I20260709 13:09:50.044308 19242 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.920082 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:49.949201 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:50.023119 15307 rpcz_store.cc:269] 0709 13:09:48.446911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.576190 (+1129279us) service_pool.cc:224] Handling call
0709 13:09:49.911108 (+334918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.952327 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:50.022517 15308 rpcz_store.cc:269] 0709 13:09:48.566615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.564102 (+997487us) service_pool.cc:224] Handling call
0709 13:09:49.909740 (+345638us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:49.952219 15974 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.543s (SENT) [suppressed 4 similar messages]
W20260709 13:09:50.039793 15301 rpcz_store.cc:269] 0709 13:09:48.577121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.886477 (+1309356us) service_pool.cc:224] Handling call
0709 13:09:50.039200 (+152723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.932725 15273 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50774 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2444)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1948)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1946)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1939)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1940)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2436)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 473)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 474)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 475)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 476)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 477)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 479)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 480)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1935)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1942)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1944)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1945)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1947)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1954)
I20260709 13:09:50.039841 19226 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:50.024428 15303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2445) took 1578 ms (client timeout 1565 ms). Trace:
W20260709 13:09:50.048861 15303 rpcz_store.cc:269] 0709 13:09:48.445876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.532970 (+1087094us) service_pool.cc:224] Handling call
0709 13:09:50.024311 (+491341us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:50.037232 15274 connection.cc:256] RPC call timeout handler was delayed by -1.2900820230000818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2859s for a response
I20260709 13:09:50.038237 15380 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:50.022956 15227 rpcz_store.cc:276] 0709 13:09:48.588698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.602588 (+ 13890us) service_pool.cc:224] Handling call
0709 13:09:49.888097 (+1285509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.973235 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.051779 15302 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:50.036190 15376 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:50.037097 15299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2433) took 1613 ms (client timeout 1821 ms). Trace:
I20260709 13:09:49.938534 19220 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.025753 15305 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:50.053683 15299 rpcz_store.cc:269] 0709 13:09:48.423697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.423971 (+   274us) service_pool.cc:224] Handling call
0709 13:09:50.036913 (+1612942us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b540017a554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:50.037036 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802243328}
I20260709 13:09:50.026724 15232 rpcz_store.cc:276] 0709 13:09:48.439408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.456371 (+ 16963us) service_pool.cc:224] Handling call
0709 13:09:48.456844 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.796652 (+1339808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.796685 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.796767 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:49.796822 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.798440 (+  1618us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540009c754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:49.798494 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.798655 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3080580992}
I20260709 13:09:49.900126 19364 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:50.061983 15302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2444) took 1606 ms (client timeout 2063 ms). Trace:
W20260709 13:09:50.068329 15302 rpcz_store.cc:269] 0709 13:09:48.445562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.972747 (+1527185us) service_pool.cc:224] Handling call
0709 13:09:50.052249 (+ 79502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.885249 19345 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.066463 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:50.067193 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.929898 19326 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.070113 15300 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.888849 19284 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:49.884027 19378 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:50.074398 15403 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5dc0 after lost signal to thread 15257
I20260709 13:09:49.899013 19342 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:50.079044 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 126829us
I20260709 13:09:50.025563 15231 rpcz_store.cc:276] 0709 13:09:48.494640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.498982 (+  4342us) service_pool.cc:224] Handling call
0709 13:09:48.499454 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.602129 (+1102675us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:49.630410 (+ 28281us) log.cc:844] Serialized 14 byte log entry
0709 13:09:49.674716 (+ 44306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:49.674775 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:49.674825 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.713317 (+ 38492us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001c7854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:49.713446 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.714229 (+   783us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28141,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":99,"raft.queue_time_us":857,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":956,"spinlock_wait_cycles":2534828160,"thread_start_us":70786,"threads_started":2,"wal-append.queue_time_us":85166}
I20260709 13:09:50.109791 19254 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:50.111021 19254 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.109885 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.078747 19238 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.082993 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:50.117174 15380 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.954169 19384 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.083194 19190 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.117445 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.039549 19380 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.089953 19232 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.127573 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.025262 16001 rpcz_store.cc:276] 0709 13:09:48.517668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.529843 (+ 12175us) service_pool.cc:224] Handling call
0709 13:09:48.530568 (+   725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.768484 (+1237916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.771578 (+  3094us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54006b03d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:49.771822 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2844853120}
I20260709 13:09:50.094174 16003 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:09:50.097038 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.132575 15374 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:50.133034 15226 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:50.097666 19375 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.097985 19361 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.099325 19365 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.100032 19387 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:50.144906 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.102689 19180 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.103220 19183 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.095036 15131 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 5 to 8, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:50.086685 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:50.106534 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.157176 15299 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:09:50.086674 19369 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.162565 19226 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.163930 19332 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.165097 15378 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:50.165377 19366 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:50.165750 15378 pending_rounds.cc:85] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:09:50.166272 15378 pending_rounds.cc:107] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:50.166759 15378 raft_consensus.cc:2889] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.169073 19387 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.169682 19387 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.169806 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:50.171284 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.171993 16002 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:50.173328 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.174381 16001 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:50.113920 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:49.939002 19368 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.120572 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.151284 19183 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.176668 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56261.1us
I20260709 13:09:50.176975 19183 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:50.179592 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.882779 19376 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:50.125303 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.180683 19180 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.181697 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.181528 19180 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:50.182042 19238 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.182564 19369 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.183034 19369 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.183422 19369 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.055632 19252 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.184552 19180 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.146685 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.186594 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.188282 19368 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.128738 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:50.152320 15308 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:09:50.137207 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.138600 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.196637 15302 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:50.139271 19303 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.139874 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.140193 19190 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.142077 19254 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.131898 15306 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:50.103786 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56849.2us
I20260709 13:09:50.148106 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.135733 19310 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:09:50.161224 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:50.207157 15304 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:50.168838 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.130662 15231 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:09:50.181947 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 95502.8us
W20260709 13:09:50.119270 15403 debug-util.cc:398] Leaking SignalData structure 0x7b08001c47c0 after lost signal to thread 15258
I20260709 13:09:50.192822 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.200328 15305 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:50.205046 15131 catalog_manager.cc:5697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 3 to 7, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:09:50.131665 19348 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:50.165952 19366 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:50.209873 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.216795 15307 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:50.210847 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:50.213873 15305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2434) took 1788 ms (client timeout 1868 ms). Trace:
W20260709 13:09:50.219436 15305 rpcz_store.cc:269] 0709 13:09:48.425674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.887142 (+1461468us) service_pool.cc:224] Handling call
0709 13:09:50.213793 (+326651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.224924 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.225140 15233 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:50.225829 15304 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:50.200937 19303 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.230829 15403 debug-util.cc:398] Leaking SignalData structure 0x7b0800105640 after lost signal to thread 15332
W20260709 13:09:50.232131 15403 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8940 after lost signal to thread 15406
W20260709 13:09:50.233443 15403 debug-util.cc:398] Leaking SignalData structure 0x7b08002c1080 after lost signal to thread 16032
W20260709 13:09:50.233675 15403 debug-util.cc:398] Leaking SignalData structure 0x7b080037b7e0 after lost signal to thread 16033
I20260709 13:09:50.229888 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.238525 15376 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:50.237407 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.239274 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.248814 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.249001 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.249001 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.249843 15376 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:50.250906 15305 raft_consensus.cc:2410] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:09:50.225979 19240 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.500s	user 0.013s	sys 0.000s
I20260709 13:09:50.253448 15378 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 5.
I20260709 13:09:50.258236 15226 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:50.264174 19348 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.239423 19274 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.265817 19274 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.266268 19274 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.260649 19349 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:50.269948 19349 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:50.270375 19349 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:50.261502 15303 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:50.272004 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.272766 15303 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:50.273777 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.274501 15303 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:50.275440 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.276603 15299 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:50.276073 19366 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.277720 19366 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.279117 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:50.281508 19284 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.282083 19364 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:50.283030 19284 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:50.284211 19242 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:50.251029 19337 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.238976 19303 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.217110 19272 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.229220 19310 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.277655 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:50.262406 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4530607030000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2932s for a response
I20260709 13:09:50.284292 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:50.302026 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53297.4us
W20260709 13:09:50.302142 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.320288 15380 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:50.321640 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.292286 19280 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.322077 19274 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.284770 19242 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:50.306396 15382 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:50.299613 15306 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:50.312108 15303 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:50.301748 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:50.291625 15131 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 5 to 10, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 10 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:50.325563 15306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2437) took 1898 ms (client timeout 2081 ms). Trace:
W20260709 13:09:50.326022 15306 rpcz_store.cc:269] 0709 13:09:48.426943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.919701 (+1492758us) service_pool.cc:224] Handling call
0709 13:09:50.325483 (+405782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.327250 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.328104 15198 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.329391 15300 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:50.302038 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:50.330687 15300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2435) took 1904 ms (client timeout 2097 ms). Trace:
W20260709 13:09:50.331212 15300 rpcz_store.cc:269] 0709 13:09:48.426082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.053409 (+1627327us) service_pool.cc:224] Handling call
0709 13:09:50.330611 (+277202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:50.295549 19278 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.008s
I20260709 13:09:50.347592 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:50.349792 15300 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.285010 19368 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:50.331686 19256 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.008s
I20260709 13:09:50.347962 15308 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:50.303139 19363 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.361565 15301 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:50.364470 15304 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.358844 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.347540 19284 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.324180 19280 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:09:50.288682 19387 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:50.324266 19240 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:50.373265 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:50.373135 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.374439 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.367923 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:50.378840 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:50.370069 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 85931us
W20260709 13:09:50.380419 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8f60 after lost signal to thread 14100
I20260709 13:09:50.375638 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.383838 15379 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:09:50.384406 15379 pending_rounds.cc:85] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:09:50.384728 15379 pending_rounds.cc:107] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:09:50.385020 15379 raft_consensus.cc:2889] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.385799 15381 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:50.386631 15228 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:50.393975 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7b00 after lost signal to thread 15165
W20260709 13:09:50.395442 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8c80 after lost signal to thread 15257
W20260709 13:09:50.395730 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe260 after lost signal to thread 15258
I20260709 13:09:50.378055 19284 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:09:50.396879 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef9c0 after lost signal to thread 15332
I20260709 13:09:50.383148 15307 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:50.396900 19284 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.398083 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.399078 15307 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:09:50.399230 19387 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:50.367127 19361 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:50.368637 19274 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.401784 19129 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:50.403838 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800399860 after lost signal to thread 15406
I20260709 13:09:50.354924 19368 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:50.402294 15307 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:50.333550 19369 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:50.410591 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080031e960 after lost signal to thread 16032
W20260709 13:09:50.422283 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080039b040 after lost signal to thread 16033
W20260709 13:09:50.422684 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080030e280 after lost signal to thread 19109
W20260709 13:09:50.422976 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08003daec0 after lost signal to thread 19147
W20260709 13:09:50.423193 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4a80 after lost signal to thread 19180
W20260709 13:09:50.423408 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002efc60 after lost signal to thread 19183
W20260709 13:09:50.423666 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800270680 after lost signal to thread 19192
W20260709 13:09:50.423911 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800323a60 after lost signal to thread 19196
W20260709 13:09:50.424158 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800387a20 after lost signal to thread 19200
W20260709 13:09:50.424404 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8500 after lost signal to thread 19207
I20260709 13:09:50.406728 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.383308 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.410310 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.417450 15306 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:50.417906 15381 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:50.418848 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:50.408430 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:50.424645 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08003daa40 after lost signal to thread 19220
I20260709 13:09:50.421486 15308 raft_consensus.cc:2368] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11.
I20260709 13:09:50.426453 15305 raft_consensus.cc:2368] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:09:50.432984 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.397451 19348 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.440394 19361 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:50.441541 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2442) took 2012 ms. Trace:
I20260709 13:09:50.441692 19361 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.442167 15306 rpcz_store.cc:276] 0709 13:09:48.428894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.427105 (+1998211us) service_pool.cc:224] Handling call
0709 13:09:50.440876 (+ 13771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.441088 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.441114 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.441175 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:50.441247 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.441305 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.441449 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:50.444682 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080030ef80 after lost signal to thread 19231
W20260709 13:09:50.445142 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef760 after lost signal to thread 19232
I20260709 13:09:50.432904 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2436) took 1993 ms. Trace:
W20260709 13:09:50.445811 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800344ae0 after lost signal to thread 19238
I20260709 13:09:50.426868 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:50.446112 15307 rpcz_store.cc:276] 0709 13:09:48.426529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.399951 (+1973422us) service_pool.cc:224] Handling call
0709 13:09:50.401864 (+  1913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.419838 (+ 17974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.420065 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:50.446791 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800221020 after lost signal to thread 19242
I20260709 13:09:50.452564 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:50.453593 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080035afc0 after lost signal to thread 19245
I20260709 13:09:50.453742 15301 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:50.454242 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4340 after lost signal to thread 19265
W20260709 13:09:50.455225 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6720 after lost signal to thread 19272
W20260709 13:09:50.455492 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1de0 after lost signal to thread 19274
I20260709 13:09:50.455926 15303 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:09:50.455921 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800308660 after lost signal to thread 19278
I20260709 13:09:50.457803 15305 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:50.458429 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2446) took 2012 ms. Trace:
I20260709 13:09:50.458683 15232 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:50.458824 15305 rpcz_store.cc:276] 0709 13:09:48.446188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.428486 (+1982298us) service_pool.cc:224] Handling call
0709 13:09:50.457639 (+ 29153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.458201 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.458379 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.459968 15300 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:09:50.460371 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 386141us
I20260709 13:09:50.460435 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 472) took 1885 ms. Trace:
W20260709 13:09:50.460947 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 508733us
I20260709 13:09:50.461198 15306 rpcz_store.cc:276] 0709 13:09:48.563704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.443393 (+1879689us) service_pool.cc:224] Handling call
0709 13:09:50.443765 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.444014 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.444047 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.444109 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:50.444144 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.444203 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.449343 (+  5140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.382653 19221 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:50.462728 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 83961.3us
I20260709 13:09:50.463352 15299 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:50.418386 19129 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:50.464044 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080034bd60 after lost signal to thread 19280
W20260709 13:09:50.474835 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800036220 after lost signal to thread 19284
I20260709 13:09:50.466099 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2438) took 2036 ms. Trace:
I20260709 13:09:50.465411 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2440) took 2028 ms. Trace:
W20260709 13:09:50.466351 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56127.3us
I20260709 13:09:50.475310 15299 rpcz_store.cc:276] 0709 13:09:48.427357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.412731 (+1985374us) service_pool.cc:224] Handling call
0709 13:09:50.449598 (+ 36867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.463814 (+ 14216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.464089 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.462579 19303 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.475414 15303 rpcz_store.cc:276] 0709 13:09:48.428151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.413862 (+1985711us) service_pool.cc:224] Handling call
0709 13:09:50.448951 (+ 35089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.456481 (+  7530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.456722 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:50.477205 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08002e58a0 after lost signal to thread 19289
I20260709 13:09:50.468585 15225 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:50.478091 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2441) took 2049 ms. Trace:
I20260709 13:09:50.515826 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 475) took 1950 ms. Trace:
I20260709 13:09:50.517855 15306 rpcz_store.cc:276] 0709 13:09:48.564918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.462244 (+1897326us) service_pool.cc:224] Handling call
0709 13:09:50.480783 (+ 18539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.515444 (+ 34661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.515474 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.515520 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.515558 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.515623 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.515746 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.511976 15382 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:50.477655 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 473) took 1913 ms. Trace:
I20260709 13:09:50.519815 15307 rpcz_store.cc:276] 0709 13:09:48.564136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.447855 (+1883719us) service_pool.cc:224] Handling call
0709 13:09:50.466668 (+ 18813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.466919 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.466943 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.477305 (+ 10362us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:50.477362 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.477431 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.477594 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.519797 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.457683 19289 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:50.518675 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:50.525981 15308 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:50.528730 15302 rpcz_store.cc:276] 0709 13:09:48.428561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.419332 (+1990771us) service_pool.cc:224] Handling call
0709 13:09:50.458593 (+ 39261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.467507 (+  8914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.467540 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.477833 (+ 10293us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:50.477876 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.477937 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.478024 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.467059 19345 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:50.533828 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08003bdac0 after lost signal to thread 19290
W20260709 13:09:50.524796 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 82792.6us
I20260709 13:09:50.478559 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.473120 19364 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:50.539884 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08000e88c0 after lost signal to thread 19303
W20260709 13:09:50.541103 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080035fe00 after lost signal to thread 19310
W20260709 13:09:50.541402 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800106400 after lost signal to thread 19328
W20260709 13:09:50.541632 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800325f20 after lost signal to thread 19332
I20260709 13:09:50.465749 19284 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.543344 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 476) took 1978 ms. Trace:
W20260709 13:09:50.546136 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800351740 after lost signal to thread 19336
W20260709 13:09:50.547016 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800291780 after lost signal to thread 19337
I20260709 13:09:50.543915 15305 rpcz_store.cc:276] 0709 13:09:48.565479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.479670 (+1914191us) service_pool.cc:224] Handling call
0709 13:09:50.523484 (+ 43814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.539977 (+ 16493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.540021 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.543001 (+  2980us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.543061 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.543133 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.543279 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.543605 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.544018 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 474) took 1969 ms. Trace:
I20260709 13:09:50.550278 15308 rpcz_store.cc:276] 0709 13:09:48.564548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.449268 (+1884720us) service_pool.cc:224] Handling call
0709 13:09:50.468385 (+ 19117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.533473 (+ 65088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.533719 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.553596 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.557922 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 479) took 1991 ms. Trace:
I20260709 13:09:50.558426 15307 rpcz_store.cc:276] 0709 13:09:48.569171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.522695 (+1953524us) service_pool.cc:224] Handling call
0709 13:09:50.548936 (+ 26241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.557578 (+  8642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.557608 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.557655 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.557685 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.557748 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.557861 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.463407 19337 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:50.477589 19280 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.759744 19284 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.513768 19303 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:50.562391 15329 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf540 after lost signal to thread 19339
W20260709 13:09:50.808527 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800345de0 after lost signal to thread 19342
W20260709 13:09:50.808961 15329 debug-util.cc:398] Leaking SignalData structure 0x7b080029d3e0 after lost signal to thread 19345
W20260709 13:09:50.809252 15329 debug-util.cc:398] Leaking SignalData structure 0x7b0800309e20 after lost signal to thread 19348
I20260709 13:09:50.562702 15300 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:09:50.788695 19280 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:50.813664 15300 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:50.813823 19280 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.814546 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1944) took 1276 ms. Trace:
I20260709 13:09:50.815096 15300 rpcz_store.cc:276] 0709 13:09:49.537642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.812981 (+1275339us) service_pool.cc:224] Handling call
0709 13:09:50.813421 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.814198 (+   777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.814466 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.525454 19183 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.759600 19242 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.828279 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:50.829260 15300 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:09:50.830298 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1945) took 1292 ms. Trace:
I20260709 13:09:50.830787 15300 rpcz_store.cc:276] 0709 13:09:49.537958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.816144 (+1278186us) service_pool.cc:224] Handling call
0709 13:09:50.828751 (+ 12607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.829949 (+  1198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.830229 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.833330 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.545418 19364 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.520996 19380 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.625072 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.531073 19252 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.703235 19337 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.631619 19369 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:50.627444 15345 connection.cc:256] RPC call timeout handler was delayed by -1.3560962000000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2348s for a response
I20260709 13:09:50.568488 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 477) took 2002 ms. Trace:
I20260709 13:09:50.543990 19232 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.538220 19376 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.448143 19363 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:09:50.760846 19310 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:50.750379 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.618842 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.593093 19373 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.591089 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:50.908538 15305 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:50.910202 15305 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:09:50.594216 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.544934 19289 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.912791 19232 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.654368 15301 raft_consensus.cc:2410] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:50.636740 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.751453 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:50.918030 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.917766 19376 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:50.919896 15301 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:50.762312 15299 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:09:50.780736 19365 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.612s	user 0.014s	sys 0.000s
I20260709 13:09:50.625802 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.617568 19274 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.795140 19384 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.623356 19366 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 13:09:50.796361 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.552830 19200 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.564591 19372 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:50.979756 19372 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.589228 15308 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:50.980886 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 480) took 2411 ms. Trace:
I20260709 13:09:50.981073 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.981208 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.982065 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.982185 15229 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:50.982601 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.983595 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.538266 19345 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.984596 19345 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.912782 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.983996 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.985792 16001 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:09:50.986310 15225 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:50.632681 19368 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.988173 15231 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:50.989199 19368 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.538357 19180 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:50.990962 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.991649 19180 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:50.987718 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.714046 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.992314 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.936975 19183 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:50.995802 15231 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:50.802364 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 248878us
I20260709 13:09:50.981285 15308 rpcz_store.cc:276] 0709 13:09:48.575276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.551243 (+1975967us) service_pool.cc:224] Handling call
0709 13:09:50.568224 (+ 16981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.980575 (+412351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.980794 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.996831 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:50.997994 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:50.994171 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.999281 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:50.738984 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.850755 19252 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.852252 19380 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:50.882540 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0552607029999308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33740000000000003s for a response
I20260709 13:09:50.882668 15306 rpcz_store.cc:276] 0709 13:09:48.566221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.518889 (+1952668us) service_pool.cc:224] Handling call
0709 13:09:50.538894 (+ 20005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.560181 (+ 21287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.560212 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.568129 (+  7917us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:50.568177 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.568258 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.568419 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.855181 19349 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.906658 15302 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:09:50.907169 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.913168 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2382) took 1169 ms. Trace:
I20260709 13:09:51.013724 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1947) took 1471 ms. Trace:
I20260709 13:09:50.891518 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.858809 19364 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.920439 19371 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.908285 19373 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.618047 15307 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:50.938236 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.944414 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1942) took 1402 ms. Trace:
W20260709 13:09:50.938385 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 384435us
W20260709 13:09:50.950439 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 324732us
I20260709 13:09:51.022094 15299 rpcz_store.cc:276] 0709 13:09:49.536842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.761310 (+1224468us) service_pool.cc:224] Handling call
0709 13:09:50.761932 (+   622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.939089 (+177157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.939426 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:50.960487 15304 consensus_meta.cc:287] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.001s
I20260709 13:09:51.023479 15304 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:51.023866 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1935) took 1492 ms. Trace:
I20260709 13:09:51.024324 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 1940) took 1488 ms. Trace:
I20260709 13:09:51.024459 15307 rpcz_store.cc:276] 0709 13:09:49.531765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.559388 (+1027623us) service_pool.cc:224] Handling call
0709 13:09:50.617856 (+ 58468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.023570 (+405714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.023796 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.025031 15304 rpcz_store.cc:276] 0709 13:09:49.535777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.240047 (+704270us) service_pool.cc:224] Handling call
0709 13:09:51.024233 (+784186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:50.969534 15301 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:50.946138 19274 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.970575 19384 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:50.949908 19242 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.624929 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:50.980263 19372 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.984155 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:50.984303 15226 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
W20260709 13:09:51.010922 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 66547.9us
I20260709 13:09:51.014256 15302 rpcz_store.cc:276] 0709 13:09:49.541909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.905746 (+1363837us) service_pool.cc:224] Handling call
0709 13:09:50.906294 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.013412 (+107118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.013662 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:51.013586 15379 rpcz_store.cc:276] 0709 13:09:49.743967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.744150 (+   183us) service_pool.cc:224] Handling call
0709 13:09:49.744609 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.761639 (+1017030us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5400182020. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a9db06 00007f2f53b2914a 00007f2f53b28fb7 00007f2f53b29470 00007f2f53b25d8f 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91
0709 13:09:50.761921 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.893228 (+131307us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54004051d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:50.913078 (+ 19850us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476288128}
W20260709 13:09:51.018626 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71068.8us
I20260709 13:09:51.027957 15305 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:51.029477 15308 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:51.030977 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 481) took 2454 ms. Trace:
I20260709 13:09:51.072050 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.012833 19366 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.011500 19401 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:51.017031 19183 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:51.111433 15227 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:09:51.112402 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.114183 15303 rpcz_store.cc:276] 0709 13:09:48.576718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.556806 (+1980088us) service_pool.cc:224] Handling call
0709 13:09:50.590749 (+ 33943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.001583 (+410834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.001632 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.011355 (+  9723us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:51.016462 (+  5107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.030696 (+ 14234us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:51.030776 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.030912 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944137088}
I20260709 13:09:51.129779 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.131219 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.137533 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.035409 19274 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.144369 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:51.154778 15302 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
W20260709 13:09:50.992539 19265 consensus_queue.cc:1175] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 13:09:51.165028 19290 raft_consensus.cc:2764] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:51.166054 19349 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:51.121438 19378 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:09:51.169188 19378 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:51.169750 19378 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:51.170432 19200 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:51.171253 19200 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:51.137652 19401 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:51.173451 19401 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.027997 19371 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.171891 19200 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.122144 19183 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:51.186811 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:51.192149 15301 raft_consensus.cc:2376] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7. Re-sending same reply.
I20260709 13:09:51.195241 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:51.211335 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107744us
I20260709 13:09:51.197786 19183 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:51.237098 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 106859us
I20260709 13:09:51.177716 19366 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:09:51.236016 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83812.4us
I20260709 13:09:51.244161 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:51.232123 19390 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:51.231273 19310 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:51.254688 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 110421us
I20260709 13:09:51.261410 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:51.263868 15379 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.269486 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:51.269670 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.270367 15375 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.273484 19326 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:51.264233 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:51.284248 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 177775us
I20260709 13:09:51.285022 15377 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.286509 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 1954) took 1742 ms. Trace:
I20260709 13:09:51.284152 15375 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:51.295858 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:51.296835 15373 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.280241 19232 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:51.289603 15379 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:51.287184 15300 rpcz_store.cc:276] 0709 13:09:49.544568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.913381 (+1368813us) service_pool.cc:224] Handling call
0709 13:09:50.937747 (+ 24366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:50.945180 (+  7433us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:51.206690 (+261510us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.263564 (+ 56874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.263637 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:51.285906 (+ 22269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.286036 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.286393 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"thread_start_us":252868,"threads_started":2}
I20260709 13:09:51.300985 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:51.306829 15382 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.308641 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:51.323009 15233 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:51.296990 19326 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:51.328086 15375 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:51.328620 15375 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:51.265226 19310 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.295186 19284 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:09:51.317474 19380 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:51.330571 19326 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:51.337016 19369 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:51.349902 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 106734us
I20260709 13:09:51.348044 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.351874 15226 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:51.357100 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59291.8us
I20260709 13:09:51.356730 19252 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:51.362670 19326 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:51.354717 15375 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.355258 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:51.389426 19310 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:51.391597 19180 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:51.398726 19378 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:51.401377 19376 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:51.387475 19369 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:51.407846 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52800.6us
I20260709 13:09:51.409483 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:51.409809 19384 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:51.411978 19411 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:51.412684 19414 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:51.418067 15375 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:51.420214 15232 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:51.424219 19388 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:51.424816 19388 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:51.405872 19369 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:51.428488 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.439031 15382 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:51.442224 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:51.448413 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:51.450568 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.451390 19363 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.452108 15373 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:51.410003 19402 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:51.466802 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:51.467967 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.412650 19411 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.485668 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:51.486078 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:51.447003 19403 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
I20260709 13:09:51.485175 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.490116 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:51.490991 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67460.6us
I20260709 13:09:51.434165 19378 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.449756 19326 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.498479 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:51.471524 19303 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:51.503199 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.507985 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:51.488322 19280 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.006s
I20260709 13:09:51.499852 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.521857 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.350132 19413 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
I20260709 13:09:51.509143 15303 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:51.487473 19411 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.508412 15308 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:51.517614 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:51.476620 19402 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:51.523669 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.524744 15299 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:09:51.527339 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 148321us
I20260709 13:09:51.529071 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.495169 19306 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.532946 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.532764 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.538043 15375 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:51.538769 15377 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:51.495024 19366 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.534409 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.491402 19376 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.487358 19363 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:51.536711 15345 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.793s (SENT)
I20260709 13:09:51.537230 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.539862 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.530704 19180 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:51.534480 19402 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:51.543108 15302 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:09:51.533061 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.534035 19303 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:51.547873 15232 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:09:51.502672 19425 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.559770 15303 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:51.520804 19337 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:51.605551 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.620515 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 112644us
I20260709 13:09:51.603726 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.599947 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.632118 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.634023 15303 raft_consensus.cc:2410] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:51.592784 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.575954 15198 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:51.584695 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.629577 15226 raft_consensus.cc:2410] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:09:51.564834 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 135208us
I20260709 13:09:51.563627 19366 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:51.643106 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67327.1us
W20260709 13:09:51.637589 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 100238us
I20260709 13:09:51.534179 19280 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:51.676077 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.603191 19200 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.639811 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:51.680886 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 173343us
I20260709 13:09:51.677238 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:51.669797 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:51.677960 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.552819 19306 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:51.680191 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.683485 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:51.552294 19180 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.683322 15301 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:09:51.679757 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 148853us
I20260709 13:09:51.684973 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:51.683547 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.694082 15308 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:09:51.689131 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.582535 19256 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.560215 19365 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:09:51.691663 15302 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:51.600924 19376 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.543078 19388 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:51.696535 15230 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:51.645980 19284 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.646273 19373 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:51.700543 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:51.696424 19345 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.711s	user 0.016s	sys 0.000s
I20260709 13:09:51.701619 15375 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:51.727123 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50002us
I20260709 13:09:51.730985 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.696159 19180 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.740916 15301 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:09:51.741649 15345 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.932s (SENT)
I20260709 13:09:51.741901 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.744639 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:51.733659 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:51.635072 19425 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:51.716578 19372 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.005s
I20260709 13:09:51.664821 19421 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:09:51.718834 19414 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:51.752256 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.674283 19363 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.752799 15300 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:51.711860 19265 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:51.751061 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:51.758287 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46021us
I20260709 13:09:51.766923 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:51.686265 19183 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:51.769703 15302 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:09:51.711411 19256 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.778051 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.780897 19306 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.783994 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2206) took 1380 ms. Trace:
I20260709 13:09:51.783818 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:51.784677 15230 rpcz_store.cc:276] 0709 13:09:50.403305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.421886 (+ 18581us) service_pool.cc:224] Handling call
0709 13:09:50.856822 (+434936us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800002798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:09:50.857111 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.717075 (+859964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.783720 (+ 66645us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54002d0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:51.783917 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958108160}
I20260709 13:09:51.784874 15233 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:51.789754 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63583.5us
W20260709 13:09:51.765745 19417 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:09:51.759153 19414 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:51.777673 19420 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.400s	user 0.000s	sys 0.002s
I20260709 13:09:51.783375 19289 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:51.832432 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:51.835269 19256 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:51.749233 19349 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:09:51.707922 19303 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.836939 15232 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:51.837808 19200 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:51.757786 19372 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.776484 19265 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:51.791302 19368 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:51.888965 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.898542 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.744163 19345 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:51.893138 15303 raft_consensus.cc:2376] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8. Re-sending same reply.
I20260709 13:09:51.803308 19384 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:51.931854 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 201795us
W20260709 13:09:51.932960 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 163596us
I20260709 13:09:51.935825 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:51.852242 19414 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.941507 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:51.845970 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:51.958508 15231 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:51.962868 15377 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:51.965951 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:51.969247 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.972499 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.979480 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.904434 19265 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.904588 19368 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:51.792238 19366 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:51.953293 19349 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.025339 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60329.2us
I20260709 13:09:52.031566 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:52.012030 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:52.054740 19274 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.892s	user 0.020s	sys 0.006s
W20260709 13:09:52.079157 19433 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:09:51.953935 19289 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.970573 19200 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:52.111186 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.984882 19337 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.067798 19408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.010s	sys 0.016s
I20260709 13:09:51.962888 19376 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:52.138962 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 293048us
W20260709 13:09:52.100757 19242 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.994s	user 0.009s	sys 0.020s
I20260709 13:09:52.097705 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:52.067961 19368 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:51.962119 19384 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:52.143049 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 204786us
I20260709 13:09:52.158613 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2144) took 1531 ms. Trace:
I20260709 13:09:52.111426 19200 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.175216 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:52.159320 15231 rpcz_store.cc:276] 0709 13:09:50.627199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.996626 (+369427us) service_pool.cc:224] Handling call
0709 13:09:50.996993 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.959138 (+962145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.158264 (+199126us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54003129d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:52.158514 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210736384}
I20260709 13:09:52.160264 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.164032 15224 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:09:52.131614 19408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.010s	sys 0.017s
I20260709 13:09:51.983825 19284 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:52.095145 19349 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.166564 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:52.195096 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46313.6us
W20260709 13:09:52.195375 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 97816.7us
I20260709 13:09:52.165443 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:52.148524 19376 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:52.176762 19373 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.207160 19242 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:52.207226 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:52.211401 19371 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:52.218950 15224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2214) took 1812 ms (client timeout 1543 ms). Trace:
I20260709 13:09:52.220194 19290 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:52.220412 19349 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:52.221587 19372 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:52.227453 19439 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:09:52.115981 19289 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.229149 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:52.230137 15373 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:52.237777 19425 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.231410 19280 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:52.180181 19200 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.184931 19440 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:52.108654 19274 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:52.239133 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.142786 19337 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:52.282791 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 117435us
I20260709 13:09:52.288364 16006 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:09:52.285915 15224 rpcz_store.cc:269] 0709 13:09:50.406456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.434743 (+ 28287us) service_pool.cc:224] Handling call
0709 13:09:50.713860 (+279117us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b5800002798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:09:52.218677 (+1504817us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540012f2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:52.218825 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2710140544}
I20260709 13:09:52.230618 19183 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:52.294840 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 346329us
I20260709 13:09:52.272688 19373 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:52.289119 19364 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.175s	user 0.015s	sys 0.011s
I20260709 13:09:52.310387 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:52.285395 19376 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:52.294605 19369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.009s	sys 0.012s
I20260709 13:09:52.293360 19242 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:52.322075 19290 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:52.322837 19290 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.323288 19337 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.324491 19284 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.325412 19274 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.325654 19290 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:52.326225 19440 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.328933 19440 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:52.320291 19411 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.775s	user 0.016s	sys 0.006s
I20260709 13:09:52.330222 19364 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.332775 19364 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:52.316773 19373 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.337294 15229 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:52.337388 15228 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:52.340265 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:09:52.341514 19448 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:52.330210 19411 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.348483 16006 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:52.353058 19242 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.356020 19384 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:52.360244 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49955.4us
W20260709 13:09:52.375412 15233 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.000s
W20260709 13:09:52.377317 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 148280us
I20260709 13:09:52.379760 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:52.381570 15233 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:09:52.314384 19401 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:52.404947 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:52.406925 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:52.316731 19450 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:09:52.408470 19337 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:52.409262 19450 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.409407 19337 consensus_queue.cc:1243] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:52.409813 19450 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:52.410156 19337 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.410902 19337 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:52.411355 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2158) took 1265 ms. Trace:
I20260709 13:09:52.411019 19450 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.411751 15229 rpcz_store.cc:276] 0709 13:09:51.146077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.162131 (+ 16054us) service_pool.cc:224] Handling call
0709 13:09:52.411084 (+1248953us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003c23d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:52.411279 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2621334784}
W20260709 13:09:52.413452 15228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2216) took 2006 ms (client timeout 1596 ms). Trace:
I20260709 13:09:52.413684 15227 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:52.414170 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:52.410239 19430 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.638s	user 0.003s	sys 0.000s
W20260709 13:09:52.413899 15228 rpcz_store.cc:269] 0709 13:09:50.407185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.436936 (+ 29751us) service_pool.cc:224] Handling call
0709 13:09:50.833085 (+396149us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800002798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:09:52.413209 (+1580124us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540035b454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:52.413373 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3498508800}
I20260709 13:09:52.415563 19449 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:52.416860 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2425) took 1154 ms. Trace:
I20260709 13:09:52.417342 15376 rpcz_store.cc:276] 0709 13:09:51.262487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.281756 (+ 19269us) service_pool.cc:224] Handling call
0709 13:09:51.282457 (+   701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.331272 (+ 48815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.331325 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.344466 (+ 13141us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.553876 (+209410us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:51.553962 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.554058 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.409493 (+855435us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:52.416517 (+  7024us) raft_consensus.cc:1685] finished
0709 13:09:52.416541 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.416795 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38375,"raft.queue_time_us":93881,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":20736,"spinlock_wait_cycles":151330688,"thread_start_us":162118,"threads_started":2,"wal-append.queue_time_us":335963}
I20260709 13:09:52.417109 19449 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:52.402077 19376 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:52.418385 19337 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.420677 19376 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:52.421196 19337 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.419646 19449 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:52.425537 19378 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.925s	user 0.020s	sys 0.004s
I20260709 13:09:52.382064 19290 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:09:52.425384 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:52.426934 19290 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.427546 19290 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:52.428753 19349 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:52.430389 19428 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:52.430812 19428 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:52.432714 19415 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:52.415510 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2159) took 1238 ms. Trace:
I20260709 13:09:52.434921 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:52.434434 15227 rpcz_store.cc:276] 0709 13:09:51.176770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.177025 (+   255us) service_pool.cc:224] Handling call
0709 13:09:52.413488 (+1236463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.414100 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.415304 (+  1204us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540035b450. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:52.415450 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793506048}
W20260709 13:09:52.440307 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.431917 19428 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.443634 19428 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.446123 19345 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.447423 19310 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:52.447906 19310 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:52.449055 19310 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:52.450719 19402 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.813s	user 0.005s	sys 0.014s
I20260709 13:09:52.451125 19411 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:52.451341 19402 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.451980 19447 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:52.452728 19310 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:52.454031 16003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.004s	sys 0.017s
W20260709 13:09:52.459597 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52799us
W20260709 13:09:52.465487 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 228259us
I20260709 13:09:52.459642 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:52.467832 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2429) took 1036 ms. Trace:
W20260709 13:09:52.468721 16003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.005s	sys 0.017s
I20260709 13:09:52.433450 19415 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:52.479071 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:52.480033 15376 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:52.442147 19326 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.933s	user 0.011s	sys 0.012s
I20260709 13:09:52.438361 19450 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.468552 15374 rpcz_store.cc:276] 0709 13:09:51.431655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.447322 (+ 15667us) service_pool.cc:224] Handling call
0709 13:09:51.485432 (+ 38110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.485725 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:51.992550 (+506825us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.467234 (+474684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.467329 (+    95us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:52.467409 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.467524 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.467735 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261325,"prepare.run_cpu_time_us":4818,"prepare.run_wall_time_us":10358,"thread_start_us":925827,"threads_started":2}
W20260709 13:09:52.501219 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.462641 19421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.015s	sys 0.014s
W20260709 13:09:52.461594 19180 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.011s
I20260709 13:09:52.512980 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:52.522332 15228 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:52.471127 19431 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.499778 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:52.501332 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59433.8us
I20260709 13:09:52.440848 19401 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:52.510521 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.478581 19384 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.533943 15233 raft_consensus.cc:2410] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:09:52.534776 15227 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:52.526367 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.503149 19414 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
W20260709 13:09:52.471086 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 244702us
W20260709 13:09:52.499323 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 85211.9us
I20260709 13:09:52.538713 19368 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.522625 19180 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.554304 19388 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.556804 19415 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.566866 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:52.518275 19421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.016s	sys 0.015s
I20260709 13:09:52.500011 19399 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:52.483942 19447 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:52.501878 19290 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.568114 19414 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.598320 19290 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.599048 19289 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.599535 19402 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:52.598388 19401 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.602133 19368 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.605010 16008 raft_consensus.cc:2368] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9.
I20260709 13:09:52.605233 19458 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:52.605803 19349 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:52.605051 19371 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:52.607126 19371 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:52.607443 19449 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.609664 19384 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:52.609403 19447 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.612136 19414 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.614382 19180 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:52.612186 19369 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:09:52.618544 19265 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.000s
I20260709 13:09:52.619060 19265 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:52.619840 19426 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:52.620396 19426 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:52.621461 19426 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.622996 19426 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:52.619987 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:52.625487 15373 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:52.629076 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.633097 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:52.633901 15227 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
W20260709 13:09:52.633324 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66571.5us
W20260709 13:09:52.639017 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 160346us
I20260709 13:09:52.569967 19373 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.636159 15376 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
W20260709 13:09:52.653842 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98041.9us
I20260709 13:09:52.642522 15373 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:09:52.644661 19431 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.645551 19465 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.646615 19453 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.002s
I20260709 13:09:52.646212 19368 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:52.634133 19384 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.648478 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:52.610162 19449 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:52.666167 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:52.632581 19399 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:52.641405 19289 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.672147 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:52.675436 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.684163 15227 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:52.678709 19265 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:52.680526 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.688306 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:52.694348 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.694065 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.694947 15376 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.695345 15233 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:09:52.695022 15225 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:52.691659 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.693848 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:52.702730 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.703907 15303 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:52.704885 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.706082 15308 raft_consensus.cc:2410] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:09:52.710423 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:52.711511 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.712723 15301 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:52.715312 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:52.720088 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:52.721383 16008 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:52.724006 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:52.715018 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.725641 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.732074 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.727561 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.729390 15300 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:52.733047 15303 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:52.734620 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.734920 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.735332 15308 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.735481 15300 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.736812 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:52.737797 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44066.3us
I20260709 13:09:52.738981 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.740161 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.740939 15304 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:52.733075 15230 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:52.738413 15299 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:52.745870 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.746748 15301 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.736748 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:52.608146 19371 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.754029 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.755012 15305 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:52.682713 19289 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.761777 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.658408 19180 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:09:52.775427 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.780485 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:52.707967 19339 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:52.775085 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51274.3us
I20260709 13:09:52.781163 15373 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.729485 19440 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:52.801515 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:52.808894 15380 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:52.813333 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:52.816763 15299 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:52.753171 19431 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:52.682119 19378 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:09:52.782593 19289 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.747251 19365 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:09:52.857038 19440 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:52.784574 19415 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:52.880565 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:52.880731 15376 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:09:52.875419 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 202880us
I20260709 13:09:52.865058 15300 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:52.870829 15375 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:52.878921 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.879479 15303 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:52.879791 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:52.669303 19465 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.681986 19468 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:09:52.883222 15228 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:52.884200 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.892627 15301 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:52.899494 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:52.902493 15199 leader_election.cc:400] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9.
I20260709 13:09:52.900007 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:52.850418 19265 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.895679 15225 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:52.859005 19339 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:52.881824 19180 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:52.915836 19180 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:52.917178 19477 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:52.919108 19477 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:52.919627 19373 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:52.881462 19431 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:52.901075 19363 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:09:52.924719 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 222101us
I20260709 13:09:52.925777 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:52.922230 19265 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.927942 15373 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:52.912077 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.928634 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:52.928647 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:52.938869 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.947222 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.948073 15307 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:52.945739 15303 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:52.948798 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:52.953022 19378 raft_consensus.cc:2764] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:52.954357 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:52.950654 15299 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:52.949901 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:52.927758 19399 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.963882 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.964753 15307 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.969152 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:52.981547 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55874us
I20260709 13:09:52.982443 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:52.984761 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 102755us
I20260709 13:09:52.973501 19378 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.989248 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.991189 15299 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.991537 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:52.985829 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:52.982962 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:52.938110 19363 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.983412 19376 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:53.001861 19471 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:09:53.003062 19475 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:52.985716 19180 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:52.945757 19469 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:09:53.040158 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:53.035162 19384 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.036499 19440 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.041092 19369 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.987787 19431 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.990180 19349 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:53.124768 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 133314us
W20260709 13:09:53.060038 19472 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.170s	user 0.001s	sys 0.001s
I20260709 13:09:53.062214 19290 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:53.062502 15302 raft_consensus.cc:2410] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:53.069841 19465 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:53.072531 19373 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.999405 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:53.076576 19454 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:52.995978 19450 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.998579 19378 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.025992 19339 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:52.998904 19414 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 13:09:53.025992 19467 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.344s	user 0.005s	sys 0.000s
I20260709 13:09:53.089177 15376 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:09:53.150902 15376 pending_rounds.cc:85] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 4
I20260709 13:09:53.151310 15376 pending_rounds.cc:107] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:09:53.151635 15376 raft_consensus.cc:2889] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.135782 19180 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.042042 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:53.094703 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.132299 19349 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:53.095927 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:53.157022 15382 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:53.060038 19200 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.000s
W20260709 13:09:53.096611 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45234us
I20260709 13:09:53.134259 19454 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:53.104538 15299 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:53.106874 15379 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:53.109144 15308 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:53.096258 19388 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.102691 19376 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.111809 19475 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:53.092546 15377 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:53.131265 19290 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.170452 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:53.171402 15308 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.083673 15303 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
W20260709 13:09:53.160851 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 191855us
I20260709 13:09:53.153342 15307 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:53.173048 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:53.129812 19369 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.178339 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:53.178484 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:53.179086 15307 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.179615 15303 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:53.185796 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:53.187280 15303 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:53.155741 19265 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:53.180855 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:53.198956 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:53.201265 15308 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:53.139422 19373 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.196242 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.160989 19349 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.166286 19454 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:53.194849 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55812.4us
I20260709 13:09:53.175420 19376 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.208523 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.211840 15308 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:09:53.176865 19290 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.217758 15299 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:53.220813 15303 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:09:53.222451 15299 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:09:53.215592 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 216257us
I20260709 13:09:53.224671 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:53.212642 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 106180us
I20260709 13:09:53.226927 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:53.227453 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:53.227792 16003 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:53.228538 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:53.226927 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:53.230146 15308 pending_rounds.cc:85] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 7
I20260709 13:09:53.231104 15308 pending_rounds.cc:107] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:09:53.231637 15308 raft_consensus.cc:2889] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.231269 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:53.197042 19428 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.196238 19465 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:53.165582 19200 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.169708 19388 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.238814 15228 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:53.229681 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:53.249114 15233 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:53.258114 15227 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.231935 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:53.246780 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:53.215983 19447 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.268373 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 59885us
I20260709 13:09:53.270197 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.274374 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:53.275867 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:53.241493 19428 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:53.278023 15227 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:53.279208 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48065.9us
I20260709 13:09:53.284117 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:53.277212 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45316.7us
I20260709 13:09:53.279616 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:53.251551 19465 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:53.286546 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:53.289561 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.267827 19482 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.280090 19183 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:53.288915 19428 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:53.346748 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50051.8us
I20260709 13:09:53.279997 19326 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.289554 19411 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:53.360389 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:53.361056 19489 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:09:53.293385 19465 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.362790 19496 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:53.325889 19477 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:53.292721 19474 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.280650 19289 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.371253 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:53.353792 19265 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:53.352591 19183 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:53.379863 19496 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.377799 19493 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:53.278347 19447 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.363700 19482 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.373586 19366 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:53.391002 19369 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:53.367568 19363 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:53.368476 19384 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:53.412272 15306 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:53.373675 19411 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:53.422832 15227 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:53.389194 19183 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.286340 19475 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:53.445448 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 161483us
I20260709 13:09:53.418829 19415 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:53.425081 19477 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.391862 19265 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:53.418555 19493 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.461211 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:53.445173 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 73989.2us
I20260709 13:09:53.480300 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:53.424599 19366 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.494344 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.424422 19491 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:09:53.463603 19477 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:53.489418 19494 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:09:53.476156 19493 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.493139 19415 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:53.511757 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:53.512758 15378 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:53.461037 19384 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:53.524372 19384 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:53.524796 19384 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:53.525743 19384 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:53.527294 19384 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:53.499027 19487 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:09:53.516264 19256 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:53.516570 19492 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:09:53.517721 19500 raft_consensus.cc:2764] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:09:53.519261 19495 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:09:53.520157 19498 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:53.520882 19501 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.521243 19449 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:53.511269 19415 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.498173 19489 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.496270 19388 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:53.550626 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.571404 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 87209us
I20260709 13:09:53.574288 19369 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:53.575924 19496 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:53.506701 19477 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.553836 19411 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:53.579393 19504 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:09:53.580032 19289 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:53.484592 19363 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:09:53.508848 19200 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:53.508054 19373 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:53.563171 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 75106.1us
I20260709 13:09:53.586467 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:53.565474 19449 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:53.572163 19489 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:53.610814 19480 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 13:09:53.605638 19489 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.628865 19449 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.630100 19473 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.630407 19449 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.566882 19265 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.643847 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:53.645677 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.670547 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:53.673065 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86695.8us
I20260709 13:09:53.674371 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:53.678448 19469 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:53.679029 19469 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:53.679961 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:53.681497 19447 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:53.683586 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:53.684304 15308 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.688476 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:53.696077 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:53.696247 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.700910 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:53.702288 15377 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:09:53.702735 15377 pending_rounds.cc:85] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 5
I20260709 13:09:53.703007 15377 pending_rounds.cc:107] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:09:53.703282 15377 raft_consensus.cc:2889] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.707091 19366 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:53.707825 19339 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.709600 15378 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:53.686741 19369 raft_consensus.cc:2764] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:53.712100 19339 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.719359 19339 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.720986 19373 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:53.721388 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47149.5us
I20260709 13:09:53.722362 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:09:53.723449 19474 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:53.680069 19469 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.725297 15373 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:53.715157 15377 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:53.726897 19412 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:09:53.716049 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:53.716995 19473 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.717679 15379 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.701725 19364 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.729708 19412 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.730193 19412 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:53.730604 19412 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.710741 19284 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:53.731462 19284 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:53.731865 19284 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.718008 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:53.721551 19373 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:53.725514 19469 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:53.728264 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.732833 15305 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:53.723969 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.758903 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:53.759392 15273 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.553s (SENT)
I20260709 13:09:53.759903 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:53.760162 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:53.761636 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.761440 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.735605 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:53.624049 19376 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.774533 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:53.775629 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:53.788444 15379 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:53.762771 19373 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.800490 15308 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:09:53.784404 19310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.008s	sys 0.028s
I20260709 13:09:53.770533 19503 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.803912 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:53.806416 15305 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:09:53.797473 19349 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.561s	user 0.015s	sys 0.004s
I20260709 13:09:53.788543 19473 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:53.785009 19474 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.788405 19200 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:09:53.826350 19183 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:53.829087 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67723.9us
I20260709 13:09:53.830179 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.831871 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.849721 19492 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.850883 19465 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.785454 19513 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.910279 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:53.861681 19290 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.001s
W20260709 13:09:53.916683 15273 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.562s (SENT)
I20260709 13:09:53.917312 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.865025 19489 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.863646 19493 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:53.867449 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.869690 19180 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.710s	user 0.014s	sys 0.000s
I20260709 13:09:53.872476 19509 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:53.875124 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:53.926565 15375 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:09:53.878458 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:53.911175 15307 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:09:53.927942 15374 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:53.810231 19310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.009s	sys 0.028s
I20260709 13:09:53.912711 15305 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:53.928097 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:53.877637 19473 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:53.943646 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 166571us
I20260709 13:09:53.945291 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:53.938449 19454 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.699s	user 0.017s	sys 0.001s
I20260709 13:09:53.871876 19505 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:53.940047 15300 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:09:53.950847 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.911185 19491 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:53.981804 15375 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.985688 15233 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:53.992328 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 160530us
I20260709 13:09:53.993861 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:53.950949 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:53.986483 15381 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:53.911979 19366 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:09:53.903616 19349 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:53.969705 19473 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.959344 19503 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:54.006908 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 56041.8us
I20260709 13:09:53.918309 19368 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:09:53.957785 19337 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.983299 19402 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:53.920943 19242 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:09:53.903437 19339 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:53.925269 19290 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.061440 15379 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:54.062016 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80816.7us
W20260709 13:09:54.062287 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78004.2us
W20260709 13:09:54.025697 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.017975 19428 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.007s
W20260709 13:09:54.068989 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 152350us
W20260709 13:09:54.094355 15273 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.573s (SENT)
I20260709 13:09:54.094828 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:54.026084 19415 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:53.981431 19454 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.056821 19183 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:54.093092 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 99387.9us
I20260709 13:09:54.074199 19402 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.101927 19402 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.086992 19364 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:54.105541 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:54.106428 19454 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:54.106936 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:54.088382 19401 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:54.086278 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:54.081646 19337 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.108453 19442 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:54.109064 19442 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.109261 19368 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:54.109589 19366 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:54.110328 19337 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:54.110110 19442 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.110853 19366 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:54.107806 19401 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.111377 19366 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.113363 19465 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:54.113979 19401 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:54.115734 19384 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.005s
I20260709 13:09:54.107790 15373 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:09:54.107219 19454 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:54.109899 19368 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:54.100937 19522 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 13:09:54.084290 19477 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
I20260709 13:09:54.115547 19401 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.116575 19454 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:54.099300 19428 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.135643 19511 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.141379 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:09:54.148520 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.120765 19415 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.123446 19368 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:54.131313 19458 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.006s	sys 0.009s
I20260709 13:09:54.149556 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:54.137042 19412 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:54.140758 19373 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.134167 19310 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:54.117213 19366 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:54.190507 19449 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.005s
W20260709 13:09:54.194598 19520 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.128s	user 0.000s	sys 0.006s
I20260709 13:09:54.195801 19415 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.196071 19284 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.259660 19183 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:54.197783 19402 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:54.129691 19477 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.210968 19290 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:54.215216 19493 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:54.215389 15307 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:54.290323 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:54.217170 19489 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:54.292836 19412 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:54.220928 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.293650 19477 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:54.260274 19310 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:54.256527 19469 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.295080 19469 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.224001 15305 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:54.297542 19469 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:54.190609 19242 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:54.232070 19339 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:54.226945 19521 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:54.301733 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:54.257936 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 108546us
I20260709 13:09:54.142916 19454 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:54.255033 19458 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.006s	sys 0.010s
I20260709 13:09:54.286010 19366 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:54.287745 15302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2468) took 1426 ms (client timeout 1842 ms). Trace:
I20260709 13:09:54.288282 19373 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:54.277266 19183 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.291131 16003 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.292014 15308 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:09:54.294595 19310 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.150184 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:54.307475 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:09:54.309559 15302 rpcz_store.cc:269] 0709 13:09:52.860983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.861269 (+   286us) service_pool.cc:224] Handling call
0709 13:09:54.287353 (+1426084us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540006bdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:54.287615 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358786816}
I20260709 13:09:54.253964 19535 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.315331 19256 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:09:54.327939 19509 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:09:54.315018 19489 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:09:54.344595 19349 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:54.341984 19183 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:09:54.348654 15308 pending_rounds.cc:85] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 6
I20260709 13:09:54.437703 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:54.352556 19535 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:54.356650 19242 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:54.358078 19373 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:54.359768 19469 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:54.438277 15308 pending_rounds.cc:107] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:09:54.455294 15308 raft_consensus.cc:2889] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.350770 15379 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:54.455597 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:54.439464 16003 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:09:54.451905 19200 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:54.454470 15300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2477) took 1500 ms (client timeout 1598 ms). Trace:
I20260709 13:09:54.459906 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:09:54.460201 15300 rpcz_store.cc:269] 0709 13:09:52.954303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.971301 (+ 16998us) service_pool.cc:224] Handling call
0709 13:09:54.454078 (+1482777us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b540006c554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:54.454284 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165420416}
I20260709 13:09:54.461253 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:54.458035 15382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.011s
W20260709 13:09:54.462204 15382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.017s	sys 0.011s
I20260709 13:09:54.434712 19511 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.466894 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:54.467803 15379 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.433379 19339 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:54.467234 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 319525us
I20260709 13:09:54.495427 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:09:54.462806 19525 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.184s	user 0.000s	sys 0.007s
W20260709 13:09:54.507489 19519 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:54.463526 19200 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:09:54.520991 19200 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.524922 19428 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:54.489610 19534 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:54.525955 19534 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.526374 19534 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.464407 19242 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.472915 19510 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:54.472605 19493 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:54.525452 19373 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.530604 19256 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.540853 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48974.1us
I20260709 13:09:54.532970 19458 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:54.528530 19284 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:54.554595 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.496835 19339 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:54.561133 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:54.567278 15300 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.569022 15379 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:54.574566 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.542795 19510 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.544587 19256 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.540505 19493 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:54.647723 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 105829us
I20260709 13:09:54.649011 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:54.540901 19373 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:54.684269 15300 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:09:54.688117 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:54.701017 15225 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:54.706025 15227 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:54.706854 15227 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:54.712795 15230 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:54.691887 19402 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:54.715602 15227 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:54.720944 15227 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:54.697208 19428 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:54.702255 19450 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:54.728225 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79346.8us
I20260709 13:09:54.730257 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:54.739624 15348 leader_election.cc:336] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.513s (SENT)
I20260709 13:09:54.740473 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:54.725468 19428 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:54.767496 19428 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:54.769057 19539 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:09:54.781519 19310 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.783205 15378 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:54.845679 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 115572us
W20260709 13:09:54.849234 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109653us
W20260709 13:09:54.862317 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.879763 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:54.765268 19536 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:09:54.801934 19473 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.744s	user 0.015s	sys 0.006s
I20260709 13:09:54.689919 19242 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.724774 19450 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:54.916874 19384 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.997967 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2489) took 1141 ms. Trace:
I20260709 13:09:54.914144 19349 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:54.953991 19469 raft_consensus.cc:2764] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:09:55.005610 15381 rpcz_store.cc:276] 0709 13:09:53.856362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.875725 (+ 19363us) service_pool.cc:224] Handling call
0709 13:09:53.876049 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.995963 (+119914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.997477 (+1001514us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003c4454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:54.997820 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253353344}
W20260709 13:09:55.027057 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 147560us
W20260709 13:09:55.037503 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 299236us
I20260709 13:09:54.733969 19493 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:54.490298 19511 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:54.994890 19535 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.041996 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.041800 19450 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.041321 19310 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:54.758567 19510 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.050977 15227 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:54.968572 19473 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.073778 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2485) took 1218 ms. Trace:
I20260709 13:09:55.074340 15382 rpcz_store.cc:276] 0709 13:09:53.854975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.873299 (+ 18324us) service_pool.cc:224] Handling call
0709 13:09:53.873740 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.909860 (+ 36120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.909898 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.910501 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.462658 (+552157us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:54.462706 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.781846 (+319140us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54001b99d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:54.781911 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.067669 (+285758us) raft_consensus.cc:1685] finished
0709 13:09:55.067693 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.073683 (+  5990us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30745,"raft.queue_time_us":7168,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":5130,"spinlock_wait_cycles":82070912,"thread_start_us":551726,"threads_started":1,"wal-append.queue_time_us":635376}
W20260709 13:09:55.076607 15228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2226) took 1850 ms (client timeout 1513 ms). Trace:
W20260709 13:09:55.077108 15228 rpcz_store.cc:269] 0709 13:09:53.225991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.227204 (+  1213us) service_pool.cc:224] Handling call
0709 13:09:55.076302 (+1849098us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5400312754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.076513 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24065280}
I20260709 13:09:55.079602 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.079377 19450 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.095431 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 624) took 1905 ms. Trace:
I20260709 13:09:55.096025 16008 rpcz_store.cc:276] 0709 13:09:53.177737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.180468 (+  2731us) service_pool.cc:224] Handling call
0709 13:09:55.082575 (+1902107us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b5400660b54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.082730 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185918848}
I20260709 13:09:55.089982 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.098342 15382 raft_consensus.cc:2410] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:09:55.066911 19399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.034s	sys 0.070s
I20260709 13:09:55.040534 19402 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:09:55.109884 19402 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:55.102669 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:55.099187 19368 consensus_meta.cc:287] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.815s	user 0.008s	sys 0.006s
I20260709 13:09:55.068295 19256 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.111546 19402 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:55.121214 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:55.108183 19399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.034s	sys 0.071s
I20260709 13:09:55.101984 19339 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.134408 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.135284 15379 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:55.136765 15306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2474) took 2183 ms (client timeout 2024 ms). Trace:
W20260709 13:09:55.137281 15306 rpcz_store.cc:269] 0709 13:09:52.953289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.953980 (+   691us) service_pool.cc:224] Handling call
0709 13:09:55.136510 (+2182530us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54001d5e54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.136661 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050836224}
I20260709 13:09:55.139619 19511 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:55.143595 19376 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.148021 19473 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:55.119972 19368 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.148967 19473 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.141891 19458 consensus_meta.cc:287] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.000s
I20260709 13:09:55.158305 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:55.164971 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.166880 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.168259 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:55.174623 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.177160 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:55.158787 19371 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.157897 19368 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.178901 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2457) took 2230 ms. Trace:
I20260709 13:09:55.189800 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.180604 19402 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:55.156728 19454 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.805s	user 0.015s	sys 0.001s
I20260709 13:09:55.184789 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.204447 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.205852 15382 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 11 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
W20260709 13:09:55.206228 19484 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 1.920s	user 0.007s	sys 0.009s
I20260709 13:09:55.186298 19428 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.209574 19402 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.211807 19428 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:55.175637 19200 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.003s
I20260709 13:09:55.217160 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.217465 19200 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.219236 15225 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:55.149806 19473 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:09:55.191402 15974 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.524s (SENT) [suppressed 58 similar messages]
I20260709 13:09:55.222514 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.224087 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.224941 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.225967 15226 raft_consensus.cc:2410] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:09:55.200023 19510 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.165791 19458 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:55.189299 15380 rpcz_store.cc:276] 0709 13:09:52.948794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.957499 (+  8705us) service_pool.cc:224] Handling call
0709 13:09:52.980758 (+ 23259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.980970 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:53.139657 (+158687us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.831846 (+692189us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18003e2180. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:09:55.178155 (+1346309us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18003e2180. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287
0709 13:09:55.178374 (+   219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.178441 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:55.178523 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.178606 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.178767 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":256705,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3064,"raft.queue_time_us":115402,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":3665,"spinlock_wait_cycles":44626944,"thread_start_us":259818,"threads_started":2}
I20260709 13:09:55.204177 15228 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:55.187207 19373 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.214025 19454 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.215822 15382 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:55.215960 19426 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:55.224049 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2493) took 1106 ms. Trace:
I20260709 13:09:55.242655 15230 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:55.205232 19534 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.009s
I20260709 13:09:55.230123 15232 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:55.251425 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.240147 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.240577 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.242638 15374 rpcz_store.cc:276] 0709 13:09:54.118056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.120068 (+  2012us) service_pool.cc:224] Handling call
0709 13:09:54.137384 (+ 17316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.313599 (+176215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.313645 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.313736 (+    91us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:54.313798 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.223658 (+909860us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003c3a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:55.223740 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.223951 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404525312}
I20260709 13:09:55.229744 19473 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:09:55.247731 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.257876 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.260464 15379 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:55.264256 15379 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:55.268275 15379 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:55.242354 19426 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:55.286441 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.287686 15381 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:55.288240 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 96877.1us
I20260709 13:09:55.239395 19510 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.254671 19534 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:55.299134 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.301443 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:55.302307 16008 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:55.303994 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.300058 19473 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:55.305804 19473 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.306329 19547 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.306929 19547 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.309733 19454 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:55.310396 19514 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 1.233s	user 0.009s	sys 0.016s
I20260709 13:09:55.312430 19378 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.317966 15231 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:55.319713 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.320470 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.320961 15225 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.321420 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.321928 15228 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:55.323693 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.319155 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:55.324623 15224 raft_consensus.cc:2410] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:09:55.328727 16003 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:55.326220 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.330550 15228 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:55.332110 15229 raft_consensus.cc:2368] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:55.332441 15232 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:55.335253 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:55.337572 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:55.337692 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:55.339774 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2492) took 1730 ms. Trace:
I20260709 13:09:55.340085 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2489) took 2215 ms. Trace:
I20260709 13:09:55.302073 19200 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.341096 16006 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:55.342480 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.342698 16001 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:55.342816 19510 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.345299 15300 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:55.345690 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.346277 15971 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:55.346664 16004 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:09:55.346592 15231 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.348838 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.340269 15301 rpcz_store.cc:276] 0709 13:09:53.609170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.612706 (+  3536us) service_pool.cc:224] Handling call
0709 13:09:53.613067 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.613670 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.613701 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.614352 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.919564 (+305212us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:53.999396 (+ 79832us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.339012 (+1339616us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b1800481ea0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:09:55.339250 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.339368 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.339432 (+    64us) raft_consensus.cc:1685] finished
0709 13:09:55.339561 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.339705 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23610,"prepare.queue_time_us":79836,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":5325,"raft.queue_time_us":1342204,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":40194,"spinlock_wait_cycles":3704704,"thread_start_us":304575,"threads_started":1,"wal-append.queue_time_us":737227}
I20260709 13:09:55.351313 15382 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:55.340510 15299 rpcz_store.cc:276] 0709 13:09:53.124983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.234554 (+109571us) service_pool.cc:224] Handling call
0709 13:09:53.235114 (+   560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.372842 (+137728us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:53.591676 (+218834us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.000592 (+408916us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.042012 (+ 41420us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.043238 (+  1226us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:54.043551 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.339740 (+1296189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.339829 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.339878 (+    49us) raft_consensus.cc:1685] finished
0709 13:09:55.339892 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.340021 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2591909,"prepare.queue_time_us":150345,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":7485,"raft.queue_time_us":1426703,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":12577,"thread_start_us":726951,"threads_started":3,"wal-append.queue_time_us":648907,"wal-append.run_cpu_time_us":3305,"wal-append.run_wall_time_us":1082375}
I20260709 13:09:55.308216 19473 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:55.375768 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.355389 15305 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:09:55.376822 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:55.377951 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:55.382148 15300 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:55.382308 15306 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:55.383195 15299 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.353513 19326 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:09:55.385509 19534 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.347658 19503 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.386437 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.350387 19460 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:09:55.386230 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 1.2918e+06us
I20260709 13:09:55.385870 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:55.383992 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:55.388805 15307 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:55.385555 19538 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.747s	user 0.002s	sys 0.010s
I20260709 13:09:55.375576 19337 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.392326 15305 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:55.392993 15302 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:55.361758 19413 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:55.392926 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.395816 19337 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.397512 19290 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.398164 19497 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.398518 19180 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:55.399080 15273 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.556s (SENT)
I20260709 13:09:55.382743 19454 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:55.404489 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.407331 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.408404 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.386659 19503 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:55.409472 15233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 628) took 1739 ms (client timeout 1524 ms). Trace:
I20260709 13:09:55.380558 19482 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.410705 19528 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.949s	user 0.000s	sys 0.013s
I20260709 13:09:55.410913 19547 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.412151 15231 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:09:55.412048 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.412989 15306 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:55.413401 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2494) took 1294 ms. Trace:
I20260709 13:09:55.444365 15379 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:55.448388 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:55.448519 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:55.442188 15375 rpcz_store.cc:276] 0709 13:09:54.118869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.119011 (+   142us) service_pool.cc:224] Handling call
0709 13:09:54.119454 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.121998 (+  2544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.122032 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.122583 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.459327 (+336744us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:54.459383 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.459457 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.384931 (+925474us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:55.413018 (+ 28087us) raft_consensus.cc:1685] finished
0709 13:09:55.413047 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.413327 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2091,"raft.queue_time_us":8853,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":3697,"spinlock_wait_cycles":19791104,"thread_start_us":306659,"threads_started":1,"wal-append.queue_time_us":394335}
I20260709 13:09:55.415632 15228 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:09:55.303157 19426 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.381536 19465 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.417304 15382 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:55.420960 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:55.403762 15307 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:55.465509 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.427037 15299 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:55.439213 15233 rpcz_store.cc:269] 0709 13:09:53.669932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.670131 (+   199us) service_pool.cc:224] Handling call
0709 13:09:55.409189 (+1739058us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b540012f7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.409370 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710965120}
I20260709 13:09:55.440236 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.455585 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.452421 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:55.474095 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:55.475260 15382 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:55.475644 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:55.492739 15373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2476) took 1696 ms (client timeout 2093 ms). Trace:
I20260709 13:09:55.496694 15382 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:55.493631 15373 rpcz_store.cc:269] 0709 13:09:53.758048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.758178 (+   130us) service_pool.cc:224] Handling call
0709 13:09:55.453989 (+1695811us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540023e6d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.454103 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764288384}
I20260709 13:09:55.502022 15377 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:55.417011 19473 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:55.428174 19413 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:55.445541 19378 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.427738 19290 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.455458 19371 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:55.466485 19376 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.537501 19378 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.541025 19449 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.541584 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.541882 19449 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.543612 19378 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.545006 15373 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:55.546079 19337 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.546452 19371 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:55.547320 19562 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:55.548307 19562 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:55.547788 19371 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.549660 19562 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.506040 19428 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:55.433003 19180 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.433468 19497 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:55.523478 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 124452us
I20260709 13:09:55.519609 19493 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:09:55.561015 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 108737us
W20260709 13:09:55.563019 15273 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.575s (SENT)
I20260709 13:09:55.535880 19465 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:55.565667 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.567165 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.567663 15233 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:09:55.534476 19450 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.568569 15228 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:55.585768 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:55.533998 19511 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:55.589139 19511 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.572686 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.578405 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.454461 19482 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.575744 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:55.612938 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:55.450263 19454 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.626540 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.669143 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.530491 19473 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.682578 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.682749 15381 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:09:55.574061 19449 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:55.687806 15273 connection.cc:256] RPC call timeout handler was delayed by -1.4603043559999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260709 13:09:55.557365 19376 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.701472 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:55.613467 19378 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.703660 15373 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:55.704818 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:09:55.689945 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.704623 15273 connection.cc:256] RPC call timeout handler was delayed by -1.4594043559999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 13:09:55.702809 15375 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:55.599090 19337 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.718684 15273 connection.cc:256] RPC call timeout handler was delayed by -1.446804355999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 13:09:55.719565 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.559567 19428 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:55.727887 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.732306 15225 raft_consensus.cc:2410] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:09:55.733682 15273 connection.cc:256] RPC call timeout handler was delayed by -1.377993363999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:09:55.736292 15273 connection.cc:256] RPC call timeout handler was delayed by -1.3640043559998958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:09:55.735226 15381 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:09:55.738068 15273 connection.cc:256] RPC call timeout handler was delayed by -1.3217043559999411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:09:55.685240 19511 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:55.572875 19493 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.742280 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:55.758224 15373 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:55.747953 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:55.743858 15273 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.685s (SENT)
I20260709 13:09:55.614571 19450 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:55.749593 19556 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.366s	user 0.000s	sys 0.002s
I20260709 13:09:55.664817 19465 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:55.771767 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:55.773818 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:09:55.465843 19339 consensus_queue.cc:1175] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 12 status { last_received { term: 11 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:55.774909 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:55.775723 15301 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.760588 19511 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:55.776521 19511 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.778939 19511 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.779577 19511 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:55.780503 15302 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:55.760914 15273 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.696s (SENT)
I20260709 13:09:55.770681 19465 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.632045 19310 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:55.782615 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.786523 15301 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:55.733547 16001 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:09:55.769876 19557 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:09:55.793248 15273 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.736s (SENT)
I20260709 13:09:55.793545 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:55.803699 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:55.801751 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:55.803627 15304 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:55.726446 19378 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.804629 15301 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:55.800823 15302 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:55.709048 19413 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.805349 15373 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:55.737537 19337 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.791776 19465 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:55.818239 15273 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.736s (SENT)
I20260709 13:09:55.818913 19560 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:55.818843 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:55.806250 19310 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.847579 16006 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:55.859293 16007 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:55.830396 15303 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:55.853013 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:09:55.861907 19563 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:55.862494 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2490) took 2255 ms. Trace:
I20260709 13:09:55.843108 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:55.862584 19563 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.864581 15381 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:09:55.865751 19310 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.865373 19563 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:55.843497 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.866483 15299 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:55.866842 15299 pending_rounds.cc:85] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 4
I20260709 13:09:55.867149 15299 pending_rounds.cc:107] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:55.867465 15299 raft_consensus.cc:2889] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:55.863794 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.849872 19180 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.828492 19450 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:55.822155 19428 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:55.829738 15304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2465) took 3100 ms (client timeout 2147 ms). Trace:
W20260709 13:09:55.874888 15304 rpcz_store.cc:269] 0709 13:09:52.737107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.741621 (+  4514us) service_pool.cc:224] Handling call
0709 13:09:55.829253 (+3087632us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b54001d5954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.829405 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6723498752}
I20260709 13:09:55.877679 19290 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.828642 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:55.879588 19473 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:55.880700 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52260.9us
I20260709 13:09:55.882264 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:55.780161 19511 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.883127 19339 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:55.883594 19339 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.883975 19339 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:55.885715 19511 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.886334 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:55.886909 19265 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:55.887684 19265 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:55.821331 15273 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.805s (SENT)
I20260709 13:09:55.890429 19265 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.892438 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:09:55.892659 19441 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:55.894421 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.889775 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:55.895475 19509 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:55.895939 19509 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.896327 19509 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:55.898300 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2493) took 2280 ms. Trace:
I20260709 13:09:55.898759 15308 rpcz_store.cc:276] 0709 13:09:53.618404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.810128 (+191724us) service_pool.cc:224] Handling call
0709 13:09:54.289000 (+478872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.461189 (+172189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.898008 (+1436819us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540006bdd0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.898218 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883869056}
I20260709 13:09:55.811862 19503 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:55.880743 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2497) took 1758 ms. Trace:
W20260709 13:09:55.902813 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.886487 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.896363 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75054.5us
W20260709 13:09:55.905404 15273 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.811s (SENT)
I20260709 13:09:55.905999 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:55.908771 15300 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:55.863010 15303 rpcz_store.cc:276] 0709 13:09:53.607587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.607739 (+   152us) service_pool.cc:224] Handling call
0709 13:09:55.829957 (+2222218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.860584 (+ 30627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.862269 (+  1685us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54001d5950. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:55.862420 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5109689600}
I20260709 13:09:55.902448 15378 rpcz_store.cc:276] 0709 13:09:54.122216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.505726 (+383510us) service_pool.cc:224] Handling call
0709 13:09:54.506048 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.783798 (+277750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.880462 (+1096664us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54003c3f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:55.880667 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636811008}
I20260709 13:09:55.915539 15379 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:55.916039 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:55.918998 19265 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:55.920293 19265 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:55.920833 19265 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:55.920408 19563 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:55.921766 19265 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.923317 19265 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:55.830327 19493 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:55.912835 19363 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.925709 19363 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:55.924454 19563 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:55.956871 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.960587 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44639.4us
W20260709 13:09:55.962131 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.964133 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.965076 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.968138 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.968752 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.970666 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.973289 19490 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:55.975358 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:55.976485 15373 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:55.967257 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:55.979874 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.982326 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.983994 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:55.917198 19290 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:55.993244 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.998414 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.000070 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 92504.2us
I20260709 13:09:55.998111 19503 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.004740 19454 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:56.002329 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:55.995028 19363 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:56.005359 19465 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:56.006150 19363 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:56.007108 19454 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:56.007969 19454 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.011386 19454 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:56.015189 15273 connection.cc:256] RPC call timeout handler was delayed by -1.2983043559999032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:09:56.018167 15273 connection.cc:256] RPC call timeout handler was delayed by -1.2920043559998931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:09:56.021960 15273 connection.cc:256] RPC call timeout handler was delayed by -1.2884043559998872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
I20260709 13:09:56.008147 19465 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:56.021005 19415 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:56.023540 19415 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:56.022864 15273 connection.cc:256] RPC call timeout handler was delayed by -1.2714194289999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2579s for a response
W20260709 13:09:56.032294 15273 connection.cc:256] RPC call timeout handler was delayed by -1.2677043559999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 13:09:56.035168 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 423070us
W20260709 13:09:56.036026 15273 connection.cc:256] RPC call timeout handler was delayed by -1.2527846389999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:09:56.037568 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.039182 15373 raft_consensus.cc:2410] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:09:56.050140 15273 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.632s (SENT)
I20260709 13:09:56.050952 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:56.052778 15273 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.867s (SENT)
I20260709 13:09:56.059717 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:56.067440 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.025206 19509 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:56.099028 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.099480 19509 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:56.101341 15373 raft_consensus.cc:2410] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 11 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:09:56.092813 19532 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:56.102291 19532 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:56.103180 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.105491 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.106175 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.106899 15375 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:56.107120 15373 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:56.108777 19509 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:56.113729 19566 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:09:56.115399 19532 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:56.117219 19465 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.052582 19415 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:56.127774 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75031.9us
I20260709 13:09:56.070274 19290 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:56.154975 19376 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:56.077765 19497 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:56.155520 15273 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.868s (SENT)
I20260709 13:09:56.157969 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.156210 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.172575 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.151947 15379 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:56.178452 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.179437 15379 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 5.
I20260709 13:09:56.180856 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.152537 15380 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:09:56.192516 15375 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:09:56.194483 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.199208 15273 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.882s (SENT)
I20260709 13:09:56.199906 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:56.208617 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.200693 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:56.210438 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 446368us
W20260709 13:09:56.213023 15273 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.886s (SENT)
I20260709 13:09:56.214263 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:56.216565 15273 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.974s (SENT)
I20260709 13:09:56.217217 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.220504 15382 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:56.221331 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.223124 15379 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:56.226717 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.207435 19376 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:56.196759 19441 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:09:56.231220 19482 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:56.231761 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.242585 15374 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:09:56.232600 19473 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:56.196715 19454 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.225582 19290 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.233518 19493 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:56.194964 19460 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.227690 15382 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:09:56.235342 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.236824 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:56.224555 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.257376 19482 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.242066 19450 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:09:56.259024 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.220157 19497 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:56.232151 19378 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:56.260537 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.260192 15375 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:09:56.269845 15382 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:56.269814 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.197031 19544 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:09:56.282217 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.283391 15381 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:09:56.258001 19543 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.500s	user 0.006s	sys 0.000s
I20260709 13:09:56.271642 15380 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:56.272755 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.273527 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.289605 15374 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
W20260709 13:09:56.291492 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54774.3us
W20260709 13:09:56.292126 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75600.7us
W20260709 13:09:56.293463 15273 leader_election.cc:336] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.021s (SENT)
I20260709 13:09:56.293982 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:56.297406 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:56.299970 15378 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:56.287479 15306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.001s	sys 0.013s
W20260709 13:09:56.306962 15306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.001s	sys 0.014s
I20260709 13:09:56.307667 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.309028 15378 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:56.315747 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.315521 15273 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.047s (SENT)
I20260709 13:09:56.316967 15378 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:56.316776 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:56.320722 15273 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.054s (SENT)
I20260709 13:09:56.321627 19450 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:56.329128 15348 leader_election.cc:400] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:56.324955 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.262917 19473 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:56.328956 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.325718 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:56.329701 15348 leader_election.cc:403] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:09:56.322978 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 267287us
W20260709 13:09:56.395000 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.357313 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:56.395483 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74793.5us
I20260709 13:09:56.335528 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.396020 15377 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:56.399087 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 70155us
W20260709 13:09:56.396409 15273 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.058s (SENT)
W20260709 13:09:56.357674 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.344086 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.331151 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.334668 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:56.342504 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.402139 15374 raft_consensus.cc:2368] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:09:56.423128 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:56.424669 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.260519 19454 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.313463 19458 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:56.433791 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.435361 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.328227 19376 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.435433 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.516904 15225 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:56.436955 15381 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:09:56.439008 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.436450 15273 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.081s (SENT)
I20260709 13:09:56.333866 19310 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:56.444305 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:56.450515 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.401304 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 431448us
W20260709 13:09:56.459134 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.518688 15378 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:56.463927 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 516254us
W20260709 13:09:56.530669 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 94263.8us
W20260709 13:09:56.531790 15273 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.481s (SENT)
I20260709 13:09:56.532377 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.421216 19473 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.535207 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.536407 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.538851 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.554364 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.551240 15308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.011s
W20260709 13:09:56.556160 15308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.003s	sys 0.011s
I20260709 13:09:56.422446 19450 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:56.562355 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:56.426683 19371 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.558808 15380 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:56.403244 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:56.577571 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:56.576395 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.555372 19570 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:56.580626 15380 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:56.581956 15375 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:56.582051 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:56.519336 19563 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.585559 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2498) took 2459 ms. Trace:
I20260709 13:09:56.334862 19265 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.328402 19497 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.439146 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:56.566061 15378 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:56.566443 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:56.586247 15376 rpcz_store.cc:276] 0709 13:09:54.126265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.521100 (+394835us) service_pool.cc:224] Handling call
0709 13:09:54.521538 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.531473 (+  9935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.531512 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.532110 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.638720 (+106610us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:54.638770 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.638856 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.242658 (+1603802us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:56.575057 (+332399us) raft_consensus.cc:1685] finished
0709 13:09:56.575086 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.585449 (+ 10363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9604,"raft.queue_time_us":10423,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5521,"spinlock_wait_cycles":71739648,"thread_start_us":71057,"threads_started":1,"wal-append.queue_time_us":158747}
I20260709 13:09:56.566748 15377 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:56.596669 15381 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:56.597044 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:09:56.570075 15273 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.499s (SENT)
I20260709 13:09:56.517531 19458 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:56.594487 15373 raft_consensus.cc:2376] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7. Re-sending same reply.
I20260709 13:09:56.400904 19490 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:56.544695 19310 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:56.580379 19570 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.602353 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.582105 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:56.606464 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:56.607527 15378 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:56.607823 15273 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.598s (SENT)
I20260709 13:09:56.604300 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:56.609886 19371 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:56.612985 15375 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:56.617156 19579 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:56.618125 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.614301 15376 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:56.574064 19503 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.620968 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.632328 15380 raft_consensus.cc:2410] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:09:56.622743 15374 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:56.623723 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.620242 19371 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.619469 19579 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:09:56.667331 15273 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.077s (SENT)
I20260709 13:09:56.668957 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:56.672562 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.631098 15301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.002s	sys 0.018s
W20260709 13:09:56.675693 15273 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.859s (SENT)
I20260709 13:09:56.684105 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.681938 15380 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
W20260709 13:09:56.682391 15301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.003s	sys 0.018s
I20260709 13:09:56.674801 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2512) took 1087 ms. Trace:
I20260709 13:09:56.686854 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.688135 15374 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:56.602098 19265 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:56.601253 19583 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:09:56.710124 15305 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:56.709905 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.693941 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.665287 19560 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.673362 19537 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:56.673907 19576 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:56.714341 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 144335us
I20260709 13:09:56.719161 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:56.726663 16000 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.729797 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:56.691416 19339 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.750s	user 0.015s	sys 0.009s
W20260709 13:09:56.733886 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.734269 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.706036 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:56.707808 19290 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:56.736734 15373 raft_consensus.cc:2393] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:09:56.738432 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.751075 19339 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:56.740676 15380 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
W20260709 13:09:56.762593 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.664885 19450 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.796173 19537 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:56.742863 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.770085 19454 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:56.770331 19337 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:56.773659 19265 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:56.773494 19591 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:56.783188 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 380016us
I20260709 13:09:56.787995 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.802340 15375 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.802366 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:56.802702 15376 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:56.803643 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54345.5us
I20260709 13:09:56.695043 19310 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:56.789613 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78373us
W20260709 13:09:56.770109 19571 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:09:56.808866 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:56.810828 16007 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:09:56.782490 19493 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.830265 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.830976 15375 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:56.722241 19490 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.828115 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:56.834617 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.844110 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.810600 19265 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:56.849133 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:56.850863 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.851814 15228 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:09:56.853427 15233 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:56.855468 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.858630 16000 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:09:56.848243 19388 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:09:56.860822 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.862021 15375 raft_consensus.cc:2410] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:56.862144 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:56.863022 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:56.827476 19426 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:56.863737 15227 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:56.866616 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:56.864705 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.858371 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:56.868098 15376 raft_consensus.cc:2410] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:56.868566 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:56.865991 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:56.869486 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.870467 15305 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:56.809252 19413 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:09:56.874912 19582 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:09:56.876019 19570 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:56.877182 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2524) took 1195 ms. Trace:
I20260709 13:09:56.866104 19596 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:56.878536 19339 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:56.878978 19596 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.879459 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.822217 19537 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:56.878207 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:56.857415 19310 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.877692 15308 rpcz_store.cc:276] 0709 13:09:55.682260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.899798 (+217538us) service_pool.cc:224] Handling call
0709 13:09:55.900261 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.944922 (+ 44661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.944979 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.978450 (+ 33471us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.558506 (+580056us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:56.558556 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.558633 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.876901 (+318268us) raft_consensus.cc:1685] finished
0709 13:09:56.876926 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.877105 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50622,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":19041,"thread_start_us":523271,"threads_started":1,"wal-append.queue_time_us":664734}
I20260709 13:09:56.882493 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.865378 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:56.864066 19578 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:56.870786 15376 raft_consensus.cc:2410] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:09:56.882309 19588 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:09:56.879419 19596 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.897351 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:56.898216 15304 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:09:56.841681 19576 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:56.871552 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 309253us
I20260709 13:09:56.891001 15305 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:09:56.902231 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 511) took 1514 ms. Trace:
W20260709 13:09:56.903331 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45058us
I20260709 13:09:56.905005 15306 rpcz_store.cc:276] 0709 13:09:55.387977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.459320 (+ 71343us) service_pool.cc:224] Handling call
0709 13:09:55.504651 (+ 45331us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:55.601470 (+ 96819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.601522 (+    52us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:55.618339 (+ 16817us) log.cc:844] Serialized 78 byte log entry
0709 13:09:56.307478 (+689139us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:56.427006 (+119528us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.516870 (+ 89864us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.520106 (+  3236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.520188 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.901968 (+381780us) raft_consensus.cc:1685] finished
0709 13:09:56.901990 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.902162 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91876,"prepare.queue_time_us":182115,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":14903,"raft.queue_time_us":157525,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":49343,"spinlock_wait_cycles":60990464,"thread_start_us":719798,"threads_started":2,"wal-append.queue_time_us":894947}
I20260709 13:09:56.865389 19595 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:56.916157 15305 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:56.920619 15305 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:56.920797 15307 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:56.921375 15378 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:09:56.922575 15373 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:56.923233 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.923666 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:56.924134 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.924466 15307 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.923617 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.926046 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:56.926857 15229 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.926998 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:56.928117 15230 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.918052 19578 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:56.929296 19586 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:09:56.929597 19578 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:56.930545 19600 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:56.932822 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.933894 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.937256 15304 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:56.938277 15308 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:56.939159 15273 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.139s (SENT)
I20260709 13:09:56.939654 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.940604 19337 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.915550 19579 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:56.943791 15306 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:09:56.948455 15273 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 3.245s (SENT)
I20260709 13:09:56.950718 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:56.912801 19265 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:56.964287 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:56.976296 19511 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:56.976936 19511 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:56.977909 19511 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.979447 19511 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.687222 15302 rpcz_store.cc:276] 0709 13:09:55.587095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.807114 (+220019us) service_pool.cc:224] Handling call
0709 13:09:55.807625 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.807946 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:56.306139 (+498193us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.663103 (+356964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.663199 (+    96us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:56.663296 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.663423 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.674725 (+ 11302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346,"prepare.queue_time_us":106748,"prepare.run_cpu_time_us":3005,"prepare.run_wall_time_us":15320,"raft.queue_time_us":503,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":12941,"spinlock_wait_cycles":113152,"thread_start_us":803042,"threads_started":2}
W20260709 13:09:56.980949 15974 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.524s (SENT)
I20260709 13:09:56.953946 19339 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:56.966368 19598 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:09:56.985088 19265 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.969455 19337 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.953692 19567 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:56.990505 19567 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:56.995563 15229 raft_consensus.cc:2410] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:56.999840 15307 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:57.000582 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:57.012020 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 140893us
I20260709 13:09:57.017042 19567 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:57.009655 19589 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:09:57.027830 19473 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:57.028519 19589 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:57.028981 19589 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:57.029956 19589 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.031370 19589 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.019999 19458 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.033105 19458 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.026620 19576 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.026602 15230 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:09:57.045950 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:57.046993 15378 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.051819 15379 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:57.056452 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:57.061601 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 113229us
I20260709 13:09:57.064364 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2511) took 1477 ms. Trace:
I20260709 13:09:57.065094 15301 rpcz_store.cc:276] 0709 13:09:55.586753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.807058 (+220305us) service_pool.cc:224] Handling call
0709 13:09:55.807602 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.958328 (+150726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.958381 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.984765 (+ 26384us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.687381 (+702616us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:56.687451 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.041452 (+354001us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540026c5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:57.041526 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.041603 (+    77us) raft_consensus.cc:1685] finished
0709 13:09:57.041625 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.064220 (+ 22595us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39632,"raft.queue_time_us":40889,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":5908,"spinlock_wait_cycles":253990400,"thread_start_us":674437,"threads_started":1,"wal-append.queue_time_us":762091}
W20260709 13:09:57.102020 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.105671 15378 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:09:57.107225 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:57.108799 15307 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:57.109122 15301 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:57.111142 15307 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:57.111218 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 203114us
I20260709 13:09:57.114795 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.118295 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.120716 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.122975 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.123736 15299 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:57.110569 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.132853 15301 raft_consensus.cc:2368] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:09:57.139370 15228 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:57.112905 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.137877 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:09:57.140911 15307 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:57.145515 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 221496us
I20260709 13:09:57.146445 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.148912 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.149791 15302 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:57.150856 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.151585 15304 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:57.152618 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.157135 16004 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:09:57.157840 19447 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.161756 19447 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:57.172741 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 641489us
I20260709 13:09:57.173238 19415 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.172930 15232 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:57.176753 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:57.179819 15307 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:57.178872 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.180583 15304 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:57.180830 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 789) took 1558 ms. Trace:
I20260709 13:09:57.181320 15381 rpcz_store.cc:276] 0709 13:09:55.622725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.543307 (+920582us) service_pool.cc:224] Handling call
0709 13:09:56.596467 (+ 53160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.597187 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.180611 (+583424us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b5400003050. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:57.180764 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121141120}
I20260709 13:09:57.140262 19595 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:57.185041 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:57.148921 19265 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:57.195209 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.196064 15306 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.187978 15229 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:57.191118 15227 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:09:57.202493 15227 pending_rounds.cc:85] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 9
I20260709 13:09:57.202927 15227 pending_rounds.cc:107] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:09:57.203253 15227 raft_consensus.cc:2889] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:57.208583 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:57.210361 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.210772 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:57.211889 15227 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:09:57.256222 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.156721 19579 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:57.281922 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 103057us
I20260709 13:09:57.188427 19378 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:57.285542 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.299489 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:57.303154 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.303930 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.304379 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.305855 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.187621 19426 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 13:09:57.321440 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.208513 19595 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:09:57.268040 19449 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:57.265684 19560 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.351441 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.264850 19310 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:57.352694 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.366707 15307 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:09:57.267637 19482 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:57.367848 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.372484 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.372680 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.379370 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:09:57.379860 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 231766us
I20260709 13:09:57.380987 15307 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:09:57.372649 19571 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:57.353636 19449 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.350092 19378 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:57.366051 19562 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:57.392246 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.389125 19449 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.397182 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.397662 19579 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.403502 15380 raft_consensus.cc:2410] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:09:57.408747 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.354099 19490 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:09:57.419194 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.414745 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.420168 15302 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:09:57.383673 19606 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:09:57.413021 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 129788us
I20260709 13:09:57.363799 15306 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:09:57.391523 19482 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:09:57.373857 19560 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.438237 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.415892 19337 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:57.377338 19310 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:57.422410 19612 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:09:57.439090 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 355048us
I20260709 13:09:57.440240 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.448910 15302 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:57.412987 19426 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.441740 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 228572us
I20260709 13:09:57.449903 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:57.441967 15306 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
W20260709 13:09:57.453893 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52234.5us
I20260709 13:09:57.454252 15308 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:57.447650 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 232153us
I20260709 13:09:57.446882 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:57.459134 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:57.460777 15307 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:09:57.461664 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:09:57.462592 15230 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:57.464761 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:57.413430 19562 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.470256 19583 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:57.477129 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.476678 19363 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:57.491847 19596 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.005s
I20260709 13:09:57.474853 19537 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:57.496191 19596 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.498478 15233 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:57.500443 19596 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:57.500631 19611 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:09:57.501917 19310 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:57.453403 19337 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:57.509130 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.509213 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49379.9us
I20260709 13:09:57.512007 15232 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:57.510041 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 79492.5us
I20260709 13:09:57.520802 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.527130 15308 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:09:57.521785 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.525805 15302 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:57.530273 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.514396 15231 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:57.538818 15299 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:57.538903 15301 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:57.538801 15226 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:57.519292 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.436189 19595 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.459461 19426 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.462785 19505 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:09:57.528610 15305 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:57.557649 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.557777 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.558674 15305 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.547353 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:57.562479 15301 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:57.562908 15301 pending_rounds.cc:85] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 3
I20260709 13:09:57.563139 15301 pending_rounds.cc:107] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:57.563462 15301 raft_consensus.cc:2889] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:57.545154 15303 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:57.549860 19567 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:57.574666 19567 consensus_queue.cc:1243] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:57.575542 19567 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:57.576007 19567 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:09:57.577211 19567 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.554239 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:57.555639 19583 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.585395 19583 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:57.550765 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 88668.6us
I20260709 13:09:57.545131 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:57.588231 19583 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:57.558789 15299 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:57.590981 15299 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:57.595304 19458 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:57.596108 19458 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:57.597563 19583 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:57.598791 19583 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:57.600793 19583 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.601365 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:57.599462 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45150.9us
I20260709 13:09:57.601845 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:09:57.607520 16007 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:57.610718 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:57.615598 19458 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:57.584817 19567 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.618981 15302 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:09:57.629842 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:57.638616 19596 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:57.655368 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50006.8us
I20260709 13:09:57.662881 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:57.665560 15305 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:09:57.669499 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.671829 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:57.702647 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.556262 19614 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:09:57.509822 19589 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 13:09:57.554751 19310 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.716799 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 115036us
W20260709 13:09:57.717936 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.660132 19578 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.546108 19601 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.165s
I20260709 13:09:57.484362 19378 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.729542 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:57.740247 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 193728us
W20260709 13:09:57.748970 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 119259us
W20260709 13:09:57.756232 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 151307us
I20260709 13:09:57.762737 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:57.763999 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.764437 15308 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:09:57.766776 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109797us
I20260709 13:09:57.553850 19482 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.738021 19632 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:57.750491 19589 consensus_queue.cc:1243] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:57.753639 19284 raft_consensus.cc:2764] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:09:57.753945 19562 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:57.805255 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:57.812529 15230 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:09:57.731480 19596 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:09:57.817260 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.730110 19310 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.810537 19632 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.738440 19578 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:57.795799 19576 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:57.757216 19402 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:09:57.812098 19511 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.832s	user 0.016s	sys 0.000s
I20260709 13:09:57.804889 19629 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:57.826699 19576 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:57.885749 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.893553 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.899613 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.912663 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.919282 19490 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:57.921223 19490 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:57.925061 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 198972us
I20260709 13:09:57.929656 19511 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.960683 19623 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:09:57.826789 19638 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.202s
W20260709 13:09:58.048642 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 153111us
W20260709 13:09:58.053233 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.048045 19426 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:57.928807 19629 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:58.065282 19618 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.357s	user 0.001s	sys 0.001s
I20260709 13:09:58.060726 19337 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:58.009768 19490 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.059316 19511 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:58.094774 19634 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 13:09:58.076251 19601 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:09:58.128664 19647 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:09:58.129757 19602 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:58.130399 19602 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:09:58.133473 19626 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:58.135396 19637 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:58.130419 19632 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:58.065198 19576 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.127381 19490 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.131582 19602 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:58.177671 19567 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.003s
I20260709 13:09:58.178779 19602 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.178912 19578 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:58.135399 19646 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:09:58.181684 19449 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:09:58.182204 19449 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:58.185552 19649 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.063s	user 0.000s	sys 0.004s
I20260709 13:09:58.185408 19656 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:58.186741 19310 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:58.186491 19656 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.187386 19310 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.187951 19310 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:58.188763 19583 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.013s
I20260709 13:09:58.189203 19656 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.189308 19583 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:58.193869 19415 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.020s	user 0.020s	sys 0.002s
W20260709 13:09:58.194396 15379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2519) took 1964 ms (client timeout 2014 ms). Trace:
I20260709 13:09:58.195065 15225 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:09:58.195503 15225 pending_rounds.cc:85] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 8
I20260709 13:09:58.195768 15225 pending_rounds.cc:107] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:09:58.196027 15225 raft_consensus.cc:2889] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.196695 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2264) took 1197 ms. Trace:
I20260709 13:09:58.197124 15228 rpcz_store.cc:276] 0709 13:09:56.999669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.999856 (+   187us) service_pool.cc:224] Handling call
0709 13:09:57.001728 (+  1872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.139903 (+138175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.196389 (+1056486us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003c1ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:58.196621 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315962112}
I20260709 13:09:58.198459 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2259) took 1365 ms. Trace:
I20260709 13:09:58.198869 15225 rpcz_store.cc:276] 0709 13:09:56.832724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.832894 (+   170us) service_pool.cc:224] Handling call
0709 13:09:56.833400 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.196560 (+1363160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.198199 (+  1639us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002d0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:58.198396 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130508032}
W20260709 13:09:58.194871 15379 rpcz_store.cc:269] 0709 13:09:56.229639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.291664 (+ 62025us) service_pool.cc:224] Handling call
0709 13:09:58.194124 (+1902460us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b540023e6d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:58.194308 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172188544}
I20260709 13:09:58.212884 19449 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:58.221076 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.223253 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 173313us
W20260709 13:09:58.224725 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.225095 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:58.226344 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:09:58.225409 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.242259 19656 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:58.260263 19656 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:58.260676 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:09:58.217374 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 280382us
I20260709 13:09:58.265074 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:58.265846 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.270748 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:58.272990 16006 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:09:58.271288 19490 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.279063 19656 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:58.280542 19490 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:58.281837 19601 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:58.282130 19644 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:58.282685 19644 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:58.283592 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:58.283630 19644 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.285334 19644 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.285598 19601 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:58.285601 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.286265 19601 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.286746 19601 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.292421 16007 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:58.299223 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2174) took 1487 ms. Trace:
I20260709 13:09:58.299839 15380 rpcz_store.cc:276] 0709 13:09:56.811768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.812538 (+   770us) service_pool.cc:224] Handling call
0709 13:09:58.298908 (+1486370us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540012b1d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:58.299132 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284126464}
I20260709 13:09:58.264528 19643 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.260177 19662 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:58.275362 19415 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.260747 19657 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:58.303478 19643 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.319675 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:58.297945 19656 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.321482 19643 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:58.324383 19473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.016s
I20260709 13:09:58.320926 19629 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:58.323338 19583 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:58.323951 19589 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.317627 19657 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.352798 19601 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:58.353453 19657 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.354035 19669 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.354627 19669 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.355362 19601 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:58.357081 19669 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.359520 19589 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.333925 19656 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:58.341239 19473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.016s
I20260709 13:09:58.365440 19656 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.367309 19589 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:58.371623 19633 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.614s	user 0.003s	sys 0.000s
I20260709 13:09:58.374776 19643 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.377269 19643 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:58.417685 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 122533us
W20260709 13:09:58.426334 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 165584us
I20260709 13:09:58.431362 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:58.435933 15299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.007s	sys 0.008s
W20260709 13:09:58.436844 15299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.008s	sys 0.008s
I20260709 13:09:58.439284 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.440732 15228 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
W20260709 13:09:58.444273 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.444623 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 122094us
W20260709 13:09:58.445547 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.446202 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.448225 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.452064 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:58.454059 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.455310 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:09:58.457209 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.325235 19415 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:58.477281 19605 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:58.494741 19637 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:58.505923 19532 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:58.508059 19589 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.509508 19589 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.509994 19337 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:58.544718 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64074.5us
I20260709 13:09:58.568996 15379 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:58.570465 19609 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.201s	user 0.007s	sys 0.003s
W20260709 13:09:58.572803 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.574303 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:58.539111 19447 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.517932 19415 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:58.577214 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:58.578155 15378 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:09:58.533149 19656 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.576159 15373 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:09:58.591496 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 136435us
I20260709 13:09:58.554427 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:58.549672 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.596747 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:58.598008 15381 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:58.598541 15381 pending_rounds.cc:85] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 3
I20260709 13:09:58.598453 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:58.598920 15381 pending_rounds.cc:107] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:58.599267 15381 raft_consensus.cc:2889] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.599411 16002 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.512197 19337 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:58.545603 15233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2194) took 1551 ms (client timeout 1893 ms). Trace:
I20260709 13:09:58.601223 19337 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:58.602085 19337 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.557386 19576 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.604835 19482 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:58.545231 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 646) took 1127 ms. Trace:
I20260709 13:09:58.541435 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:09:58.526881 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:58.515774 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:58.557204 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:58.605989 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:09:58.621755 15374 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:09:58.623273 15379 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:58.625732 15379 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:58.546818 19505 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:09:58.539641 19458 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:58.542608 19511 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:09:58.630820 19473 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.633514 19629 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:58.638450 19605 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:58.641705 19650 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:58.534802 19619 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:58.628976 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2541) took 1108 ms. Trace:
I20260709 13:09:58.650868 15224 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:09:58.627847 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:58.558838 19560 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:58.581190 19656 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.606318 19562 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.601258 19449 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.664461 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:58.605926 19482 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:58.601696 15233 rpcz_store.cc:269] 0709 13:09:56.921640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.923755 (+  2115us) service_pool.cc:224] Handling call
0709 13:09:58.458005 (+1534250us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54000dded4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:58.472931 (+ 14926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298712448}
I20260709 13:09:58.671267 19567 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:58.672554 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52118us
I20260709 13:09:58.674081 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:58.675362 19473 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.607216 15229 rpcz_store.cc:276] 0709 13:09:57.417503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.417659 (+   156us) service_pool.cc:224] Handling call
0709 13:09:57.433456 (+ 15797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.433878 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.433905 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.437262 (+1003357us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b2c000014c8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:09:58.438379 (+  1117us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.467868 (+ 29489us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:58.467947 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.468113 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.544377 (+ 76264us) raft_consensus.cc:1685] finished
0709 13:09:58.544415 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.544837 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2676,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4329,"spinlock_wait_cycles":4580096,"thread_start_us":28730,"threads_started":1,"wal-append.queue_time_us":29561}
I20260709 13:09:58.678428 19473 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.679306 19337 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:58.680752 19656 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.685181 15380 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:58.655052 19605 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:58.696056 19678 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:58.698276 19619 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:58.657094 15299 rpcz_store.cc:276] 0709 13:09:57.526470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.592293 (+ 65823us) service_pool.cc:224] Handling call
0709 13:09:57.592944 (+   651us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:57.714089 (+121145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.714135 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:57.714865 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 13:09:58.437670 (+722805us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:58.438531 (+   861us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.606760 (+168229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.614743 (+  7983us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.614794 (+    51us) raft_consensus.cc:1685] finished
0709 13:09:58.614806 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.628903 (+ 14097us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179447,"prepare.queue_time_us":31544,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":14720,"raft.queue_time_us":1093687,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":14384,"thread_start_us":778000,"threads_started":2,"wal-append.queue_time_us":608436}
I20260709 13:09:58.700709 19562 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.520895 19644 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:09:58.703833 19562 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:58.704721 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.701025 19482 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:58.647095 19458 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:09:58.713270 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 956148us
I20260709 13:09:58.716995 19643 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.724968 16001 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:09:58.706789 16006 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:09:58.726550 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 151754us
W20260709 13:09:58.726989 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.732496 15381 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.723160 19371 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:58.735114 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.728150 15274 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:58.740319 19458 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.743024 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:09:58.751410 15380 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.755095 15379 raft_consensus.cc:2410] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:09:58.742173 19458 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.722326 19656 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.769627 15379 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:58.770159 19597 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:09:58.780776 19310 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.748716 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:58.734200 19371 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.784679 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2545) took 1228 ms. Trace:
W20260709 13:09:58.786142 19681 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.163s	user 0.005s	sys 0.000s
I20260709 13:09:58.796931 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:09:58.823266 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72780.8us
I20260709 13:09:58.802927 19371 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:58.803640 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 90959.1us
I20260709 13:09:58.794090 15308 rpcz_store.cc:276] 0709 13:09:57.535352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.765604 (+230252us) service_pool.cc:224] Handling call
0709 13:09:57.805978 (+ 40374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.528634 (+722656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.528704 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.530691 (+  1987us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.616623 (+ 85932us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:58.617066 (+   443us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.654864 (+ 37798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.666173 (+ 11309us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.742471 (+ 76298us) raft_consensus.cc:1685] finished
0709 13:09:58.742498 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.763483 (+ 20985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":834587,"prepare.queue_time_us":288,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":870451,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":7506,"thread_start_us":85256,"threads_started":1,"wal-append.queue_time_us":208444}
W20260709 13:09:58.810039 19621 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.018s	user 0.002s	sys 0.001s
I20260709 13:09:58.823408 15379 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:58.837719 15379 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:58.755963 19567 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:58.797052 19656 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:58.854012 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.877496 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 151100us
W20260709 13:09:58.878363 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 150350us
I20260709 13:09:58.888657 19567 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:58.891513 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.892196 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 521) took 1709 ms. Trace:
I20260709 13:09:58.893368 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.894955 15230 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:58.892922 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:58.901651 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68420.6us
I20260709 13:09:58.903021 15198 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:09:58.904600 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 142332us
I20260709 13:09:58.904875 19598 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:58.905598 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:09:58.767743 19643 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:58.906080 19598 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:09:58.892928 15304 rpcz_store.cc:276] 0709 13:09:57.182906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.184445 (+  1539us) service_pool.cc:224] Handling call
0709 13:09:57.264847 (+ 80402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.267626 (+  2779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.267676 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.319090 (+ 51414us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.508262 (+189172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:57.508323 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.508432 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.808857 (+1300425us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:09:58.891300 (+ 82443us) raft_consensus.cc:1685] finished
0709 13:09:58.891322 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.891889 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2279,"raft.queue_time_us":5224,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16948,"spinlock_wait_cycles":10623360,"thread_start_us":115921,"threads_started":1,"wal-append.queue_time_us":291956}
W20260709 13:09:58.913125 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 182447us
I20260709 13:09:58.913554 19619 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:58.914316 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:58.914611 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:58.915014 19589 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:09:58.915455 19637 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:58.915961 19589 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:58.916553 19589 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.908526 19598 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.915881 19629 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.917865 15233 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.919698 19310 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.920183 19310 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:58.920734 19310 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.920614 19363 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:58.729071 19650 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:58.927523 15229 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:58.930250 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:58.930796 19284 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:58.931277 19284 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:58.934242 19654 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:58.934388 19284 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:58.919974 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:58.948242 16004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 374) took 3382 ms (client timeout 3033 ms). Trace:
W20260709 13:09:58.949019 16004 rpcz_store.cc:269] 0709 13:09:55.565417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.565694 (+   277us) service_pool.cc:224] Handling call
0709 13:09:58.947706 (+3382012us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54005b2cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:09:58.947904 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3540535552}
I20260709 13:09:58.916982 19589 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.965790 16002 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:09:58.933493 19680 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:58.972276 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.936262 19650 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:58.978302 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.975895 15381 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:09:58.991518 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.903980 19639 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:09:59.003286 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:58.971262 19680 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:59.011555 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:59.011494 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:59.009193 19532 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.907897 19643 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:59.018026 19511 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.053841 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.015487 19680 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.061834 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:09:59.056303 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:59.062939 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.037009 19532 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:09:59.070171 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:59.071540 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.068831 19473 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.090847 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:59.107307 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:09:59.061343 19650 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:59.091053 15228 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:09:59.125902 15380 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:09:59.130317 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 190863us
I20260709 13:09:59.131728 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:59.110674 19284 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.149791 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:59.090612 19642 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.061842 19511 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:59.158629 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 187552us
I20260709 13:09:59.125578 19629 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:59.156329 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:59.159821 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:09:59.165195 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 145822us
I20260709 13:09:59.161972 15230 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:09:59.161410 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:09:59.133101 19473 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:59.207434 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 166858us
I20260709 13:09:59.200027 19575 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:59.218852 15299 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:59.197909 19624 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:59.199968 19642 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:59.246433 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:59.249307 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:59.270525 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:59.259030 15382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.019s	sys 0.027s
W20260709 13:09:59.282207 15382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.020s	sys 0.028s
I20260709 13:09:59.267964 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:09:59.280859 16003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.013s	sys 0.026s
W20260709 13:09:59.301039 16003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.013s	sys 0.026s
I20260709 13:09:59.236845 19415 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:59.246670 19656 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:09:59.307319 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59621us
I20260709 13:09:59.333418 19511 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:09:59.307721 15131 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 194) took 35839 ms (client timeout 15000 ms). Trace:
I20260709 13:09:59.308288 19597 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:59.335089 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43838.9us
I20260709 13:09:59.308645 19592 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:09:59.308822 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:59.309661 15377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.027s	sys 0.029s
W20260709 13:09:59.336664 15377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.027s	sys 0.029s
I20260709 13:09:59.313948 19378 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:59.314704 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:09:59.315691 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:59.316982 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 91393.9us
I20260709 13:09:59.317778 19640 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:59.319294 15231 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:09:59.320628 15300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.047s	sys 0.041s
W20260709 13:09:59.345129 15300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.048s	sys 0.041s
W20260709 13:09:59.323580 19576 consensus_meta.cc:287] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.009s
W20260709 13:09:59.325579 19685 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:09:59.325927 19632 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:59.331485 19642 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:59.340325 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:59.334410 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:09:59.370826 15224 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:09:59.379026 15228 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:09:59.399786 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65548us
I20260709 13:09:59.357095 19415 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:59.393360 15379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.032s	sys 0.044s
W20260709 13:09:59.408169 15379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.033s	sys 0.045s
W20260709 13:09:59.410168 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.412134 19605 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.004s
I20260709 13:09:59.391188 19629 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.404961 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:09:59.426756 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.387508 19363 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:59.435125 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 296324us
W20260709 13:09:59.469424 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.474318 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51844.5us
I20260709 13:09:59.468315 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2532) took 1951 ms. Trace:
I20260709 13:09:59.342941 19532 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:59.482424 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.525727 19688 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:09:59.526911 19578 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:09:59.531040 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 131112us
I20260709 13:09:59.418571 19632 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:59.539250 19632 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:09:59.559896 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 342081us
I20260709 13:09:59.562808 16000 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:59.442818 19597 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:09:59.433385 19605 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:59.417793 19378 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:59.579380 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72267.4us
W20260709 13:09:59.605019 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.639846 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 124019us
I20260709 13:09:59.649367 15307 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:09:59.576495 19598 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.010s
I20260709 13:09:59.652560 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:09:59.475183 15300 rpcz_store.cc:276] 0709 13:09:57.517317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.517708 (+   391us) service_pool.cc:224] Handling call
0709 13:09:57.518189 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:57.641405 (+123216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.641456 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:57.642158 (+   702us) log.cc:844] Serialized 52 byte log entry
0709 13:09:57.717412 (+ 75254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:57.749625 (+ 32213us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.451474 (+701849us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b18004752a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:09:58.580479 (+129005us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18004752a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:09:59.399982 (+819503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.422476 (+ 22494us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.438404 (+ 15928us) raft_consensus.cc:1685] finished
0709 13:09:59.438424 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.468228 (+ 29804us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112104,"prepare.queue_time_us":32264,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":1079175,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":366,"spinlock_wait_cycles":12307072,"thread_start_us":1066563,"threads_started":3,"wal-append.queue_time_us":196651,"wal-append.run_cpu_time_us":4758,"wal-append.run_wall_time_us":1322751}
W20260709 13:09:59.653990 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81914.1us
I20260709 13:09:59.668511 15305 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:59.673409 19620 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.674602 19620 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:59.679221 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:09:59.679585 15258 heartbeater.cc:646] Failed to heartbeat to 127.13.196.126:35597 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.196.126:35597 timed out after 15.000s (SENT)
I20260709 13:09:59.683965 19632 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:09:59.684927 19415 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:09:59.686513 19490 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:59.687215 19490 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:09:59.691655 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62503.1us
I20260709 13:09:59.693023 15233 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:59.657478 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:09:59.564760 19576 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 13:09:59.722824 15302 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:59.717396 19310 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.010s
I20260709 13:09:59.753444 19490 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:59.334383 15131 rpcz_store.cc:269] 0709 13:09:23.420149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.468856 (+ 48707us) service_pool.cc:224] Handling call
0709 13:09:24.203516 (+734660us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5400260110. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a02640 00007f2f598d9b76 00007f2f599e3c3e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:09:59.246028 (+35042512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:51.277421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:51.278087 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:51.278152 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:09:51.278179 (+    27us) tablet.cc:662] Decoding operations
0709 13:09:51.278843 (+   664us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:51.278939 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:51.278969 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:51.279456 (+   487us) tablet.cc:701] Row locks acquired
0709 13:09:51.279503 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:09:51.279907 (+   404us) write_op.cc:270] Start()
0709 13:09:51.280130 (+   223us) write_op.cc:276] Timestamp: P: 1783602591279784 usec, L: 0
0709 13:09:51.280171 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:09:51.367719 (+ 87548us) log.cc:844] Serialized 1706 byte log entry
0709 13:09:52.545199 (+1177480us) op_driver.cc:464] REPLICATION: finished
0709 13:09:52.881374 (+336175us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f5755cef0
0709 13:09:53.000101 (+118727us) write_op.cc:301] APPLY: starting
0709 13:09:53.000238 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:53.040213 (+ 39975us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:53.040281 (+    68us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:53.379589 (+339308us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:53.479975 (+100386us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:09:53.484791 (+  4816us) write_op.cc:312] APPLY: finished
0709 13:09:53.520711 (+ 35920us) log.cc:844] Serialized 49 byte log entry
0709 13:09:53.520958 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:53.521074 (+   116us) write_op.cc:454] Released schema lock
0709 13:09:53.521138 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:53.521694 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:53.521726 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1748524,"reported_tablets":53,"spinlock_wait_cycles":2564480,"child_traces":[["op",{"apply.queue_time_us":454515,"apply.run_cpu_time_us":22641,"apply.run_wall_time_us":521577,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20831,"cfile_init":1,"lbm_read_time_us":479,"lbm_reads_lt_1ms":4,"num_ops":4,"prepare.queue_time_us":578767,"prepare.run_cpu_time_us":33615,"prepare.run_wall_time_us":964896,"raft.queue_time_us":201655,"raft.run_cpu_time_us":24688,"raft.run_wall_time_us":413642,"replication_time_us":1264766,"spinlock_wait_cycles":38948224,"thread_start_us":1669545,"threads_started":4,"wal-append.queue_time_us":809071,"wal-append.run_cpu_time_us":42624,"wal-append.run_wall_time_us":2436596}]]}
W20260709 13:09:59.826084 15229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.027s
W20260709 13:09:59.828081 15229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.010s	sys 0.027s
I20260709 13:09:59.684971 19632 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:59.727449 19640 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:09:59.848811 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 97437.7us
W20260709 13:09:59.824524 15304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.016s	sys 0.026s
W20260709 13:09:59.850358 15304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.016s	sys 0.026s
I20260709 13:09:59.742900 19642 raft_consensus.cc:2764] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:09:59.867326 15382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.023s	sys 0.026s
W20260709 13:09:59.868813 15382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.023s	sys 0.026s
W20260709 13:09:59.881634 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 229171us
I20260709 13:09:59.879940 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2522) took 1356 ms. Trace:
I20260709 13:09:59.699244 19598 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:59.907668 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 434566us
I20260709 13:09:59.751022 19310 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:09:59.939630 15227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.019s	sys 0.019s
W20260709 13:09:59.953747 15227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.020s	sys 0.020s
W20260709 13:09:59.938060 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58388us
I20260709 13:09:59.982734 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2547) took 1094 ms. Trace:
I20260709 13:09:59.983371 15376 rpcz_store.cc:276] 0709 13:09:58.652224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.267228 (+615004us) service_pool.cc:224] Handling call
0709 13:09:59.321641 (+ 54413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.321988 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:59.322405 (+   417us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.746230 (+423825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.746292 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:59.746358 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.746436 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.746596 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20701,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":412403,"threads_started":1}
W20260709 13:09:59.987257 19703 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:09:59.987964 19694 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:09:59.989212 19695 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:09:59.946784 19640 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:09:59.990790 15303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.030s
W20260709 13:09:59.991221 15303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.009s	sys 0.030s
I20260709 13:09:59.991875 19690 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.992527 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2532) took 1352 ms. Trace:
I20260709 13:09:59.993012 19640 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:59.992606 19690 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:09:59.993172 15375 rpcz_store.cc:276] 0709 13:09:58.601929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.604540 (+  2611us) service_pool.cc:224] Handling call
0709 13:09:58.605177 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.605883 (+   706us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:59.061260 (+455377us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.951371 (+890111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.951463 (+    92us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:59.951550 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.951672 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.954571 (+  2899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36625,"prepare.queue_time_us":15739,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":83,"raft.queue_time_us":256295,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":11267,"thread_start_us":1165687,"threads_started":3,"wal-append.queue_time_us":724689}
I20260709 13:09:59.995349 19690 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:09:59.997741 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2533) took 1395 ms. Trace:
I20260709 13:09:59.998291 15377 rpcz_store.cc:276] 0709 13:09:58.602512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.656260 (+ 53748us) service_pool.cc:224] Handling call
0709 13:09:58.661450 (+  5190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.692616 (+ 31166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.692652 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.705104 (+ 12452us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.337155 (+632051us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:59.337216 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.337303 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.997482 (+660179us) raft_consensus.cc:1685] finished
0709 13:09:59.997512 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.997670 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16191,"raft.queue_time_us":7023,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":26843,"thread_start_us":631434,"threads_started":1,"wal-append.queue_time_us":815428}
I20260709 13:10:00.001897 15377 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:10:00.005839 15224 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:00.021657 15378 raft_consensus.cc:2393] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:09:59.885520 15382 rpcz_store.cc:276] 0709 13:09:58.514023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.517849 (+  3826us) service_pool.cc:224] Handling call
0709 13:09:58.518547 (+   698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.519227 (+   680us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:58.519847 (+   620us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.870054 (+1350207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.870135 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:59.870199 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.870281 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.870464 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3320,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":55,"raft.queue_time_us":56916,"spinlock_wait_cycles":20924672,"thread_start_us":1296804,"threads_started":2,"wal-append.queue_time_us":1113778}
W20260709 13:10:00.029557 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.035723 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 101583us
W20260709 13:10:00.020607 19654 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.086s	user 0.014s	sys 0.003s
I20260709 13:10:00.049474 19654 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:00.039139 19682 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.138s	user 0.006s	sys 0.000s
I20260709 13:09:59.919638 19706 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 13:10:00.085091 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 810) took 1065 ms. Trace:
I20260709 13:10:00.063208 19605 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:00.112469 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 154403us
I20260709 13:10:00.102591 15379 rpcz_store.cc:276] 0709 13:09:59.019304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.669449 (+650145us) service_pool.cc:224] Handling call
0709 13:09:59.669795 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.670162 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:59.671057 (+   895us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.074988 (+403931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.075087 (+    99us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:00.081146 (+  6059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.081270 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.084993 (+  3723us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":206,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"thread_start_us":378628,"threads_started":1}
I20260709 13:10:00.109719 16002 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:00.079272 19690 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.146649 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 189694us
I20260709 13:10:00.104960 19640 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:00.140671 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 59590.7us
W20260709 13:10:00.154714 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.154909 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:00.145248 19284 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.982s	user 0.012s	sys 0.004s
W20260709 13:10:00.155491 19426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.015s	sys 0.031s
I20260709 13:10:00.174119 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:00.152037 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2552) took 1145 ms. Trace:
I20260709 13:10:00.175627 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.175885 15308 rpcz_store.cc:276] 0709 13:09:59.006526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.011296 (+  4770us) service_pool.cc:224] Handling call
0709 13:09:59.030463 (+ 19167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.127256 (+ 96793us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:59.438565 (+311309us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.151442 (+712877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.151535 (+    93us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:00.151624 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.151749 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.151955 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":538571,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":122688,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":25706,"thread_start_us":817200,"threads_started":3,"wal-append.queue_time_us":570382}
I20260709 13:10:00.187088 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:00.192409 19378 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.197294 19310 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:00.196919 19640 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:00.163137 19632 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.204761 19713 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:00.208246 19709 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:10:00.174290 19426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.016s	sys 0.032s
W20260709 13:10:00.228025 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80294.9us
I20260709 13:10:00.231622 19717 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.232604 19717 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:00.238549 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2554) took 1176 ms. Trace:
I20260709 13:10:00.155675 19690 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:00.257272 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.128s (SENT) [suppressed 33 similar messages]
I20260709 13:10:00.222023 19706 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:00.267470 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.239240 15303 rpcz_store.cc:276] 0709 13:09:59.062137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.069628 (+  7491us) service_pool.cc:224] Handling call
0709 13:09:59.143400 (+ 73772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.206929 (+ 63529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.206966 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.247335 (+ 40369us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.991630 (+744295us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:59.991674 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.991756 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.238176 (+246420us) raft_consensus.cc:1685] finished
0709 13:10:00.238208 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.238452 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4122,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":45871,"thread_start_us":670569,"threads_started":1,"wal-append.queue_time_us":914770}
I20260709 13:10:00.171790 19602 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.288s
I20260709 13:10:00.250193 19656 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:00.255591 19632 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:00.234335 19717 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:00.282877 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53506.3us
I20260709 13:10:00.285444 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2281) took 1242 ms. Trace:
I20260709 13:10:00.271359 19706 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.301453 15308 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:00.298220 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 811) took 1264 ms. Trace:
W20260709 13:10:00.315220 19689 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.379s	user 0.001s	sys 0.002s
I20260709 13:10:00.302147 15376 rpcz_store.cc:276] 0709 13:09:59.033463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.985526 (+952063us) service_pool.cc:224] Handling call
0709 13:09:59.985943 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.986277 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:59.986746 (+   469us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.292134 (+305388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.292228 (+    94us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:00.297753 (+  5525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.297885 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.298105 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17093,"prepare.queue_time_us":9617,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":20654,"thread_start_us":287656,"threads_started":1}
I20260709 13:10:00.284471 19656 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:00.316176 19700 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
W20260709 13:10:00.327823 19705 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.337s	user 0.002s	sys 0.000s
W20260709 13:10:00.328929 19696 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:10:00.329082 19624 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:00.329828 19722 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:10:00.330772 19721 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:00.334290 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 806) took 1327 ms. Trace:
I20260709 13:10:00.302012 19640 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:00.336795 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 189779us
I20260709 13:10:00.287323 19632 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:00.303814 19706 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.303489 19726 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.349045 15381 rpcz_store.cc:276] 0709 13:09:59.006881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.479206 (+472325us) service_pool.cc:224] Handling call
0709 13:10:00.333325 (+854119us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01eee 0000000000375939 00007f2f58a751e0 00007f2f58b3e0c4 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:10:00.333531 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.333820 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.333866 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.333918 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.333972 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.334038 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.334212 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731392}
I20260709 13:10:00.325785 19656 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.359742 19598 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:00.359596 19567 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:00.362824 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 805) took 1356 ms. Trace:
W20260709 13:10:00.358068 19693 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.817s	user 0.004s	sys 0.000s
I20260709 13:10:00.348233 19624 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.363499 19632 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.383066 15307 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:00.383831 15380 rpcz_store.cc:276] 0709 13:09:59.006526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.478422 (+471896us) service_pool.cc:224] Handling call
0709 13:09:59.540325 (+ 61903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.693154 (+152829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.693190 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.752151 (+ 58961us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.155443 (+403292us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.155498 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.155574 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.362499 (+206925us) raft_consensus.cc:1685] finished
0709 13:10:00.362525 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.362742 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65126,"raft.queue_time_us":105233,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7209,"thread_start_us":269362,"threads_started":1,"wal-append.queue_time_us":418519}
W20260709 13:10:00.372309 19458 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.573s	user 0.010s	sys 0.014s
I20260709 13:10:00.382742 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:00.393008 15302 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.613s	user 0.014s	sys 0.001s
I20260709 13:10:00.394613 15302 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:00.397888 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2560) took 1035 ms. Trace:
I20260709 13:10:00.398456 15302 rpcz_store.cc:276] 0709 13:09:59.359925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.360204 (+   279us) service_pool.cc:224] Handling call
0709 13:10:00.395210 (+1035006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.404330 19426 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:10:00.399718 19589 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.390s	user 0.020s	sys 0.000s
I20260709 13:10:00.366446 19713 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:10:00.396430 19717 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:00.399081 19629 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.923s	user 0.015s	sys 0.006s
W20260709 13:10:00.415738 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52810.3us
I20260709 13:10:00.402974 19640 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:00.418571 15228 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:00.415413 19604 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:10:00.431352 15302 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:10:00.421365 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.425400 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2209) took 1206 ms. Trace:
W20260709 13:10:00.433163 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.433923 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.432955 15229 rpcz_store.cc:276] 0709 13:09:59.219494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.219642 (+   148us) service_pool.cc:224] Handling call
0709 13:09:59.250685 (+ 31043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.828579 (+577894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.828630 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.859522 (+ 30892us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.269760 (+410238us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.269832 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.269956 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.425136 (+155180us) raft_consensus.cc:1685] finished
0709 13:10:00.425160 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.425326 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42409,"raft.queue_time_us":43933,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":837117,"threads_started":2,"wal-append.queue_time_us":477564}
W20260709 13:10:00.439095 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.444653 19579 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:00.416723 19589 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:00.449098 19589 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:00.451289 15373 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:00.454023 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 809) took 1443 ms. Trace:
I20260709 13:10:00.454409 19284 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.454677 15373 rpcz_store.cc:276] 0709 13:09:59.010770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.137818 (+127048us) service_pool.cc:224] Handling call
0709 13:10:00.453691 (+1315873us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540023f5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:00.453907 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2946312576}
I20260709 13:10:00.455142 19284 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.394182 19726 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.456749 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 653) took 1839 ms. Trace:
I20260709 13:10:00.459602 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 654) took 1533 ms. Trace:
I20260709 13:10:00.462419 15233 rpcz_store.cc:276] 0709 13:09:58.926322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.939923 (+ 13601us) service_pool.cc:224] Handling call
0709 13:09:58.964543 (+ 24620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.706493 (+741950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.459329 (+752836us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54003ce454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:00.459536 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674767616}
I20260709 13:10:00.467900 19735 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:00.470372 19690 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.470891 16004 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:00.481298 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.485596 19680 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.377s	user 0.018s	sys 0.000s
I20260709 13:10:00.459355 19726 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:00.472162 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.488087 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 813) took 1437 ms. Trace:
W20260709 13:10:00.507609 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.509093 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.509673 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.460438 15225 rpcz_store.cc:276] 0709 13:09:58.646659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.651418 (+  4759us) service_pool.cc:224] Handling call
0709 13:09:58.652003 (+   585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.652764 (+   761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.652792 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.653605 (+   813us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.020757 (+367152us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:59.115463 (+ 94706us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.115935 (+   472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.116054 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.337513 (+1221459us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:00.446821 (+109308us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18002428c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:00.456443 (+  9622us) raft_consensus.cc:1685] finished
0709 13:10:00.456474 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.456668 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":95846,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":55,"raft.queue_time_us":1889,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":389,"spinlock_wait_cycles":41244288,"thread_start_us":366562,"threads_started":1,"wal-append.queue_time_us":740249}
I20260709 13:10:00.508093 15378 rpcz_store.cc:276] 0709 13:09:59.051079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.136007 (+ 84928us) service_pool.cc:224] Handling call
0709 13:10:00.487722 (+1351715us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400224f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:00.487974 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967345920}
I20260709 13:10:00.495586 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:00.500790 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:00.418653 19629 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.506110 19473 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:00.504595 19598 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.505360 15303 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:00.481377 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:00.445643 19579 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:00.477423 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 646) took 1800 ms. Trace:
I20260709 13:10:00.292683 15227 rpcz_store.cc:276] 0709 13:09:59.043370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.049271 (+  5901us) service_pool.cc:224] Handling call
0709 13:09:59.116737 (+ 67466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.215893 (+ 99156us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:59.247111 (+ 31218us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.954433 (+707322us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.964518 (+ 10085us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.965017 (+   499us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:00.284206 (+319189us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.284880 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.285009 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.285077 (+    68us) raft_consensus.cc:1685] finished
0709 13:10:00.285099 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.285345 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32626,"prepare.queue_time_us":24876,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":74,"raft.queue_time_us":54680,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":20002,"thread_start_us":950020,"threads_started":2,"wal-append.queue_time_us":882302}
I20260709 13:10:00.489117 19735 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:10:00.535946 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.405644 19426 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:00.518414 19726 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.529287 16003 rpcz_store.cc:276] 0709 13:09:58.677454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.692850 (+ 15396us) service_pool.cc:224] Handling call
0709 13:09:58.728472 (+ 35622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.730786 (+  2314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.730817 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.733903 (+  3086us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.301599 (+567696us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:59.301659 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.301747 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.001793 (+700046us) raft_consensus.cc:1685] finished
0709 13:10:00.001817 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.476964 (+475147us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b5400660b50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:00.477295 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":635,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":5448,"spinlock_wait_cycles":13972224,"thread_start_us":567071,"threads_started":1,"wal-append.queue_time_us":1265121}
I20260709 13:10:00.569706 15381 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:00.524111 19690 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.567307 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:00.506174 19644 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:10:00.588214 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:00.592166 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 120193us
W20260709 13:10:00.597550 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.523129 19602 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:10:00.512089 19680 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.574193 19726 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:00.617439 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 108948us
I20260709 13:10:00.618836 15377 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.619285 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.547049 19598 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:00.610621 19473 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.634557 19583 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:10:00.633551 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0644349860000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2786s for a response
W20260709 13:10:00.642167 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67345.6us
I20260709 13:10:00.647258 19598 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:00.651218 19620 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.623684 19690 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:00.704566 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:00.711273 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78506.4us
W20260709 13:10:00.712132 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56821.6us
I20260709 13:10:00.713078 19505 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:00.720920 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 101817us
I20260709 13:10:00.714129 19644 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:00.723489 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:00.711066 15377 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:00.641928 19473 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.730472 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.725919 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:00.745863 19505 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:00.746749 19726 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:00.746630 19505 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:00.731649 19583 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.764189 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:00.758164 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.726989 19713 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:10:00.774928 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.777238 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:00.778887 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.780025 19604 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:00.781288 15307 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:00.743028 19490 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:00.751037 19415 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.777966 15227 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:00.756631 19690 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.763768 19640 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.793121 16002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 381) took 1809 ms. Trace:
I20260709 13:10:00.793663 16002 rpcz_store.cc:276] 0709 13:09:58.983701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.003569 (+ 19868us) service_pool.cc:224] Handling call
0709 13:09:59.015296 (+ 11727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.124291 (+1108995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.792696 (+668405us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54005b2cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:00.792932 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2450939648}
I20260709 13:10:00.775846 19378 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:00.798733 15382 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:00.783190 19579 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:00.804811 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:00.795228 19388 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.807572 16008 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:00.799959 15345 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.348s (SENT)
I20260709 13:10:00.801940 19608 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:10:00.810434 19608 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.810961 19608 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:00.812000 19473 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:00.802341 19426 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.793027 19415 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.785652 19583 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.816905 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 658) took 1506 ms. Trace:
I20260709 13:10:00.817140 19415 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.817415 15224 rpcz_store.cc:276] 0709 13:09:59.310996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.641211 (+330215us) service_pool.cc:224] Handling call
0709 13:09:59.708582 (+ 67371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.016105 (+307523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.816631 (+800526us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400359dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:00.816834 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578928000}
I20260709 13:10:00.808857 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.818328 19583 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:00.819576 19750 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:00.801985 19640 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.824815 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:00.829149 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:00.837973 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:00.844065 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 226723us
I20260709 13:10:00.846414 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.851431 19740 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.852082 19640 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.853106 19608 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:00.854602 19608 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.823129 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:00.862357 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:00.862951 19378 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:10:00.870519 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:00.863149 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:00.871760 19378 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.865979 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:00.849274 19583 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.874795 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:00.856693 19749 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:10:00.795900 19690 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:00.871321 15302 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:00.868502 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 125226us
I20260709 13:10:00.860956 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:00.861536 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:00.889330 15345 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.500s (SENT)
I20260709 13:10:00.825927 19473 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:00.899161 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.832762 19680 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:00.903857 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:00.905350 15304 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:00.921506 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:00.921789 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:00.918319 19656 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.006s
I20260709 13:10:00.932057 15304 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:00.863026 19640 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:10:00.923273 19730 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:00.889031 19378 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:00.949795 19643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.007s	sys 0.027s
W20260709 13:10:00.965377 19692 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.757s	user 0.005s	sys 0.000s
W20260709 13:10:00.970959 19699 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.305s	user 0.005s	sys 0.005s
W20260709 13:10:00.972273 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 83159.6us
W20260709 13:10:00.993836 15345 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.516s (SENT)
I20260709 13:10:00.994313 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:00.973472 19730 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:00.979354 19624 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.002s
I20260709 13:10:00.986577 19402 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:00.988786 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.955600 19388 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.936223 19656 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:01.013250 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.989126 19643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.008s	sys 0.028s
I20260709 13:10:01.017892 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:01.017994 19758 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:10:01.019044 15306 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:10:01.013916 19632 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.009s
I20260709 13:10:01.012533 19402 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:01.010624 19473 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:01.066300 19706 consensus_meta.cc:287] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.705s	user 0.013s	sys 0.004s
I20260709 13:10:01.097469 19402 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:01.015450 19624 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:01.101327 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 107530us
I20260709 13:10:01.068637 19598 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.114049 19402 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:01.111317 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 203147us
W20260709 13:10:01.103295 15345 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.517s (SENT)
I20260709 13:10:01.117619 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.119014 19726 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:01.120476 19764 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:10:01.122511 19284 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.124985 19505 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:01.126178 19763 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:10:01.102586 19767 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:01.135778 15232 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:01.140226 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2215) took 1848 ms. Trace:
I20260709 13:10:01.140790 15228 rpcz_store.cc:276] 0709 13:09:59.291461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.389466 (+ 98005us) service_pool.cc:224] Handling call
0709 13:09:59.400285 (+ 10819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.430035 (+1029750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.139929 (+709894us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003c23d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:01.140147 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336415104}
I20260709 13:10:01.143004 16001 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:01.144934 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.145785 19532 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.147008 19730 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.114720 19598 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.130291 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.065464 19632 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.161823 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:01.170264 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.169512 15306 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
W20260709 13:10:01.172859 15345 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 3.374s (SENT)
I20260709 13:10:01.181267 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.175931 19730 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.182500 19730 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.185815 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.186036 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.187078 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.187772 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.188560 15233 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:01.145285 15231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:01.189360 15231 raft_consensus.cc:606] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:01.189713 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.190478 15226 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:10:01.191056 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.192983 19730 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.196707 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:01.199026 19717 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.000s
I20260709 13:10:01.200295 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2550) took 3615 ms. Trace:
I20260709 13:10:01.200984 19632 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.203357 19544 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.203917 19544 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:01.204357 19544 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.218560 19532 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:01.219205 19639 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.102383 19706 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.220012 19639 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.222131 19735 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:01.222874 19706 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:01.166040 19388 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:10:01.227157 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.228485 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 51784.8us
W20260709 13:10:01.230592 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.236774 15224 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:01.223726 19735 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:01.252624 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.255738 15227 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:01.257063 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.262396 15303 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:01.260669 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:01.272998 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.275295 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:01.277431 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.278357 15228 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:01.276455 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:01.200786 15301 rpcz_store.cc:276] 0709 13:09:57.537329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.448207 (+910878us) service_pool.cc:224] Handling call
0709 13:09:58.544784 (+ 96577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.654329 (+109545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.654362 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.662664 (+  8302us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.801381 (+138717us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b48000b0058. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:09:59.037549 (+236168us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:59.037604 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.037700 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.964449 (+1926749us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:01.152457 (+188008us) raft_consensus.cc:1685] finished
0709 13:10:01.152494 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.152736 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180868,"raft.queue_time_us":110620,"raft.run_cpu_time_us":1621,"raft.run_wall_time_us":142799,"spinlock_wait_cycles":33489536,"thread_start_us":374231,"threads_started":1,"wal-append.queue_time_us":471648}
I20260709 13:10:01.281206 19706 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:01.317806 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.292021 19690 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.326113 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.326684 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:01.330477 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:01.337662 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.331221 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.258850 19620 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:10:01.344619 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.334429 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:01.342803 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:01.347880 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.354001 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.326366 19608 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:01.327746 19378 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:01.367367 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 194550us
W20260709 13:10:01.369693 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.369876 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:01.370277 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.370661 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.334161 19604 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:01.375079 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:01.380955 15226 raft_consensus.cc:2410] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:01.346849 19579 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.357679 19608 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:01.351300 19644 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:01.329607 19770 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:10:01.357432 19656 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:01.391995 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.392709 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:01.386989 15345 leader_election.cc:336] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.619s (SENT)
I20260709 13:10:01.391178 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:01.397130 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 247257us
I20260709 13:10:01.425585 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:01.410501 19415 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:01.399960 19741 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:01.395522 19608 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.400117 19690 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.387663 19604 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.435753 19598 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.472309 19780 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:10:01.438632 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.476655 19780 consensus_queue.cc:1243] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:01.479027 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:01.481848 15304 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:01.458690 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.440286 15228 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.465574 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:01.484663 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:01.484995 15231 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.463693 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.490382 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.490756 15227 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:01.495900 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.490335 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.498934 19706 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.441067 19415 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:01.499202 19363 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:01.503561 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.499830 19780 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.508103 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.512192 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.518342 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.462215 19778 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:01.444555 19741 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:01.457821 19640 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:01.519876 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 132966us
I20260709 13:10:01.505959 19378 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:01.521555 19657 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.522260 19773 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:01.523053 19740 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.004s
I20260709 13:10:01.560111 19740 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.514390 19706 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.562537 15307 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:01.563652 19773 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:01.514599 19780 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.495613 19656 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.527644 19604 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:01.515743 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 169774us
I20260709 13:10:01.541208 15274 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.532315 19639 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:01.536362 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 275798us
I20260709 13:10:01.539273 19473 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.518397 19717 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.571208 15228 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:01.584656 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.571821 15231 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:01.564244 19773 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.588353 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.591080 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.591385 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:01.540459 19775 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:01.546422 19378 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:01.596650 19775 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.596702 19706 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:01.601210 19604 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.633016 19604 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.633548 19604 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.577872 19544 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:01.638381 19544 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.629426 19378 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.631292 19775 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.589082 19768 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:01.555528 19778 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:01.616559 19741 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:01.578750 19640 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:01.587287 19624 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.608616 19415 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:01.624526 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.589277 19657 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:01.572651 19780 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:01.628908 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.665719 19706 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:01.677100 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.678264 19706 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.681130 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.682004 15374 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:01.683530 19768 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:01.677100 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:01.686813 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.687045 15382 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:01.687256 15233 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:01.655706 15345 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.667s (SENT)
I20260709 13:10:01.698953 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.704557 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.708889 15381 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:01.709597 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.710409 15376 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:01.711151 15305 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:01.711566 15305 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:01.712610 15305 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:01.714918 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.715440 15231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:01.715829 15373 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:10:01.717331 19639 raft_consensus.cc:2764] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:01.715036 19604 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.722947 19604 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:01.716295 15231 raft_consensus.cc:606] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:01.736477 15233 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:01.736999 15305 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:01.738793 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 142817us
I20260709 13:10:01.745525 19473 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.734059 19657 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:01.738425 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:01.747798 19657 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.752856 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:01.738417 19784 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:10:01.775565 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.732880 19770 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.735924 19741 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:01.783113 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.787232 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 131797us
W20260709 13:10:01.788501 15345 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.716s (SENT)
I20260709 13:10:01.789151 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.776672 19388 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:01.751876 19608 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:01.806110 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44593.4us
I20260709 13:10:01.806583 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.812728 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.815321 15373 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:01.839563 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:01.827039 19473 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.809876 19749 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:10:01.861809 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73373.2us
I20260709 13:10:01.808060 19768 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.821933 19597 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:10:01.854063 19730 raft_consensus.cc:993] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:10:01.871146 15345 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.735s (SENT)
I20260709 13:10:01.872115 15373 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:01.876204 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46949.7us
W20260709 13:10:01.860275 19735 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.002s
I20260709 13:10:01.886930 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:01.871995 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:01.822386 19775 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.888517 15377 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.896005 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.903721 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2561) took 2513 ms. Trace:
I20260709 13:10:01.912410 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:01.913452 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 138041us
I20260709 13:10:01.883370 19767 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:01.927711 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.937173 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.939684 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:01.941051 19787 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:10:01.912148 19770 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:01.945338 19363 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.945983 19363 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.883404 19773 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.954468 16002 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:01.959075 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:01.904417 15299 rpcz_store.cc:276] 0709 13:09:59.389794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.389989 (+   195us) service_pool.cc:224] Handling call
0709 13:09:59.422732 (+ 32743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.495934 (+ 73202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.495986 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.524994 (+ 29008us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.746915 (+221921us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:59.860918 (+114003us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.708179 (+1847261us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003144a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:10:01.881509 (+173330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.881601 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.881651 (+    50us) raft_consensus.cc:1685] finished
0709 13:10:01.897535 (+ 15884us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.903448 (+  5913us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":112392,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":52,"raft.queue_time_us":132907,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":17745,"spinlock_wait_cycles":23778176,"thread_start_us":394647,"threads_started":2,"wal-append.queue_time_us":537654,"wal-append.run_cpu_time_us":5189,"wal-append.run_wall_time_us":1297430}
I20260709 13:10:01.962248 16006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bec569d5083b416380cac661b1b44368"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:01.963125 16006 raft_consensus.cc:606] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:01.949082 19597 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:01.964411 19597 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:01.965610 15305 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:01.966346 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2592) took 1099 ms. Trace:
I20260709 13:10:01.917799 19473 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:01.967099 15305 rpcz_store.cc:276] 0709 13:10:00.866627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.137600 (+270973us) service_pool.cc:224] Handling call
0709 13:10:01.137977 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.711036 (+573059us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540020fe20. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a9ddc0 00007f2f53b281c0 00007f2f53b29231 00007f2f53b25d8f 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c
0709 13:10:01.966029 (+254993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.966274 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645013376}
I20260709 13:10:01.991921 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:01.992687 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 130254us
W20260709 13:10:01.993817 15345 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.756s (SENT)
I20260709 13:10:01.994261 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:01.956161 19640 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:01.968221 19624 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.970396 19632 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.005180 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.010489 15306 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:02.015789 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:01.981132 19388 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:01.999444 19706 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.020440 15306 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:01.950016 19767 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:01.965437 19597 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:02.036717 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 99720.9us
I20260709 13:10:02.069034 19778 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:02.079639 15377 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:02.081379 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.158202 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.158658 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.094453 19773 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:02.101872 19791 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:10:02.104683 15303 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:10:02.058495 19608 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:02.108217 19767 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.022888 19378 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.118175 19596 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:02.125371 19765 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:10:02.128273 19490 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:02.121217 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:02.334408 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 213295us
I20260709 13:10:02.108814 19775 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.336855 19402 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.338814 19735 raft_consensus.cc:993] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:02.339403 19799 raft_consensus.cc:1081] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:02.036677 19780 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.342705 19780 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.141256 19415 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.141563 19806 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:02.142701 19784 raft_consensus.cc:993] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:02.143567 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:02.148767 19730 raft_consensus.cc:1081] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:10:02.218686 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.345947 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.151947 19388 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:02.348016 15302 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:02.325001 19363 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.350781 19363 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.327121 15128 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 7, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 7 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.352607 15128 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:10:02.354130 19741 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.002s
I20260709 13:10:02.353907 15128 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:02.086618 19597 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:02.381014 15128 catalog_manager.cc:5697] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:02.382678 15128 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 4 to 7, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:10:02.391014 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 247543us
I20260709 13:10:02.393970 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:02.390232 19806 raft_consensus.cc:1081] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:02.404951 15378 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bec569d5083b416380cac661b1b44368"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:52412
I20260709 13:10:02.412293 19710 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:02.424474 19710 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:02.424892 19710 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.426316 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:02.427222 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:02.428932 19644 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.429338 19644 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:02.429768 19644 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.430132 19378 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.432139 19598 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.432904 19598 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.415899 19363 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:02.440047 15380 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:02.445528 15380 pending_rounds.cc:85] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 6
I20260709 13:10:02.447041 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:02.447175 15380 pending_rounds.cc:107] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:02.447886 15380 raft_consensus.cc:2889] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.447566 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:02.439632 19657 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:02.439035 19598 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.449021 19363 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.463626 16001 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:02.462761 19578 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:02.466735 19363 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:02.489642 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.492132 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.500240 15345 leader_election.cc:336] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.769s (SENT)
I20260709 13:10:02.534929 15224 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:02.533771 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:02.536635 15378 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.537132 15378 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.468704 19657 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:02.488071 19578 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:02.560081 19706 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:02.593048 19816 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:10:02.596941 19793 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.583s	user 0.007s	sys 0.004s
I20260709 13:10:02.597571 19363 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.614430 19657 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:02.595799 19644 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.628304 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:02.625041 15378 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:02.629369 16001 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:02.638645 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:02.631227 19596 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.630697 19415 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.606315 19578 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.658852 19473 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.637547 19710 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.635002 19706 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:10:02.682049 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:02.683007 15380 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.663623 19596 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:02.691565 19596 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:02.692863 19706 consensus_queue.cc:1243] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer 5c70ddb5aae14b059dc90fd40125b034 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:02.693483 19706 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:02.693828 19706 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:02.694065 19710 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.675841 19473 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:02.695756 19473 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.698603 19826 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:02.694814 19706 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:02.703028 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:02.706689 15227 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:02.707016 15224 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:02.670769 19415 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:02.709676 19780 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:02.709808 19378 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:02.710326 19780 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.710598 19378 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:02.712991 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.713444 19378 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.725312 19706 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:02.748615 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 248399us
W20260709 13:10:02.749507 15345 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.771s (SENT)
I20260709 13:10:02.750066 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:02.859054 15380 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:02.850103 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.862529 15304 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:02.744285 19780 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:02.741019 19415 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:02.851105 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.867563 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.747968 19629 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:02.874680 15380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
I20260709 13:10:02.876204 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.874809 15306 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:02.875954 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.877846 15304 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:02.848894 19388 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.879007 15380 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.881007 15301 raft_consensus.cc:2410] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:10:02.852455 19827 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:02.849453 19378 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:02.899175 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 149667us
I20260709 13:10:02.901489 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:02.901963 15345 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.784s (SENT)
I20260709 13:10:02.902681 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:02.898466 15380 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.906340 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.902465 15306 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:02.910750 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.911394 15301 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:02.913386 15304 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:02.922576 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:02.925420 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:02.897130 19388 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:02.909462 19657 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.931043 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.926994 19799 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.879369 19629 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:02.953804 16006 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:02.952191 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:02.956754 15301 raft_consensus.cc:2410] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:02.992998 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:02.993767 15305 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:10:02.994800 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92907.1us
W20260709 13:10:02.995556 15345 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.815s (SENT)
I20260709 13:10:02.995929 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:02.998457 16001 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:02.999754 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.001744 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.002044 15373 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:03.005193 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 186903us
I20260709 13:10:02.906842 19378 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.002663 15301 raft_consensus.cc:2376] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:10:03.011693 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:03.013518 15345 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.847s (SENT)
I20260709 13:10:03.013984 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:03.014407 15301 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:02.998785 19826 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.012669 15380 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.018239 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.018859 15381 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:03.019205 15305 raft_consensus.cc:2410] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:03.008270 19415 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.020795 19415 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.021759 19657 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:03.022845 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.023622 15301 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:03.028474 15380 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:02.962641 19799 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:03.031894 19832 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:10:03.025058 19831 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:10:03.026181 19837 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:10:03.027029 19836 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:03.044269 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.033740 19629 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:03.045817 15345 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.868s (SENT)
I20260709 13:10:03.047853 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.024266 19415 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.066171 16002 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:03.027501 19388 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:03.062750 15304 raft_consensus.cc:2368] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:03.063843 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.045148 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:03.061964 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:03.065094 15301 raft_consensus.cc:2410] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:10:03.065882 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.053929 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.069401 16006 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:03.069886 15373 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
W20260709 13:10:03.049073 19598 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.005s
W20260709 13:10:03.088492 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.053347 19284 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:03.090586 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:03.096572 15224 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:03.091007 19830 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:10:03.098699 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.099251 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.097060 15224 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:03.103274 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.103763 15304 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 3.
I20260709 13:10:03.045634 19578 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:10:03.109249 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.044883 19473 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.112321 15301 raft_consensus.cc:2410] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:03.092932 19284 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:03.116767 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.117756 15306 raft_consensus.cc:2410] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:03.095052 19826 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:03.089233 19598 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:03.147121 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 101333us
I20260709 13:10:03.113921 15224 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:03.147972 15345 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.869s (SENT)
I20260709 13:10:03.148370 15224 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.148448 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:03.157008 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.158388 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.160422 19829 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:03.160894 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.161446 19363 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:03.162340 19629 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.158648 15306 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:10:03.164309 15345 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.870s (SENT)
I20260709 13:10:03.164942 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:03.162927 19629 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.166765 19284 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.170967 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.171962 15305 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:10:03.168457 19657 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.181679 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.181658 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.181675 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.185670 19598 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:03.185825 15305 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:03.174162 19378 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.186769 19378 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:03.187374 19378 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.189833 19378 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:03.172924 19284 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:03.193193 15345 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.941s (SENT)
I20260709 13:10:03.195292 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:03.198187 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.199286 15304 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:03.199050 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.200002 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:03.221100 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.224584 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.225865 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.227073 15308 raft_consensus.cc:2410] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:10:03.229104 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.230087 15306 raft_consensus.cc:1813] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Handling vote request from an unknown peer 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:03.230321 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.231042 15306 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:03.229166 19706 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:03.229278 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.236653 15305 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 6: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:03.238060 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.239881 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.243377 15304 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:03.243846 15224 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:03.246104 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.246359 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.248214 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.249624 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.251803 15308 raft_consensus.cc:2410] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:03.252508 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.254478 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.257659 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.253342 15306 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:03.245283 19780 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:03.278801 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.284188 15301 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:03.287493 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 94329.7us
W20260709 13:10:03.288318 15345 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.024s (SENT)
I20260709 13:10:03.288793 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:03.290439 15345 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.042s (SENT)
I20260709 13:10:03.290977 15345 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:03.262655 19644 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:03.293123 19473 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.293869 19473 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:03.294610 19473 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:03.257280 19799 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:03.265919 19839 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:10:03.305858 15345 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.091s (SENT)
W20260709 13:10:03.313481 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.306535 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:03.285086 19780 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:03.322427 15303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2608) took 2036 ms (client timeout 1983 ms). Trace:
I20260709 13:10:03.283489 19657 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:03.327181 15227 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:03.320248 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77986.3us
W20260709 13:10:03.327710 15303 rpcz_store.cc:269] 0709 13:10:01.266805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.320384 (+ 53579us) service_pool.cc:224] Handling call
0709 13:10:03.302590 (+1982206us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400430b54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:03.302698 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744994048}
I20260709 13:10:03.334019 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.330672 15300 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:03.307950 19629 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.363245 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:03.364638 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.365357 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.366357 15224 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:03.370082 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.372282 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.326431 19706 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.324281 19599 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:03.381476 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.331445 19780 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.329150 19644 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:03.387800 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.356132 19598 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.386876 15302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2619) took 1538 ms (client timeout 1518 ms). Trace:
W20260709 13:10:03.393817 15302 rpcz_store.cc:269] 0709 13:10:01.848085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.885051 (+ 36966us) service_pool.cc:224] Handling call
0709 13:10:03.386612 (+1501561us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54001856d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:03.386789 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997797632}
I20260709 13:10:03.391574 15378 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:03.386852 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81033us
I20260709 13:10:03.387662 15224 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:03.386090 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:03.395628 15345 leader_election.cc:336] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.128s (SENT)
I20260709 13:10:03.396184 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:03.400900 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.401722 15224 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:03.401962 15300 raft_consensus.cc:2410] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:10:03.402307 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:03.400902 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:03.405987 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:03.408744 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:03.409716 15226 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:03.405637 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52412 (request call id 827) took 1030 ms. Trace:
I20260709 13:10:03.410979 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:03.410820 15378 rpcz_store.cc:276] 0709 13:10:02.377223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.377406 (+   183us) service_pool.cc:224] Handling call
0709 13:10:03.333445 (+956039us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540023fad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b1da3d 00007f2f58aedcd0 00007f2f52072254 00007f2f520721e2 00007f2f52072111 00007f2f5207208c 00007f2f52071342 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:03.395083 (+ 61638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287228800}
I20260709 13:10:03.412215 15232 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.413470 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.414837 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.353273 19657 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.428411 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:03.429191 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.434693 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.435316 15231 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:03.428228 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.430044 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.432895 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.433144 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:03.433480 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.437109 15226 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:03.437197 15300 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:03.439548 15302 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:03.447717 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:03.451658 19841 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:10:03.389346 19363 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:10:03.429811 19505 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:03.452894 19363 consensus_queue.cc:1243] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:03.435477 19605 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:03.397984 19599 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.427965 19644 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.416224 19829 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:03.457190 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.408835 19598 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.458060 19853 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.471292 19853 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.471848 19853 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.457927 19602 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:03.473197 19602 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:03.473459 19598 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:03.473678 19602 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.474094 19602 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.474427 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.462743 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.518392 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.464704 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.519805 15305 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:03.487037 15378 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:03.521159 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.521591 19599 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.522294 15305 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:03.523411 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.488049 15375 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:03.488670 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93086.1us
I20260709 13:10:03.489265 15228 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:03.490018 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.529937 15299 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:03.530021 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.530934 15302 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:03.531143 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.497406 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.533185 15306 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:03.513338 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.534324 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.498494 19706 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:03.479261 19775 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:03.538908 19775 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:03.539412 19775 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:03.499199 19845 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:03.501049 19657 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:03.504151 15225 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:03.540597 19775 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.441150 19826 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:03.542378 19775 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.542889 19826 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:03.543704 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.543989 19826 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.545954 19713 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:03.546537 19713 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:03.505329 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.549271 15307 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:03.506599 19644 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.513293 19284 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.513789 19576 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.477720 19734 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:03.464371 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.582477 15230 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:10:03.487298 19835 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.735s	user 0.004s	sys 0.000s
I20260709 13:10:03.524819 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:03.529223 15345 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.165s (SENT)
I20260709 13:10:03.586236 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:03.586678 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61976.6us
I20260709 13:10:03.587131 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:03.587859 15373 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:03.550658 15232 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:03.536156 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.554850 16003 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:03.546453 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.555657 15305 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:03.591531 15299 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.532107 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.593204 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:03.593639 15225 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:03.548236 19713 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.592432 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.565062 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:03.564069 15300 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:10:03.577780 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.603907 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.604842 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:03.605630 15307 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.605530 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.594491 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.589823 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:03.606700 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50128.3us
I20260709 13:10:03.607331 15374 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.593852 15377 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.595825 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:03.585150 19284 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.614849 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:03.597877 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.615597 15381 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:03.615424 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.599757 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2604) took 1055 ms. Trace:
I20260709 13:10:03.610773 15376 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:03.616448 15382 rpcz_store.cc:276] 0709 13:10:02.544758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.706593 (+161835us) service_pool.cc:224] Handling call
0709 13:10:02.706937 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.713629 (+  6692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.713668 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.719072 (+  5404us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.752208 (+ 33136us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:02.752275 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.752395 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.486638 (+734243us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:03.599411 (+112773us) raft_consensus.cc:1685] finished
0709 13:10:03.599435 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.599683 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6193,"raft.queue_time_us":6916,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":2861,"spinlock_wait_cycles":27106688,"thread_start_us":26868,"threads_started":1,"wal-append.queue_time_us":27322}
I20260709 13:10:03.622947 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.624229 15306 raft_consensus.cc:2410] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:03.612759 15231 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.594077 19576 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.628566 19378 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:03.641078 19378 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:03.642175 19378 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:03.642799 19576 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:03.629256 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 100077us
W20260709 13:10:03.645221 15345 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.177s (SENT)
I20260709 13:10:03.645722 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:03.647219 15345 leader_election.cc:336] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.186s (SENT)
I20260709 13:10:03.585337 19734 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:03.647684 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:03.631922 19855 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:03.654470 19855 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:03.655300 19620 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:03.654942 19855 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:03.658639 19284 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.659288 19855 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.601004 19629 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.648904 19829 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:03.630309 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:03.655647 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48122.3us
I20260709 13:10:03.665464 15300 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:03.666558 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.667254 15300 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:03.669510 19855 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.634496 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:03.635466 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:03.677734 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.678727 15376 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.659773 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.625967 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:03.678058 15382 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:03.679931 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:03.701308 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.710615 15300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:10:03.712167 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.621951 19680 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:03.621362 19706 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:03.719237 19644 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.670413 19847 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 13:10:03.730708 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.670260 19657 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:03.735193 19657 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:03.736964 19657 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.730851 19784 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:03.739816 19784 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.740450 19784 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.697780 19829 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.745011 19829 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.649180 19734 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:03.700434 19843 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:10:03.737011 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:03.750325 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49080.3us
I20260709 13:10:03.755162 16003 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:03.753840 15231 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:03.753749 15299 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:10:03.759080 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 393652us
I20260709 13:10:03.760682 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.756423 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:03.766294 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 349019us
I20260709 13:10:03.772704 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:03.778368 15231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:03.779184 15231 raft_consensus.cc:606] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:03.759177 19578 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.748199 19829 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:03.794849 15374 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:03.838164 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 48420.5us
I20260709 13:10:03.838753 15299 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:03.852535 15377 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:03.877873 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:03.879042 15373 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:03.897936 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:03.770426 19363 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:03.898413 15301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.017s
W20260709 13:10:03.901454 15301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.000s	sys 0.018s
I20260709 13:10:03.906503 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:03.907708 16001 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:03.912979 15376 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:03.915795 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:03.795740 19734 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.766924 19619 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
W20260709 13:10:03.926733 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 166527us
I20260709 13:10:03.838461 19578 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.839818 19805 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:03.931891 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 135907us
W20260709 13:10:03.933876 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 166385us
I20260709 13:10:03.891682 19829 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.911530 19363 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.920850 19775 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:03.947453 19578 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.947844 19805 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.949548 19629 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:04.015534 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.959614 19363 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:03.998004 19853 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.007s
I20260709 13:10:03.981600 19680 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:03.958418 19829 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.010048 19805 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.990644 19826 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:04.084270 15305 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:04.072454 19602 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.003s
W20260709 13:10:04.078331 19780 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.004s
I20260709 13:10:03.981524 19775 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:04.139989 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 492786us
W20260709 13:10:04.144160 15345 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.206s (SENT)
W20260709 13:10:04.129220 19861 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:10:04.152717 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 237052us
I20260709 13:10:04.157877 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:04.132047 19629 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:04.163973 19339 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.169191 19339 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:04.177029 19865 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:10:04.086308 19853 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.179097 19853 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.179821 19339 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:04.180949 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:04.186488 15345 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.210s (SENT)
I20260709 13:10:04.186973 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:04.188057 15345 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.850s (SENT)
I20260709 13:10:04.196534 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:04.199697 15307 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.001s
I20260709 13:10:04.200137 15307 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:10:04.200924 19866 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:04.201016 15302 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:04.203083 19855 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:10:04.182000 19870 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:04.182480 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:04.183713 19829 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:04.188279 19871 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:04.189600 19857 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:10:04.190148 19873 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.155936 19826 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:04.191387 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:04.176585 19629 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.208726 15382 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:10:04.212877 15228 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:04.181777 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:04.147933 19602 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:04.218688 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 273842us
I20260709 13:10:04.219640 15301 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:10:04.223587 16002 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:04.222308 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:04.150810 19780 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.210170 19473 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:04.216836 19870 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.219435 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:04.235767 19619 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:04.243090 19619 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.243449 19619 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.243723 19602 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:04.235081 19706 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:04.250236 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:04.250240 19826 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.255401 19578 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.260926 15225 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:04.261436 19780 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.262100 19578 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:04.262271 15303 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:04.263357 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:04.264189 16001 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:04.265004 19629 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.229423 19680 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.267046 19378 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:04.267445 19378 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:04.267526 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:04.269958 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.236164 19875 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:10:04.272507 19784 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
I20260709 13:10:04.272927 19784 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.275061 19784 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:04.277010 15228 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:04.268247 15373 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.279281 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:04.280028 15305 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.282279 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:04.283255 16001 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:04.285247 19775 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:04.242383 19870 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.287338 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:04.294822 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58349.9us
I20260709 13:10:04.296977 15373 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:04.298965 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:04.300418 19388 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:04.300658 19883 raft_consensus.cc:993] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:10:04.300938 19388 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:04.301177 19883 raft_consensus.cc:1081] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:10:04.307561 15305 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:04.309165 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:04.315186 15304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.005s	sys 0.001s
W20260709 13:10:04.315855 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 96529.9us
W20260709 13:10:04.315757 15304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.001s
I20260709 13:10:04.316720 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:04.318760 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:04.324558 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:04.324918 15232 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:04.325165 15228 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:04.318099 19620 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:04.334978 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:04.319653 19599 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:04.301860 19388 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.338860 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:04.339776 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:04.354653 19378 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.319859 19605 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:10:04.356835 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 159028us
I20260709 13:10:04.358911 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:04.363715 15308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.004s	sys 0.011s
I20260709 13:10:04.363818 15232 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:04.364153 15308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.004s	sys 0.012s
I20260709 13:10:04.360814 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:04.365393 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.339761 19604 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:04.368880 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:04.338825 19578 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:04.336452 19620 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:04.375402 15226 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:04.375772 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.363559 19378 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.376708 15380 raft_consensus.cc:2410] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 8 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:04.364431 19599 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:04.395587 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.396374 15380 raft_consensus.cc:2368] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
W20260709 13:10:04.396960 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 157399us
I20260709 13:10:04.397439 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.401862 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.399891 19578 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:04.402940 19534 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:04.402737 19620 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.404125 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.405599 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.406549 19680 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:04.407095 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.407196 19680 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.409240 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.410009 15373 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:04.410594 19680 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.410799 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.411595 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.413084 15381 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:04.414000 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.414618 19599 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.415729 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.411823 15380 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:04.417457 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.418857 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.419812 15376 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:04.421228 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:04.422237 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.396436 19805 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.423305 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.424440 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.424628 19805 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:04.425583 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.425748 19363 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.426334 15373 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:04.427568 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.428016 19363 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.428193 15373 raft_consensus.cc:2368] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:10:04.430222 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.431250 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.435094 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.442608 15300 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.463086 15300 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.461723 15380 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.442690 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2621) took 1208 ms. Trace:
I20260709 13:10:04.447271 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.448024 15303 pending_rounds.cc:85] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 9
I20260709 13:10:04.468674 15303 pending_rounds.cc:107] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:10:04.468696 15379 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.469163 15303 raft_consensus.cc:2889] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:04.449616 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:04.452776 15305 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:04.459635 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.470724 15304 rpcz_store.cc:276] 0709 13:10:03.234107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.261421 (+ 27314us) service_pool.cc:224] Handling call
0709 13:10:03.261853 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.262198 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:03.365676 (+103478us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.442130 (+1076454us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.442339 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.442393 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.442444 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.442527 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.442635 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166732,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":3510,"raft.queue_time_us":278836,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":41388,"thread_start_us":1157604,"threads_started":4,"wal-append.queue_time_us":408486}
I20260709 13:10:04.506256 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:04.506935 16002 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.512390 15381 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:10:04.512701 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.512997 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.512382 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.514120 15382 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:10:04.516294 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 141590us
I20260709 13:10:04.526373 15228 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:04.528141 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.533609 16002 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:04.535912 15373 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:04.539285 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2627) took 1303 ms. Trace:
I20260709 13:10:04.510246 15300 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.545554 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.545806 15374 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:04.546355 15376 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:04.547556 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:04.487493 19578 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:04.506693 19534 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:04.459483 19619 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.556281 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:04.554906 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.558804 15376 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:10:04.559653 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.561661 15380 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:10:04.536001 19706 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:04.546182 19604 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:04.573994 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.578375 15380 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:04.585577 16001 raft_consensus.cc:2368] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:10:04.585434 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.587096 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:04.587715 15307 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:04.600258 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:04.605712 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.608901 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.609601 15380 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:04.611085 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:04.611541 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:04.611843 15307 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:04.620855 15307 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:10:04.621322 15307 pending_rounds.cc:85] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 5
I20260709 13:10:04.621735 15307 pending_rounds.cc:107] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:04.622038 15307 raft_consensus.cc:2889] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:04.624877 15307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:10:04.625730 15307 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.626159 15307 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.628543 15374 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:04.622241 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:04.631865 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:04.634295 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.635414 15374 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:04.636653 19856 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:04.637473 19856 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.642300 19856 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:04.646377 19604 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.649080 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:04.649833 15303 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:04.653820 15300 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.653993 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:04.657722 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.660892 15374 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:04.664769 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:04.665450 15232 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:04.665788 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50788 (request call id 2636) took 1415 ms. Trace:
I20260709 13:10:04.667903 15300 rpcz_store.cc:276] 0709 13:10:03.239026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.710380 (+471354us) service_pool.cc:224] Handling call
0709 13:10:04.614526 (+904146us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b540025a8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b1da3d 00007f2f58aedcd0 00007f2f52072254 00007f2f520721e2 00007f2f52072111 00007f2f5207208c 00007f2f52071342 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:04.654281 (+ 39755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680589568}
I20260709 13:10:04.659605 15307 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.666846 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:04.666751 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.646860 19578 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.626392 19644 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:04.655251 19505 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.684039 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.689436 15226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:04.693471 15226 raft_consensus.cc:606] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:04.661082 19858 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:04.691704 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.665784 19805 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:04.695428 15307 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.695284 15376 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:04.665530 19599 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:04.699424 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.700583 15376 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:04.701301 15374 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:04.703753 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.704658 15380 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:10:04.707341 19619 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:04.692771 19339 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:04.708171 19339 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:04.708559 19339 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.621220 19534 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.712702 15379 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:04.714195 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:04.714824 15232 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.716751 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.718007 19805 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:04.718799 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.718979 15231 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:04.719375 15231 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:04.720109 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.721349 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.721570 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.722493 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.724484 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:04.725708 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:04.539724 15308 rpcz_store.cc:276] 0709 13:10:03.235939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.269840 (+ 33901us) service_pool.cc:224] Handling call
0709 13:10:03.270256 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.270542 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:03.385143 (+114601us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.538556 (+1153413us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.538925 (+   369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.538976 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:04.539029 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.539099 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.539229 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14017,"prepare.queue_time_us":176132,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":196506,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":11215,"thread_start_us":1222906,"threads_started":4,"wal-append.queue_time_us":555383}
I20260709 13:10:04.726828 19284 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:04.727234 19284 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.727604 19284 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.728407 15376 raft_consensus.cc:2368] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:10:04.644078 19870 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.719141 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.737650 15373 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:04.732959 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.734818 15232 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:04.720196 15231 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.741328 15231 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:04.730504 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.743013 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.743429 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:04.728984 19599 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.753846 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.698546 19858 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:04.756796 15381 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:04.749643 19856 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:04.771598 15225 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:04.770826 15231 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:04.740639 19644 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:10:04.780401 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.782454 15381 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.719129 19805 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.776569 19879 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:04.784014 19856 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:04.800357 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.798858 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:04.822968 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.823659 15373 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.862874 15373 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:04.863122 15381 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:04.873363 19856 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.802258 19879 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.876801 19879 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:04.877650 19906 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:04.813870 19339 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:04.884987 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.885670 15373 raft_consensus.cc:2376] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10. Re-sending same reply.
I20260709 13:10:04.885854 15374 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:04.886914 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:04.873878 19619 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.893389 19339 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:04.894495 19908 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:04.895087 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.895697 15381 raft_consensus.cc:2376] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7. Re-sending same reply.
W20260709 13:10:04.897495 19909 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:10:04.898453 19284 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:04.900799 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5631110890000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 13:10:04.901389 15345 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.669s (SENT)
I20260709 13:10:04.908739 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:04.901772 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:04.947794 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59586.2us
W20260709 13:10:04.951844 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 363603us
I20260709 13:10:04.943926 19870 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:04.956549 19578 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.957183 19578 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:04.959578 19578 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:04.960136 19886 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:04.960371 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58995.9us
W20260709 13:10:04.960865 15345 connection.cc:256] RPC call timeout handler was delayed by -1.50911108899993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 13:10:04.961177 15345 connection.cc:256] RPC call timeout handler was delayed by -1.5037110890000349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:10:04.919698 19879 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:04.962194 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.962965 15380 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:04.937124 19902 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.192s	user 0.000s	sys 0.004s
I20260709 13:10:04.968433 15374 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:04.969048 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:04.975493 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.976802 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:04.977417 15378 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.977475 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:04.978312 16001 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.979647 16002 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:05.007512 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:05.014024 15232 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.024022 15373 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:04.895714 19619 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:05.038820 15232 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:05.048225 15378 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:10:05.050647 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 102017us
I20260709 13:10:05.052073 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:05.008172 19879 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.099467 15227 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:05.100980 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49031.6us
I20260709 13:10:05.014119 19284 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:05.104389 15233 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:05.049211 19912 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:10:05.107086 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:05.113672 15227 raft_consensus.cc:2368] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14.
I20260709 13:10:05.111057 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:05.115257 15378 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:10:05.126006 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.128863 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:05.136745 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 175139us
W20260709 13:10:05.137426 15345 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.092s (SENT)
I20260709 13:10:05.137789 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.038184 19657 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:10:05.137949 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:05.122670 19917 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.161201 15345 connection.cc:256] RPC call timeout handler was delayed by -1.4783092310000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:10:05.161768 15345 connection.cc:256] RPC call timeout handler was delayed by -1.40450923100002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:10:05.162060 15345 connection.cc:256] RPC call timeout handler was delayed by -1.3838092309999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 13:10:05.162328 15345 connection.cc:256] RPC call timeout handler was delayed by -1.3172092309999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21200000000000002s for a response
W20260709 13:10:05.162607 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0006110890000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2786s for a response
I20260709 13:10:05.167214 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.126780 19916 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.134202 19872 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.146059 19870 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.154626 19644 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.133894 19378 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:10:05.187398 19378 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:05.187805 19378 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:05.188650 19378 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.190261 19378 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.194300 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:05.195058 15227 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:05.199846 19858 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.201963 15974 leader_election.cc:400] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14.
I20260709 13:10:05.202453 15974 leader_election.cc:403] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.202605 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:05.203277 16002 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.203461 19339 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:05.203274 19799 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:10:05.169445 19917 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.214409 19917 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:05.216005 19898 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.623s	user 0.000s	sys 0.003s
I20260709 13:10:05.222318 16001 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
W20260709 13:10:05.225061 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65228.4us
I20260709 13:10:05.186259 19619 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:05.218364 16002 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:05.223508 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:05.175751 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.172196 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.135679 19879 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.226338 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:05.228458 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56333.8us
I20260709 13:10:05.233021 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:05.233394 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.238366 16000 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:05.239382 19916 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:05.239724 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.241183 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.227453 19339 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14.
I20260709 13:10:05.242427 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:05.229277 19886 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.230082 19917 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.247076 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.235656 19619 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:05.239858 19916 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.240489 19415 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:05.243001 19879 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.249481 19926 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.252506 19916 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.243227 19927 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.247313 19680 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.250782 19872 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:05.249771 19619 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.268217 19927 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:05.268589 19415 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:05.269356 19927 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:05.269526 19415 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:05.279639 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:05.252310 19284 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:10:05.261257 19926 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.267791 19886 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.272734 19619 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.266816 19680 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.287631 19578 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.288393 19578 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:05.289469 19578 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.286576 19926 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.257236 19920 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:10:05.259296 19917 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:10:05.298292 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:05.315524 19916 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:05.319151 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70338.6us
I20260709 13:10:05.319999 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.321312 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.323072 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.330319 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.332700 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.295465 19886 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.295334 19680 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.322633 19888 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.327988 19872 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.322772 19920 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:05.331163 19879 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.321048 19706 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:10:05.343586 19886 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:05.353937 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 178295us
I20260709 13:10:05.344679 19888 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:05.359127 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.350279 19920 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.343845 19619 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:05.354159 19930 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:05.369091 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.383962 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.365801 19706 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.395731 19870 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.360128 19888 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.397538 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.363817 19920 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:05.403097 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70438.8us
I20260709 13:10:05.369733 19916 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.405927 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.381697 19930 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.400484 19706 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:05.401006 19888 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.412987 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.407591 19870 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.418115 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.420109 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:05.408108 19378 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.435119 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:05.435199 19619 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:05.436136 19872 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.437681 19927 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:05.425522 19879 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:05.439378 15226 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.410982 19930 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.452931 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:05.459542 15273 leader_election.cc:400] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9.
I20260709 13:10:05.461117 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.462391 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.457823 15126 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 9 to 11, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 11 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.448853 19927 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:05.463186 19928 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.420233 19916 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.458788 19858 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:05.470711 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73248.8us
I20260709 13:10:05.471467 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.471490 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:05.463919 19887 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:05.473198 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.475507 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.477941 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:05.478724 19879 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:05.479223 19879 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:05.475399 19872 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.481128 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:05.480181 19879 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.488368 19935 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.489010 19935 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:05.490078 19936 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:10:05.489874 19935 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.476188 19929 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.493144 19937 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.474189 19887 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.497119 19887 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.474298 19378 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.503906 19882 raft_consensus.cc:993] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:05.513116 19882 raft_consensus.cc:1081] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:05.513679 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.481222 19916 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:05.463693 19927 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:05.521744 19937 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.521865 19927 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.522771 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.505606 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2251) took 1147 ms. Trace:
I20260709 13:10:05.526360 15225 rpcz_store.cc:276] 0709 13:10:04.357831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.357979 (+   148us) service_pool.cc:224] Handling call
0709 13:10:04.368780 (+ 10801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.777903 (+409123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.505329 (+727426us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54000e79d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:05.505542 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925840640}
I20260709 13:10:05.526979 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.527562 19937 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.528182 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.528914 19657 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.529397 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:05.515784 19931 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:05.463693 19928 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:05.524827 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.549978 15378 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:05.533784 19934 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:10:05.534942 19878 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.535661 19888 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:05.515095 19933 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:05.528455 19937 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:05.541385 19870 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.544935 15226 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:05.582590 15225 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:05.583304 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:05.468708 19926 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.566530 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:05.568985 15231 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:05.567587 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:05.580031 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:05.571565 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:05.573537 19942 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:05.577206 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.569468 19916 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.593773 19888 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.595726 19920 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.594962 19930 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.606331 15232 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:05.618639 15232 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:05.555276 19657 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:05.561323 15274 leader_election.cc:400] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:10:05.621732 15274 leader_election.cc:403] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.593925 19706 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:05.615047 15375 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:05.617165 15379 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:10:05.618083 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.619983 15228 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:05.613220 15373 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:05.577677 19937 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.619577 15232 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.616518 19853 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:05.629954 15232 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:05.627992 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66810.1us
I20260709 13:10:05.598676 19870 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.577677 19878 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.631078 19935 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.630961 19887 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.644958 19680 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.646224 19935 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10.
I20260709 13:10:05.635625 19853 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 15 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:05.649894 19853 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:05.652314 19886 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.654680 19886 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:05.628948 19937 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.648861 19920 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.616083 19916 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.678973 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:05.679723 15305 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:05.680892 15376 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:05.685671 15381 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:05.686465 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 130715us
I20260709 13:10:05.687762 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:05.688540 15304 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:05.688686 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:05.689332 15305 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:05.690397 15232 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:05.692842 15305 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:05.695004 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:05.696478 15373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
I20260709 13:10:05.697111 15373 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.697470 15373 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.697647 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:05.701930 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:05.706316 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:05.707221 15305 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:05.708570 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:05.735704 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.670316 19926 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.669466 19930 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.738248 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:05.667300 19680 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.740943 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:05.742429 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.775813 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.776801 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:05.778201 15381 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.743445 19870 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:05.743988 19888 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.695186 19917 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:10:05.752770 15291 tablet_service.cc:1558] Processing DeleteTablet for tablet dc5a1ea32aef45d1b6e1ff8b0718d178 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:53964
W20260709 13:10:05.755156 15128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 193) took 37506 ms (client timeout 15000 ms). Trace:
I20260709 13:10:05.756572 15303 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:05.762374 19940 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:05.802208 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:05.804171 15301 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.765038 15304 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:05.769959 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.772130 15374 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.742960 19886 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.778743 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:05.779047 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:05.809914 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:05.810930 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:05.782377 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:05.794538 15303 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.790457 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:05.815933 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:05.816692 15381 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:05.800191 15373 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:05.739281 19378 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.695130 19935 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:10:05.766533 19937 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.773535 19928 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.823159 19378 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.823390 19926 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:05.838815 15306 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:05.830432 15303 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:05.828227 15379 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:05.843148 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:05.846709 15304 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
W20260709 13:10:05.790380 15128 rpcz_store.cc:269] 0709 13:09:28.248957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.249820 (+   863us) service_pool.cc:224] Handling call
0709 13:10:05.755050 (+37505230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:02.710167 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:02.710811 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:02.710866 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:10:02.710886 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:02.711653 (+   767us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:02.711803 (+   150us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:02.711830 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:02.739881 (+ 28051us) tablet.cc:701] Row locks acquired
0709 13:10:02.741245 (+  1364us) write_op.cc:260] PREPARE: finished
0709 13:10:02.741519 (+   274us) write_op.cc:270] Start()
0709 13:10:02.741732 (+   213us) write_op.cc:276] Timestamp: P: 1783602602741388 usec, L: 0
0709 13:10:02.741775 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:10:02.742734 (+   959us) log.cc:844] Serialized 2094 byte log entry
0709 13:10:03.411021 (+668287us) op_driver.cc:464] REPLICATION: finished
0709 13:10:04.170954 (+759933us) write_op.cc:301] APPLY: starting
0709 13:10:04.171053 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:04.175202 (+  4149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:04.175331 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:04.179989 (+  4658us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:04.180373 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:10:04.180421 (+    48us) write_op.cc:312] APPLY: finished
0709 13:10:04.181235 (+   814us) log.cc:844] Serialized 57 byte log entry
0709 13:10:04.183347 (+  2112us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:04.183479 (+   132us) write_op.cc:454] Released schema lock
0709 13:10:04.183530 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:04.183987 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:04.184017 (+    30us) write_op.cc:454] Released schema lock
0709 13:10:04.273895 (+ 89878us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2332a 00007f2f53aa8f14 00007f2f53aa8ec3 00007f2f53aa8e38 00007f2f53aa8df3 00007f2f53aa80dc 00007f2f53ad1e16 00007f2f53ab9cbb 00007f2f53aa439d 00007f2f53aa7d75
Metrics: {"mutex_wait_us":12426,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":735751,"apply.run_cpu_time_us":9405,"apply.run_wall_time_us":13045,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25007,"num_ops":5,"prepare.queue_time_us":193629,"prepare.run_cpu_time_us":57436,"prepare.run_wall_time_us":188222,"raft.queue_time_us":160203,"raft.run_cpu_time_us":23642,"raft.run_wall_time_us":921834,"replication_time_us":638491,"spinlock_wait_cycles":17300864,"thread_start_us":658947,"threads_started":4,"wal-append.queue_time_us":189804,"wal-append.run_cpu_time_us":74340,"wal-append.run_wall_time_us":2237634}]]}
I20260709 13:10:05.802217 19872 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:05.852725 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:05.808773 19886 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:05.853859 15306 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.807821 19888 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:05.817158 19870 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:10:05.879254 15379 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:05.827060 19944 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:05.781795 15126 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.885303 19888 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:05.851297 19680 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:05.892181 15303 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:05.896301 15300 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:05.866086 19886 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:05.905452 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 274731us
I20260709 13:10:05.907213 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:05.851524 19926 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:05.903975 19943 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.143s	user 0.000s	sys 0.004s
I20260709 13:10:05.937513 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:05.940196 15308 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:05.865163 19872 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:05.941223 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:05.942698 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:05.943670 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.946339 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.926348 19680 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:05.986287 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:05.987928 15373 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:06.018772 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:06.019629 15227 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:06.020012 15227 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:06.023592 15300 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:05.932505 19887 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:06.036465 19870 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:06.037149 19870 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:06.038414 19926 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:06.044873 19950 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.045650 19950 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:06.050380 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:06.048619 19950 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:06.026189 15306 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:06.027386 15299 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.992658 19916 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:06.052836 19680 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.064890 19937 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:06.065905 15301 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:06.066164 19378 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:06.067045 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:06.067605 15301 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.067798 19872 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:06.069164 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:06.070761 15302 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:06.071951 15302 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:06.074720 15308 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.076535 15304 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:06.076731 19870 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:06.084993 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.090059 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 258427us
I20260709 13:10:06.090426 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:06.090843 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.091871 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.025481 15227 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:06.093711 15227 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.094995 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:06.106334 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:06.107110 15233 raft_consensus.cc:2368] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:06.114058 15373 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:06.115551 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:06.115360 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.125528 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:06.127446 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:06.056120 19339 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:10:06.133090 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:06.136497 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:06.147732 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:06.105300 19879 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.134536 19917 consensus_queue.cc:1243] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:06.151589 19942 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.138093 19575 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:10:06.160329 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:06.163875 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:06.163452 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 71637.6us
I20260709 13:10:06.171519 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.173007 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.174362 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.178948 15301 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:06.184245 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:06.185820 15227 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:10:06.218716 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44439.5us
I20260709 13:10:06.219837 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.222720 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.181998 19887 raft_consensus.cc:2764] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:10:06.156625 19952 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.224843 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:06.228097 15233 raft_consensus.cc:2368] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:10:06.187378 19917 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.224303 19879 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.231961 15274 leader_election.cc:400] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:10:06.233187 15274 leader_election.cc:403] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:06.231781 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 333681us
I20260709 13:10:06.166026 19888 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:10:06.163628 19578 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:10:06.222460 19957 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.238308 19959 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.240993 19917 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:06.258350 15115 catalog_manager.cc:5028] TS 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): tablet dc5a1ea32aef45d1b6e1ff8b0718d178 (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
W20260709 13:10:06.288597 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49681.7us
W20260709 13:10:06.298578 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.304378 15233 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:06.239631 19879 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:06.314980 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 180595us
I20260709 13:10:06.131705 15126 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 10 to 13, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 13 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.323875 16000 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:06.332590 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 193201us
W20260709 13:10:06.331239 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 193012us
W20260709 13:10:06.341976 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 119377us
I20260709 13:10:06.343043 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.344118 19879 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.344892 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.353209 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.328630 19928 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.346779 19879 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.323081 19957 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:06.329471 19881 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:06.363448 19928 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.379148 19886 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.370764 15126 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 9, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:06.374272 15308 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:06.370378 19962 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:06.393384 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.395608 15227 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:06.396378 15308 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:06.401680 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.406134 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:06.410830 15379 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:06.386163 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 95044.2us
I20260709 13:10:06.413683 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:06.418988 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:06.419710 15382 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:06.422762 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:06.423880 15303 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:06.423950 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:06.425181 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:06.425990 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:06.427863 15301 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:06.421363 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 86614.5us
I20260709 13:10:06.395258 19927 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.428710 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76664.8us
I20260709 13:10:06.397624 19879 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.425881 15308 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.431589 15308 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.432768 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.413430 19957 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:06.445097 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 95603us
I20260709 13:10:06.413247 19958 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.452042 15301 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:06.457648 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:06.413121 19604 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:10:06.471549 16001 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:06.490996 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:06.449059 19952 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.493502 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:06.497042 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.504367 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:06.496724 19853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.006s	sys 0.023s
I20260709 13:10:06.445340 19927 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.462963 19928 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:06.534850 19853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.023s
I20260709 13:10:06.517830 19972 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:06.398010 19881 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:06.387159 19883 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:10:06.433379 19968 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:10:06.581355 19858 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:06.591572 15380 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:06.451419 19974 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:10:06.571849 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 142494us
I20260709 13:10:06.595953 15227 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:10:06.603932 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.607944 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.600806 19973 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.626081 19710 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:06.626574 19710 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:06.626786 19980 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:06.628134 19980 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.628530 19980 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:06.631076 19942 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:06.631587 19942 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.627667 19710 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.633577 19710 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.637135 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2669) took 1056 ms. Trace:
I20260709 13:10:06.637575 15378 rpcz_store.cc:276] 0709 13:10:05.580472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.581043 (+   571us) service_pool.cc:224] Handling call
0709 13:10:05.581323 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.700188 (+118865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.700238 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.783102 (+ 82864us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.106737 (+323635us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:06.106800 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.636715 (+529915us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003f2354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:06.636764 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.636814 (+    50us) raft_consensus.cc:1685] finished
0709 13:10:06.636827 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.637067 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":12363,"spinlock_wait_cycles":243450240,"thread_start_us":268425,"threads_started":1,"wal-append.queue_time_us":405897}
I20260709 13:10:06.645473 19878 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:06.661089 19713 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:06.661706 19713 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:06.662726 19713 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.618455 19926 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:10:06.512544 15126 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 10 to 12, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:06.670984 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52217us
I20260709 13:10:06.673520 19599 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:06.673813 19604 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:06.672184 15126 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 9, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 9 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.686865 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:06.773979 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 87218.4us
I20260709 13:10:06.774995 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:06.694411 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86079.8us
I20260709 13:10:06.605228 19972 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:06.664108 19713 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.748239 19886 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:06.749303 19680 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:06.749500 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76253.7us
W20260709 13:10:06.753486 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.759496 15308 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:06.809368 15308 pending_rounds.cc:85] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 6
I20260709 13:10:06.809722 15308 pending_rounds.cc:107] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:06.761135 19927 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:06.740550 19980 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:06.765852 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72243.4us
W20260709 13:10:06.763665 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 308037us
I20260709 13:10:06.610570 19858 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:06.819157 19858 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.821439 19858 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.800769 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:06.810746 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 362177us
I20260709 13:10:06.815387 15308 raft_consensus.cc:2889] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.830186 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.833711 15227 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:06.801819 19935 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:06.841540 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.688867 19973 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.809602 19887 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.846925 15299 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:06.816250 19886 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.835602 19959 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:06.846432 19930 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:10:06.846467 19378 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.843371 19968 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:06.849673 19887 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.857244 19980 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.831192 19710 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:06.884929 15348 leader_election.cc:400] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:06.886070 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:06.857540 19957 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.888019 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:06.891336 15348 leader_election.cc:403] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:06.894747 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:06.827890 19987 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:06.862504 19927 raft_consensus.cc:476] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:06.906219 15227 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:10:06.908852 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67437.6us
I20260709 13:10:06.861246 19916 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:06.884438 19887 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.917943 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:06.914381 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:06.882352 19935 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.862504 19784 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:10:06.882793 19944 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.863304 19576 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:06.861605 19886 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:06.920321 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:06.941686 15303 raft_consensus.cc:1813] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Handling vote request from an unknown peer 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:06.921793 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:06.925603 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:06.865949 19974 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:10:06.895040 19952 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.869561 19963 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:10:06.942189 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.909484 19970 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:06.945124 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:06.963119 15308 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.945158 15303 raft_consensus.cc:2368] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:06.948661 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.891851 19657 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:10:06.971743 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 123142us
I20260709 13:10:06.873570 19805 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:10:06.890334 19968 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:06.942765 19927 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.983983 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.985185 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:06.919504 19957 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:10:06.939350 19881 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:10:06.987959 19917 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.001s
I20260709 13:10:06.893133 19972 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:07.013700 19490 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:07.015606 19994 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:10:07.020974 19991 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:10:07.021852 19989 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:10:07.023396 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44512.6us
I20260709 13:10:07.024003 19970 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:06.941223 19935 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:07.030052 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46204.4us
I20260709 13:10:07.050173 15345 leader_election.cc:400] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:07.051441 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:06.985628 19958 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.944505 19944 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.000393 19986 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:07.025532 20004 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.094699 15377 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:07.040990 19917 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:10:07.038940 19657 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:07.035154 19490 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:07.099614 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51800.8us
I20260709 13:10:07.010941 19927 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.071935 19878 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:07.150377 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 236083us
I20260709 13:10:07.100942 19993 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:07.160933 19657 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.105225 20004 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.161572 19657 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.163585 19657 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:07.164446 19968 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.164211 19657 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:07.165465 19657 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.167218 19944 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.131142 19958 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:07.186753 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.174988 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:07.189857 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 82531.8us
I20260709 13:10:07.187989 19970 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.173556 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.193257 19973 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:07.194669 19997 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:07.198752 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.215958 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.216929 15307 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:07.219448 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.157091 19878 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:07.252177 20000 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:07.170270 19657 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:07.234920 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.237504 19918 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 13:10:07.240929 19998 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:07.244168 19710 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:07.245461 19927 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:07.261174 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45443.9us
I20260709 13:10:07.263056 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2272) took 1101 ms. Trace:
I20260709 13:10:07.273232 15226 rpcz_store.cc:276] 0709 13:10:06.161951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.162142 (+   191us) service_pool.cc:224] Handling call
0709 13:10:06.162509 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.167584 (+  5075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.167622 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.188824 (+ 21202us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.675693 (+486869us) spinlock_profiling.cc:243] Waited 942 us on lock 0x7b180032b180. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:06.836869 (+161176us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:06.836939 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.837031 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:07.247351 (+410320us) raft_consensus.cc:1685] finished
0709 13:10:07.247379 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.262987 (+ 15608us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15045,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7851,"spinlock_wait_cycles":2165632,"thread_start_us":160239,"threads_started":1,"wal-append.queue_time_us":814862}
I20260709 13:10:07.234830 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.195654 19598 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:07.290511 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:07.294067 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:07.271170 19657 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.270232 19878 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.302331 19883 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.302912 19883 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.303139 19957 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:07.310389 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58449.2us
I20260709 13:10:07.190567 19490 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.313980 19490 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.190140 19993 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.317623 19784 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:07.318068 19784 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:07.318130 19993 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.318909 19784 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:07.320894 19995 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 13:10:07.321339 20021 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.321655 19916 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.322387 20027 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.322259 19916 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.322908 20027 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.321880 20021 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.324932 20027 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.325151 19883 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:07.303282 19878 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:07.327831 19858 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.004s
W20260709 13:10:07.298107 19942 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.666s	user 0.001s	sys 0.010s
I20260709 13:10:07.329932 19942 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.332027 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.197252 19958 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.333616 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.326360 20021 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.385155 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:07.322389 19713 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:10:07.296615 19952 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:07.292922 19972 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.320909 19935 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.328673 19886 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.379750 19916 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.375104 19927 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.424047 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:07.429587 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 94066.4us
I20260709 13:10:07.385838 19929 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:07.404906 20024 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:07.432147 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:07.321010 19576 consensus_queue.cc:1175] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
W20260709 13:10:07.442543 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 223932us
I20260709 13:10:07.443642 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:07.373787 19657 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.295841 19598 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.403571 19993 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:07.447074 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.411599 19872 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:07.430548 19886 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.423171 19926 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.422897 19952 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.459583 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.461053 15377 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:07.470129 15381 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:07.471925 19980 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.000s
I20260709 13:10:07.477221 15374 pending_rounds.cc:85] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 10
I20260709 13:10:07.407631 19972 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.486476 15381 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:07.489692 15374 pending_rounds.cc:107] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:10:07.497541 15374 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:07.495772 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52251us
I20260709 13:10:07.493963 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.501603 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.474017 19706 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.468467 19878 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.464624 20032 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.448053 19927 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.543175 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.550526 15381 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:07.542362 19706 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.551391 19878 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.552824 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.540621 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.560719 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.476756 19993 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.445760 19929 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.480558 19872 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.595551 19916 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.596184 19916 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.576236 20021 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.597208 20021 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.598423 19916 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.599107 20021 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.600600 20031 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.601203 20031 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.603438 20031 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.604441 20019 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:07.605093 20022 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:10:07.605005 20019 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.607146 20019 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.559223 19942 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.496475 19952 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.608472 19657 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.609095 19870 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.609442 19952 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.609596 19870 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.611030 19927 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.611543 19870 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.485714 19886 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.491380 19926 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.607205 19993 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.616451 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.611287 15226 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:07.621047 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.675084 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.675560 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.673749 15231 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
W20260709 13:10:07.681371 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61103us
I20260709 13:10:07.685701 19886 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.686576 15378 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:07.675870 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58723.7us
I20260709 13:10:07.689918 15228 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:10:07.700109 20044 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:10:07.704200 19598 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:07.704524 20038 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:07.681062 19657 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.705295 19657 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.711841 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.713435 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.714272 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:07.716702 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.717032 20036 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.717548 20036 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.717880 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.721684 19972 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:07.733244 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57769.2us
I20260709 13:10:07.562839 20032 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.708030 19657 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.749172 19961 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:10:07.751677 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.756686 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2107) took 1335 ms. Trace:
I20260709 13:10:07.758119 19878 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.757191 15306 rpcz_store.cc:276] 0709 13:10:06.421823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.421951 (+   128us) service_pool.cc:224] Handling call
0709 13:10:06.433826 (+ 11875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.434171 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.434199 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.449687 (+ 15488us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.778501 (+328814us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:07.045573 (+267072us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.046227 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.046476 (+   249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:07.749322 (+702846us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b18003d1d40. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9
0709 13:10:07.752654 (+  3332us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b24001c86f8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a77fb0 00007f2f536ee488 00007f2f536eebe8 00007f2f536c6398 00007f2f536c176a 00007f2f536c0bb6
0709 13:10:07.756445 (+  3791us) raft_consensus.cc:1685] finished
0709 13:10:07.756469 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.756619 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7273,"prepare.queue_time_us":266232,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":6588,"raft.queue_time_us":23672,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":11900,"spinlock_wait_cycles":98439168,"thread_start_us":496949,"threads_started":2,"wal-append.queue_time_us":356724}
I20260709 13:10:07.744277 19959 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:07.784808 20032 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.801576 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:07.802556 19929 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:07.820930 15348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.024s	sys 0.050s
W20260709 13:10:07.821682 15348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.025s	sys 0.050s
W20260709 13:10:07.822088 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 587666us
I20260709 13:10:07.823012 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.824808 19993 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.825429 19993 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:07.828002 19993 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:07.841063 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:07.844009 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.847424 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.854743 20015 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:07.855227 20015 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:07.859117 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.863322 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:07.864156 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.853376 19339 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:07.853041 19993 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:07.852543 19942 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:07.871266 19887 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.927s	user 0.012s	sys 0.004s
I20260709 13:10:07.894227 19942 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.872882 20032 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.893536 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.871820 19878 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.873126 19973 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.871624 19657 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.902694 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:07.904227 20048 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.872905 19972 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.882781 19339 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:07.912235 19971 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:07.913802 19784 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:07.892006 19886 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:07.955928 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 53697.4us
I20260709 13:10:07.904423 19942 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:07.919893 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.959170 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.922647 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.959827 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.878594 20019 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:10:07.896123 20031 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.895582 20032 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.957823 19878 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:07.962102 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.973554 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.963368 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.973971 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.973971 15373 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:07.977028 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:07.897943 19887 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.922508 19972 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.967180 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.970285 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.979737 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.986992 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.981148 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:07.982481 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:07.994998 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.925863 19339 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:07.995548 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.956681 19879 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:07.999925 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.994424 20048 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:07.995764 15306 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:10:07.995108 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:08.014674 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.906417 19973 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.011499 15301 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:08.000305 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.026504 15300 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:08.002354 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.015930 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.000859 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.019627 15308 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:08.028393 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.028900 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.029567 15301 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:08.029980 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.030249 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:08.032475 15227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.045s	sys 0.041s
I20260709 13:10:08.027068 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.028250 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:07.879439 20015 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.987300 19971 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.037375 15299 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:07.996449 19888 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:07.985754 19959 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.038355 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.048931 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.054693 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.962949 19886 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.049589 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.010634 20021 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:08.058246 15307 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:08.059819 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.060408 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:07.973660 20031 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:07.925539 19657 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:08.063174 15227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.046s	sys 0.041s
I20260709 13:10:08.063340 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.082489 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.096083 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.020380 20048 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.092938 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:08.057405 19888 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.130894 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.132383 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.134666 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.057233 19378 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.096973 15229 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:08.020841 19879 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.134052 15377 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:08.143792 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.083246 19916 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:08.144630 15230 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:08.149647 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.156752 15229 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:08.136351 20047 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:08.169764 20047 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.171166 20047 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.130658 20021 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.165392 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.167979 20005 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:08.183820 15232 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:08.133443 19888 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.192000 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.199469 15229 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:08.181288 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:08.204232 15305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.008s	sys 0.047s
W20260709 13:10:08.204746 15305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.008s	sys 0.047s
I20260709 13:10:08.148352 19935 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.232750 19883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.014s	sys 0.029s
W20260709 13:10:08.233690 19883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.014s	sys 0.029s
I20260709 13:10:08.238583 20068 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.239605 15302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.011s	sys 0.032s
W20260709 13:10:08.242307 15302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.012s	sys 0.032s
I20260709 13:10:08.246611 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2716) took 1018 ms. Trace:
W20260709 13:10:08.243113 19918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.022s
W20260709 13:10:08.243405 16003 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.021s
W20260709 13:10:08.251726 19918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.003s	sys 0.022s
W20260709 13:10:08.251899 16003 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.014s	sys 0.022s
I20260709 13:10:08.151222 19916 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.251237 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.261826 15348 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.062287 19959 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.271018 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.271313 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.273499 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:08.277566 15229 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:08.250002 15302 rpcz_store.cc:276] 0709 13:10:07.228078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.253050 (+ 24972us) service_pool.cc:224] Handling call
0709 13:10:07.253436 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:07.316529 (+ 63093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.316563 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.317151 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 13:10:07.477717 (+160566us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:07.541441 (+ 63724us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.541828 (+   387us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.724708 (+182880us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b1800457240. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:08.130878 (+406170us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b48000b0058. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:10:08.246191 (+115313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.246282 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.246330 (+    48us) raft_consensus.cc:1685] finished
0709 13:10:08.246349 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.246542 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89205,"prepare.queue_time_us":112357,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":8720,"raft.queue_time_us":94524,"raft.run_cpu_time_us":3162,"raft.run_wall_time_us":591393,"spinlock_wait_cycles":71918848,"thread_start_us":863586,"threads_started":2,"wal-append.queue_time_us":372924}
I20260709 13:10:08.284814 20035 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:08.296314 20035 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.296829 20035 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:08.266327 19916 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.334656 15303 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:08.280195 19870 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.260279 19935 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:08.286334 20021 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.303730 20005 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:08.332921 19972 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.339980 20068 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:08.358791 19578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.030s	sys 0.018s
W20260709 13:10:08.371636 15231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.040s	sys 0.068s
I20260709 13:10:08.375226 15299 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:10:08.378563 15380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.032s	sys 0.042s
W20260709 13:10:08.378979 15380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.032s	sys 0.042s
I20260709 13:10:08.357266 19957 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.334745 20030 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.356235 19927 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:08.378383 19680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.022s	sys 0.050s
W20260709 13:10:08.386246 19578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.031s	sys 0.018s
I20260709 13:10:08.362108 20021 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.422780 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2720) took 1193 ms. Trace:
I20260709 13:10:08.397351 19886 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.429072 15305 rpcz_store.cc:276] 0709 13:10:07.229234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.329988 (+100754us) service_pool.cc:224] Handling call
0709 13:10:07.330292 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.330478 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:07.330784 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.420581 (+1089797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.420662 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:08.422383 (+  1721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.422491 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.422692 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":830,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":34531,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":1089271,"threads_started":2,"wal-append.queue_time_us":898647}
I20260709 13:10:08.364804 20005 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.393860 20029 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:08.432230 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 161044us
I20260709 13:10:08.416183 19973 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:08.426697 19980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.052s	sys 0.077s
I20260709 13:10:08.439194 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:08.408715 19680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.022s	sys 0.050s
W20260709 13:10:08.428433 19988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.035s	sys 0.035s
I20260709 13:10:08.453999 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.455570 20030 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.435833 19657 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.462388 15348 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.411806 19927 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:08.437011 19879 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.396432 19957 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.438632 19886 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:08.439437 19959 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:08.452301 19980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.053s	sys 0.077s
W20260709 13:10:08.501245 20052 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 13:10:08.504030 19888 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.464246 19870 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.474505 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:08.475704 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.507985 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:08.460876 19988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.036s	sys 0.036s
I20260709 13:10:08.511770 20077 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.513772 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.471457 19878 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.489187 20068 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:08.490375 20051 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:10:08.494894 19886 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:08.445693 19972 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:08.450507 19973 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.520740 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:08.478942 19680 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.535008 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:08.518738 20077 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:08.536101 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:08.485139 19879 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:08.541862 19935 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:08.539932 20068 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.548168 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2706) took 1088 ms. Trace:
I20260709 13:10:08.537147 19972 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:08.549962 19878 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:08.529932 19870 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.533906 19993 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:08.554078 15380 rpcz_store.cc:276] 0709 13:10:07.459358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.459758 (+   400us) service_pool.cc:224] Handling call
0709 13:10:07.460179 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.460768 (+   589us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:07.485227 (+ 24459us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.830751 (+345524us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b1800457120. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:10:08.383362 (+552611us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.387839 (+  4477us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.388045 (+   206us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:08.388082 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.388179 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.547693 (+159514us) raft_consensus.cc:1685] finished
0709 13:10:08.547838 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.548087 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19931,"prepare.queue_time_us":29314,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":22773,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":53354,"spinlock_wait_cycles":2410368,"thread_start_us":548404,"threads_started":1,"wal-append.queue_time_us":935442}
I20260709 13:10:08.500232 20035 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.541110 20030 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.538118 20077 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.573237 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2287) took 1242 ms. Trace:
I20260709 13:10:08.554011 19879 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:08.586321 15227 rpcz_store.cc:276] 0709 13:10:07.330384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.331750 (+  1366us) service_pool.cc:224] Handling call
0709 13:10:07.388853 (+ 57103us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.389190 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.389215 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.389647 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.085377 (+695730us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:08.085425 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.085496 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.572968 (+487472us) raft_consensus.cc:1685] finished
0709 13:10:08.572991 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.573164 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1354,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11285,"thread_start_us":695432,"threads_started":1,"wal-append.queue_time_us":885049}
I20260709 13:10:08.596630 19870 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.597543 19870 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.598791 20035 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.601842 19870 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.606349 20047 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.609827 19879 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:08.611815 20005 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:08.612557 19784 consensus_meta.cc:287] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.000s
I20260709 13:10:08.568303 20075 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:08.613829 19958 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:08.616241 19972 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:08.618911 19886 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:08.558216 19878 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.538772 19680 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.538167 19973 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.589689 20077 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.586632 20030 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.642629 15228 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:10:08.599885 20035 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:10:08.644307 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 137599us
I20260709 13:10:08.645637 20021 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.580142 19993 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:08.639631 20075 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.628218 19870 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.681675 20030 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.672672 19878 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:08.726655 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 187000us
I20260709 13:10:08.692703 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 692) took 1021 ms. Trace:
I20260709 13:10:08.694845 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:08.699504 19339 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.664s	user 0.004s	sys 0.012s
I20260709 13:10:08.689955 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.698908 19957 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.726986 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.762501 16003 rpcz_store.cc:276] 0709 13:10:07.671849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.672017 (+   168us) service_pool.cc:224] Handling call
0709 13:10:07.672299 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.672531 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:08.262131 (+589600us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.682985 (+420854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.683134 (+   149us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:08.683299 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.683503 (+   204us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.692589 (+  9086us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":567111,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":39514,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":994167,"threads_started":3,"wal-append.queue_time_us":302431}
I20260709 13:10:08.766957 15305 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:08.762095 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:08.693773 20073 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.774552 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.778851 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.701431 20075 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.784313 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:08.785923 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:08.765821 20004 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.769104 19927 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:08.790278 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.771533 19886 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.798272 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:08.792665 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:08.775637 19993 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.725467 19975 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:08.765300 19916 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.769996 19339 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:08.784121 20079 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:08.805405 20079 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:08.806247 20047 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.806819 19916 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.807780 20079 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:08.728279 19870 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.809391 19680 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.814845 19973 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.806864 20015 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:08.815016 20078 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:10:08.823851 20048 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.824155 20029 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:08.825110 20032 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.826136 20029 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.826679 19926 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.835657 20075 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.837627 20029 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.839483 20075 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.840766 20036 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.841150 20029 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.780210 20073 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.844249 20031 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.846380 20073 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:08.849303 20077 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.852501 20077 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.855648 20030 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:08.860262 20030 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:08.932614 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:08.934765 15300 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:08.942154 15302 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:10:08.957057 15348 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.13.196.126:35597, user_credentials={real_user=slave}} blocked reactor thread for 166910us
I20260709 13:10:08.957948 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.960753 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.961031 15373 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:08.962342 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:08.963505 15380 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:08.964767 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:08.993901 15348 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:08.998407 15348 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:09.009055 19575 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:09.017268 19870 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:09.018636 19870 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:09.010890 19575 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.019788 19870 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.055812 16003 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:09.057703 19973 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.058796 19973 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.061385 20032 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.062461 20032 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.060115 20030 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.070106 19680 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:09.070389 20030 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.073909 20073 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:09.075191 20073 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.079129 19339 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.082266 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:09.083334 20030 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:09.084867 20027 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.085412 20027 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.086108 20027 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.092720 19926 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.094081 19926 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.083257 19575 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:09.071250 19680 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.109577 19942 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:09.159268 19918 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:09.160535 19918 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.163941 19918 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.172649 19975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33306 (request call id 0) took 8704 ms. Trace:
I20260709 13:10:09.175072 19968 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.176187 19968 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.179258 19706 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:09.185288 19926 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.190685 19887 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.142536 19870 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.168927 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:09.148097 20030 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.183903 19968 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.208678 20026 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.209700 20026 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.174525 19975 rpcz_store.cc:276] 0709 13:10:00.467949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.468126 (+   177us) service_pool.cc:224] Handling call
0709 13:10:00.484137 (+ 16011us) log.cc:844] Serialized 501 byte log entry
0709 13:10:01.119521 (+635384us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b4c0007e540. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f51df2a20 00007f2f51e03a29 00007f2f51e0413f 00007f2f51dc82ab 00007f2f51df5f3c 00007f2f51df63fe 00007f2f5208350b 00007f2f53a82381 00007f2f53a8026b 00007f2f53a86d53 00007f2f53a86cd9
0709 13:10:09.172085 (+8052564us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":291,"raft.run_cpu_time_us":4553,"raft.run_wall_time_us":426780,"spinlock_wait_cycles":11482240,"thread_start_us":206487,"threads_started":1,"wal-append.queue_time_us":207864,"wal-append.run_cpu_time_us":2503,"wal-append.run_wall_time_us":1008901}
I20260709 13:10:09.180718 19942 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.204082 20032 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:09.223450 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.233731 19888 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.226893 20030 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.254539 20030 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:09.260614 15307 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.262194 20032 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.263888 19870 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:09.263756 20032 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.266860 20032 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.266991 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2347) took 1212 ms. Trace:
I20260709 13:10:09.267557 15228 rpcz_store.cc:276] 0709 13:10:08.054105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.054456 (+   351us) service_pool.cc:224] Handling call
0709 13:10:09.266349 (+1211893us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b540043c954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:09.266633 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350245632}
I20260709 13:10:09.270167 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:09.276513 20070 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.277709 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:09.278602 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.278964 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2138) took 1035 ms. Trace:
I20260709 13:10:09.280481 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:09.281455 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:09.312357 16000 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:09.315980 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:09.317131 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:09.283005 19969 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.283214 20026 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:09.287322 15378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2705) took 1828 ms (client timeout 1548 ms). Trace:
I20260709 13:10:09.287806 19870 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.295883 19887 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:09.297966 19680 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:09.301718 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.302299 15118 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 362d7a17088a4e86a51428b5ee97346e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:10:09.303928 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2133) took 1334 ms. Trace:
I20260709 13:10:09.304533 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.307065 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:09.308563 19942 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.309850 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:09.311967 15299 rpcz_store.cc:276] 0709 13:10:08.243400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.243719 (+   319us) service_pool.cc:224] Handling call
0709 13:10:08.244146 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.375887 (+131741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.278458 (+902571us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54003e17d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:09.278737 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300179328}
I20260709 13:10:09.322546 15382 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:09.331911 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.332964 15299 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
W20260709 13:10:09.320719 15378 rpcz_store.cc:269] 0709 13:10:07.459081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.459358 (+   277us) service_pool.cc:224] Handling call
0709 13:10:09.286769 (+1827411us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54003f3254. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:09.287006 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464661248}
I20260709 13:10:09.322230 15303 rpcz_store.cc:276] 0709 13:10:07.968974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.002013 (+ 33039us) service_pool.cc:224] Handling call
0709 13:10:09.303406 (+1301393us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002fb054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:09.303680 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666331904}
W20260709 13:10:09.347723 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77891us
I20260709 13:10:09.350085 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:09.353292 15302 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:09.361003 15306 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:09.362984 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.363911 15303 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:10:09.365028 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.365834 15303 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:09.366890 15304 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:09.367854 19657 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:09.392239 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:09.395438 15231 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:09.386263 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:09.416493 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:09.424201 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:09.425961 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.426941 15382 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:09.427870 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.431173 15300 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:09.432560 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.433444 15300 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:09.434742 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.439277 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.453022 15299 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:09.460922 19942 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:09.368049 19878 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.597s	user 0.023s	sys 0.004s
I20260709 13:10:09.464766 19878 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.467685 19878 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:09.469555 15380 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
W20260709 13:10:09.470645 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 119384us
I20260709 13:10:09.339500 20070 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.480762 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:09.385654 19870 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.485843 19870 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:09.493615 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:09.505654 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.507401 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.509238 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2713) took 2036 ms. Trace:
I20260709 13:10:09.509696 15375 rpcz_store.cc:276] 0709 13:10:07.472888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.472997 (+   109us) service_pool.cc:224] Handling call
0709 13:10:07.473299 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.554720 (+ 81421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.554749 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:07.554788 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:07.554817 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.508684 (+1953867us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b54001aa9d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:09.508776 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.509021 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186868096}
I20260709 13:10:09.511297 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.513865 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.515055 15373 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:09.385358 19805 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.368424 19657 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.550675 19973 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.508261 15374 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:09.412428 20026 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.516319 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.384545 19887 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.568903 19657 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:09.588459 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:09.384859 19969 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.545204 19805 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:09.591020 15300 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:09.602573 19870 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:09.593452 19942 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:09.664606 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:09.679380 15374 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.680289 15373 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:09.609356 19878 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:09.684923 19944 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:09.686010 15348 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.715s (SENT) [suppressed 48 similar messages]
I20260709 13:10:09.685622 19942 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.695298 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:09.573352 20027 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.702355 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:09.643165 19805 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.658836 20030 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:09.728683 15307 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:09.737310 15303 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:09.672820 19973 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:09.740926 15302 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:09.742172 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.712028 19926 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:09.753991 19944 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.762323 19973 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.765753 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2708) took 2841 ms. Trace:
I20260709 13:10:09.766249 15308 rpcz_store.cc:276] 0709 13:10:06.923826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.965974 (+ 42148us) service_pool.cc:224] Handling call
0709 13:10:06.966478 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.028982 (+1062504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.765069 (+1736087us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003dccd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:09.765511 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417592576}
I20260709 13:10:09.707656 20026 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.788548 19872 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:09.797123 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:09.799487 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:09.801710 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.774937 19339 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:09.815990 15378 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.786545 19975 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:09.768388 20030 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.839623 19926 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.841428 19969 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:09.841634 15374 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:09.843237 19887 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:09.857539 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.833305 15373 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:09.865151 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2284) took 1085 ms. Trace:
I20260709 13:10:09.865727 15373 rpcz_store.cc:276] 0709 13:10:08.779318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.751072 (+971754us) service_pool.cc:224] Handling call
0709 13:10:09.865030 (+113958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.799468 15382 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
W20260709 13:10:09.885547 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 418501us
I20260709 13:10:09.831833 19973 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:09.885530 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 876) took 1445 ms. Trace:
I20260709 13:10:09.806293 19878 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.884066 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2288) took 1102 ms. Trace:
I20260709 13:10:09.892762 15382 rpcz_store.cc:276] 0709 13:10:08.781260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.664240 (+882980us) service_pool.cc:224] Handling call
0709 13:10:09.883994 (+219754us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:09.885692 15381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.106s	sys 0.130s
W20260709 13:10:09.897765 15381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.106s	sys 0.130s
I20260709 13:10:09.903841 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:09.891420 15379 rpcz_store.cc:276] 0709 13:10:08.439962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.440122 (+   160us) service_pool.cc:224] Handling call
0709 13:10:08.440530 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.540881 (+100351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.540920 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.540976 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:08.541018 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.884947 (+1343929us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540023f5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:09.885034 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.885288 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230212480}
I20260709 13:10:09.902753 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:09.910878 15373 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:09.921252 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:09.921813 20098 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.099s	user 0.004s	sys 0.000s
I20260709 13:10:09.882560 19339 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.938782 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:09.877934 19870 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.900202 19975 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.913775 19887 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:09.914737 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 204170us
I20260709 13:10:09.922133 19872 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.944758 15382 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:10:09.921892 19973 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:09.940877 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 254892us
I20260709 13:10:09.973879 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2292) took 1007 ms. Trace:
I20260709 13:10:09.974375 15382 rpcz_store.cc:276] 0709 13:10:08.955416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.894942 (+939526us) service_pool.cc:224] Handling call
0709 13:10:09.963223 (+ 68281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.966548 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:09.987135 20095 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.189s	user 0.002s	sys 0.000s
I20260709 13:10:09.986940 19973 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:09.958599 19942 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:09.956048 19992 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:09.988184 19935 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.989686 19339 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:09.962850 19872 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.003155 19872 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.004916 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 881) took 1214 ms. Trace:
I20260709 13:10:10.005456 15374 rpcz_store.cc:276] 0709 13:10:08.790816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.908241 (+1117425us) service_pool.cc:224] Handling call
0709 13:10:09.966709 (+ 58468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.004457 (+ 37748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.004495 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.004578 (+    83us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:10.004618 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.004693 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.004822 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.999986 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:10.008473 19942 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:10.009069 19942 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.009181 15382 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
I20260709 13:10:10.009531 19942 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.010643 15382 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:10.013324 19878 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.015884 19969 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.015540 19992 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.016877 20102 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:10.017199 19710 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:10.016795 19935 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:10.016815 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57099.2us
I20260709 13:10:10.018462 15382 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:10.018534 19973 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.016906 19713 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:10.020675 19917 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.023772 19872 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:09.990057 20099 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:10.040264 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 243455us
I20260709 13:10:10.045253 15378 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:09.993911 20018 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.043426 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:10.046993 15377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2277) took 1862 ms (client timeout 1830 ms). Trace:
I20260709 13:10:10.061461 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:10.059597 15377 rpcz_store.cc:269] 0709 13:10:08.129928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.130079 (+   151us) service_pool.cc:224] Handling call
0709 13:10:09.976071 (+1845992us) spinlock_profiling.cc:243] Waited 911 us on lock 0x7b5400289bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:09.991935 (+ 15864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094848}
I20260709 13:10:10.069010 15307 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:10.074065 19918 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:09.991653 19887 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.076181 15308 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:10.074831 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2708) took 2614 ms. Trace:
I20260709 13:10:10.076197 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.057456 20099 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:10.081224 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:10.060738 19973 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.065851 19917 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.084751 19713 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:10.091694 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 193037us
I20260709 13:10:10.092829 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:10.095983 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:10.081995 20099 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.105870 19959 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:10.106441 19959 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.106649 20070 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.106859 19959 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.107836 19575 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:10.109196 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 458) took 1331 ms. Trace:
I20260709 13:10:10.109618 16003 rpcz_store.cc:276] 0709 13:10:08.777832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.778256 (+   424us) service_pool.cc:224] Handling call
0709 13:10:08.778602 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.057083 (+278481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.108833 (+1051750us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54004edc54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:10.109102 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616764672}
I20260709 13:10:10.110410 19975 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.078838 15376 rpcz_store.cc:276] 0709 13:10:07.459927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.460446 (+   519us) service_pool.cc:224] Handling call
0709 13:10:07.465076 (+  4630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.479925 (+ 14849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.479961 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.492857 (+ 12896us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.856313 (+1363456us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b480012d158. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:10:09.291678 (+435365us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b1800397660. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:09.666380 (+374702us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:09.666430 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.666532 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.842804 (+176272us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:10.070831 (+228027us) raft_consensus.cc:1685] finished
0709 13:10:10.070854 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.074312 (+  3458us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14470,"raft.queue_time_us":29209,"raft.run_cpu_time_us":5318,"raft.run_wall_time_us":1335761,"spinlock_wait_cycles":25433216,"thread_start_us":361520,"threads_started":1,"wal-append.queue_time_us":2200560}
I20260709 13:10:10.095639 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.129395 19619 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:10.095201 19926 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.131026 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.138672 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.144188 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.145988 19926 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:10.146430 15228 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:10.082921 20102 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.147226 19713 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.146486 19926 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:10.150457 20097 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:10:10.151211 15377 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:10.150985 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.152217 16003 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:10.153308 15377 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:10.151000 19926 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.121387 20104 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:10.131584 20070 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:10.127249 20027 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.099824 19969 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:10.179993 19969 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.173689 19887 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.174799 19872 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.175689 19944 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:10.180721 20094 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.917s	user 0.000s	sys 0.004s
I20260709 13:10:10.090565 19710 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.181227 19917 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.181489 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.150031 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:10.215037 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 65236.3us
I20260709 13:10:10.186528 15300 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:10.215545 19881 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:10.220707 20104 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.224972 19992 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.225878 20107 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 13:10:10.227804 19657 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.001s
W20260709 13:10:10.194670 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49184.1us
I20260709 13:10:10.130669 19973 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.230832 19710 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:10.198266 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 174426us
I20260709 13:10:10.232129 20027 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:10.232828 20027 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:10.233340 20027 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.207650 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.235430 20073 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.237025 19935 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.211100 19944 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:10.238333 19944 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.238996 19657 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.242687 15375 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:10.246392 19870 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.160588 20070 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.186007 20105 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.246512 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 888) took 1063 ms. Trace:
I20260709 13:10:10.211594 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:10.233134 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:10.242025 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2274) took 2740 ms. Trace:
I20260709 13:10:10.249006 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:10.249136 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:10.257929 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 43556.2us
I20260709 13:10:10.258751 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2742) took 1331 ms. Trace:
I20260709 13:10:10.266630 15299 raft_consensus.cc:1813] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Handling vote request from an unknown peer 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:10.249744 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:10.251276 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.273010 15305 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:10.257194 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 883) took 1255 ms. Trace:
I20260709 13:10:10.279572 15379 rpcz_store.cc:276] 0709 13:10:09.001740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.943957 (+942217us) service_pool.cc:224] Handling call
0709 13:10:09.956824 (+ 12867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.985918 (+ 29094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.985958 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.990677 (+  4719us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:09.990743 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.256848 (+266105us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54003c4454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:10.256902 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.257071 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56025856}
I20260709 13:10:10.265203 15375 rpcz_store.cc:276] 0709 13:10:09.198729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.510955 (+312226us) service_pool.cc:224] Handling call
0709 13:10:10.246267 (+735312us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b540027b0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:10.246439 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680133376}
I20260709 13:10:10.272640 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.266863 15302 rpcz_store.cc:276] 0709 13:10:08.926872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.599825 (+672953us) service_pool.cc:224] Handling call
0709 13:10:09.740460 (+140635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.747280 (+  6820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.258500 (+511220us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b54003dc7d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:10.258680 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229382400}
I20260709 13:10:10.247241 20070 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.268164 20104 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.265589 15381 rpcz_store.cc:276] 0709 13:10:07.501882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.820467 (+318585us) service_pool.cc:224] Handling call
0709 13:10:09.288587 (+1468120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.289470 (+   883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.289515 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.290378 (+   863us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.907867 (+617489us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:09.907919 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.908002 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.153645 (+245643us) raft_consensus.cc:1685] finished
0709 13:10:10.153668 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.241652 (+ 87984us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003f3250. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:10.241938 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":255,"spinlock_wait_cycles":3375190400,"thread_start_us":607311,"threads_started":1,"wal-append.queue_time_us":690249}
I20260709 13:10:10.249951 20030 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.213970 19887 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:10.295980 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:10.296798 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 91289.3us
I20260709 13:10:10.301265 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2299) took 1076 ms. Trace:
I20260709 13:10:10.314985 15378 rpcz_store.cc:276] 0709 13:10:09.225289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.385851 (+160562us) service_pool.cc:224] Handling call
0709 13:10:10.301087 (+915236us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b540012a7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:10.301199 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747490048}
I20260709 13:10:10.311117 15376 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:10.317941 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88718.4us
I20260709 13:10:10.290045 15299 raft_consensus.cc:2410] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:10.321350 15304 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:10.300420 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2283) took 1521 ms. Trace:
I20260709 13:10:10.323872 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:10.322625 15380 rpcz_store.cc:276] 0709 13:10:08.778977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.964251 (+185274us) service_pool.cc:224] Handling call
0709 13:10:10.300176 (+1335925us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54001a95d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:10.300322 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159170432}
I20260709 13:10:10.242048 19959 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.291483 19944 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.296550 20102 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.298729 20109 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.353541 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74464.2us
I20260709 13:10:10.296741 19969 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:10.366324 19710 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.367249 19710 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.367563 20099 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.347752 20104 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.368904 20104 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.370178 20102 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:10.350099 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.371327 20104 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.373234 20111 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.375114 19710 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.375525 19657 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.376221 20110 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:10.377061 20110 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:10.377715 20110 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:10.386641 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 62945us
I20260709 13:10:10.387853 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:10.392134 20121 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:10.344614 19881 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.381223 19575 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.375777 19710 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:10.403311 20112 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:10.405164 15304 raft_consensus.cc:2955] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:10.356940 19969 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:10.399784 19926 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.425590 16008 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:10.296906 20105 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:10.426463 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 341432us
I20260709 13:10:10.421377 20109 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.442757 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:10.453212 15225 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.443966 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.384112 19887 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.466457 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:10.480675 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:10.481594 16006 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:10.481634 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 130779us
I20260709 13:10:10.437067 19657 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.476207 20087 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.495206 20087 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.496297 19926 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.496614 20105 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.497546 19918 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:10.498057 19918 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:10.499228 19918 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.452579 19575 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.455626 20111 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.504150 15225 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:10.491532 19339 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.515506 19575 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.516193 20027 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.516499 19657 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.518868 20027 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.519181 19657 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.524384 19992 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:10.525484 20122 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:10.525889 20109 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.526384 20115 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:10.527726 15126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 96) took 13057 ms (client timeout 15000 ms). Trace:
I20260709 13:10:10.462710 19881 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.529084 19969 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:10.530748 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71340.4us
I20260709 13:10:10.530881 20087 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.531473 20105 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:10.504904 20026 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.532214 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:10.534969 19942 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.007s
W20260709 13:10:10.566286 19805 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.808s	user 0.016s	sys 0.000s
W20260709 13:10:10.540503 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 96755.9us
W20260709 13:10:10.550609 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68175.5us
I20260709 13:10:10.552047 16006 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:10.554400 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:10.526223 19887 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.565830 15377 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:10.578321 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:10.539981 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:10.588004 20105 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:10.580917 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.556686 19992 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:10.588594 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.572476 20027 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.605872 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 66027us
I20260709 13:10:10.606032 16001 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:10.567965 20115 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.602615 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:10.547601 19339 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.552448 20070 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.610545 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.604367 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.611219 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:10.607908 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107085us
I20260709 13:10:10.605782 19944 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:10:10.612607 20087 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.625240 19969 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.625418 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:10.574929 20111 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.580703 19959 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.612111 20026 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.605811 19805 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.614430 20115 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.656664 20027 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.616011 19975 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:10.612910 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.633025 20030 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:10.659586 20030 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.660247 20030 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:10.632741 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55171.6us
I20260709 13:10:10.627013 20109 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:10.634981 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:10.635637 19944 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.636158 19657 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:10.601119 20105 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.620286 19887 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.647297 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.634984 20087 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.676798 19881 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.664728 20116 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:10.617635 20122 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.679735 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:10.675146 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.681393 20027 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.682085 19918 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.685916 19805 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.665810 20125 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:10.597770 19942 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.676622 20111 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.712395 20102 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:10.689651 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.690948 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.692049 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.691893 20026 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.697440 19339 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.662889 20099 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.611251 19992 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.719641 19575 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:10.726944 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 110393us
I20260709 13:10:10.738390 15231 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:10:10.743726 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68736.6us
I20260709 13:10:10.711146 19657 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:10.674278 20070 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.752185 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.789875 15228 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
W20260709 13:10:10.752171 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72538.5us
I20260709 13:10:10.753822 15227 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
W20260709 13:10:10.757411 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 143293us
I20260709 13:10:10.757959 15225 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:10.761392 15374 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:10.754360 15233 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:10.749130 20027 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:10.711213 20110 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.731650 19887 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.797971 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.786391 19973 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.759294 20117 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:10.800185 20122 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.744879 19944 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.813918 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.801455 19657 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.753122 20102 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:10.817176 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:10.818493 19887 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:10.820441 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 81048.6us
I20260709 13:10:10.821559 20110 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.822937 19942 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.761560 20125 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.825027 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2720) took 1145 ms. Trace:
I20260709 13:10:10.839413 15374 rpcz_store.cc:276] 0709 13:10:09.679557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.006516 (+326959us) service_pool.cc:224] Handling call
0709 13:10:10.006911 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.792878 (+785967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.824763 (+ 31885us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400224a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:10.824956 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734676736}
I20260709 13:10:10.825975 19850 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:10.811365 20104 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:10.827912 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 106899us
I20260709 13:10:10.816176 20087 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.829712 20128 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:10.805894 20027 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.854701 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.831806 19992 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.834789 19944 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:10.838761 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 115477us
I20260709 13:10:10.850375 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.866173 15228 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:10.870712 20030 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.850548 20117 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:10.873292 20102 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.874356 20117 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.874989 20102 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.852614 20128 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:10.857712 19878 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:10.877420 20128 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.878436 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:10.879254 20125 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:10.846272 20104 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:10.880554 20104 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.853562 20026 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.853948 20027 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.873499 20115 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.843945 20122 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:10:10.844501 19850 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:10.852933 19657 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.904757 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.905490 15231 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:10:10.905092 19850 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.906663 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.907900 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.893671 19339 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:10.895139 20128 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.895000 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.912837 15228 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:10.913854 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.915160 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.895061 20030 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.917603 20130 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:10.918072 20130 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:10.894163 19878 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:10.919456 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:10.900743 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.930040 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.901508 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.901762 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.902796 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:10.920198 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.920579 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51476us
I20260709 13:10:10.899600 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.916282 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:10.923014 20115 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:10.897003 20105 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:10.940552 19878 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:10.941733 20105 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:10.945817 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:10.948612 15380 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:10.949293 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.950243 15230 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:10.951089 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:10.952967 19575 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:10.953717 19575 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:10.906678 19850 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:10.919066 20130 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:10.934546 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 121019us
I20260709 13:10:10.932175 15224 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:10.954305 19575 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.915699 15345 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:10.982450 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 66842us
I20260709 13:10:10.984802 20115 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:10.986037 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:10.986950 15374 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:10.989163 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.990850 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.988157 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:10.992918 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:10.993754 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:10.995646 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:10.992851 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:10.989856 15226 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:11.001041 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.001822 15304 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:11.002249 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:10.994478 15376 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:11.005373 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.006049 15378 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:11.007457 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:11.008884 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.008698 15130 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 4 to 5, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 5 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.011809 16007 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:11.012674 20125 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.014667 20125 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:11.015133 20125 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.016201 20122 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:11.016937 20122 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:11.017686 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.020558 15229 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:11.020720 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.021981 19969 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:11.022845 15227 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:11.012713 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.024852 20120 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:11.025355 20120 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.025866 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.017613 20122 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:11.033805 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:11.040692 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:11.041560 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.042217 15373 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.046757 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:11.048246 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.046444 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:11.051633 15382 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:11.053045 19918 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:11.053928 20110 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:11.051657 20120 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.055209 20110 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:11.055668 20120 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.051739 19887 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:11.062289 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.062001 20104 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.055672 20110 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:11.064718 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:11.024868 20125 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.069334 20130 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.096138 20125 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.071148 20128 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:11.032477 20027 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.080932 19973 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:11.100503 20110 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:11.107729 20110 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.110448 20132 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:11.110827 19918 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:11.111109 20132 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.111405 19918 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.104565 20115 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:10:11.102514 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.112759 20115 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:11.113196 20115 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:11.112919 20132 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.114173 20115 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:11.114779 20132 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.115377 19887 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:11.115649 20115 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.115836 19887 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:11.116407 20104 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:11.117183 19887 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:11.100641 19973 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.120543 20116 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:11.120986 19973 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:11.026489 15130 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 5 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 8 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } }
I20260709 13:10:11.122396 19918 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.123847 19918 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:11.090324 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54581.7us
I20260709 13:10:11.125643 15130 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 8 to 9, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 9 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.107828 20027 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:11.102047 19657 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:11.129516 19657 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:11.134033 19657 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:11.121047 20116 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:11.085987 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52313.2us
I20260709 13:10:11.139420 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:11.140200 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 89914us
I20260709 13:10:11.139796 15378 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:11.153028 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.153967 15304 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:11.135300 19805 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:11.127810 15130 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:11.140477 15373 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:11.161197 16007 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:10:11.163509 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.165047 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.132197 19969 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:10:11.177410 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:10.574725 15126 rpcz_store.cc:269] 0709 13:09:57.470135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.470427 (+   292us) service_pool.cc:224] Handling call
0709 13:10:10.527407 (+13056980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:07.446914 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:07.676263 (+229349us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:07.679419 (+  3156us) write_op.cc:435] Acquired schema lock
0709 13:10:07.683401 (+  3982us) tablet.cc:662] Decoding operations
0709 13:10:07.748990 (+ 65589us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:07.749054 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:07.749096 (+    42us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:07.749620 (+   524us) tablet.cc:701] Row locks acquired
0709 13:10:07.749639 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:10:07.749791 (+   152us) write_op.cc:270] Start()
0709 13:10:07.749911 (+   120us) write_op.cc:276] Timestamp: P: 1783602607749738 usec, L: 0
0709 13:10:07.749932 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:10:07.750599 (+   667us) log.cc:844] Serialized 2452 byte log entry
0709 13:10:08.251335 (+500736us) op_driver.cc:464] REPLICATION: finished
0709 13:10:08.548852 (+297517us) write_op.cc:301] APPLY: starting
0709 13:10:08.549004 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:08.619511 (+ 70507us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:08.619652 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:08.807014 (+187362us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:08.807300 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:10:08.807349 (+    49us) write_op.cc:312] APPLY: finished
0709 13:10:08.807670 (+   321us) log.cc:844] Serialized 65 byte log entry
0709 13:10:08.819843 (+ 12173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:08.822652 (+  2809us) write_op.cc:454] Released schema lock
0709 13:10:08.842087 (+ 19435us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:08.842577 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:08.842610 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":403098,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":297165,"apply.run_cpu_time_us":15882,"apply.run_wall_time_us":293696,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29183,"num_ops":6,"prepare.queue_time_us":146387,"prepare.run_cpu_time_us":30626,"prepare.run_wall_time_us":707183,"raft.queue_time_us":15539,"raft.run_cpu_time_us":35992,"raft.run_wall_time_us":229311,"replication_time_us":501205,"thread_start_us":733410,"threads_started":4,"wal-append.queue_time_us":482133,"wal-append.run_cpu_time_us":6332,"wal-append.run_wall_time_us":1648969}]]}
I20260709 13:10:11.177696 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:11.178398 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.190256 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.183157 15307 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:11.148672 20116 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.193872 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.196087 15378 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:11.175822 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.179239 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.197062 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.179649 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.178925 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.198377 15308 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:11.191793 15382 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:11.205627 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.205999 15377 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:11.196992 15300 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:11.197731 15301 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:11.207008 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.207020 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.168241 19887 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.217574 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.218269 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.218519 15301 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:11.219605 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.224133 15299 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:11.225087 15373 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:10:11.237461 15376 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:11.237574 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.178063 19619 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.230571 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.242223 15302 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:10:11.248915 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.239905 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:11.256685 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.257546 15380 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:11.266604 15304 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:11.272326 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.279909 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.292140 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.296800 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.297045 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.299024 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.281401 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:11.300843 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.301143 15225 raft_consensus.cc:606] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:11.301528 15377 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:11.302543 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.303242 15378 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:11.304370 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.305008 15375 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 6.
W20260709 13:10:11.306075 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.294648 19973 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:11.308936 19973 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.313481 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.314141 19713 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:11.314666 19713 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.320079 15227 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:11.321286 15130 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 4 to 6, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 6 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:11.323395 15382 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:11.267817 19878 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:11.324694 19878 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:11.326143 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.326406 19846 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:11.311609 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.334452 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.335628 15378 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:11.333123 15376 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:11.342232 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.346316 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.323413 15130 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 7, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 7 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:11.340548 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.355487 15382 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:11.359505 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.359673 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.315706 19713 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.360786 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.361415 19713 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.362290 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.363744 19878 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:11.368270 15130 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 7 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 8 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.372944 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.370736 15130 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 8 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:11.379932 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:11.383549 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.391438 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.295389 19881 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:10:11.421314 19881 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:11.421830 19881 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.422910 19881 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.349766 19575 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.431723 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.432514 15227 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:11.438498 15230 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:11.452461 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.459134 15130 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 10, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:11.462986 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.465339 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.466723 15227 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:10:11.468657 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.470088 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.473959 19973 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:11.479295 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.480209 15382 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:11.443856 19575 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:11.446704 19881 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.496807 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.500593 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.512396 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.513252 15373 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:10:11.515722 15226 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:11.527325 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 258823us
I20260709 13:10:11.542958 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.544824 15373 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:11.547067 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.543505 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.553350 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.554833 15374 raft_consensus.cc:2376] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9. Re-sending same reply.
I20260709 13:10:11.556481 15226 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:11.564884 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.569377 15130 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 9, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 9 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.561445 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:11.572268 15130 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 6 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 8 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.579712 15373 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:11.576696 20122 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
I20260709 13:10:11.583911 15225 raft_consensus.cc:606] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:11.583468 20122 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.588816 15225 raft_consensus.cc:614] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.559598 20119 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.607713 20112 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:11.609207 15378 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:10:11.598244 20125 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.004s
W20260709 13:10:11.617774 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.617326 15229 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:11.620971 15227 raft_consensus.cc:1217] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 13:10:11.621637 15227 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:11.599954 19973 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:11.624717 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.635327 15373 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:11.624504 15130 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:11.616223 20121 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.628477 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.629156 19935 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:11.609686 20119 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.642658 20112 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.653940 20122 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:11.661307 15224 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:11.667516 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.669893 15198 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:11.676797 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.678689 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.679481 15380 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.680701 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:11.681675 15377 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:11.681589 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.682803 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.683637 15375 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:11.669469 19935 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:11.684779 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.686439 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.676636 19657 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:11.639577 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.634166 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.691197 15377 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:11.614403 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53060.4us
I20260709 13:10:11.695855 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.696152 15380 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:11.699589 15378 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:11.668896 20119 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.698165 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:11.696740 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.706903 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.702270 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:11.712227 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.714272 15230 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:11.686820 19935 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:11.722566 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.642637 19973 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.730731 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.698572 19713 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.741012 15226 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:11.721194 15198 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.745878 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.749461 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:11.713872 20122 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.756325 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.756846 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.757686 15226 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:11.736625 20121 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:11.763051 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.740433 20112 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:11.760192 19935 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:11.746852 19887 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:11.774223 15224 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:11.699941 19657 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.764008 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.786372 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.748450 19713 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.788002 19713 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.791862 15233 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:11.792761 16001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3f082f323814ed98886bca799e3d232"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:11.713138 19575 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:11.772693 20121 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:11.781721 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.756539 20122 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.752573 20125 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:11.797575 20141 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.798108 20130 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:11.799049 20121 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.800423 19805 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:11.793411 16001 raft_consensus.cc:606] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:11.838698 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.839510 15305 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.803259 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.805205 19575 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:11.820240 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:11.781718 20116 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.004s
I20260709 13:10:11.824831 15225 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:11.826184 15231 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:11.783387 19887 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.795423 20140 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:11.842258 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.850805 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:11.822729 19918 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.007s
I20260709 13:10:11.852173 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.862254 15304 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:11.863283 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.715s (SENT)
I20260709 13:10:11.863528 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:11.818882 20125 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.778716 20132 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:11.843849 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.819217 20122 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.857254 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:11.851462 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.877506 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.859169 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.878250 15300 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:10:11.878860 15301 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:11.879786 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.880712 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.881640 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.882282 15307 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:11.838685 19805 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.864032 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:11.867309 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 131655us
I20260709 13:10:11.885351 15299 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:11.880944 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76017.3us
I20260709 13:10:11.888063 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:11.888063 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:11.891942 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:11.885110 19881 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:11.846460 19575 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.858412 20120 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:11.909675 20104 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.859444 19887 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.910539 20120 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.911074 20120 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.896000 19878 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.885445 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.869568 20125 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.870275 20132 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.814246 19935 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.889206 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:11.894459 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.920261 15301 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:11.920282 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.899328 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.921837 15233 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:11.900102 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.922999 15378 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:11.902539 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:11.906010 20140 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.924309 20140 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.924528 15306 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
W20260709 13:10:11.909013 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 45800.8us
W20260709 13:10:11.893950 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.913527 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.852586 20115 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.914985 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.933764 20115 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:11.918444 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.942097 20115 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:11.956399 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.894260 19805 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.964107 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.965466 15299 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:11.859145 20116 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:11.895870 19881 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.965268 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.910593 20104 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:11.962778 15373 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:11.950197 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:11.974938 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:11.981860 15224 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:11.988799 15232 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:11.919169 20132 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.996330 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.999114 20141 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:12.000726 20154 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:10:11.997066 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107999us
I20260709 13:10:12.009217 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55ea5972868497eb17221413640fbea"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:12.009910 15224 raft_consensus.cc:606] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:12.013386 15379 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:12.000684 20141 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:11.997473 20087 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:11.997153 20128 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.029484 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:11.953454 20099 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:10:12.034621 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 142799us
I20260709 13:10:12.033699 19575 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.040926 19575 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.044965 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:12.046756 19973 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.048067 16001 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:12.051783 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.052783 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.054217 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.056473 20128 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.056814 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.057724 15231 raft_consensus.cc:2376] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:10:12.058045 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.058873 15306 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:12.059415 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.059934 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.060510 15307 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:12.061489 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:12.058696 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.064229 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.050269 20141 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.066435 19878 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:12.066862 19878 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.067269 19878 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.073132 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:12.075076 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:12.079468 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.090687 16001 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:12.082676 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.096632 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.074050 15224 raft_consensus.cc:606] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:12.042593 20147 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.228s	user 0.001s	sys 0.012s
I20260709 13:10:12.100181 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:12.102468 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 56202.6us
I20260709 13:10:12.110052 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:12.115610 15233 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:12.117550 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:12.117669 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:12.121402 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 218266us
I20260709 13:10:12.128479 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:12.130257 20140 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.108731 20027 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:12.132639 20027 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.133013 20027 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.130987 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:12.108290 20160 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:12.148555 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.155377 19935 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.068322 20132 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.156198 19935 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:12.098498 19881 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.158272 20132 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.101295 20115 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:10:12.183507 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.137449 20160 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:12.183077 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:12.143524 20102 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.159814 19713 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.194145 15229 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:12.194967 19713 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.184729 20117 raft_consensus.cc:993] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:12.198221 20117 raft_consensus.cc:1081] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:10:12.201457 20121 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:12.184280 15373 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.211838 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.213006 15377 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.215768 15378 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:10:12.219507 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.186723 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.224915 15224 raft_consensus.cc:2376] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8. Re-sending same reply.
I20260709 13:10:12.239241 20140 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.178740 19935 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.243718 19935 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.251010 20130 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:12.251581 20130 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.253870 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.204268 20121 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:12.258847 19657 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:12.259600 19657 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:12.259982 19657 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.240082 20027 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.263634 20027 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:12.251611 19887 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.264460 20104 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:12.268126 20116 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:12.272979 20155 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.273627 20155 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:12.275914 20155 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.282904 19878 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.291392 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:12.292380 16001 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:12.184938 15233 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:12.190122 20112 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:12.190824 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.307080 20125 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.307699 15373 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:12.308794 15226 raft_consensus.cc:2368] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
W20260709 13:10:12.328056 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.341372 15377 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:12.359684 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.311340 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.361330 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.333287 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.362330 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.379487 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.454859 15299 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.455116 15231 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:12.373019 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.364600 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:12.456509 15303 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:12.451189 15308 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.357376 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.457312 15301 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.334573 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.355815 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.347417 15224 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:12.325376 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.458853 15233 raft_consensus.cc:2368] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:12.459355 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:12.348672 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:12.345085 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.456578 16001 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:12.354849 15302 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.327328 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:12.464905 15305 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:10:12.466084 15305 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:12.467208 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:12.467933 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.468561 15382 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.468688 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.469323 15381 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.470147 15229 raft_consensus.cc:2368] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:12.469182 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:12.473878 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.476563 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.477003 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.478219 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.478421 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.481112 15198 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:12.357641 19887 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.489733 19713 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:12.490504 20102 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:12.464874 19973 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.491915 19973 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:12.226821 20159 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.340247 19657 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.365341 19881 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.309911 20125 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.359278 20160 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:12.501827 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.502017 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.502506 15231 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:12.348495 20112 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.495909 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.487074 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.358783 19878 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:12.472100 20141 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:12.499590 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 403041us
I20260709 13:10:12.520587 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.500710 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.503373 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:12.521493 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 407408us
I20260709 13:10:12.512990 15224 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:12.490310 19805 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.382853 20120 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.521078 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.521256 15232 raft_consensus.cc:2376] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:10:12.483398 15377 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3f082f323814ed98886bca799e3d232"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:52412
W20260709 13:10:12.520153 20122 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 13:10:12.534024 15377 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.538662 15377 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.535099 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:12.534504 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.506039 19713 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.542285 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:12.377044 20130 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.518704 20102 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.547971 15225 raft_consensus.cc:2368] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9.
I20260709 13:10:12.550877 15382 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:12.551586 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 441617us
I20260709 13:10:12.552685 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.550534 15377 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:12.562011 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 2.000s (SENT)
I20260709 13:10:12.539209 19878 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:12.569726 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.571214 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.536871 20087 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:12.571821 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.517115 20112 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.574916 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:12.552889 19619 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.578516 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.580575 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.558552 20115 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:12.597118 15306 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:12.561453 20166 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:10:12.597540 15306 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:12.601377 15375 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:12.544416 20122 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.603149 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.604147 15373 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.604161 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.566881 19878 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.605340 15224 raft_consensus.cc:2368] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
W20260709 13:10:12.593266 19575 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.008s
I20260709 13:10:12.608723 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:12.616147 16008 raft_consensus.cc:3055] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:12.616551 16008 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:12.617399 16008 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:12.618564 16008 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:12.587162 19887 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.609660 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:12.621636 20120 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.622200 15378 raft_consensus.cc:2368] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
W20260709 13:10:12.621417 15274 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.548s (SENT)
W20260709 13:10:12.624387 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.551s (SENT)
I20260709 13:10:12.624833 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:12.626205 19887 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.626541 15308 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:12.628299 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.582396 20163 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:12.629878 20163 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:12.629948 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.615836 19935 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.630952 20163 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.631950 15304 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.613390 19713 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.601913 15306 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.655476 15375 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:12.608841 19878 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.657049 19935 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.657992 19973 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:12.655997 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.658653 15378 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:12.606623 20119 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.859s	user 0.013s	sys 0.000s
I20260709 13:10:12.643627 15306 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:12.643141 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.668674 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.669499 15232 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:12.669643 15227 raft_consensus.cc:2368] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11.
I20260709 13:10:12.655551 15229 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:12.637902 20170 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:12.671514 15377 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:12.671723 20170 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.672160 20170 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.673107 20140 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:12.673718 20140 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.588840 20102 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.674897 20140 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:12.678079 15348 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.507s (SENT)
I20260709 13:10:12.677874 20119 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:12.679219 15228 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:12.681540 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2372) took 1153 ms. Trace:
I20260709 13:10:12.681941 15228 rpcz_store.cc:276] 0709 13:10:11.528179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.543052 (+ 14873us) service_pool.cc:224] Handling call
0709 13:10:11.562398 (+ 19346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.679621 (+1117223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.681234 (+  1613us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003ffcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:12.681447 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2567787904}
I20260709 13:10:12.682788 20140 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:12.682931 15274 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.581s (SENT)
I20260709 13:10:12.681957 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.589378 19805 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.645949 15301 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:12.694917 20120 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:12.700284 20120 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.700950 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:12.702646 19619 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.704083 20112 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.705113 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:12.706460 16003 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
W20260709 13:10:12.709182 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.675s (SENT)
I20260709 13:10:12.709740 15377 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:12.711927 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.703778 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.713115 15308 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.694948 15381 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:12.716523 15233 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:12.721983 15373 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:12.726419 16008 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:10:12.727043 15226 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:12.727952 15378 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:12.729682 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.730360 15232 raft_consensus.cc:2376] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15. Re-sending same reply.
I20260709 13:10:12.730783 15299 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:12.735772 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:12.740465 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:12.747750 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 167300us
I20260709 13:10:12.701020 20120 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.747954 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:12.728642 20174 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.116s	user 0.003s	sys 0.001s
I20260709 13:10:12.749333 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:12.733428 20160 raft_consensus.cc:2764] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:10:12.751147 15274 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.607s (SENT)
I20260709 13:10:12.749658 19881 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:12.743464 20112 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:12.761983 15308 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:12.760251 15226 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:12.752512 19935 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.755100 19973 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:12.765394 19973 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:12.753175 19887 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.766945 19887 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.767719 19973 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:12.758795 20121 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:12.769263 19887 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.771534 20130 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.750942 20119 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:12.776665 15348 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.785s (SENT)
I20260709 13:10:12.777398 15227 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:12.779621 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:12.781628 15198 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:12.785573 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.787571 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:12.788244 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.788548 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:12.789270 16007 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:12.763019 20112 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.794476 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.795524 15228 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:12.798627 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:12.799404 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.802233 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.790s (SENT)
I20260709 13:10:12.782070 19887 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.780440 19973 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.804760 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.807365 15227 raft_consensus.cc:2376] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15. Re-sending same reply.
I20260709 13:10:12.777683 20121 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.798005 19575 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:12.783973 19881 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:12.814170 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 2.082s (SENT)
I20260709 13:10:12.780386 19935 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.811195 20158 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:12.793105 20120 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:12.815896 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.816766 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.817832 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:12.806499 20119 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:12.806350 19887 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.787572 20141 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:10:12.820722 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.824877 15230 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:12.825413 20176 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:12.773675 20128 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:12.833850 20121 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:12.839294 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:12.844678 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.852901 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.855681 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.805088 20112 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.897931 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:12.898694 15379 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.899302 19887 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.798727 20169 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:12.841797 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.900898 15299 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.862823 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.853667 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.877744 20122 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.844434 19878 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.804013 20104 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:12.905134 20104 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.854066 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.906996 15232 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:12.907163 19878 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:12.907647 15379 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:12.840495 20158 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.907982 20104 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:12.864513 19881 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.908996 20158 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.853399 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.911552 15229 raft_consensus.cc:2376] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:10:12.842080 19935 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:12.913578 20120 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.915196 20176 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:12.843151 19575 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.854399 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.956267 15224 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.916306 20125 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:12.916877 19657 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.900104 20119 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:12.918793 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.924750 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:12.926731 15299 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:12.927064 15379 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.932170 15306 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:12.953939 20169 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:12.938395 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:12.967814 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:12.976545 15231 raft_consensus.cc:2376] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:10:12.982743 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:12.983899 15229 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:12.990626 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:12.992892 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 178739us
I20260709 13:10:12.999334 15224 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
W20260709 13:10:12.993758 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 2.092s (SENT)
W20260709 13:10:13.003737 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 217432us
I20260709 13:10:12.955117 20176 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.004102 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.006340 15380 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:13.004662 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.960554 20125 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:13.005921 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67682.2us
I20260709 13:10:13.007807 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:12.863941 20170 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:12.988161 20122 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:13.018780 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.020918 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.016554 19878 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:13.021580 15224 raft_consensus.cc:2376] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11. Re-sending same reply.
I20260709 13:10:13.003497 20179 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:13.023479 20179 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:13.023947 20179 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.033356 15307 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:13.035254 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.044874 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.042486 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.047657 15232 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:13.047796 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.012156 20130 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.042025 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.041433 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.013906 19887 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:13.057410 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.058148 15225 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:13.044529 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.058981 15233 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:13.059072 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.059942 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.057508 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.060724 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.061592 15230 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:13.046198 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.050542 15224 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:13.064611 15227 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:13.064900 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.048849 20122 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:13.065716 15224 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.066118 20122 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.050964 20163 raft_consensus.cc:2764] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:13.051802 20125 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.070375 20125 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.034216 20170 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.054150 20179 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:13.074347 20179 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:13.049327 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.075871 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:13.076604 19575 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.077587 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.055737 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:13.056730 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63005.7us
W20260709 13:10:13.079422 15348 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.676s (SENT)
I20260709 13:10:13.079721 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.079850 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.066498 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.080282 19935 raft_consensus.cc:2764] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:13.080826 15224 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.081081 19935 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.081645 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.081758 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.082825 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.082921 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.063617 19887 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:13.083777 15224 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.048758 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:13.084010 19887 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.085635 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.086898 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:13.088553 20160 raft_consensus.cc:2764] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:13.088809 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.080111 20163 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:13.091068 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.089768 15229 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:13.090381 15233 raft_consensus.cc:2368] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:13.090989 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.088100 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.072263 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.090296 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.084076 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.081135 15348 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:13.034932 20184 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:10:13.020076 20141 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:10:13.014729 19805 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:13.107416 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.108453 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.110117 15226 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.112035 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.034210 20087 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:13.088894 20180 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:13.117681 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.117923 15233 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:13.126421 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.125247 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.127148 15224 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:13.103516 19935 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:13.122140 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.123307 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.128551 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.130637 15226 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.130677 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.131932 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.131798 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.133276 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.133798 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.100263 20171 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.113188 19878 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:13.116936 15348 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.785s (SENT)
I20260709 13:10:13.136615 15233 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:13.140602 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.138509 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.126223 20087 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:13.154031 20087 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:13.155401 20170 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.145728 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.158289 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:13.121647 20163 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:13.157119 15231 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:13.165964 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:13.132822 20181 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.169884 15232 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:13.158488 19935 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:13.143362 20160 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:13.174062 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:13.180864 16007 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:13.185297 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 68405.2us
W20260709 13:10:13.186175 15348 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.821s (SENT)
I20260709 13:10:13.186697 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.188957 15230 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:13.170279 19887 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.200958 19935 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.203421 19887 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.203681 15228 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:13.184363 19973 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.117256 20119 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:13.205070 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.220304 19657 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:13.231730 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 86063.3us
W20260709 13:10:13.239511 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53389.4us
W20260709 13:10:13.240509 15348 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.866s (SENT)
I20260709 13:10:13.241003 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.243373 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:13.253435 15274 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:13.237358 19878 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:13.263175 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.238999 19657 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.257961 20160 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:13.260818 19887 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:13.279870 15348 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.577s (SENT)
I20260709 13:10:13.280699 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.284869 19878 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:13.264032 20187 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.280853 20170 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.274636 20160 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:13.290928 19973 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.313040 15306 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:13.316190 20102 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.263310 20163 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.316882 20125 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:13.316941 20102 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.294134 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.280758 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.298498 20112 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:13.279642 19887 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:13.278198 20186 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:13.301604 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 222894us
I20260709 13:10:13.309327 15308 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:13.310307 20160 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:13.339954 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48583.2us
I20260709 13:10:13.341558 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:13.341996 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:13.342191 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 62362.4us
W20260709 13:10:13.343479 15348 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.972s (SENT)
I20260709 13:10:13.344058 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.350080 20187 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.340830 19887 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.356618 20153 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:13.357247 20187 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:13.358525 20115 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:13.358922 20115 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:13.357051 15307 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:13.359823 20115 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.361366 20115 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.340879 20180 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.366485 20104 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.366901 20140 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:13.367306 20140 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:13.368031 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.368703 20179 raft_consensus.cc:2764] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:13.376870 20140 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.384059 15304 raft_consensus.cc:2368] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15.
I20260709 13:10:13.390493 20112 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:13.391788 20181 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.384526 20180 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.382128 20140 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.380206 19973 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.400456 15348 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.397365 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:13.404488 20176 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.384212 20119 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:10:13.418699 15348 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:13.427479 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 85567.2us
I20260709 13:10:13.431854 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.439234 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.433113 19973 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:13.441308 20196 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:13.441642 20104 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.443382 15273 leader_election.cc:400] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:13.443789 15273 leader_election.cc:403] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.447127 20170 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.453199 15301 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:13.454425 20176 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.468539 16007 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:13.470578 20186 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.470780 20125 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:13.472015 20125 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:13.472434 20125 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:13.472549 20102 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.424759 20169 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.473392 20125 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:13.474857 20125 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.477975 15348 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.480069 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.480906 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.480927 15376 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:13.482403 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:13.483656 15380 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:13.487558 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61073.9us
I20260709 13:10:13.487620 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:13.491026 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58503.4us
I20260709 13:10:13.492545 15376 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:13.493048 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.493605 15274 leader_election.cc:400] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:13.494587 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.500425 15305 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:13.502166 15373 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:13.509191 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:13.509539 20104 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.510478 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:13.509584 19973 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.512287 19713 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:13.512759 19713 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.513104 19713 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.485271 19878 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.517266 20102 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:13.519481 15305 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:13.512007 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.512053 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:13.520722 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:13.521317 15305 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.504839 20176 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.523447 15348 leader_election.cc:400] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:13.532823 15348 leader_election.cc:403] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.523484 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:13.533972 15305 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:13.524237 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:13.535456 15303 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:13.523377 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:13.536633 15300 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:13.535514 20186 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:10:13.543097 19887 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.548280 15301 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:13.550203 15303 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:10:13.536795 15274 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.559193 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:13.559193 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.561074 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.562122 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.562927 15380 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:13.562729 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.526945 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:13.564333 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.564764 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.565346 15380 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.566031 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.567096 15379 raft_consensus.cc:2393] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.522166 20163 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.522918 19878 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.571975 15303 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:13.569463 19973 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.581704 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.582485 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.583416 15379 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.583707 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:13.584586 20179 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:13.585062 20179 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:13.585872 20180 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.586011 20179 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.588406 20104 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:13.582613 19935 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.589022 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:13.590948 20187 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:13.591594 20187 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:13.591718 20115 raft_consensus.cc:2764] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:13.592595 20104 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:13.592973 20187 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.593961 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:13.594818 20104 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:13.595340 20104 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:13.596287 20104 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.605183 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.580695 20186 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:13.607609 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.608949 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:13.525319 20160 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.566435 20200 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.610255 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.606761 20115 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:13.610963 20188 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:10:13.616918 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.611781 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.619575 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.615792 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:13.612907 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:13.623483 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.622817 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.628058 15224 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.631491 15379 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:13.575105 20153 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:13.658870 19713 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.663007 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:13.663928 15999 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.646219 15224 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:13.646340 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.640250 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.650669 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.644816 20102 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:10:13.639804 19881 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:13.665759 15379 raft_consensus.cc:2393] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:10:13.666218 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53393.4us
I20260709 13:10:13.669730 19713 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.675410 19887 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.677085 19881 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.679590 20122 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:13.680409 20122 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:13.681373 20122 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.682933 20122 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.680007 19881 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.667809 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.635326 19657 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:13.645284 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:13.697649 15226 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.694820 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.698176 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.695931 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:13.699164 15299 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:13.699043 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.701298 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:13.702783 20171 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.702875 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.703532 15377 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.703677 15378 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:13.705720 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.711565 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:13.714560 15226 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:13.714391 15999 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:13.702255 15196 leader_election.cc:400] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15.
I20260709 13:10:13.732641 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:13.718700 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:13.755030 15381 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:13.718214 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.664775 19878 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:13.745317 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.751716 15196 leader_election.cc:403] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.716190 16007 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:13.697250 19657 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.723464 20171 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.704510 20115 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.759743 20169 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:13.691782 19992 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.742511 20186 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:13.807569 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 113828us
W20260709 13:10:13.808801 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 90706.7us
I20260709 13:10:13.814006 19657 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.817261 16007 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:13.818594 20179 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:13.819643 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74406.2us
I20260709 13:10:13.840184 19805 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.848206 15226 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:13.765693 20087 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:10:13.808573 20120 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15.
I20260709 13:10:13.858107 15377 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:13.891652 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46758.9us
I20260709 13:10:13.895744 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:13.838732 20176 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:13.837569 20169 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:13.892762 20171 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.842406 19935 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.851287 19992 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.958501 15302 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:13.959658 19992 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.892310 19881 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:13.961462 15228 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:13.820464 15126 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.917975 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:13.974161 20169 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:10:13.975205 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57321.8us
I20260709 13:10:13.918279 20176 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:13.918820 20187 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:13.976313 19887 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.924417 20140 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:10:13.976836 20176 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:13.891511 19805 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:13.977413 19887 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:13.933241 20160 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:13.977846 20176 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:13.975835 20169 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.979786 19805 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:13.981911 15274 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:13.984686 20200 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:13.985246 20200 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:13.986198 20200 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:13.999070 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:14.000378 19935 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:14.000955 19935 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:14.001977 19935 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.030611 19657 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.036265 15126 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.040570 20155 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:14.039356 15126 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:14.061621 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 220791us
I20260709 13:10:14.063201 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:14.053794 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 213112us
I20260709 13:10:14.070274 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:14.081653 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 375958us
I20260709 13:10:14.083775 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.098475 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:14.120674 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 276184us
I20260709 13:10:14.124856 19657 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:14.130208 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:14.121475 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:14.085254 19878 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:14.087064 19805 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.119529 19992 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:14.143234 20188 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:14.168582 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.142850 20158 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.060648 20155 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.144467 19713 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:14.191421 16007 raft_consensus.cc:2410] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:10:14.188824 20122 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.505s	user 0.016s	sys 0.003s
W20260709 13:10:14.161685 15300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.007s
W20260709 13:10:14.200026 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 116357us
I20260709 13:10:14.206115 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:14.200929 20115 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:14.203112 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81754.6us
I20260709 13:10:14.211511 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.207644 20215 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:14.233376 15299 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:14.235006 15300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.011s	sys 0.007s
I20260709 13:10:14.235227 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:14.236164 15305 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.241289 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:14.244477 15303 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:14.181221 19992 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.253196 20213 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.183254 20158 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.291468 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:14.259238 15377 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:14.260790 15378 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:14.292213 15228 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:14.262107 15376 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:14.257423 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.242755 20199 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:14.187132 19713 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.262035 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:14.182375 19878 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.259649 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:14.364369 15381 raft_consensus.cc:2368] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:14.299567 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.326392 15379 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:14.359510 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:14.360776 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.369171 19973 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:14.369823 19973 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:14.370838 19973 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.374068 19992 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.298179 20213 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.376935 20213 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.288812 20120 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.377758 20120 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:14.363178 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 101229us
I20260709 13:10:14.258459 20188 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:14.381507 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:14.382216 15303 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:10:14.382257 20188 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:14.260028 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54054.6us
I20260709 13:10:14.332707 20155 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.300455 19887 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.384953 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:14.380065 20120 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.242872 20200 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:14.386394 20155 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.386806 20155 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:14.387200 20155 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.388767 19713 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.396495 20171 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.397467 15305 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:14.397265 20171 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.399514 20171 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:14.300501 20215 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:10:14.400153 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56607.7us
I20260709 13:10:14.401157 20215 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.406258 15381 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:14.409631 15381 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:10:14.410995 20212 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.321s	user 0.000s	sys 0.003s
I20260709 13:10:14.411618 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:14.412456 15375 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:14.415695 20200 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:14.415333 15126 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 9 to 12, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.416319 20200 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.417891 15126 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.420686 20200 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:14.259018 20176 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:14.424814 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:14.426019 16007 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:14.426369 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 126885us
I20260709 13:10:14.427762 20211 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:14.428800 20211 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:14.428871 20176 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.429291 20211 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.429171 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.420331 15126 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 9 to 14, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:14.434085 15381 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:14.440692 15229 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:14.441027 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:14.446102 15226 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:14.448633 15224 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:14.427897 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.399711 15379 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:14.456590 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:14.460196 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:14.461325 15224 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:14.462455 15227 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:14.468693 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.469573 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.471240 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:14.480721 15228 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:14.481742 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:14.477725 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:14.536098 15226 raft_consensus.cc:2376] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11. Re-sending same reply.
I20260709 13:10:14.461453 19887 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.492002 20165 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:14.499105 15230 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:14.496687 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:14.461125 20219 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.538252 20165 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.544307 20165 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.499604 20156 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.545749 20156 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.501580 19992 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.548820 20217 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.218s	user 0.003s	sys 0.000s
I20260709 13:10:14.549592 20156 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:14.502637 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:14.550629 20122 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:14.507135 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:14.551198 20122 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:14.487350 20087 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.552129 20122 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.552681 20087 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.553228 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:14.554131 15226 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:14.555083 20087 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.482720 19935 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.487025 20160 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:10:14.460270 20222 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:14.487347 20186 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:14.540992 19968 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:14.540885 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44577.9us
I20260709 13:10:14.548657 19992 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.565600 20155 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.506031 20221 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.550786 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48265.5us
I20260709 13:10:14.508458 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:14.572110 20221 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.573136 20219 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.572700 15130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 194) took 21625 ms (client timeout 15000 ms). Trace:
I20260709 13:10:14.527972 19805 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.566666 19992 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.579770 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:14.580667 15232 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.584919 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:14.560946 20200 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:14.590143 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:14.567364 19968 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.568904 20119 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.592193 16001 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:14.601568 15232 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:14.591815 16003 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:14.602083 15227 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:14.605546 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:14.606462 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 133126us
I20260709 13:10:14.577939 20222 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:14.623958 15230 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:14.575413 15130 rpcz_store.cc:269] 0709 13:09:52.983506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.992635 (+  9129us) service_pool.cc:224] Handling call
0709 13:10:14.572551 (+21579916us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:11.904467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:11.905263 (+   796us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:11.905321 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:10:11.905342 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:11.906618 (+  1276us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.906747 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.906773 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:10:12.040814 (+134041us) tablet.cc:701] Row locks acquired
0709 13:10:12.040871 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:10:12.041060 (+   189us) write_op.cc:270] Start()
0709 13:10:12.041253 (+   193us) write_op.cc:276] Timestamp: P: 1783602612040988 usec, L: 0
0709 13:10:12.041294 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:10:12.042127 (+   833us) log.cc:844] Serialized 4801 byte log entry
0709 13:10:12.587232 (+545105us) op_driver.cc:464] REPLICATION: finished
0709 13:10:12.818353 (+231121us) write_op.cc:301] APPLY: starting
0709 13:10:12.818527 (+   174us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:12.834447 (+ 15920us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:12.834627 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:13.146883 (+312256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:13.147280 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:10:13.147324 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:13.147774 (+   450us) log.cc:844] Serialized 113 byte log entry
0709 13:10:13.147988 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.148146 (+   158us) write_op.cc:454] Released schema lock
0709 13:10:13.148220 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:13.148831 (+   611us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.148859 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26965,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":193877,"apply.run_cpu_time_us":20059,"apply.run_wall_time_us":349818,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54239,"num_ops":12,"prepare.queue_time_us":115504,"prepare.run_cpu_time_us":18798,"prepare.run_wall_time_us":212206,"raft.queue_time_us":163797,"raft.run_cpu_time_us":20438,"raft.run_wall_time_us":210041,"replication_time_us":521972,"thread_start_us":417845,"threads_started":4,"wal-append.queue_time_us":107231,"wal-append.run_cpu_time_us":12706,"wal-append.run_wall_time_us":1978994}]]}
I20260709 13:10:14.615027 20155 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.600296 19968 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:14.608458 19918 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.585587 19805 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.619526 20087 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:14.620797 20130 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:14.620908 20158 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.631652 19575 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:14.632666 20140 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:14.621311 15126 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.629251 15348 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:14.764990 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:14.629295 19918 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.636796 20130 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.453254 20130 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.600070 19881 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:10:14.736651 19968 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.479277 16008 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:14.607460 20119 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.731652 19805 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:14.628775 20200 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:10:14.736579 20186 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:14.576983 20219 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.497946 20253 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.503400 20253 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:14.735219 20176 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.540591 20176 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:15.541450 20176 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:14.736214 20211 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.545156 20211 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.545871 20211 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:14.706964 20214 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:14.728667 20221 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.548216 20214 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:14.956301 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 334272us
I20260709 13:10:15.550284 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:14.959120 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 488013us
W20260709 13:10:15.007020 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.016211 15126 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 10 to 11, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:15.017464 15299 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:15.053321 20248 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.612205 15224 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:15.557600 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:15.559183 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2448) took 1083 ms. Trace:
W20260709 13:10:15.111861 15231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.002s
W20260709 13:10:15.560281 15231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.012s	sys 0.002s
I20260709 13:10:15.561504 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2450) took 1076 ms. Trace:
W20260709 13:10:15.115846 15999 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.015s	sys 0.019s
W20260709 13:10:15.155508 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.168275 15305 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:15.174396 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 546153us
I20260709 13:10:15.566514 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:15.192625 20099 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.559752 15224 rpcz_store.cc:276] 0709 13:10:14.475611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.481431 (+  5820us) service_pool.cc:224] Handling call
0709 13:10:15.559040 (+1077609us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:15.227674 15229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.004s	sys 0.012s
W20260709 13:10:15.574198 15229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.004s	sys 0.012s
I20260709 13:10:15.239054 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.242295 20215 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.242699 20218 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.252533 20250 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:10:15.255059 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.262959 20115 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:15.345094 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:15.350883 19575 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.348223 20153 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:15.354833 19713 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.331898 20235 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.719s	user 0.007s	sys 0.000s
I20260709 13:10:15.379896 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.603368 15302 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:15.381551 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.400434 19878 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.412596 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:15.430174 15233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.012s	sys 0.034s
W20260709 13:10:15.606171 15233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.013s	sys 0.035s
W20260709 13:10:15.606271 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 193803us
I20260709 13:10:15.431248 20199 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:10:15.435016 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 808263us
I20260709 13:10:15.609659 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:15.443502 20252 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.442772 19887 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:10:15.481546 19918 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.482268 19968 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.482884 20245 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:15.488443 19973 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.632652 19973 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:15.622575 20260 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.489003 20160 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.489084 20163 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:15.636559 20260 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.637034 20163 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.489626 20238 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:15.639446 20260 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.639780 20238 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.640842 15126 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 3 to 7, term changed from 8 to 10, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 10 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.642367 20238 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:15.489892 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.643982 15304 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:15.592211 20215 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.490077 19935 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.648492 19935 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.649767 20176 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:15.651065 19935 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.491906 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.518189 20186 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.651611 20176 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:15.519258 20119 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.652182 15307 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:15.535061 20130 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.589433 20248 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.652238 20186 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.655287 20130 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.655632 20186 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:15.572007 15999 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.016s	sys 0.020s
I20260709 13:10:15.607378 19713 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.655288 20248 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.575574 15301 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:15.546446 20211 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.589618 15300 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:15.590015 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.657689 15299 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:15.570569 20102 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.601749 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2451) took 1116 ms. Trace:
I20260709 13:10:15.610721 20199 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.608645 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2391) took 1169 ms. Trace:
I20260709 13:10:15.606427 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:15.687388 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81062.3us
I20260709 13:10:15.648025 20215 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.616369 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.614862 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.599587 20158 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:15.614728 20252 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.610597 20213 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:15.600612 19575 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:15.629848 20245 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.602636 20153 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.631309 20259 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:15.635805 19973 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:15.508174 20219 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:15.592031 20218 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.561997 15231 rpcz_store.cc:276] 0709 13:10:14.484816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.485157 (+   341us) service_pool.cc:224] Handling call
0709 13:10:14.485541 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.493844 (+  8303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.493878 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.500664 (+  6786us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.560944 (+1060280us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:15.561015 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.561138 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.561211 (+    73us) raft_consensus.cc:1685] finished
0709 13:10:15.561230 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.561419 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7849,"raft.queue_time_us":11789,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":2987,"thread_start_us":999992,"threads_started":1,"wal-append.queue_time_us":182743}
I20260709 13:10:14.644104 20220 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.719494 20222 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.584611 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.788867 15305 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:15.789114 20211 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.589110 20099 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.559893 20214 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.682432 15229 rpcz_store.cc:276] 0709 13:10:14.485525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.485696 (+   171us) service_pool.cc:224] Handling call
0709 13:10:14.486148 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.496788 (+ 10640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.496839 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.497491 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.557636 (+ 60145us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b1800327be0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:15.574790 (+1017154us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:15.595901 (+ 21111us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.596597 (+   696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.596682 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.596727 (+    45us) raft_consensus.cc:1685] finished
0709 13:10:15.601510 (+  4783us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.601692 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10099,"prepare.queue_time_us":20876,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":2926,"raft.queue_time_us":11928,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":7150,"spinlock_wait_cycles":43657984,"thread_start_us":1016857,"threads_started":1,"wal-append.queue_time_us":219494}
I20260709 13:10:15.595198 20115 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.799710 20115 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.800064 20245 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.690814 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:15.691632 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.801656 15300 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:15.692528 20130 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:15.802536 20130 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.802968 20130 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:15.806556 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002db5a0 after lost signal to thread 14100
I20260709 13:10:15.640220 20260 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.809115 20260 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:15.811375 20252 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.700238 15302 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
W20260709 13:10:15.700145 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 133791us
I20260709 13:10:15.639449 20163 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:15.665886 20176 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.813434 20153 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.813762 20176 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.814721 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:15.815474 20218 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.815972 20270 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:15.705722 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:15.816562 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:15.817137 20211 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:15.778264 20253 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.610723 19878 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.818122 20253 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:15.818929 20211 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:15.819492 20211 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:15.819877 19878 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.705986 20213 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.820540 20213 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.705256 20221 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.816627 20270 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:15.824728 20221 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.825400 20270 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.827380 20221 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.687800 20102 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:15.739203 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 129598us
I20260709 13:10:15.829448 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:15.830716 20102 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.719307 20259 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:15.835723 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.836450 15231 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:15.837281 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.838006 15226 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:15.751879 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2848) took 1016 ms. Trace:
I20260709 13:10:15.703378 20200 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.719853 19805 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:15.812011 20260 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:15.748953 20186 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.738121 20257 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:15.765585 20261 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:15.766144 19713 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:15.766700 20256 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:10:15.772621 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 479) took 1195 ms. Trace:
I20260709 13:10:15.762092 19973 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:15.781237 19575 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.885345 20269 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.885987 20269 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.890667 20269 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.842298 20200 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.893496 20261 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:15.894662 20261 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.895217 20200 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:15.781605 20258 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:15.782374 20262 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.777133 20267 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.784446 20220 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.772109 20215 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.796913 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.918802 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2849) took 1183 ms. Trace:
I20260709 13:10:15.799093 15304 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:15.920614 15304 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:15.685721 15233 rpcz_store.cc:276] 0709 13:10:14.439361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.447262 (+  7901us) service_pool.cc:224] Handling call
0709 13:10:14.447626 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.498643 (+ 51017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.498686 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.500471 (+  1785us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.463697 (+963226us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4800002958. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:10:15.606637 (+142940us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:15.606685 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.606763 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.606829 (+    66us) raft_consensus.cc:1685] finished
0709 13:10:15.606840 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.608576 (+  1736us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29706,"raft.queue_time_us":30517,"raft.run_cpu_time_us":10437,"raft.run_wall_time_us":963640,"spinlock_wait_cycles":44509056,"thread_start_us":1098686,"threads_started":1,"wal-append.queue_time_us":227976}
W20260709 13:10:15.808259 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002892e0 after lost signal to thread 15165
W20260709 13:10:15.816754 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 111219us
I20260709 13:10:15.636569 20160 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.838837 15308 rpcz_store.cc:276] 0709 13:10:14.735407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.469261 (+733854us) service_pool.cc:224] Handling call
0709 13:10:15.469825 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.470164 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:15.506564 (+ 36400us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.751458 (+244894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.751523 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:15.751584 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.751653 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.751811 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34821,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":55365,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":280020,"threads_started":3,"wal-append.queue_time_us":113089}
I20260709 13:10:15.845124 20163 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:10:15.848086 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.933236 15224 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:15.849242 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.850147 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.855196 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.792052 20099 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.863696 16003 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:15.867374 15230 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:15.832728 20259 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.873749 16001 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:15.875113 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:15.878600 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:15.841513 20221 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:15.873673 20102 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.876315 15999 rpcz_store.cc:276] 0709 13:10:14.577516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.577679 (+   163us) service_pool.cc:224] Handling call
0709 13:10:14.600394 (+ 22715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:14.600628 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:15.656455 (+1055827us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.772196 (+115741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.772257 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:15.772312 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.772411 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.772541 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":226,"prepare.queue_time_us":127884,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":59,"raft.queue_time_us":108,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":2164,"thread_start_us":1168224,"threads_started":2,"wal-append.queue_time_us":153794}
I20260709 13:10:15.882035 20237 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:15.883188 19973 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.842604 20245 raft_consensus.cc:2764] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:10:15.954834 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.737744 20219 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.919332 15306 rpcz_store.cc:276] 0709 13:10:14.735708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.272421 (+536713us) service_pool.cc:224] Handling call
0709 13:10:15.273063 (+   642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.492530 (+219467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.492572 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.493224 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.509565 (+ 16341us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:15.509604 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.509678 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.918461 (+408783us) raft_consensus.cc:1685] finished
0709 13:10:15.918494 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.918706 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218998,"raft.queue_time_us":235672,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3973,"thread_start_us":15812,"threads_started":1,"wal-append.queue_time_us":43855}
I20260709 13:10:15.924080 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:15.917922 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 330031us
I20260709 13:10:15.921948 15304 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.873606 20186 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.938460 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:15.941902 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 125422us
I20260709 13:10:15.877753 20257 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:15.924278 19878 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:15.924638 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8d80 after lost signal to thread 15257
W20260709 13:10:15.975561 16029 debug-util.cc:398] Leaking SignalData structure 0x7b080028e3a0 after lost signal to thread 15258
I20260709 13:10:15.959537 15304 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.932210 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:15.959255 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:15.977412 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002db220 after lost signal to thread 15332
I20260709 13:10:15.962328 15305 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
W20260709 13:10:15.977946 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002db200 after lost signal to thread 15333
W20260709 13:10:15.979540 16029 debug-util.cc:398] Leaking SignalData structure 0x7b0800218300 after lost signal to thread 15406
W20260709 13:10:15.979849 16029 debug-util.cc:398] Leaking SignalData structure 0x7b0800037240 after lost signal to thread 15407
I20260709 13:10:15.980162 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:15.981005 15302 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:15.982756 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:15.949095 20221 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.982657 15273 leader_election.cc:400] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:15.982823 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:15.985751 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4960 after lost signal to thread 16032
W20260709 13:10:15.986231 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa7c0 after lost signal to thread 16033
I20260709 13:10:15.949261 20237 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:15.920455 20267 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.954140 20253 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.880786 20211 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.992733 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:15.933971 20215 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.991905 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.000730 15230 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:15.961066 19713 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:15.996124 15231 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:15.917377 20262 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.960728 20219 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:15.986991 20245 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:16.008288 19973 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:15.958205 20115 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.002604 20153 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.016891 20153 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.017313 20153 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.017758 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.019919 20259 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.021888 20267 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.021277 20199 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.022447 20267 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.022958 20267 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.023988 20199 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:15.987262 20248 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:16.005518 15302 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:10:16.029120 15299 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:15.987440 20221 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.989612 20222 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:15.953832 20102 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.036757 20220 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:16.037837 20252 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:16.038476 20102 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.006275 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:16.005566 19713 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.039558 20186 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.039572 19713 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.999508 20264 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:10:16.041271 20215 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:15.987515 19878 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.041903 20215 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:16.040642 20099 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:16.042773 20099 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:16.042464 20215 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.000267 20253 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.033829 20248 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.012076 20219 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.030007 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:16.038414 20252 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.043215 20099 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.035283 20222 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.035915 20257 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.029002 20273 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:15.994946 20272 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:10:16.050483 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.005328 15304 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:10:16.059053 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.036685 20115 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.045746 20259 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:16.091358 15304 pending_rounds.cc:85] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 8
I20260709 13:10:16.067258 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.093561 15299 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:16.070662 15302 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:16.064872 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.094317 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.095162 15305 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:16.090883 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.097693 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.102073 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.046547 20248 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.107249 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.096282 15304 pending_rounds.cc:107] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:10:16.111924 15304 raft_consensus.cc:2889] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.115432 19973 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:16.119171 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.120383 19968 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:16.034315 20245 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:10:16.063982 20219 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:16.135574 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:16.131767 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.133203 15229 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:10:16.133581 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 170184us
I20260709 13:10:16.138432 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.101970 20200 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:16.146152 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.133915 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.089259 20220 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:16.102173 20257 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:16.139163 15233 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:16.167363 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.092854 20259 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:16.133095 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 150353us
I20260709 13:10:16.140684 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.103190 20269 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:10:16.141940 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.174583 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.174618 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.175887 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.177116 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.172015 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.142235 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.143841 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:16.178192 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.144068 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.179180 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.101826 20115 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:16.164649 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.151051 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:16.180683 16003 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.181038 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.165645 15229 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:10:16.134061 19935 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:10:16.169127 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.169066 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.170182 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.036603 20237 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.173373 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.140895 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:16.190217 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.134797 20215 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.175724 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.197983 15233 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:10:16.199404 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.178731 15224 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.138780 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.182327 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.182735 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.180085 15379 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:16.190893 15227 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:16.202824 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.204037 20267 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.204310 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.206516 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.210387 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.210866 20262 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.211195 16000 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:16.211721 20222 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.204053 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.213297 15227 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:16.208236 15225 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:16.154768 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.192785 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.112644 20264 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:10:16.218000 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.193843 15381 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:16.172557 20211 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.171420 20220 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.222677 20220 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:16.219705 20211 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.223948 20279 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:16.224627 20279 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.226785 20279 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.227342 15381 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:16.229040 20211 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.231575 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.203641 20130 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.234179 20130 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:16.234290 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.234999 15381 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:16.113389 20199 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:10:16.238219 15973 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.505s (SENT) [suppressed 80 similar messages]
I20260709 13:10:16.239986 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.150079 20253 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.146760 20219 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.143807 19968 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:16.247676 15228 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:16.236090 20102 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.179667 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.149907 20200 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.092314 20273 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.315603 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.176152 20259 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.333411 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:16.311269 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 63677.3us
I20260709 13:10:16.327798 15381 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:16.339295 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 101106us
W20260709 13:10:16.340613 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 161007us
I20260709 13:10:16.342897 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.346601 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.343605 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.194705 20119 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:16.277777 20220 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.195132 19881 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:16.399204 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52711.7us
I20260709 13:10:16.352725 15224 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:16.333276 20200 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:16.404467 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 60946.6us
I20260709 13:10:16.195729 20260 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:16.388542 20283 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:16.343091 20130 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:16.420591 16001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:16.345603 20264 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.421869 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.465415 15375 raft_consensus.cc:2410] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:16.466581 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.464208 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:16.422780 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.404634 20119 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.424727 20286 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:16.476928 20286 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.470913 20211 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:10:16.426136 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.480172 15381 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 3.
I20260709 13:10:16.426882 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.427904 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:16.405802 20292 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:10:16.435761 20261 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:16.403695 19575 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.280414 20238 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.165s
I20260709 13:10:16.414472 20218 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:16.196197 20115 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.409437 19881 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:16.325498 20163 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.330068 20160 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:16.325119 20281 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:16.458271 16001 raft_consensus.cc:606] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:16.421663 20253 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.350613 19935 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.462476 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.423763 15374 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:16.470571 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 301588us
I20260709 13:10:16.467366 15375 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:10:16.462563 20130 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.552774 15378 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:16.465238 19713 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.481892 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:16.330418 20213 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.498385 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.571072 15381 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:16.572108 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.572645 20213 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.572777 15381 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:16.573799 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.574594 15381 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:16.575435 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.459007 20283 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.533528 20218 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.576603 20283 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:16.576884 20218 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:16.349720 20102 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.515522 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.511355 19575 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.516130 20275 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:10:16.517261 20276 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:10:16.464927 20264 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.480921 20119 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:16.473683 19878 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.538717 16003 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:16.479704 20286 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.414434 20220 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:16.549098 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 84955.1us
I20260709 13:10:16.464936 20260 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.557837 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:16.639319 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 81537.5us
I20260709 13:10:16.468355 20248 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.565441 15232 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:16.590832 19575 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.537561 19881 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.564283 20253 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.662889 20253 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.547533 20163 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.666163 20163 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:16.569437 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.666790 20260 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.667160 15378 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:10:16.668470 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.669866 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:16.670384 20222 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.670625 15377 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:16.569964 19918 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.671114 20222 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.671559 19918 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.577777 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.673343 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.579830 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:16.589237 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 149723us
I20260709 13:10:16.676187 15375 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:16.543171 20252 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.627728 16000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8218e039c251425fb97ad83094c709da"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:16.591704 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:16.635033 20264 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.542518 20211 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:16.631872 15225 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:10:16.578063 19935 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.578783 20262 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:16.577934 20130 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.636780 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:16.641104 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.564363 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.714087 15374 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:16.584415 19968 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:16.641001 20160 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:16.733372 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79195us
I20260709 13:10:16.733654 20102 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:16.737588 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.655453 20280 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.759692 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.657081 20115 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:16.657711 20287 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:10:16.780260 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.677192 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.670439 15378 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.781754 15375 raft_consensus.cc:2410] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:16.595119 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:16.782560 15230 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:16.684279 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.685266 15376 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:16.635782 15999 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:10:16.657112 20295 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:16.698838 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.706203 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.551486 20281 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.708474 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.709684 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.715924 15374 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:16.713325 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72317.5us
I20260709 13:10:16.716797 20252 consensus_queue.cc:1059] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:10:16.706012 20262 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.722942 20220 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.724833 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.727029 19887 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:16.740018 20163 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.730533 20308 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:16.739439 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.675083 20219 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:16.673367 20222 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:16.742661 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:16.745291 15305 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:16.747197 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.749362 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:16.822551 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 97842.2us
I20260709 13:10:16.822834 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.752144 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.765556 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.823495 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.656435 20199 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:16.713119 20221 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.002s
W20260709 13:10:16.886242 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54500.4us
I20260709 13:10:16.777200 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.727670 20283 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.786382 16000 raft_consensus.cc:606] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:16.790373 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.903906 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.803503 20237 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:16.807163 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.905169 15376 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:16.907794 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.809839 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:16.706755 20211 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:16.826597 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.890749 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.891892 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.895484 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:16.694914 20284 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.134s
I20260709 13:10:16.904366 16000 raft_consensus.cc:614] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:16.793125 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.910386 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.816838 20262 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.910908 15378 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:16.911871 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:16.916887 15301 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
W20260709 13:10:16.941485 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 264934us
W20260709 13:10:16.943068 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49753.2us
I20260709 13:10:16.815467 19887 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:16.982671 16007 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 16: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:16.954528 15300 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:16.935434 15376 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:16.951457 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.990682 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.984028 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.933043 20282 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:16.992275 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.993577 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.981352 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.902666 20115 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:16.818113 20160 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:16.923401 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:16.974408 15230 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
W20260709 13:10:16.991044 20301 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:16.996759 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.945649 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.940690 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.997828 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.924049 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.997176 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:16.986608 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:17.006130 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 182701us
I20260709 13:10:17.022904 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.023133 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.977329 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:17.024278 15230 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:17.025446 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:17.026077 15230 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.784482 20280 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.999495 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.995110 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:17.028860 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:16.986131 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:16.940645 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:17.027309 20176 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.204s	user 0.008s	sys 0.007s
I20260709 13:10:17.057284 20176 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.027884 20160 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:16.911490 20221 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.081857 19973 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.082173 15303 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:16.932453 20220 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:10:16.888041 20219 raft_consensus.cc:3055] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:17.095031 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 95716us
I20260709 13:10:16.906828 20199 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.064975 20253 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:17.085145 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 161248us
I20260709 13:10:17.091511 15301 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:16.902076 20163 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:17.083051 19713 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:16.939769 20252 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:10:17.084867 19935 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.098208 19887 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.089149 20156 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.099603 15305 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:17.124274 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 101467us
I20260709 13:10:17.126958 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.096726 15306 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:17.104588 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:17.103261 20218 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.002s
W20260709 13:10:17.108654 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 128559us
I20260709 13:10:17.109293 15381 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:17.109297 15228 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:17.115481 15227 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:17.142905 19918 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.106573 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.145654 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:16.934167 20296 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.215s
I20260709 13:10:17.090855 20211 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:17.091080 15302 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:17.156235 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.147408 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.141027 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:17.105538 20278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.010s	sys 0.021s
I20260709 13:10:17.149480 20253 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.155122 20158 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:17.095609 20219 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:17.136683 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:17.117591 20284 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.158747 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.126195 19935 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:17.136626 20115 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.162617 20238 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:17.144587 20153 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.127s	user 0.011s	sys 0.005s
W20260709 13:10:17.185194 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46416.2us
I20260709 13:10:17.154735 19878 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:10:17.205495 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49355.7us
I20260709 13:10:16.995168 19968 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.182603 15307 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 7.
I20260709 13:10:17.196002 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:17.197001 15224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.025s	sys 0.043s
I20260709 13:10:17.206861 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:17.207432 15224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.026s	sys 0.044s
I20260709 13:10:17.187613 15305 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.189745 15380 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:10:17.172139 20303 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:10:17.195860 15345 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:17.177970 20099 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.086s	user 0.011s	sys 0.002s
W20260709 13:10:17.246435 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50515.1us
W20260709 13:10:17.182951 20278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.010s	sys 0.021s
I20260709 13:10:17.180575 19918 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:17.260453 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64716.7us
I20260709 13:10:17.261735 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.168015 20248 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.210278 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.250509 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:17.182706 19881 consensus_meta.cc:287] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.004s
I20260709 13:10:17.174783 20283 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.178265 20221 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.189035 20211 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:17.182956 20222 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.182953 20281 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:17.179590 20280 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:17.184283 20158 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.259714 19918 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:17.254068 19575 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.000s
W20260709 13:10:17.263195 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 265437us
I20260709 13:10:17.243821 20253 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:17.205391 19935 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.279883 20282 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:17.259850 20099 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.279764 19881 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.293354 20297 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:17.294066 15305 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:17.250324 20199 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:17.245106 20284 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.252632 19805 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.145467 20218 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.175979 20130 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.204603 20153 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.175391 20163 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.188747 20238 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.275489 20252 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.266832 20275 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.315128 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:17.363584 20264 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.000s
W20260709 13:10:17.391139 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76178.2us
I20260709 13:10:17.392385 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:17.396471 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.334640 20304 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:17.401247 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 191059us
I20260709 13:10:17.339775 15233 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:17.339998 20119 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.695s	user 0.012s	sys 0.000s
I20260709 13:10:17.341634 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:17.345203 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.315905 20158 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:17.317269 19918 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.313263 20211 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.251796 20176 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:17.318061 20253 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:17.346810 20259 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.948s	user 0.015s	sys 0.000s
I20260709 13:10:17.340274 20099 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.346735 20284 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.349247 20282 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:17.338783 19881 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.353892 19805 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:17.319124 19575 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.298609 20219 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.360591 20297 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:10:17.497982 20310 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.342s	user 0.000s	sys 0.002s
I20260709 13:10:17.554325 15305 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:17.399613 20200 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.928s	user 0.007s	sys 0.007s
I20260709 13:10:17.515475 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.545306 19973 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.555387 20200 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.555953 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.557104 15300 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:17.557193 20325 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:17.557575 20284 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.557876 20325 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.558398 20325 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.557221 19805 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.560544 20253 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:17.561483 19575 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.403334 20264 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.563398 15299 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:17.564888 20324 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:17.565793 20297 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.566906 20259 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:17.567368 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.568259 15304 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:17.568503 20324 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.568871 20282 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.558368 20200 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.569057 20325 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.570312 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.570545 20259 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:17.572114 20325 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:17.403163 20317 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:17.509321 20313 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.356s	user 0.000s	sys 0.002s
I20260709 13:10:17.587426 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:17.430944 20199 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:17.401654 20304 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.573779 19881 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:17.585503 20318 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:10:17.525511 20296 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.545627 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 149374us
I20260709 13:10:17.638320 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2829) took 1117 ms. Trace:
I20260709 13:10:17.638674 20296 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.639631 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:17.640779 20317 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:17.640828 20160 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.641351 20317 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:17.530072 20218 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:17.641804 20317 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:17.641772 20160 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:17.642913 20160 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:17.638952 15373 rpcz_store.cc:276] 0709 13:10:16.520774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.057408 (+536634us) service_pool.cc:224] Handling call
0709 13:10:17.081250 (+ 23842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.125687 (+ 44437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.125719 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.168965 (+ 43246us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.317191 (+148226us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:17.317239 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.317329 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.638024 (+320695us) raft_consensus.cc:1685] finished
0709 13:10:17.638047 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.638248 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33593,"raft.queue_time_us":38025,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":10639,"thread_start_us":146097,"threads_started":1,"wal-append.queue_time_us":218837}
I20260709 13:10:17.643348 20160 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:17.644203 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.645838 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.641965 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:17.647655 20200 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:17.648141 20200 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:17.648607 20200 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.649937 20273 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:17.651897 19973 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:17.652653 19973 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.655165 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 427) took 1095 ms. Trace:
I20260709 13:10:17.655615 15999 rpcz_store.cc:276] 0709 13:10:16.559470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.559688 (+   218us) service_pool.cc:224] Handling call
0709 13:10:16.635484 (+ 75796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.785576 (+150092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.654899 (+869323us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400118fd0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:17.655087 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96281984}
I20260709 13:10:17.576103 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:17.658131 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82103.6us
W20260709 13:10:17.573026 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 228709us
I20260709 13:10:17.598960 15301 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.599998 20199 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:17.564949 20264 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.604329 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2371) took 1175 ms. Trace:
I20260709 13:10:17.607165 19935 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.608865 20130 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.610616 20153 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.574980 20119 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.617259 20304 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.618494 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:17.623059 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:17.691226 15302 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:17.617576 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 597603us
I20260709 13:10:17.576612 20324 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:17.589040 20316 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:10:17.629949 20262 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
I20260709 13:10:17.662552 20199 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:17.575798 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:17.661132 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.663040 15377 rpcz_store.cc:276] 0709 13:10:16.429486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.737204 (+307718us) service_pool.cc:224] Handling call
0709 13:10:16.737647 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.738103 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.738137 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:16.738671 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.820159 (+ 81488us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:16.820204 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.820289 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.604023 (+783734us) raft_consensus.cc:1685] finished
0709 13:10:17.604063 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.604253 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":348,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":81077,"threads_started":1,"wal-append.queue_time_us":352485}
I20260709 13:10:17.663599 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.684921 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:17.692842 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 277295us
I20260709 13:10:17.692920 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:17.662380 20273 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.681383 20218 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:10:17.719074 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58040us
I20260709 13:10:17.719209 15301 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:17.681012 20221 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.723124 15226 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:17.723884 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.725396 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:17.739899 15232 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:17.726949 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65264.1us
I20260709 13:10:17.740650 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:17.741206 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.683632 20259 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.744545 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.745522 15374 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.745421 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.742508 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:17.732081 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.750373 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.751899 15306 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:17.748533 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:17.760129 15302 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:17.728571 20176 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.732935 20325 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.734197 20153 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.768857 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:17.688903 19805 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.702641 20264 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:10:17.690169 20269 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:10:17.781203 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.781232 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:17.781279 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:17.680370 20160 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.726117 20272 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:10:17.808837 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:17.754714 20130 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.770761 20220 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:17.740317 20218 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.785804 20275 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.794399 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:17.835289 15302 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:17.835717 15225 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:17.803174 15231 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:17.803295 15374 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:17.793259 20273 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.785606 20267 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:10:17.854776 20267 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:17.855387 20267 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:17.835036 20275 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.857478 20275 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.805137 15232 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:17.806391 15228 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:17.807320 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:17.762431 19935 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:17.765625 20215 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.745005 20211 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:10:17.814292 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:17.771597 20176 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:17.776296 20248 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.750213 20221 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.787045 16001 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:17.758432 20259 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:17.833561 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61363.2us
I20260709 13:10:17.720742 20262 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.796638 20324 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.838485 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.868705 20334 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.840140 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.875809 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2827) took 1414 ms. Trace:
I20260709 13:10:17.904237 15378 rpcz_store.cc:276] 0709 13:10:16.461453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.945469 (+484016us) service_pool.cc:224] Handling call
0709 13:10:16.945850 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.005588 (+ 59738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.005650 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.625241 (+619591us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b2c00083318. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:10:17.625846 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.704878 (+ 79032us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:17.737016 (+ 32138us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.749374 (+ 12358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.749515 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.869520 (+120005us) raft_consensus.cc:1685] finished
0709 13:10:17.875399 (+  5879us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.875696 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103369,"prepare.queue_time_us":36974,"prepare.run_wall_time_us":44,"raft.queue_time_us":94504,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":9869,"spinlock_wait_cycles":44543488,"thread_start_us":78593,"threads_started":1,"wal-append.queue_time_us":184501}
I20260709 13:10:17.906935 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.908128 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:17.889029 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127144us
I20260709 13:10:17.804898 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:17.909910 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.911130 15378 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.869673 20160 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.868611 19935 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.931095 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.932703 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.934844 15305 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:17.887977 15999 raft_consensus.cc:606] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:17.938330 15999 raft_consensus.cc:614] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.939356 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:17.914856 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 74817.4us
I20260709 13:10:17.913769 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.941772 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.949942 15382 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:17.899559 20324 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.904513 20273 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:17.953433 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.956519 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.949575 15305 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:17.834653 20220 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.885115 20176 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.961784 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.955439 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.929225 20215 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.959621 15378 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:17.930944 20248 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:17.961529 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:17.951169 19881 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.969156 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.964393 15196 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:17.888664 19805 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.957283 20339 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:17.953810 20153 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.957788 20273 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:17.974221 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.957999 20324 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.978763 20259 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:17.978969 19887 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.980860 20200 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:17.958799 20325 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.000857 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2842) took 1434 ms. Trace:
I20260709 13:10:17.928527 20334 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:18.005115 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43693.9us
I20260709 13:10:17.968755 20283 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.970207 20312 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:17.971166 20269 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:17.972071 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:17.965895 20335 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:17.966918 20323 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.001806 20215 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.931499 20267 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.960815 20211 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:17.998519 20336 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:18.015151 20200 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.044554 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:17.984694 20248 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:18.046700 20220 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.046561 20248 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:17.986567 20153 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.048631 20153 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.023407 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:18.053397 20333 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:18.054105 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.055572 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:18.002509 15378 rpcz_store.cc:276] 0709 13:10:16.566295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.999401 (+1433106us) service_pool.cc:224] Handling call
0709 13:10:17.999908 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.000159 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.000201 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.000262 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:18.000312 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.000565 (+   253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.000767 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.040642 20273 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.057057 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.057515 20273 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:18.007107 20330 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:10:18.060305 20267 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.061452 20312 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:18.062777 20312 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.066116 20186 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:18.066707 20186 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:18.066826 20306 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.974601 20158 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.034291 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:18.011780 20119 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.061563 19713 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:18.070015 15232 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:18.073961 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2414) took 1519 ms. Trace:
I20260709 13:10:18.029255 20269 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:18.083077 15224 rpcz_store.cc:276] 0709 13:10:16.554354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.561089 (+  6735us) service_pool.cc:224] Handling call
0709 13:10:16.561530 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.654841 (+ 93311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.654884 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:16.680592 (+ 25708us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.208247 (+527655us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:17.208397 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.073455 (+865058us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b540009cc54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:18.073520 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.073580 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:18.073599 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.073880 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14706,"raft.queue_time_us":90046,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":179613056,"thread_start_us":513713,"threads_started":1,"wal-append.queue_time_us":646664}
I20260709 13:10:18.077569 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 945) took 1487 ms. Trace:
W20260709 13:10:18.058892 20325 consensus_queue.cc:1175] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:18.075881 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 944) took 1485 ms. Trace:
I20260709 13:10:18.088940 15377 rpcz_store.cc:276] 0709 13:10:16.590200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.074919 (+1484719us) service_pool.cc:224] Handling call
0709 13:10:18.075303 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.075509 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.075535 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.075581 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:18.075623 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.075684 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.075814 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.092010 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 946) took 1465 ms. Trace:
I20260709 13:10:18.092864 15377 rpcz_store.cc:276] 0709 13:10:16.627215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.090249 (+1463034us) service_pool.cc:224] Handling call
0709 13:10:18.090680 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.091649 (+   969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.091676 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.091722 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:18.091752 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.091813 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.091944 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.095960 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 947) took 1461 ms. Trace:
I20260709 13:10:18.096900 15377 rpcz_store.cc:276] 0709 13:10:16.634459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.094716 (+1460257us) service_pool.cc:224] Handling call
0709 13:10:18.095326 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.095597 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.095636 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.095697 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:18.095728 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.095779 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.095903 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.067852 20336 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:18.067808 19619 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:18.073992 19918 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 13:10:18.086675 15374 rpcz_store.cc:276] 0709 13:10:16.590590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.076378 (+1485788us) service_pool.cc:224] Handling call
0709 13:10:18.076834 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.077085 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.077125 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.077205 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:18.077269 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.077345 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.077481 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.024250 20284 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:18.041443 20279 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:10:18.113864 19918 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.115749 20284 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:18.110970 20158 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.116730 20269 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.118336 20269 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.103019 20218 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.035493 20335 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.067734 20186 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.087927 19935 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.081585 20323 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:18.099299 20130 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:17.990877 20339 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.110216 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 949) took 1426 ms. Trace:
I20260709 13:10:18.144832 15374 rpcz_store.cc:276] 0709 13:10:16.689226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.109145 (+1419919us) service_pool.cc:224] Handling call
0709 13:10:18.109540 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.109754 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.109784 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.109842 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:18.109879 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.109951 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.110129 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.126377 20186 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:18.127686 20257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.006s	sys 0.011s
I20260709 13:10:18.134478 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2843) took 1546 ms. Trace:
I20260709 13:10:18.154146 15378 rpcz_store.cc:276] 0709 13:10:16.588569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.058448 (+1469879us) service_pool.cc:224] Handling call
0709 13:10:18.058802 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.059050 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:18.109847 (+ 50797us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.133704 (+ 23857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.133785 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:18.133844 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.133936 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.134265 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2159,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":73381,"threads_started":2}
I20260709 13:10:18.111176 20221 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.088543 19713 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.108498 20297 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:18.146932 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.127775 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 948) took 1462 ms. Trace:
I20260709 13:10:18.135082 20199 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.164561 15377 rpcz_store.cc:276] 0709 13:10:16.645452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.103958 (+1458506us) service_pool.cc:224] Handling call
0709 13:10:18.107486 (+  3528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.107707 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.107736 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.107782 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:18.107841 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.107901 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.108044 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:18.155745 20257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.007s	sys 0.012s
I20260709 13:10:18.141134 20262 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:18.164216 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:18.173740 15378 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:18.142369 20218 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:18.163921 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 128531us
I20260709 13:10:18.164196 20335 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.149773 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.158857 19968 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:18.168198 20334 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.153234 20158 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:18.191665 20253 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.003s
I20260709 13:10:18.211089 20253 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.111564 19619 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.172376 19918 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.216928 19619 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:18.217494 20304 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.003s
I20260709 13:10:18.218252 20304 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.218847 15373 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:18.220413 20296 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.152917 20130 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.223330 20130 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.214079 20253 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:18.184453 20248 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:18.228228 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2469) took 2082 ms. Trace:
I20260709 13:10:18.228055 20248 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.228734 15227 rpcz_store.cc:276] 0709 13:10:16.145640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.213982 (+ 68342us) service_pool.cc:224] Handling call
0709 13:10:16.214400 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.142681 (+928281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.227910 (+1085229us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54000dded4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:18.228155 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071307136}
I20260709 13:10:18.230928 20248 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.186403 20218 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.234849 20218 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.237565 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:18.238404 15302 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:18.239403 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.240018 15302 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.187078 20284 consensus_queue.cc:1059] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:10:18.242205 15381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 952) took 1459 ms (client timeout 1862 ms). Trace:
I20260709 13:10:18.186312 20336 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.209486 20199 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.210111 20158 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.246271 20158 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.249958 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:18.250969 20158 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:18.251744 20158 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:18.251595 19968 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.253294 20158 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.254714 19968 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:18.242237 20257 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.261899 20257 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.238404 20339 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:18.207589 15304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2216) took 2125 ms (client timeout 2187 ms). Trace:
W20260709 13:10:18.265472 15304 rpcz_store.cc:269] 0709 13:10:16.081946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.131318 (+ 49372us) service_pool.cc:224] Handling call
0709 13:10:18.207316 (+2075998us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003e17d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.207494 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3258846080}
I20260709 13:10:18.266973 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.170086 20297 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:18.242755 15381 rpcz_store.cc:269] 0709 13:10:16.782975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.789553 (+  6578us) service_pool.cc:224] Handling call
0709 13:10:18.242010 (+1452457us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540023fad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.242138 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286689664}
I20260709 13:10:18.268597 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.269568 20297 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.270416 15304 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:18.272236 15303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 664) took 2333 ms (client timeout 1721 ms). Trace:
W20260709 13:10:18.272732 15303 rpcz_store.cc:269] 0709 13:10:15.938334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.938578 (+   244us) service_pool.cc:224] Handling call
0709 13:10:18.271977 (+2333399us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540017a054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.272110 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548196608}
I20260709 13:10:18.273896 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:18.206043 19713 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.277314 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:18.227092 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.278590 15305 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.278854 20218 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:18.279621 20218 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.279835 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2232) took 1499 ms. Trace:
I20260709 13:10:18.280252 20218 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.281014 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2484) took 1582 ms. Trace:
I20260709 13:10:18.281411 15233 rpcz_store.cc:276] 0709 13:10:16.698870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.699684 (+   814us) service_pool.cc:224] Handling call
0709 13:10:16.700211 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.556934 (+856723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.280775 (+723841us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54000e74d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:18.280950 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470187392}
I20260709 13:10:18.283906 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2244) took 1347 ms. Trace:
I20260709 13:10:18.284322 15306 rpcz_store.cc:276] 0709 13:10:16.936768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.146888 (+210120us) service_pool.cc:224] Handling call
0709 13:10:17.147341 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.754892 (+607551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.283640 (+528748us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54003dc7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:18.283839 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1389852544}
I20260709 13:10:18.285840 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.287142 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:18.288142 20304 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.290227 19973 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.293562 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.295194 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.280289 15299 rpcz_store.cc:276] 0709 13:10:16.780465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.905421 (+124956us) service_pool.cc:224] Handling call
0709 13:10:16.905926 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.563901 (+657975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.279490 (+715589us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b540006f254. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:18.279735 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511342976}
I20260709 13:10:18.305609 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.201920 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:18.315876 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:18.316723 15378 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:18.317559 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:18.321018 15379 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 8. Ops: []
I20260709 13:10:18.316795 15306 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
W20260709 13:10:18.324100 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.327143 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.327458 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:18.329406 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.173228 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 950) took 1463 ms. Trace:
W20260709 13:10:18.566129 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.509351 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:18.457717 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:18.348696 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.556664 15308 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:18.544296 15382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2845) took 1954 ms (client timeout 1531 ms). Trace:
I20260709 13:10:18.379230 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:18.330224 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:18.459398 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:18.573659 15374 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.497766 15228 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:18.446368 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:18.572080 15377 rpcz_store.cc:276] 0709 13:10:16.710278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.168522 (+1458244us) service_pool.cc:224] Handling call
0709 13:10:18.172701 (+  4179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.172883 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.172899 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.172932 (+    33us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:18.172961 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.173001 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.173160 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.445843 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:18.577590 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:18.354609 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 152821us
I20260709 13:10:18.577623 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2480) took 1880 ms. Trace:
I20260709 13:10:18.579288 15226 rpcz_store.cc:276] 0709 13:10:16.697419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.699124 (+  1705us) service_pool.cc:224] Handling call
0709 13:10:16.699388 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.739099 (+1039711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.577376 (+838277us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003c19d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:18.577558 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340607744}
W20260709 13:10:18.505461 15307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2877) took 1558 ms (client timeout 1594 ms). Trace:
W20260709 13:10:18.572688 15382 rpcz_store.cc:269] 0709 13:10:16.589507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.591333 (+  1826us) service_pool.cc:224] Handling call
0709 13:10:18.543924 (+1952591us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003c3a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.544179 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2814342400}
W20260709 13:10:18.556592 15300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2883) took 1602 ms (client timeout 1880 ms). Trace:
W20260709 13:10:18.582765 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.583278 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.487082 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:18.494068 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.524911 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.495049 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.586462 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.587121 15302 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:18.459259 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2374) took 1683 ms. Trace:
W20260709 13:10:18.582195 15300 rpcz_store.cc:269] 0709 13:10:16.954345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.993299 (+ 38954us) service_pool.cc:224] Handling call
0709 13:10:18.555993 (+1562694us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54003e30d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.556265 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294088960}
I20260709 13:10:18.521963 15348 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:18.580813 15307 rpcz_store.cc:269] 0709 13:10:16.947162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.951057 (+  3895us) service_pool.cc:224] Handling call
0709 13:10:18.505173 (+1554116us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54003e44d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.505362 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440707968}
I20260709 13:10:18.579068 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:18.493578 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:18.403805 20317 consensus_meta.cc:287] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.761s	user 0.014s	sys 0.000s
I20260709 13:10:18.250384 20238 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.508026 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:18.518994 20342 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
W20260709 13:10:18.655547 20309 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.574s	user 0.000s	sys 0.009s
W20260709 13:10:18.652329 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73363.4us
I20260709 13:10:18.595732 16007 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 16: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:18.592660 15302 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:18.591826 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:18.653411 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2901) took 1351 ms. Trace:
I20260709 13:10:18.654063 20264 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:18.655067 20238 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:18.360399 19713 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:18.391909 20115 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:18.602391 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 223311us
I20260709 13:10:18.653818 20317 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.301250 20257 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.507375 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:18.395959 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:18.599071 20278 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:18.400509 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:18.731431 15999 raft_consensus.cc:606] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:18.440788 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:18.736115 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.736553 20336 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.599823 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.738057 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.571413 15303 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.739152 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.739694 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.433629 20153 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.740314 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:18.741048 15231 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.742743 20153 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:18.743287 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.605616 15373 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:18.600644 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:18.594854 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:18.745887 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:18.746582 15228 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:18.558480 19887 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.001s
I20260709 13:10:18.587260 15299 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:18.715410 20238 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.752002 20238 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:18.509032 20344 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.260s	user 0.003s	sys 0.000s
I20260709 13:10:18.675861 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.682847 15307 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:18.350617 20275 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.333536 15305 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:18.687301 15306 rpcz_store.cc:276] 0709 13:10:17.301815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.651928 (+1350113us) service_pool.cc:224] Handling call
0709 13:10:18.652405 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.652631 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.652658 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.652705 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:18.652739 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.652816 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.653334 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.469893 20283 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.588478 15379 rpcz_store.cc:276] 0709 13:10:16.776078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.241125 (+1465047us) service_pool.cc:224] Handling call
0709 13:10:18.317655 (+ 76530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.321534 (+  3879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.459036 (+137502us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b5400080550. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.459193 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175029632}
I20260709 13:10:18.623533 15304 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:18.417341 20349 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:10:18.803197 15228 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:18.804129 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:18.653414 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 131613us
I20260709 13:10:18.702941 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:18.805929 15373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 2852) took 1528 ms (client timeout 1828 ms). Trace:
W20260709 13:10:18.806437 15373 rpcz_store.cc:269] 0709 13:10:17.277595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.645513 (+367918us) service_pool.cc:224] Handling call
0709 13:10:18.805744 (+1160231us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b540027b5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.805864 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316254464}
I20260709 13:10:18.806934 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:18.578253 19968 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.810503 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.439935 20282 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:18.700734 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:18.466399 20219 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:18.708896 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2828) took 2224 ms. Trace:
I20260709 13:10:18.702272 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:18.816598 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 114441us
I20260709 13:10:18.589331 19973 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:10:18.721625 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 325755us
I20260709 13:10:18.822113 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:18.650532 15233 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 16: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:18.822528 15299 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8.
I20260709 13:10:18.722018 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.709901 19713 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:18.783313 20299 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.410728 20176 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.726138 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.726430 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.848923 15224 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.664688 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2242) took 1728 ms. Trace:
I20260709 13:10:18.850805 15308 rpcz_store.cc:276] 0709 13:10:16.936012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.087254 (+151242us) service_pool.cc:224] Handling call
0709 13:10:18.556363 (+1469109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.571241 (+ 14878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.664269 (+ 93028us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003e30d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.664585 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3377700096}
I20260709 13:10:18.404109 20158 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.303s
W20260709 13:10:18.758795 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 261810us
I20260709 13:10:18.760068 15231 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:18.402593 20324 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:18.761965 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 216688us
I20260709 13:10:18.689152 20339 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:18.765384 15303 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:18.695693 20335 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:18.782040 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.456409 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:18.866443 15307 raft_consensus.cc:2368] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:10:18.793421 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:18.763039 20356 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:10:18.806135 15302 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:18.662899 20346 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:18.807771 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.611083 20302 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:18.706051 20284 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:10:18.712616 20264 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.867030 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:18.874653 15373 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:18.873831 15306 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.875795 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:18.867784 15305 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:18.832042 19713 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:18.825094 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:18.664916 20273 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:18.861058 20269 consensus_meta.cc:287] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.742s	user 0.016s	sys 0.000s
I20260709 13:10:18.827351 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.828840 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.814855 15376 rpcz_store.cc:276] 0709 13:10:16.484572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.018801 (+534229us) service_pool.cc:224] Handling call
0709 13:10:18.243549 (+1224748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.258417 (+ 14868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.258455 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.258959 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.500870 (+241911us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:18.589666 (+ 88796us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.589939 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.590042 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.590091 (+    49us) raft_consensus.cc:1685] finished
0709 13:10:18.590106 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.708619 (+118513us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540023fad0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:18.708809 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14376,"prepare.queue_time_us":97811,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":53,"raft.queue_time_us":15464,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":64539,"spinlock_wait_cycles":2793958272,"thread_start_us":189356,"threads_started":1,"wal-append.queue_time_us":182864}
I20260709 13:10:18.827634 15377 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:18.793073 20317 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.831643 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.839121 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2900) took 1556 ms. Trace:
I20260709 13:10:18.895659 15381 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:18.897620 15232 raft_consensus.cc:2393] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:18.840066 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:18.764549 20278 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.901399 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:18.903219 20278 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:18.826397 20153 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.903623 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.851585 15224 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:18.855718 15231 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:18.730780 15374 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:18.826550 20238 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:18.844578 20299 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.831801 20336 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.833537 20267 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.792948 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:18.823480 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 122831us
I20260709 13:10:18.811936 20283 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.880257 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:18.942408 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62302.8us
I20260709 13:10:18.883033 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.884971 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2501) took 1076 ms. Trace:
I20260709 13:10:18.890869 15379 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:18.945297 15373 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:18.824960 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:18.947000 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 122185us
W20260709 13:10:18.849578 20265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.007s	sys 0.018s
I20260709 13:10:18.883563 20220 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.828537 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:18.958155 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 129808us
I20260709 13:10:18.961480 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:18.894363 15301 rpcz_store.cc:276] 0709 13:10:17.283256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.909921 (+626665us) service_pool.cc:224] Handling call
0709 13:10:17.910681 (+   760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.973810 (+ 63129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.973843 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.987025 (+ 13182us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.129104 (+142079us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:18.129156 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.129239 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.508189 (+378950us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:18.830660 (+322471us) raft_consensus.cc:1685] finished
0709 13:10:18.830701 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.839010 (+  8309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81056,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":172,"spinlock_wait_cycles":117138304,"thread_start_us":203881,"threads_started":2,"wal-append.queue_time_us":198486}
I20260709 13:10:18.963442 15301 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:18.832736 19973 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:18.906431 20359 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:18.821306 19968 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:18.838593 20272 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:10:18.912139 15230 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:18.861500 15226 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:18.830648 20282 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:18.983265 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.925302 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:18.938766 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:18.985287 15374 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:18.949604 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:18.987605 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:18.953616 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:18.883678 20304 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:18.994133 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:19.017215 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.947436 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.884366 20273 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.967716 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.965761 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:19.041503 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 75896.8us
I20260709 13:10:19.041656 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:19.042397 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:18.970686 15301 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:18.976397 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:18.957098 20265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.007s	sys 0.019s
I20260709 13:10:19.073320 19887 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:19.074108 20265 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:19.074568 20272 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:19.076690 15382 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:19.078661 15377 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:19.080329 15376 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:18.923529 20238 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.881263 20335 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:18.939177 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:18.945043 15229 rpcz_store.cc:276] 0709 13:10:17.808024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.078464 (+270440us) service_pool.cc:224] Handling call
0709 13:10:18.078942 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.083380 (+  4438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.083413 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.084002 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.329712 (+245710us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:18.329825 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.329944 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.884489 (+554545us) raft_consensus.cc:1685] finished
0709 13:10:18.884513 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.884876 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":13912,"thread_start_us":76015,"threads_started":1,"wal-append.queue_time_us":88801}
I20260709 13:10:18.961310 20153 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:18.960196 20312 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:18.971776 20269 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:18.954843 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57762.4us
I20260709 13:10:19.003574 20299 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:19.004846 19973 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:19.007639 19968 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:18.994504 20353 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.972853 20317 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:18.998584 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:19.112650 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 114184us
I20260709 13:10:19.113957 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:19.011773 19918 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.015019 20304 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:18.947765 20358 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:10:18.918991 20284 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.046147 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2849) took 1772 ms. Trace:
I20260709 13:10:19.046231 15374 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:19.121250 15381 rpcz_store.cc:276] 0709 13:10:17.273689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.307440 (+1033751us) service_pool.cc:224] Handling call
0709 13:10:18.331461 (+ 24021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.904654 (+573193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.045889 (+141235us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540012acd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:19.046078 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296839936}
I20260709 13:10:18.868683 20339 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.070642 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:18.990869 20336 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.073051 15379 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:19.082289 15377 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:10:19.088114 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 148900us
W20260709 13:10:19.126130 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55663.7us
I20260709 13:10:19.095806 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2867) took 1066 ms. Trace:
I20260709 13:10:19.096524 15375 raft_consensus.cc:2410] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:10:19.072633 20357 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:10:19.133713 15375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 951) took 2413 ms (client timeout 1989 ms). Trace:
I20260709 13:10:18.986209 20267 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:10:19.134496 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2847) took 1861 ms. Trace:
I20260709 13:10:19.135320 20267 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:19.135546 15378 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:10:19.135589 20339 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:19.043251 20273 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.137418 20304 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:19.134263 15375 rpcz_store.cc:269] 0709 13:10:16.748602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.805249 (+ 56647us) service_pool.cc:224] Handling call
0709 13:10:17.515255 (+710006us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:10:19.133362 (+1618107us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001fde54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:19.133579 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3551690752}
W20260709 13:10:19.085004 20186 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.924s	user 0.011s	sys 0.005s
I20260709 13:10:19.135020 15380 rpcz_store.cc:276] 0709 13:10:17.272827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.296208 (+1023381us) service_pool.cc:224] Handling call
0709 13:10:18.308965 (+ 12757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.313067 (+  4102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.313103 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.313697 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.766216 (+452519us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:18.803262 (+ 37046us) log.cc:844] Serialized 14 byte log entry
0709 13:10:18.810314 (+  7052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.810410 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.134232 (+323822us) raft_consensus.cc:1685] finished
0709 13:10:19.134256 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.134421 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3459,"prepare.queue_time_us":37238,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":30156,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":83383,"thread_start_us":395323,"threads_started":1,"wal-append.queue_time_us":554146}
I20260709 13:10:19.140849 20186 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:19.141352 20186 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:19.142308 20186 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.143967 20186 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.097759 20158 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:19.118811 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 364261us
I20260709 13:10:18.989275 15299 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:10:19.147507 15299 pending_rounds.cc:85] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 4
I20260709 13:10:19.147867 15299 pending_rounds.cc:107] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:19.148255 15299 raft_consensus.cc:2889] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.100571 20153 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:19.094834 19713 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.126744 15373 rpcz_store.cc:276] 0709 13:10:18.029067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.043188 (+1014121us) service_pool.cc:224] Handling call
0709 13:10:19.095012 (+ 51824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.095290 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.095327 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.095390 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:19.095436 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.095511 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.095715 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.127401 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:19.173203 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45925.1us
I20260709 13:10:19.117619 20306 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.128793 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:19.118870 20353 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.129878 20219 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:19.102653 20312 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:19.195225 20312 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:19.131076 20350 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.927s	user 0.000s	sys 0.006s
I20260709 13:10:19.131584 20324 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:19.136072 15378 pending_rounds.cc:85] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 6
I20260709 13:10:19.197253 15378 pending_rounds.cc:107] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:19.197630 15378 raft_consensus.cc:2889] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.090987 20238 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.198242 20353 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:19.134574 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2251) took 1352 ms. Trace:
I20260709 13:10:19.120831 20221 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.199924 15300 rpcz_store.cc:276] 0709 13:10:17.781869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.679210 (+897341us) service_pool.cc:224] Handling call
0709 13:10:18.694373 (+ 15163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.990335 (+295962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.990375 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.990428 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:18.990459 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.134324 (+143865us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54002c2c54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:19.134372 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.134520 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680049408}
I20260709 13:10:19.103320 20275 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:19.162284 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.168726 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54906.2us
I20260709 13:10:19.174155 20220 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.189600 20283 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:19.189783 19713 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:19.190421 15225 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:19.190716 20339 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.191241 20153 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:19.190798 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62152.9us
I20260709 13:10:19.192586 20335 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:19.192942 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2914) took 1112 ms. Trace:
I20260709 13:10:19.249202 15306 rpcz_store.cc:276] 0709 13:10:18.081017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.789537 (+708520us) service_pool.cc:224] Handling call
0709 13:10:18.789984 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.882101 (+ 92117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.192604 (+310503us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b540017a554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:19.192862 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192169216}
I20260709 13:10:19.144600 20284 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:19.148797 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:19.199498 20115 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.246183 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:19.251890 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 103343us
I20260709 13:10:19.199795 20264 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:19.258826 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:19.251950 20284 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:19.264833 20353 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.271107 20115 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.277472 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:19.283002 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 458000us
I20260709 13:10:19.293159 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:19.278745 15377 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
W20260709 13:10:19.288301 20262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.039s	user 0.006s	sys 0.017s
I20260709 13:10:19.279960 20335 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.257690 20339 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.300021 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:19.306149 20262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.006s	sys 0.017s
I20260709 13:10:19.297120 20264 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:19.336265 20264 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:19.336786 20264 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.335139 20284 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.304251 20275 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.325714 20269 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:19.324254 20223 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:19.295661 20346 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:19.341918 20284 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.324271 20272 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:19.310925 20339 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.387809 20339 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:19.389192 20346 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:19.437209 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 484145us
I20260709 13:10:19.211390 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:19.442229 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:19.453890 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 391819us
W20260709 13:10:19.458098 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 246696us
I20260709 13:10:19.459537 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:19.461953 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:19.480872 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:19.306159 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 205945us
W20260709 13:10:19.484678 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.485963 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 184233us
W20260709 13:10:19.360401 20218 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.079s	user 0.012s	sys 0.006s
I20260709 13:10:19.515240 19713 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:19.517421 20282 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:19.517721 20269 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.525027 20218 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.525596 20273 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.527262 15228 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:19.360222 20223 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.533263 20223 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:19.515605 20186 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:19.535494 20278 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:19.537549 15345 leader_election.cc:400] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:10:19.538038 15345 leader_election.cc:403] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:10:19.545678 20186 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.548465 20275 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:19.548962 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68555.8us
I20260709 13:10:19.549259 20275 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:19.550611 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:19.551496 20221 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:19.501360 20339 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.518808 20282 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.497455 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:19.554183 20218 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:19.579087 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 81926.1us
I20260709 13:10:19.581001 20377 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:19.584777 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 102772us
I20260709 13:10:19.554343 20278 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:19.598088 19973 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:19.598934 19973 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:19.600726 20304 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:19.530814 20272 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:19.603323 20176 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:19.604861 20306 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:19.614456 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 83767.9us
I20260709 13:10:19.586818 20186 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.631825 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:19.633941 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:19.635602 15224 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:19.636766 20346 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:19.616912 19713 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:19.637468 15226 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.615221 20273 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:19.637363 20278 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.657912 20278 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:19.646930 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 96522.2us
I20260709 13:10:19.639835 20375 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:10:19.641381 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:19.617120 20221 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:19.642905 19973 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.637712 20346 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.626271 20365 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.628834 20304 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:19.692915 20365 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:19.693858 20380 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 13:10:19.694120 20304 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.630475 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2431) took 1003 ms. Trace:
W20260709 13:10:19.696266 20381 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.051s	user 0.001s	sys 0.001s
I20260709 13:10:19.696789 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 833) took 1214 ms. Trace:
I20260709 13:10:19.700537 15225 rpcz_store.cc:276] 0709 13:10:18.482039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.482198 (+   159us) service_pool.cc:224] Handling call
0709 13:10:18.482542 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.240681 (+758139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.680144 (+439463us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54001c6954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:19.696561 (+ 16417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627467136}
I20260709 13:10:19.703039 20221 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.707336 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:19.709052 20267 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.709632 20383 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
I20260709 13:10:19.714382 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:19.714902 19918 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.596s	user 0.014s	sys 0.009s
W20260709 13:10:19.659124 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63919.6us
W20260709 13:10:19.661070 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45724us
I20260709 13:10:19.668249 19887 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:19.668874 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 956) took 1724 ms. Trace:
I20260709 13:10:19.673023 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 839) took 1179 ms. Trace:
I20260709 13:10:19.674289 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:19.675320 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:19.678320 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.679170 19973 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.687045 20346 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:19.689929 20299 consensus_queue.cc:1175] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5c70ddb5aae14b059dc90fd40125b034" responder_term: 15 status { last_received { term: 15 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 15 index: 13 } }
I20260709 13:10:19.690640 20222 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:19.720438 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.673285 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48342.9us
I20260709 13:10:19.648789 20317 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:19.673033 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:19.726704 15227 rpcz_store.cc:276] 0709 13:10:18.493874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.494230 (+   356us) service_pool.cc:224] Handling call
0709 13:10:18.494571 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.010233 (+515662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.010271 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.010317 (+    46us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:19.010351 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.672414 (+662063us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54001c7854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:19.672541 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.672769 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185107712}
I20260709 13:10:19.715512 19918 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:19.697578 15228 rpcz_store.cc:276] 0709 13:10:18.627487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.810179 (+182692us) service_pool.cc:224] Handling call
0709 13:10:19.630068 (+819889us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54003c2dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:19.630321 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642933504}
I20260709 13:10:19.698553 20115 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:19.726320 15378 rpcz_store.cc:276] 0709 13:10:17.944162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.324876 (+380714us) service_pool.cc:224] Handling call
0709 13:10:19.134901 (+810025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.198156 (+ 63255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.668423 (+470267us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54001fde50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:19.668655 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861920512}
I20260709 13:10:19.766875 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:19.726104 19887 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:19.697348 20186 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:19.773525 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84110.7us
I20260709 13:10:19.780597 19918 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:19.772639 15229 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:19.782755 19918 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:19.783334 19918 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:19.710103 20267 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.785053 15126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 97) took 7196 ms. Trace:
I20260709 13:10:19.785015 19918 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.786887 20267 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:19.787273 19918 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:19.787662 20267 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:19.759439 20317 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:19.753912 20222 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:19.789825 20317 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.790249 20222 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.791391 20317 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.791708 20222 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.793251 20275 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.795320 20275 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:19.755594 20365 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:19.829847 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:19.831542 15300 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:19.832176 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:19.833456 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:19.835654 15304 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:19.833567 15307 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:19.838214 15226 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:19.845718 15300 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.648931 19713 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.859547 19887 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.861369 19887 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:19.777933 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 103215us
I20260709 13:10:19.878522 20176 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.879786 20176 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:19.883400 20176 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:19.898550 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 118386us
I20260709 13:10:19.966042 20222 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:19.966466 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 113603us
I20260709 13:10:19.967501 20222 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:19.981712 15300 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:19.924021 20267 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.918545 20223 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:19.981269 20222 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:10:19.988270 20238 consensus_meta.cc:287] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.789s	user 0.011s	sys 0.018s
I20260709 13:10:19.956974 20186 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:19.999601 15307 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:19.961311 20365 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:20.008792 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.011722 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:20.014389 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 212382us
W20260709 13:10:20.017107 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.018548 20264 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.010s
I20260709 13:10:20.018348 20363 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:20.018836 20222 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.019346 20264 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.020830 20222 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.021275 20186 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.022303 20264 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.027967 20365 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.018421 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.024078 20186 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:20.032984 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48880.7us
I20260709 13:10:19.997599 20238 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.041411 20284 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:20.043972 15304 raft_consensus.cc:2410] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:20.045595 20238 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.049003 15303 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:20.049984 20223 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.050590 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2933) took 1189 ms. Trace:
I20260709 13:10:20.051062 15303 rpcz_store.cc:276] 0709 13:10:18.860841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.892380 (+ 31539us) service_pool.cc:224] Handling call
0709 13:10:20.050277 (+1157897us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400186ad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:20.050486 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446866688}
I20260709 13:10:19.785677 15126 rpcz_store.cc:276] 0709 13:10:12.588774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.602717 (+ 13943us) service_pool.cc:224] Handling call
0709 13:10:12.883942 (+281225us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:19.784737 (+6900795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:15.960745 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:16.123485 (+162740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:16.129015 (+  5530us) write_op.cc:435] Acquired schema lock
0709 13:10:16.134611 (+  5596us) tablet.cc:662] Decoding operations
0709 13:10:16.430771 (+296160us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:16.430870 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:16.430916 (+    46us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:10:16.436855 (+  5939us) tablet.cc:701] Row locks acquired
0709 13:10:16.436875 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:10:16.437163 (+   288us) write_op.cc:270] Start()
0709 13:10:16.437375 (+   212us) write_op.cc:276] Timestamp: P: 1783602616436973 usec, L: 0
0709 13:10:16.437398 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:16.438254 (+   856us) log.cc:844] Serialized 3601 byte log entry
0709 13:10:17.635594 (+1197340us) op_driver.cc:464] REPLICATION: finished
0709 13:10:17.833251 (+197657us) write_op.cc:301] APPLY: starting
0709 13:10:17.833403 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:18.121921 (+288518us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:18.122053 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:18.274286 (+152233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:18.274566 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:10:18.274609 (+    43us) write_op.cc:312] APPLY: finished
0709 13:10:18.274915 (+   306us) log.cc:844] Serialized 89 byte log entry
0709 13:10:18.275158 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:18.275302 (+   144us) write_op.cc:454] Released schema lock
0709 13:10:18.275358 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:18.275797 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:18.275831 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":615339,"reported_tablets":14,"spinlock_wait_cycles":322778368,"child_traces":[["op",{"apply.queue_time_us":197224,"apply.run_cpu_time_us":21247,"apply.run_wall_time_us":442593,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41711,"num_ops":9,"prepare.queue_time_us":150182,"prepare.run_cpu_time_us":43306,"prepare.run_wall_time_us":595525,"raft.queue_time_us":316724,"raft.run_cpu_time_us":37745,"raft.run_wall_time_us":130560,"replication_time_us":1197791,"thread_start_us":486622,"threads_started":4,"wal-append.queue_time_us":397164,"wal-append.run_cpu_time_us":18645,"wal-append.run_wall_time_us":2389041}]]}
W20260709 13:10:20.061758 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.062481 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.062656 20283 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.068861 19713 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:20.036563 20257 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.075953 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.041467 20353 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:10:20.085291 20284 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:20.086056 20284 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:20.087394 20284 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:20.088755 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48038.3us
W20260709 13:10:20.089200 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46414.9us
I20260709 13:10:20.089419 20346 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:20.063491 20283 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:20.107808 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.093991 20353 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:20.127446 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.128564 15303 raft_consensus.cc:2376] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 8. Re-sending same reply.
I20260709 13:10:20.131410 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.138084 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.139540 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:20.140769 20389 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:10:20.141827 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.142426 20273 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.143610 20273 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:20.144464 20222 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:20.145649 20365 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:20.151630 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:20.152452 15230 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:20.152521 15374 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:20.154173 15378 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:20.072890 20257 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.157420 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:20.158931 15229 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:20.160205 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:20.160358 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:20.162051 20257 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.162765 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.163143 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:20.163614 15378 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:20.164806 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.157529 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.152550 19887 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.170310 15230 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:20.112824 20353 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:10:20.191893 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.193343 15226 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
W20260709 13:10:20.200987 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57263.4us
I20260709 13:10:20.148660 20272 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:20.219161 15303 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:20.233891 15378 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:10:20.234794 15378 pending_rounds.cc:85] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 8
I20260709 13:10:20.251880 15374 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:20.252192 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.254681 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.240628 15378 pending_rounds.cc:107] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:10:20.257042 15378 raft_consensus.cc:2889] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.246547 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:20.270363 15227 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:20.272503 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.280911 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.249521 20267 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:20.283085 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.283689 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.289945 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:20.288995 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49269us
I20260709 13:10:20.296429 15303 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:20.296025 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.298022 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.299273 20317 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.301584 15375 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:20.280579 20339 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:20.306946 15228 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:20.307937 15227 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:10:20.281292 19973 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.521s	user 0.014s	sys 0.000s
I20260709 13:10:20.317600 15233 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:20.311604 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.321147 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.321472 15299 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:20.322810 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:20.322971 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:20.311053 20275 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.515s	user 0.019s	sys 0.001s
I20260709 13:10:20.328708 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:20.334043 20394 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:10:20.334264 15127 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 9, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.336097 19713 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:20.337311 19713 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:20.337904 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 142119us
I20260709 13:10:20.340081 19713 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.340778 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.343039 20284 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:20.345772 20283 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.281970 20272 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.351624 15224 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:20.355160 15304 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:20.356012 15307 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:20.357724 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.346696 19973 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.367962 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:20.378563 20397 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:10:20.378981 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:20.380134 20214 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:20.346983 20267 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:20.382091 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 181398us
W20260709 13:10:20.391130 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 95810.9us
I20260709 13:10:20.374159 20339 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.397338 15375 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:20.353140 20353 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:20.416018 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 165430us
I20260709 13:10:20.416811 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:20.420034 20353 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.407130 15127 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 12, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 12 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.435746 20248 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.436578 20248 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.439507 20248 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.441252 20273 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:20.442117 20273 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.444594 20275 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.445247 20275 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.451663 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:20.460155 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 180762us
I20260709 13:10:20.464233 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:20.453222 19887 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:20.469040 20115 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.469290 19887 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:20.470479 19887 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:20.473075 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.481673 19619 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:20.422904 20269 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:20.486569 20272 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.452059 20365 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:20.489661 20115 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:20.490213 20115 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:20.491313 20115 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.493928 20115 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:20.451900 20346 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:20.496542 20267 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:20.497570 20267 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:20.500118 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70002.3us
I20260709 13:10:20.501325 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.497869 20346 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.452742 20273 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:20.448092 20275 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:20.515937 15224 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:20.517179 20269 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:20.501868 20267 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:20.518271 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:20.519354 15230 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:20.515990 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.511410 15225 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:20.522001 20363 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:20.522728 20223 consensus_queue.cc:1059] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:20.522982 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.523557 20358 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:20.523854 15307 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:20.524176 20401 raft_consensus.cc:3055] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:20.507372 19619 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:20.524725 20223 raft_consensus.cc:993] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:10:20.523384 20363 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:20.564918 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.525771 19619 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:20.566728 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.573544 15307 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:20.507380 15127 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.507721 15375 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:20.524730 20401 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:20.531585 20264 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:20.533020 20339 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:20.533802 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82379.3us
I20260709 13:10:20.535115 19918 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:20.536283 20272 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:20.536789 20306 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:20.508136 20346 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:20.538125 20238 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:20.524065 20358 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:20.540302 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:20.541249 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.542047 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:20.605139 15373 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:10:20.542514 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:20.605772 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79764.8us
I20260709 13:10:20.544193 15304 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:20.542557 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.546222 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.547503 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.548702 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:20.551301 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:20.608683 15228 raft_consensus.cc:606] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:20.609249 15299 raft_consensus.cc:2410] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:20.555117 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:20.602766 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.609653 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.608175 15374 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:20.557138 20297 raft_consensus.cc:1081] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:10:20.557315 15308 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:20.557878 19968 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:20.559376 15302 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:20.559438 20214 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:20.561667 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:20.520282 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:20.577611 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 162919us
I20260709 13:10:20.578075 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.587000 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:20.580371 15377 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:20.542979 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.607824 15381 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:20.557464 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.618039 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.618510 20358 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:20.619369 20339 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:20.593645 20363 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:20.614928 20283 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:20.636981 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:20.624354 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 82400.6us
W20260709 13:10:20.630805 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44856.4us
I20260709 13:10:20.638203 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.625231 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.633610 15380 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:20.638541 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.641259 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.621533 20214 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:20.642011 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:20.642410 20214 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:20.642042 15306 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:20.643462 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.643688 20339 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.621678 15307 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:10:20.644320 15300 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:20.644662 20269 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:20.630278 20363 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:20.645885 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.646544 15374 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:20.647589 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.631044 20365 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.618346 20401 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:20.655692 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.656831 15381 raft_consensus.cc:2410] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:20.624806 20346 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.629068 15363 tablet_service.cc:1558] Processing DeleteTablet for tablet 362d7a17088a4e86a51428b5ee97346e with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:43900
I20260709 13:10:20.658042 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.656884 20273 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:20.651337 15127 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.658176 20346 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.659478 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.622014 20257 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:20.662946 20257 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:20.663561 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.664409 20401 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:20.664155 20257 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.636373 20284 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:20.666376 20257 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:20.666424 20284 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.667057 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.672823 15375 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:20.659874 20297 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:20.643497 20214 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:20.668140 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.662353 15381 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:20.678572 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.671016 20304 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:20.620316 20358 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.664410 15303 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:20.680764 15373 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.680254 20267 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.676535 20273 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:20.647655 20363 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.686542 19713 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.707839 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.684990 20284 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:20.693449 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 165533us
W20260709 13:10:20.737916 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 151046us
W20260709 13:10:20.741932 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66186.5us
W20260709 13:10:20.743073 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 69863.5us
I20260709 13:10:20.742316 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:20.742018 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:20.754523 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:20.790427 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.741766 20278 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.792991 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:20.794164 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 185599us
I20260709 13:10:20.704296 20267 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:20.793946 15377 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:20.805825 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:20.795280 15380 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:20.811746 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.815881 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.817287 15230 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:20.796411 19713 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:20.822703 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68319.3us
I20260709 13:10:20.825003 19887 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.825783 19887 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.793325 20264 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:20.828441 20273 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.829797 20264 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:20.823688 20278 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:20.834197 19887 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.830744 20264 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.836463 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:20.837643 15376 raft_consensus.cc:2410] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:20.784144 20317 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:10:20.838373 20264 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.839362 20278 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:20.839720 20214 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:20.842368 20297 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:20.843986 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:20.844905 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:20.845351 19918 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:20.845896 16002 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:20.844046 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 133317us
I20260709 13:10:20.844049 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:20.851783 20153 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:20.847350 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:20.817847 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.784742 20284 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.852977 15127 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 10, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 10 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:20.882932 19918 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:20.885334 19918 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:20.883183 20408 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:20.796867 20306 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:10:20.890295 20306 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.890877 20306 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:20.913463 15377 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:10:20.914017 15377 pending_rounds.cc:85] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 6
I20260709 13:10:20.914434 15377 pending_rounds.cc:107] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:20.914736 15377 raft_consensus.cc:2889] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.862915 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.862763 20248 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:20.864655 15230 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:20.919667 15373 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:20.915964 15379 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:20.784430 20304 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:10:20.933697 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:20.934427 19713 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:20.949343 16008 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:20.956799 20416 tablet_replica.cc:333] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:10:20.958822 20416 raft_consensus.cc:2243] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.960126 20416 raft_consensus.cc:2272] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.945761 20222 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:20.963136 20222 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.965807 20222 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:20.969321 15380 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:10:20.970155 15380 pending_rounds.cc:85] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 5
I20260709 13:10:20.970773 15380 pending_rounds.cc:107] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:20.971102 15380 raft_consensus.cc:2889] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.971668 20416 ts_tablet_manager.cc:1916] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:20.976428 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.940188 20115 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:20.981936 20115 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.982607 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.983566 15300 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:20.912616 20284 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:20.986793 20284 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:20.946357 15127 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.988854 15382 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:20.982607 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.989931 15308 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
W20260709 13:10:20.979295 19973 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.007s
I20260709 13:10:20.992429 19973 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:20.979681 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.993254 20273 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:20.990497 15127 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 8, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.994908 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.991431 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:20.997200 15308 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:20.999029 15308 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:21.000800 15308 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:20.892128 20306 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.003401 20306 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.003615 15300 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:10:21.004945 15300 pending_rounds.cc:85] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 7
I20260709 13:10:21.005503 15300 pending_rounds.cc:107] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:21.003624 20115 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:21.006424 20115 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:21.008814 15300 raft_consensus.cc:2889] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:21.010351 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.011121 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.011879 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.012462 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.014165 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.014936 15229 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:21.016733 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.016777 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.019238 15305 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:21.019752 15377 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:21.020148 15377 pending_rounds.cc:85] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 5
I20260709 13:10:21.022202 15379 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:21.043854 15379 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:21.023765 15374 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:21.024556 15127 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.049414 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:21.008723 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.051204 15377 pending_rounds.cc:107] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:21.051729 15377 raft_consensus.cc:2889] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:21.079943 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.091732 15375 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:21.093178 15378 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:21.076241 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:21.056816 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.062548 15380 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:21.069377 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:21.125691 20273 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.126487 20273 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:21.128150 20418 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.421s	user 0.002s	sys 0.010s
W20260709 13:10:21.128583 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 59290.5us
I20260709 13:10:21.132587 20284 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:21.133091 20284 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.133494 20284 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.070143 20267 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.136780 20267 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.080384 20346 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:21.139434 20346 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:21.139865 20346 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:21.140988 20346 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:21.142678 20365 consensus_queue.cc:1175] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0f9eceec749442cb9a06c87f00f3caf" responder_term: 13 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:10:21.145218 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 69609.2us
I20260709 13:10:21.146142 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.147610 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.148859 20275 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:21.151245 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 275433us
I20260709 13:10:21.149777 20275 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:21.153180 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.099725 15127 catalog_manager.cc:5697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 1 to 7, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 7 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:10:21.163095 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.165159 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.052690 20401 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:21.169309 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:21.171828 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:21.174280 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 298850us
I20260709 13:10:21.174927 20238 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.157218 20365 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:21.181851 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.083600 20248 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.171341 20401 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:21.204082 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.198048 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:21.180060 20223 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:21.187348 20221 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:21.190116 20346 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:21.225096 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67013.1us
I20260709 13:10:21.179774 20238 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.193079 20275 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:21.231498 19713 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:21.293681 19713 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.212602 20223 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:21.298216 20223 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.209399 20401 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.203110 20222 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:21.301201 20222 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:21.301720 20222 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:21.195087 20248 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.268537 20257 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.305121 20257 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.306589 20248 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:21.307657 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 81187.3us
I20260709 13:10:21.308496 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:21.269284 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.309949 20282 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.310390 20282 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:21.310792 20282 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.266970 20238 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:21.275517 20221 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:21.313973 20221 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.314237 20153 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.315145 20153 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.282114 20273 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:21.287114 15233 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:21.210433 19918 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:21.269598 20365 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:21.317662 19713 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:21.308024 20257 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:21.209812 15302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:10:21.319067 15302 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.319635 15302 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.320648 20214 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:21.297467 20275 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.327334 20275 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.329501 20282 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.330860 20275 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:21.341928 20153 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:21.344201 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.345928 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:21.346138 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 197548us
I20260709 13:10:21.350416 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.385298 20248 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:21.340174 20284 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.418433 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.419942 15231 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:21.414729 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.694s (SENT) [suppressed 13 similar messages]
W20260709 13:10:21.435465 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 201703us
I20260709 13:10:21.406533 20248 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.436483 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:21.439958 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:21.375994 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57071.6us
I20260709 13:10:21.389652 15225 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:21.351824 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:21.377501 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 179663us
I20260709 13:10:21.461731 19713 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:21.467921 19713 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:21.438166 20346 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:21.442648 20248 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:21.483799 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51632.5us
I20260709 13:10:21.461694 19973 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.480305 20238 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:10:21.480428 19918 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:21.500365 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.501304 15304 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:21.499696 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:21.503736 19713 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:21.504959 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.514509 20304 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:21.449301 20257 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:21.520383 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 316401us
I20260709 13:10:21.521330 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.522639 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.525846 15308 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:21.495764 20222 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:21.541245 15302 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:21.544329 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.520577 20257 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.529760 20238 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:21.501345 20158 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:21.505709 20221 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.530686 20115 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:21.486090 20346 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.519661 20273 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.566494 20433 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:21.566385 20273 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:21.548693 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47132.2us
I20260709 13:10:21.554544 20115 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.577689 20282 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:21.548540 20431 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:21.575681 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:21.579310 20431 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.579767 20431 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.579962 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:21.581553 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:21.582363 20284 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:21.582681 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:21.583421 15306 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:21.585772 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:21.585937 20273 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:21.564261 20158 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:21.565486 20346 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:21.551604 20257 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:21.573726 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68815.3us
I20260709 13:10:21.565305 20267 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:21.575628 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.577031 15375 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:10:21.607002 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.599706 15230 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:21.599861 15305 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:21.600203 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:21.612087 15302 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:21.619434 20221 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:21.620637 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:21.622166 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.577764 20115 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.585985 20222 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:21.594313 20158 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:21.653105 19713 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:21.607550 20267 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.666579 15375 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:21.669426 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:21.675247 15378 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:21.600900 20306 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:10:21.700100 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:21.701606 19713 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:21.709856 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:21.710776 15375 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.701402 15377 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:21.713555 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 169329us
I20260709 13:10:21.714629 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.717875 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:21.680751 20267 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.661067 20221 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.734810 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.725831 19713 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:10:21.743894 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.697326 20222 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:21.645242 20431 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:21.753245 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 181442us
I20260709 13:10:21.758257 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:21.759538 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.679340 19619 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 13:10:21.774482 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 164981us
I20260709 13:10:21.775537 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:21.780820 15305 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:21.781255 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:21.782006 15381 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:21.745966 20346 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:21.745414 20284 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:21.748970 20441 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.788794 15380 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:21.796015 20365 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.798236 20365 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.726063 20401 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:21.774294 20275 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:21.815856 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 111280us
I20260709 13:10:21.821555 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:21.786379 20346 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:21.757500 20221 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:21.784082 20273 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:21.837479 20346 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.850771 15375 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:21.808706 20275 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:21.777830 20222 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.889650 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:21.897832 15305 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:21.810177 20441 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:21.895632 20446 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:10:21.880815 20275 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:21.927718 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 96098.4us
I20260709 13:10:21.884936 20450 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:21.809046 20158 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:21.948805 20222 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:21.895401 20445 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:21.962620 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 187197us
I20260709 13:10:21.969269 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:21.958065 20418 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:21.944185 20284 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.950701 20450 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:21.962318 20444 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:22.002277 20221 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:21.976142 20445 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:21.982267 20448 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.001714 20153 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:22.000945 20306 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.004992 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:21.974285 20459 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:21.985183 20450 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.983668 20443 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:22.030558 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78992.7us
I20260709 13:10:22.011226 20222 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:22.039423 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.039513 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:22.044171 20441 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:22.045643 20434 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.469s	user 0.002s	sys 0.000s
I20260709 13:10:22.053824 20438 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.054462 20438 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.055171 20438 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:22.057277 20452 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:10:22.061367 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:22.062179 15382 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:21.984200 20284 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.028434 20464 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:22.129364 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63529.9us
W20260709 13:10:22.133550 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93631.4us
W20260709 13:10:22.177953 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 419381us
I20260709 13:10:22.032716 20448 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.132979 20464 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.146380 20444 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:22.142387 20431 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.042625 20306 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.195250 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.198709 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:22.201717 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:22.178876 20462 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.131970 20388 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:10:22.209872 15229 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.185815 19619 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.212952 19713 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:22.211457 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.141927 20222 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.039570 20459 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.212498 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.042869 20443 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.175735 20461 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:10:22.218585 19713 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:22.220616 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77411.5us
W20260709 13:10:22.202898 19973 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.683s	user 0.014s	sys 0.001s
I20260709 13:10:22.223253 15231 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:22.224233 15377 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:22.224642 20475 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.237563 20480 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.237744 20475 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.238547 20480 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.198709 20464 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.226110 20421 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.229192 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:22.242307 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.231946 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.233582 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:22.231398 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.225400 20466 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.333796 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:22.336839 15377 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:10:22.209764 20365 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.310856 19713 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.310765 16008 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:22.314175 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:22.358631 15301 raft_consensus.cc:2410] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:22.335284 20158 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:22.224771 20463 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
W20260709 13:10:22.317436 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 86133.3us
I20260709 13:10:22.322717 20306 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.242677 19973 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.356536 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:22.316182 20223 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.010s	user 0.018s	sys 0.000s
I20260709 13:10:22.229941 19619 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.335425 20284 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:22.379654 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.360464 16008 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:22.335657 19918 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:22.365546 20448 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.316922 20419 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:10:22.398177 20431 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.403788 15198 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:22.412685 20442 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.422993 16000 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:22.423235 20401 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.426856 15300 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.462864 20442 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.429369 20444 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.465140 20444 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.465509 20442 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:22.467775 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 235906us
I20260709 13:10:22.468729 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.470678 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.471067 20214 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:22.483218 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.494210 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:22.220331 20462 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.501410 15380 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:22.504868 15299 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:22.370528 20115 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.709s	user 0.015s	sys 0.000s
I20260709 13:10:22.506516 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.519655 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.385878 20365 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.528425 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:22.528463 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70174.9us
I20260709 13:10:22.529593 15231 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:22.532176 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:22.544492 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 80206us
W20260709 13:10:22.544860 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 141291us
I20260709 13:10:22.546106 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:22.461556 19918 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.552001 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2958) took 1049 ms. Trace:
I20260709 13:10:22.552996 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.343840 20438 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.552522 15299 rpcz_store.cc:276] 0709 13:10:21.493326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.499256 (+  5930us) service_pool.cc:224] Handling call
0709 13:10:22.530647 (+1031391us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001d6854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:22.542803 (+ 12156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302272384}
I20260709 13:10:22.554219 15232 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:22.571880 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:22.578009 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:22.579173 15374 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:22.517051 20448 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.587699 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:22.590027 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.524925 19973 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.443030 20223 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.594839 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.596172 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:22.542869 20284 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.357383 20466 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.555938 19918 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.558416 20421 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.551750 20474 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.559894 20353 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.601251 20257 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.975s	user 0.015s	sys 0.000s
I20260709 13:10:22.585692 20461 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:22.530202 20431 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:22.632594 19713 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:22.524417 20115 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.593411 20442 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:22.635470 16002 raft_consensus.cc:2410] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:22.588019 20445 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.550321 20365 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:22.632977 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 138453us
I20260709 13:10:22.559514 20153 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:10:22.649047 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.623898 20482 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.641047 20461 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:22.664914 19713 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:22.646548 20267 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.884s	user 0.014s	sys 0.001s
I20260709 13:10:22.658206 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.662654 15378 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:22.663995 19619 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.667896 15380 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:22.614261 20284 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.613170 20448 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.656733 20273 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.636533 20353 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.672837 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:22.679774 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.681365 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.660423 20465 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:22.679334 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46965.8us
I20260709 13:10:22.664805 20475 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.682824 20472 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:22.683311 20498 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:22.682878 20481 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.721575 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63467.1us
I20260709 13:10:22.723937 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.683046 20496 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:22.634974 20474 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.641183 20257 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.675938 19713 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.686848 15231 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
W20260709 13:10:22.716102 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67153.5us
I20260709 13:10:22.718176 15229 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:22.684252 20430 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.027s	user 0.005s	sys 0.001s
I20260709 13:10:22.667501 20442 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.663966 20419 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:10:22.740375 20365 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.741755 20455 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:22.743188 20455 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:22.743525 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2917) took 1064 ms. Trace:
I20260709 13:10:22.743616 20455 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:22.668279 20461 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.671250 20267 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.713850 20465 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.745507 20284 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.746279 20267 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.746840 20465 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.747015 20238 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:22.747539 20238 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.748003 20238 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.748528 20257 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.748682 20431 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:10:22.751224 20499 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:10:22.752884 15375 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:22.753509 15307 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:22.754542 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2920) took 1070 ms. Trace:
I20260709 13:10:22.755179 15375 rpcz_store.cc:276] 0709 13:10:21.684086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.877457 (+193371us) service_pool.cc:224] Handling call
0709 13:10:21.878017 (+   560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.753521 (+875504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.754137 (+   616us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540023f0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:22.754481 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010896768}
I20260709 13:10:22.756162 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2982) took 1024 ms. Trace:
W20260709 13:10:22.757211 20471 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.401s	user 0.000s	sys 0.002s
I20260709 13:10:22.757308 20492 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:22.757901 20492 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.758401 20492 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.759248 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2911) took 1086 ms. Trace:
I20260709 13:10:22.760469 20490 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.759704 15379 rpcz_store.cc:276] 0709 13:10:21.672805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.672992 (+   187us) service_pool.cc:224] Handling call
0709 13:10:21.708115 (+ 35123us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:21.748256 (+ 40141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.748305 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:21.809857 (+ 61552us) log.cc:844] Serialized 52 byte log entry
0709 13:10:21.939699 (+129842us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:21.939773 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.939877 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.758977 (+819100us) raft_consensus.cc:1685] finished
0709 13:10:22.759001 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.759181 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3993,"raft.queue_time_us":11593,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9334,"thread_start_us":55401,"threads_started":1,"wal-append.queue_time_us":375515}
I20260709 13:10:22.763411 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.744069 15378 rpcz_store.cc:276] 0709 13:10:21.678842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.804991 (+126149us) service_pool.cc:224] Handling call
0709 13:10:21.805498 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.671680 (+866182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.743213 (+ 71533us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400224054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:22.743456 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970728320}
I20260709 13:10:22.756814 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.733771 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.700192 20222 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:22.738147 20470 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.452s	user 0.000s	sys 0.002s
I20260709 13:10:22.738402 20502 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:22.664698 20482 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.775987 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.699007 20273 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.769644 20438 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.770210 20416 ts_tablet_manager.cc:1929] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
W20260709 13:10:22.771063 20460 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:10:22.775382 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.720237 20498 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.777135 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.809018 15229 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:22.756625 15305 rpcz_store.cc:276] 0709 13:10:21.737278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.940203 (+202925us) service_pool.cc:224] Handling call
0709 13:10:21.946384 (+  6181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.037296 (+ 90912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.037353 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.041855 (+  4502us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.141933 (+100078us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:22.141969 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.142056 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.755890 (+613834us) raft_consensus.cc:1685] finished
0709 13:10:22.755913 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.756085 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29731,"raft.queue_time_us":57461,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":14869,"thread_start_us":147603,"threads_started":2,"wal-append.queue_time_us":630678}
I20260709 13:10:22.777971 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:22.776758 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:22.726022 20496 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.726976 20472 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:22.790510 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:22.791352 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:22.790925 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57315us
I20260709 13:10:22.771853 20480 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.793778 20441 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:22.793995 20473 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.392s	user 0.000s	sys 0.002s
I20260709 13:10:22.818565 20496 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:22.794780 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 70948.3us
I20260709 13:10:22.833472 20448 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.834343 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.835558 20115 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.817170 20498 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.794891 20501 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.798213 20273 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.830751 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2978) took 1198 ms. Trace:
I20260709 13:10:22.798740 20353 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.800666 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2968) took 1223 ms. Trace:
I20260709 13:10:22.735380 20388 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.762893 20459 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.810671 15227 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
W20260709 13:10:22.778923 20469 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.391s	user 0.002s	sys 0.000s
I20260709 13:10:22.819118 15299 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:10:22.782315 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44455.2us
I20260709 13:10:22.730792 20481 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.825845 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:22.852732 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:22.780117 20502 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:22.774737 20494 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.830338 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:22.823988 20450 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.003s
I20260709 13:10:22.836817 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2966) took 1297 ms. Trace:
I20260709 13:10:22.841367 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 696) took 1660 ms. Trace:
W20260709 13:10:22.849642 20497 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:10:22.843321 20448 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:22.873674 20248 consensus_meta.cc:287] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.354s	user 0.005s	sys 0.014s
W20260709 13:10:22.853492 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.852589 15307 rpcz_store.cc:276] 0709 13:10:21.577041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.585489 (+  8448us) service_pool.cc:224] Handling call
0709 13:10:22.800386 (+1214897us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540025a8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:22.800589 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683302656}
I20260709 13:10:22.845011 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.845659 15302 rpcz_store.cc:276] 0709 13:10:21.632640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.698173 (+ 65533us) service_pool.cc:224] Handling call
0709 13:10:21.729860 (+ 31687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.786093 (+ 56233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.786131 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.804743 (+ 18612us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.938844 (+134101us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:21.938885 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.938941 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.830516 (+891575us) raft_consensus.cc:1685] finished
0709 13:10:22.830535 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.830673 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76665,"raft.queue_time_us":142841,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":11688,"thread_start_us":59211,"threads_started":1,"wal-append.queue_time_us":168613}
I20260709 13:10:22.867352 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.855799 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:22.897780 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52875.6us
I20260709 13:10:22.898090 16002 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:10:22.898850 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.881481 15303 rpcz_store.cc:276] 0709 13:10:21.181090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.189758 (+  8668us) service_pool.cc:224] Handling call
0709 13:10:21.190209 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.200023 (+  9814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.200055 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.217413 (+ 17358us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.438255 (+220842us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:21.507031 (+ 68776us) log.cc:844] Serialized 14 byte log entry
0709 13:10:21.507602 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.507692 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.307472 (+799780us) spinlock_profiling.cc:243] Waited 9.07 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:22.841007 (+533535us) raft_consensus.cc:1685] finished
0709 13:10:22.841133 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.841292 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37749,"prepare.queue_time_us":189298,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":9643,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":10240,"spinlock_wait_cycles":20862720,"thread_start_us":186254,"threads_started":2,"wal-append.queue_time_us":282943}
I20260709 13:10:22.843569 20504 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.885798 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.852744 20441 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:22.906354 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:22.867947 20158 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.000s
I20260709 13:10:22.842546 20442 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.849876 20462 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:22.854341 20447 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:22.848191 20416 log.cc:1199] T 362d7a17088a4e86a51428b5ee97346e P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/362d7a17088a4e86a51428b5ee97346e
I20260709 13:10:22.884968 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:22.838627 20482 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.848752 20500 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.937937 20500 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.941476 20500 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.836210 20474 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.902932 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:22.867395 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 43778.5us
W20260709 13:10:22.951794 20464 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.005s
I20260709 13:10:22.882486 20459 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:22.887344 20450 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.952328 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:22.954728 20450 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.952373 20464 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.838642 20466 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:22.903465 16000 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 4.
I20260709 13:10:22.879770 15308 rpcz_store.cc:276] 0709 13:10:21.539781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.540047 (+   266us) service_pool.cc:224] Handling call
0709 13:10:21.540606 (+   559us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:21.679098 (+138492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.679143 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:21.708916 (+ 29773us) log.cc:844] Serialized 52 byte log entry
0709 13:10:22.135187 (+426271us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.135255 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.135362 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.836524 (+701162us) raft_consensus.cc:1685] finished
0709 13:10:22.836552 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.836745 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110853,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":34741,"thread_start_us":492223,"threads_started":2,"wal-append.queue_time_us":494375}
W20260709 13:10:22.973877 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76763.4us
I20260709 13:10:22.909227 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.902863 20248 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.979039 19918 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.979693 20248 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.980463 15224 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:22.980700 15225 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:22.905212 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:22.910676 20509 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.892649 20346 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.036s	user 0.016s	sys 0.000s
I20260709 13:10:22.878968 20502 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.899891 20490 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.917366 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:22.852941 20445 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:22.900461 20273 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.920806 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:22.921165 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.000326 15302 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
W20260709 13:10:22.998749 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 115565us
I20260709 13:10:23.001935 15302 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.986512 20346 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.985773 20509 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.002694 20273 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:22.902691 20448 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:22.841878 20455 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.005162 20273 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.005445 20448 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.005966 20455 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.006733 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:22.926684 20475 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:10:22.925773 20257 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.929096 20510 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:23.008915 20510 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.008847 20257 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.853092 20388 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.009632 20466 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:22.922960 20411 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:23.010566 20500 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.010628 20411 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.011304 20411 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:23.004200 20346 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.008527 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:23.015249 16000 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:10:23.013897 20445 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:22.930737 20416 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43900 (request call id 0) took 2303 ms. Trace:
I20260709 13:10:22.896922 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:22.905107 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.956808 15232 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:22.952585 20459 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.965232 20464 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.967957 20481 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:22.968519 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2918) took 1285 ms. Trace:
I20260709 13:10:22.969666 20441 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.969813 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.834425 20472 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.915144 20461 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.922076 20447 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:22.960685 20275 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.014s	user 0.001s	sys 0.016s
I20260709 13:10:22.956965 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:22.957835 20444 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:22.960301 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2909) took 1295 ms. Trace:
I20260709 13:10:22.955863 20513 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.975610 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:22.975674 16002 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:22.909811 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:22.986876 15303 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
W20260709 13:10:22.987358 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70055.5us
I20260709 13:10:22.915709 20504 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.009568 20510 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:23.067380 20498 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.073009 20444 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:23.000379 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 79683.4us
I20260709 13:10:23.051638 20411 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.010200 20466 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.922835 15299 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:10:23.078234 20466 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:22.942076 20492 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.057973 20437 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:23.025662 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.029646 16003 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 7.
I20260709 13:10:23.018379 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:23.036046 15373 rpcz_store.cc:276] 0709 13:10:21.682761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.806261 (+123500us) service_pool.cc:224] Handling call
0709 13:10:21.806746 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.326361 (+519615us) spinlock_profiling.cc:243] Waited 934 us on lock 0x7b18002a07c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b1ebfb 00007f2f53b2964b
0709 13:10:22.326534 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.326562 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.327152 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.824794 (+497642us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.826290 (+  1496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.826411 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.968016 (+141605us) raft_consensus.cc:1685] finished
0709 13:10:22.968054 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.968402 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20141,"raft.queue_time_us":88908,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6106,"spinlock_wait_cycles":2147072,"thread_start_us":588445,"threads_started":2,"wal-append.queue_time_us":576185}
I20260709 13:10:23.017185 20445 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.041672 15999 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 4.
I20260709 13:10:23.050858 20257 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.054474 20443 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.032226 20459 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.004227 20509 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:23.068130 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93152.8us
I20260709 13:10:23.069182 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.064152 15376 rpcz_store.cc:276] 0709 13:10:21.665340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.669471 (+  4131us) service_pool.cc:224] Handling call
0709 13:10:21.669988 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.670396 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.670423 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.671120 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.063390 (+392270us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b1800424ae0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:22.304097 (+240707us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:22.304149 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.304230 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.959824 (+655594us) raft_consensus.cc:1685] finished
0709 13:10:22.959862 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.960205 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1081,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":21915,"spinlock_wait_cycles":8033536,"thread_start_us":232315,"threads_started":1,"wal-append.queue_time_us":1213223}
I20260709 13:10:23.081509 15971 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:23.083038 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:23.085150 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66910.8us
W20260709 13:10:23.160558 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79113us
I20260709 13:10:23.161113 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:23.162395 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:23.162933 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:23.040040 19918 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.056243 20238 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.146314 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:23.163357 16003 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:23.166270 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.166929 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:23.168259 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:23.084514 20444 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.066386 20275 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.179651 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.183940 15305 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:23.185207 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.164780 15348 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:23.185753 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.186492 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.187664 15375 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:23.180779 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.188962 15382 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.181631 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.089075 20513 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.085652 20437 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:23.177665 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:23.190696 15373 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:23.190791 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:23.193101 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.177309 20462 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:23.149963 20353 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:23.091120 20519 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.184933 20257 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:23.196038 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.177572 20273 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.191895 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.205089 15377 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:23.185210 20509 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:23.193216 20442 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:23.183090 20443 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:23.194098 20513 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.218322 15308 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:23.219421 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.023191 20416 rpcz_store.cc:276] 0709 13:10:20.627636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.628585 (+   949us) service_pool.cc:224] Handling call
0709 13:10:20.930166 (+301581us) ts_tablet_manager.cc:1151] Deleting tablet 362d7a17088a4e86a51428b5ee97346e
0709 13:10:20.946071 (+ 15905us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:10:21.593549 (+647478us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:22.770021 (+1176472us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:22.930584 (+160563us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":242767,"thread_start_us":140497,"threads_started":1}
I20260709 13:10:23.210355 19918 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:23.242610 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.188638 20444 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.205323 20462 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.247632 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:23.252189 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 231154us
W20260709 13:10:23.257154 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.219147 20509 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.217446 20257 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.249653 19918 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.233155 20443 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.220008 20273 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.237664 20513 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.230269 20442 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.226893 20453 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:23.262400 19918 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.265678 15228 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:23.268081 20491 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:23.268997 20518 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:10:23.273711 20115 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.274684 20115 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.276777 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 362d7a17088a4e86a51428b5ee97346e (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:10:23.282759 15382 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:23.285123 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.286062 15382 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.231980 20363 consensus_queue.cc:1059] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:23.215265 20353 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.257952 20462 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:23.319092 20353 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.265910 20443 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.322358 20238 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.208125 20447 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.324805 20447 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.327244 20275 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.327873 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2530) took 1765 ms. Trace:
I20260709 13:10:23.328316 15225 rpcz_store.cc:276] 0709 13:10:21.562047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.562245 (+   198us) service_pool.cc:224] Handling call
0709 13:10:23.327625 (+1765380us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540043ba54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:23.327777 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3221885440}
I20260709 13:10:23.329746 20444 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.263358 20509 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:23.293154 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.298193 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.321112 20498 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.333313 15299 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:23.263813 20257 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.266184 20273 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.227912 20502 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.287313 20442 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:23.336899 15303 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:10:23.342837 20461 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.343045 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.328177 20492 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.300384 20346 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.349622 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.349812 15382 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:23.266515 20496 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:23.351369 20524 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:23.344875 20445 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.377254 20115 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.355938 20346 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.380509 20346 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.381279 20422 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.382007 20422 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.384637 20422 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.393970 20273 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.401377 20273 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.401576 15231 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:23.402837 20257 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:23.405397 20520 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:10:23.407533 15374 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:10:23.408026 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.409171 15302 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:23.411028 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.442528 15300 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:23.424659 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 225948us
I20260709 13:10:23.445581 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.285581 20437 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.447364 15302 raft_consensus.cc:2410] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:23.442567 20346 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:23.455883 15299 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:23.459329 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.463721 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.465145 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.465865 15302 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:23.467036 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.467665 15302 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:23.468711 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.469515 15302 raft_consensus.cc:2368] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:23.470439 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.471110 15302 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:23.458935 20461 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:23.472190 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.481194 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.482595 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.487061 15375 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:23.458812 20257 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.490644 20461 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:23.491004 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.491246 20461 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:23.491866 15375 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:23.491534 20443 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.492224 20461 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.493746 20461 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:23.494108 15303 raft_consensus.cc:2368] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:10:23.461804 20504 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.497357 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:23.501010 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:23.457542 20438 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:23.503571 20221 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:23.508701 20438 consensus_queue.cc:1243] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:23.457149 20346 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.505968 20248 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:23.509552 20438 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:23.510025 20438 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:23.503804 20455 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:23.511379 20438 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.511951 20346 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.506121 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.507367 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:23.516042 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.514273 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.517128 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.518844 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.510006 20248 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:23.520258 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.524288 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:23.524288 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.524963 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.525887 15225 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:23.525545 15374 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:23.525538 15232 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:23.530009 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.530413 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:23.531394 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.524329 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.532513 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:23.533007 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:23.534583 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.533211 15225 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:23.551159 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:23.556455 15999 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.512120 20455 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:23.533339 16003 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:23.545244 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:23.557142 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.555931 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.557559 15302 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:23.530757 15232 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:23.560694 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.533198 15375 raft_consensus.cc:2410] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:23.561748 15374 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:23.561982 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.563421 15373 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:23.562973 20504 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.565341 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.546077 20438 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:23.550702 20297 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:23.527984 20458 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:23.527712 20475 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.569787 20445 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.530683 20363 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.530435 20221 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:23.556789 20502 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.571421 20451 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.545702 20248 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.559026 20455 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:23.594616 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.654539 15375 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:10:23.573520 20458 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.657696 20458 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.577211 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.592099 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.587453 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.625543 15233 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:23.574615 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:23.660108 15302 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:23.619293 20510 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.006s
I20260709 13:10:23.666739 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.667773 20492 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:23.668754 20478 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.834s	user 0.002s	sys 0.004s
I20260709 13:10:23.673710 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.675411 16008 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.576193 20297 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:23.568534 20257 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.726480 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2964) took 2218 ms. Trace:
I20260709 13:10:23.727833 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.726934 15304 rpcz_store.cc:276] 0709 13:10:21.508611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.508824 (+   213us) service_pool.cc:224] Handling call
0709 13:10:21.509265 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.651969 (+142704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.652007 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.682542 (+ 30535us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.141295 (+458753us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.141352 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.141460 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.667966 (+1526506us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:23.726106 (+ 58140us) raft_consensus.cc:1685] finished
0709 13:10:23.726135 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.726383 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1420,"raft.queue_time_us":68991,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":29045,"spinlock_wait_cycles":73116416,"thread_start_us":520717,"threads_started":2,"wal-append.queue_time_us":1007963}
I20260709 13:10:23.729283 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.730000 15304 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.730907 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.732498 20455 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.734117 20455 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.735265 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.685722 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:23.686708 20459 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.509s	user 0.014s	sys 0.002s
I20260709 13:10:23.591614 20475 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.693506 20443 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.694813 20482 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:23.698210 20528 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:10:23.701732 20505 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.872s	user 0.001s	sys 0.001s
I20260709 13:10:23.737510 20297 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:23.705837 20466 consensus_meta.cc:287] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.003s
I20260709 13:10:23.709723 20388 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.711050 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:23.766038 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55106.1us
I20260709 13:10:23.655603 20363 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.656402 20445 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.717657 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.719599 20427 raft_consensus.cc:3055] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:23.720959 15374 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
W20260709 13:10:23.665767 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 91233.7us
I20260709 13:10:23.597066 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:23.723634 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 161178us
W20260709 13:10:23.784276 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.723795 15301 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.724560 15999 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:23.571894 20504 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.725487 16008 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.741451 15375 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:23.740823 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.732256 15308 raft_consensus.cc:2368] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:23.736289 15382 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:23.746012 15304 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:23.613994 19918 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.776633 20486 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.799948 20486 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:23.800426 20486 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.801077 19918 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.805976 20445 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:23.806874 15225 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:23.777938 20363 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:23.808451 20507 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.960s	user 0.006s	sys 0.000s
I20260709 13:10:23.808880 20411 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.726449 20257 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.756516 20482 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.747269 20459 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.662204 20451 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.777814 15306 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:23.836781 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 2991) took 1059 ms. Trace:
I20260709 13:10:23.837092 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.837810 20451 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.838121 20459 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:23.838788 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.786031 15274 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:23.837558 15305 rpcz_store.cc:276] 0709 13:10:22.777427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.853151 (+ 75724us) service_pool.cc:224] Handling call
0709 13:10:22.853518 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.186011 (+332493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.836237 (+650226us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54001874d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:23.836702 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759428992}
W20260709 13:10:23.843255 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57307.6us
I20260709 13:10:23.724001 20462 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.723775 20510 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:23.789860 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 192940us
I20260709 13:10:23.849169 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2931) took 1360 ms. Trace:
I20260709 13:10:23.790457 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:23.849784 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.850754 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.851549 15304 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:10:23.787875 20443 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:10:23.792129 20467 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.860286 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:23.861227 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.861984 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.849663 15377 rpcz_store.cc:276] 0709 13:10:22.488681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.489914 (+  1233us) service_pool.cc:224] Handling call
0709 13:10:22.490319 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.216603 (+726284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.848856 (+632253us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54001aa9d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:23.849097 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643106560}
I20260709 13:10:23.864845 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.793361 20504 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.794077 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.869659 15374 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:23.795408 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.796725 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.797886 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.704664 20442 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.815750 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.875404 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.875888 15382 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.830588 20509 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.835271 20496 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.840317 15373 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:23.841563 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.781823 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2924) took 1313 ms. Trace:
I20260709 13:10:23.853256 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.855448 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.854754 20453 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.856731 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:23.783052 20427 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:23.855792 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.804126 20458 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.919975 15378 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 4.
I20260709 13:10:23.858464 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:23.859052 19713 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.754608 20513 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.855688 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 2990) took 1078 ms. Trace:
I20260709 13:10:23.859584 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.923591 15232 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.862829 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:23.924705 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72384.7us
I20260709 13:10:23.925547 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:23.867389 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:23.867924 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:23.867977 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.926954 15376 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.927384 20273 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:23.927886 20273 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.928238 20273 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.862936 15305 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:23.876665 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:23.888501 15381 rpcz_store.cc:276] 0709 13:10:22.468490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.471561 (+  3071us) service_pool.cc:224] Handling call
0709 13:10:22.471992 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.517089 (+ 45097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.517124 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.517875 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.675719 (+157844us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:22.675766 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.675843 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.700914 (+1025071us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:23.765090 (+ 64176us) raft_consensus.cc:1685] finished
0709 13:10:23.765113 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.781720 (+ 16607us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1633,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":16910,"spinlock_wait_cycles":81384832,"thread_start_us":72379,"threads_started":1,"wal-append.queue_time_us":214861}
I20260709 13:10:23.878026 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.772656 20466 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:23.923368 15300 rpcz_store.cc:276] 0709 13:10:22.777083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.777609 (+   526us) service_pool.cc:224] Handling call
0709 13:10:23.855481 (+1077872us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400430654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:23.855627 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414791040}
I20260709 13:10:23.933008 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.933512 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:23.933926 15303 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.871100 15308 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:23.848505 20388 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.883356 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:23.884747 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:23.860816 20501 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:23.896904 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.888861 15304 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:23.889189 15225 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.911763 20453 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.875404 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.855755 15302 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:23.887787 15379 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:23.858160 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:23.953017 16002 raft_consensus.cc:2368] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:10:23.954018 15380 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:23.915838 15301 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:23.868325 20467 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:23.917997 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61366.5us
I20260709 13:10:23.956450 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:23.956975 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 98880.4us
I20260709 13:10:23.957190 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:23.862582 20459 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:23.920697 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:23.921409 19713 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.934608 15300 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:23.935729 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.940609 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.791229 20221 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:23.922179 20346 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.978168 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:23.940688 15382 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:23.980690 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 707) took 1120 ms. Trace:
I20260709 13:10:23.961210 15307 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:23.966976 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:23.982276 15381 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:23.938694 20282 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.981381 15301 rpcz_store.cc:276] 0709 13:10:22.860109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.979583 (+1119474us) service_pool.cc:224] Handling call
0709 13:10:23.979977 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.980200 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.980234 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.980279 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:23.980323 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.980437 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.980609 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:23.989853 15382 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:23.942517 20501 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.942565 20438 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:23.997620 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:23.965735 20467 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.965454 20443 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:23.938459 20527 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:10:24.006351 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:24.006735 19713 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:23.999405 15301 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:23.992786 20223 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.003336 20501 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.011891 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 709) took 1129 ms. Trace:
I20260709 13:10:23.947376 20388 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.030876 15307 rpcz_store.cc:276] 0709 13:10:22.882040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.896602 (+ 14562us) service_pool.cc:224] Handling call
0709 13:10:24.011683 (+1115081us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54002300d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:24.011827 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143849216}
I20260709 13:10:23.980773 20445 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:24.027952 15301 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:24.017941 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2480) took 1293 ms. Trace:
I20260709 13:10:24.028214 15302 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:24.009157 20346 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:24.044373 15308 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:23.993013 20459 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.036448 19713 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.985388 20504 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:10:24.011446 15304 raft_consensus.cc:2410] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:10:24.038134 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:24.022477 20447 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:24.053418 20447 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.053859 20447 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:24.056663 20496 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:24.057359 20496 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:24.020620 20438 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.058303 20496 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.059778 20438 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.060468 20445 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.063071 20445 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:24.064564 20533 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:10:24.010511 20451 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:24.036880 20443 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:24.069027 20503 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.227s	user 0.004s	sys 0.000s
I20260709 13:10:24.069165 20443 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:24.005622 20492 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:24.070446 20492 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.071002 20492 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.070690 20443 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.072950 20482 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.073563 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:24.074216 15375 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.085207 15307 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:24.086997 15232 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:24.038791 15230 rpcz_store.cc:276] 0709 13:10:22.724919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.725444 (+   525us) service_pool.cc:224] Handling call
0709 13:10:22.725883 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.726144 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:23.729015 (+1002871us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.015098 (+286083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.015184 (+    86us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:24.015273 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.017663 (+  2390us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.017849 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1002355,"prepare.queue_time_us":1006400,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":24826,"thread_start_us":285634,"threads_started":1}
I20260709 13:10:24.001844 20282 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.107745 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:24.110934 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:24.112176 15304 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:24.113103 16008 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:24.039399 20475 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.126708 15376 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:24.128964 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:24.133742 15304 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 5: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:24.130189 15225 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:24.130440 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:24.134444 16008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 439) took 1905 ms (client timeout 1607 ms). Trace:
I20260709 13:10:24.049640 20257 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:24.135535 16008 rpcz_store.cc:269] 0709 13:10:22.208475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.208644 (+   169us) service_pool.cc:224] Handling call
0709 13:10:23.674985 (+1466341us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b540064f120. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa406f 00007f2f53b1cf60 00007f2f53b1e7de 00007f2f53b2a27c 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2
0709 13:10:24.113936 (+438951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181070208}
I20260709 13:10:24.078284 20458 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.145292 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:24.076746 20513 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.149344 16003 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:24.149863 15375 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:10:24.150530 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:24.153441 15376 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:24.153815 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:24.137291 20214 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:10:24.159965 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:24.175446 16002 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:24.162938 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.177165 15230 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
W20260709 13:10:24.179772 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 319865us
I20260709 13:10:24.180030 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:24.172593 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:24.014959 20427 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.165634 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.167309 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:24.168924 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.197419 15231 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:24.201809 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.164943 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.162551 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.192960 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:24.206115 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:24.173976 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 248542us
W20260709 13:10:24.171377 20534 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:10:24.141690 20445 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:24.143172 20475 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:24.221375 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.202951 15228 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:24.150322 20462 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.158365 20346 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:24.232385 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 364534us
W20260709 13:10:24.238560 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45611.9us
I20260709 13:10:24.199366 20482 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:24.190488 20510 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.225306 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:24.188712 20442 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.295439 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:24.258576 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:24.202221 20257 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:24.273000 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:24.225951 20532 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:10:24.202726 20513 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:24.299330 20513 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.299767 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:24.302219 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 75425.7us
I20260709 13:10:24.293457 15303 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:24.307871 15225 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 16: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:24.312590 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:24.313498 15376 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:24.240031 20509 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.271077 20427 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:24.243036 20358 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.284724 20401 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:24.331048 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:24.331168 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:24.331813 15228 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:24.241235 20445 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:24.322528 20486 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.522s	user 0.014s	sys 0.000s
I20260709 13:10:24.301769 20438 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:24.247319 20363 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:24.328299 20455 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.001s
I20260709 13:10:24.346107 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:24.326042 20401 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:24.347646 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 390563us
I20260709 13:10:24.365206 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:24.326910 20442 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.345906 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:24.318382 20346 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:24.351305 20504 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:24.353135 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:24.375418 15345 leader_election.cc:400] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10.
I20260709 13:10:24.378674 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:24.356920 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.358731 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:24.361652 15376 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:24.241641 20475 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.394304 16001 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:24.371654 16003 raft_consensus.cc:2368] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:10:24.339231 20454 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.367097 20401 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:24.420867 20531 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:10:24.408908 20248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.012s	sys 0.026s
W20260709 13:10:24.422101 20248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.013s	sys 0.026s
W20260709 13:10:24.422717 20536 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:24.423897 20513 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.373936 20504 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:24.424921 20504 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.425061 20543 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.381314 20462 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.352829 20486 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:24.400635 15179 auto_rebalancer.cc:629] Failed to schedule move for tablet 10888684198543f19c54c7cbcb094157: Illegal state: Replica 841138f50ace4746978e72d7f13878de is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:24.361542 20438 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:24.440291 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:24.450765 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:24.455788 20158 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:24.457298 20519 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.457782 20519 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:24.459523 15376 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 5.
I20260709 13:10:24.460517 20388 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.447084 20282 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.465188 20502 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:24.465790 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:24.469498 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:24.371773 20442 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.480304 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 1000) took 1292 ms. Trace:
I20260709 13:10:24.483089 15380 rpcz_store.cc:276] 0709 13:10:23.180106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.200777 (+ 20671us) service_pool.cc:224] Handling call
0709 13:10:24.472197 (+1271420us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54001abdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:24.472434 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639570304}
I20260709 13:10:24.432776 20513 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.426097 20547 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:24.453758 20537 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:10:24.432384 20539 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:24.447309 20459 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.407639 20454 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.453135 20462 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:24.406690 20346 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.465826 20502 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:24.450235 20421 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:10:24.496946 20451 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:24.519711 20273 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.591s	user 0.014s	sys 0.000s
W20260709 13:10:24.541618 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 172195us
I20260709 13:10:24.556068 15348 leader_election.cc:400] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
I20260709 13:10:24.556548 15348 leader_election.cc:403] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.537652 20459 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.569841 20445 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.596719 20454 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:24.600917 20529 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.125s	user 0.007s	sys 0.000s
I20260709 13:10:24.502034 20547 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:24.605166 20492 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 13:10:24.605302 15228 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:24.605775 20492 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.607234 20547 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.608219 20492 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.539165 20546 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:24.609308 20546 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:24.609764 20546 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.610087 20442 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.611057 20442 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.571563 20451 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.613425 20504 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.614729 20451 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.615468 20363 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.615713 20504 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:24.565834 20447 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.002s
I20260709 13:10:24.568884 20273 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.616643 20447 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.616936 20462 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.618198 20273 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.618871 20447 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.619305 15308 raft_consensus.cc:2368] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17.
I20260709 13:10:24.621049 20447 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:24.621623 20438 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.627799 20273 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 7. Current term is 8.
W20260709 13:10:24.627774 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 71908.3us
I20260709 13:10:24.632125 20221 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:24.641009 20467 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.005s
I20260709 13:10:24.642107 20467 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.611933 20442 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.621620 20447 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.513096 20539 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.652261 20447 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.658499 20442 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:24.660775 20453 consensus_meta.cc:287] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.681s	user 0.003s	sys 0.012s
I20260709 13:10:24.661780 20346 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.663192 20475 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.499208 20513 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.665009 20546 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.664719 20486 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:24.652520 20539 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:24.551362 20482 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:24.692485 15376 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:24.712510 15380 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:24.621760 20504 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.655768 20502 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:24.721036 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 349549us
I20260709 13:10:24.724174 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2433) took 1237 ms. Trace:
I20260709 13:10:24.724860 15381 rpcz_store.cc:276] 0709 13:10:23.486683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.936871 (+450188us) service_pool.cc:224] Handling call
0709 13:10:23.981910 (+ 45039us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.995702 (+ 13792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.723812 (+728110us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b5400224a50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:24.724068 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97305856}
I20260709 13:10:24.727494 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3000) took 1020 ms. Trace:
W20260709 13:10:24.717835 20461 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.013s	sys 0.013s
W20260709 13:10:24.743041 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 364471us
I20260709 13:10:24.744390 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:24.748201 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2950) took 1224 ms. Trace:
I20260709 13:10:24.748778 15377 rpcz_store.cc:276] 0709 13:10:23.523632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.031285 (+507653us) service_pool.cc:224] Handling call
0709 13:10:24.049038 (+ 17753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.049329 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:24.400890 (+351561us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.747644 (+346754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.747729 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.747808 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.747912 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.748119 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85374,"prepare.queue_time_us":599591,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":33,"thread_start_us":605606,"threads_started":2}
W20260709 13:10:24.735860 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 380004us
W20260709 13:10:24.741784 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.739463 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1004) took 1046 ms. Trace:
I20260709 13:10:24.752534 15381 rpcz_store.cc:276] 0709 13:10:23.693332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.736853 (+1043521us) service_pool.cc:224] Handling call
0709 13:10:24.738825 (+  1972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.739043 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.739080 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.739135 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:24.739179 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.739255 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.739394 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.754524 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.758720 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.762164 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.764114 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:24.764824 15232 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.765947 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.767066 15231 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:24.770665 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.783802 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.784080 15198 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:24.671782 20453 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:24.746968 20461 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.013s	sys 0.013s
I20260709 13:10:24.736274 15306 rpcz_store.cc:276] 0709 13:10:23.707104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.018264 (+311160us) service_pool.cc:224] Handling call
0709 13:10:24.018601 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.018853 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:24.361309 (+342456us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.727000 (+365691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.727073 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:24.727143 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.727244 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.727416 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":493765,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":114,"thread_start_us":674749,"threads_started":2}
I20260709 13:10:24.807816 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:24.746280 20257 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:24.822541 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.021s
W20260709 13:10:24.824143 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.005s	sys 0.021s
I20260709 13:10:24.742470 20502 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.788679 15232 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
W20260709 13:10:24.826964 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 539412us
I20260709 13:10:24.788808 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:24.828286 15999 raft_consensus.cc:2368] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 11.
I20260709 13:10:24.745942 20475 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.790297 15381 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:24.780711 20545 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.789530 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2296) took 1462 ms. Trace:
I20260709 13:10:24.742966 20504 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:24.828979 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:24.813035 20501 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.004s
I20260709 13:10:24.786352 20558 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:24.851017 19713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.042s
W20260709 13:10:24.851411 19713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.003s	sys 0.042s
I20260709 13:10:24.832850 15300 rpcz_store.cc:276] 0709 13:10:23.327459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.021468 (+694009us) service_pool.cc:224] Handling call
0709 13:10:24.021838 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.022217 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.022250 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.022758 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.407019 (+384261us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:24.781508 (+374489us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.789096 (+  7588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.789198 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.789248 (+    50us) raft_consensus.cc:1685] finished
0709 13:10:24.789265 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.789410 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166724,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":6947,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":25169,"thread_start_us":687678,"threads_started":2,"wal-append.queue_time_us":620581}
I20260709 13:10:24.851811 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2447) took 1297 ms. Trace:
I20260709 13:10:24.852404 15373 rpcz_store.cc:276] 0709 13:10:23.554037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.565464 (+ 11427us) service_pool.cc:224] Handling call
0709 13:10:24.851548 (+1286084us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002896d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:24.851728 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412528000}
I20260709 13:10:24.842883 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1006) took 1122 ms. Trace:
I20260709 13:10:24.853521 15381 rpcz_store.cc:276] 0709 13:10:23.720203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.753795 (+1033592us) service_pool.cc:224] Handling call
0709 13:10:24.790058 (+ 36263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.842507 (+ 52449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.842801 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.845920 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2956) took 1225 ms. Trace:
I20260709 13:10:24.847200 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2958) took 1182 ms. Trace:
I20260709 13:10:24.854846 15376 rpcz_store.cc:276] 0709 13:10:23.620871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.466544 (+845673us) service_pool.cc:224] Handling call
0709 13:10:24.466891 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.693148 (+226257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.845589 (+152441us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001fd954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:24.845843 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515956608}
I20260709 13:10:24.771384 15345 leader_election.cc:400] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
W20260709 13:10:24.858232 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.018s	sys 0.023s
W20260709 13:10:24.881991 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.027s	sys 0.026s
I20260709 13:10:24.858897 15973 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:24.882623 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 657403us
I20260709 13:10:24.855420 15380 rpcz_store.cc:276] 0709 13:10:23.664986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.570679 (+905693us) service_pool.cc:224] Handling call
0709 13:10:24.620156 (+ 49477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.713161 (+ 93005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.846920 (+133759us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b540014d2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:24.847129 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211738880}
W20260709 13:10:24.864960 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51201.9us
W20260709 13:10:24.885084 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 113959us
I20260709 13:10:24.888159 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:24.786258 20454 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:10:24.895484 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.895835 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:24.920149 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:24.927039 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:24.835840 20543 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:24.922787 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1005) took 1221 ms. Trace:
I20260709 13:10:24.839363 20467 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.933089 15373 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:10:24.935560 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48514.9us
I20260709 13:10:24.934849 15377 rpcz_store.cc:276] 0709 13:10:23.701015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.777748 (+1076733us) service_pool.cc:224] Handling call
0709 13:10:24.922005 (+144257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.922283 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.922329 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.922391 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:24.922443 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.922522 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.922698 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.936658 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:24.935314 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127624us
I20260709 13:10:24.849566 20388 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:24.932287 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2959) took 1210 ms. Trace:
I20260709 13:10:24.859001 20459 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.942948 15381 rpcz_store.cc:276] 0709 13:10:23.721958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.854634 (+1132676us) service_pool.cc:224] Handling call
0709 13:10:24.931540 (+ 76906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.931843 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.931881 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.931939 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:24.931999 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.932058 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.932221 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.948530 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:24.926173 20427 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:24.789439 20482 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.947950 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:24.860401 20442 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.952450 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:24.943706 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:24.949640 20545 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.926568 20273 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.931391 20568 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.957507 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2955) took 1427 ms. Trace:
I20260709 13:10:24.969163 15373 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.941535 20304 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.852613 20475 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.060727 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:25.061539 16001 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:25.062726 20475 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:25.064538 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3009) took 1355 ms. Trace:
I20260709 13:10:25.065012 15305 rpcz_store.cc:276] 0709 13:10:23.708988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.040690 (+331702us) service_pool.cc:224] Handling call
0709 13:10:25.063681 (+1022991us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b58000a1d98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01eee 0000000000375939 00007f2f58a751e0 00007f2f58b3e0c4 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:10:25.063893 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.064123 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.064149 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.064203 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:25.064253 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.064314 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.064475 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2581248}
I20260709 13:10:24.973541 20513 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:24.855248 20501 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.074887 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:25.076263 15231 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:25.077507 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2954) took 1548 ms. Trace:
I20260709 13:10:25.072175 20304 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:25.090508 20304 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.077972 15382 rpcz_store.cc:276] 0709 13:10:23.529333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.057287 (+527954us) service_pool.cc:224] Handling call
0709 13:10:24.057669 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.133298 (+ 75629us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:24.515876 (+382578us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.884072 (+368196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.884144 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:24.884220 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.077178 (+192958us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b54003c3a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:25.077256 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.077442 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7811,"prepare.queue_time_us":515791,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":10318,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9339,"spinlock_wait_cycles":173028096,"thread_start_us":741974,"threads_started":2,"wal-append.queue_time_us":554771}
I20260709 13:10:25.051482 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:25.120298 15232 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:24.950011 20257 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:25.047399 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 105837us
I20260709 13:10:24.979225 20496 raft_consensus.cc:2764] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:25.028260 20543 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.055704 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.136482 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:25.055444 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:24.976707 20427 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:24.883322 20558 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.058358 15228 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:24.954358 20566 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:25.069487 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.148440 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:25.149034 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:25.149245 15228 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.071481 20504 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:25.155735 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:25.072589 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 95439.2us
W20260709 13:10:25.067567 20564 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.125s	user 0.003s	sys 0.004s
I20260709 13:10:25.145396 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:25.055560 20442 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:24.954663 20459 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.152520 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:25.158644 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:25.160061 15306 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:25.155139 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.193634 15373 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.161594 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:25.161718 20486 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.068965 20475 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:25.166246 20472 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:25.167986 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:25.169625 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:25.198450 15299 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:25.146641 20566 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:25.203828 15228 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:10:25.157496 20453 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:25.207017 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 128211us
I20260709 13:10:25.207885 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:25.209239 15304 raft_consensus.cc:2368] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12.
W20260709 13:10:25.207150 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49219.4us
I20260709 13:10:25.157040 20388 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:25.212714 15198 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:25.215603 15304 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:25.216715 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 264433us
I20260709 13:10:25.217180 15304 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:25.219027 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:25.220065 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:25.217629 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.222239 15299 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:25.221246 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:25.225024 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:25.227872 15273 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.684s (SENT)
I20260709 13:10:25.228551 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:25.229274 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:25.205513 20472 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.236918 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.237454 20472 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.237871 20388 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.236979 20427 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.241899 20459 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:25.233260 20516 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:25.265147 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.209177 20566 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.239375 15307 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:25.251364 20541 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:25.213235 20475 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.234804 15373 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
W20260709 13:10:25.240839 20401 consensus_meta.cc:287] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.008s
I20260709 13:10:25.282318 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:25.283331 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51867.8us
I20260709 13:10:25.217998 20282 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:25.209421 20486 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.291363 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:25.239483 20501 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:25.233021 20569 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:25.261317 20572 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:10:25.296901 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76095.7us
W20260709 13:10:25.298550 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70718.3us
W20260709 13:10:25.305723 15273 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.694s (SENT)
I20260709 13:10:25.263597 20558 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:25.273666 20567 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:25.294548 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:25.292788 20504 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:25.263978 20516 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:25.262401 20459 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:25.306186 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.292477 20579 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:25.306382 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:25.306223 20574 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:25.264240 20583 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:25.301122 20401 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.296923 20447 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:25.322000 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.324805 15382 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:25.299045 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.342490 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.342654 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.343083 20574 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:25.343557 15382 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:25.328126 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:25.303390 20443 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:10:25.240576 20442 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.316857 20504 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:25.325605 20516 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.347091 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.355671 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.318702 20569 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:25.332767 20421 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:10:25.332880 20579 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:25.325094 20459 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:25.346865 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.356199 15382 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:25.382390 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.357290 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:25.364169 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57897.8us
I20260709 13:10:25.364645 20602 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.344915 20595 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.368613 20571 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:25.350137 20401 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:25.382310 20502 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.001s
I20260709 13:10:25.347445 20513 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:25.355259 20504 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.344998 20543 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.347307 20574 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.398512 20602 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.399606 15224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2499) took 1839 ms (client timeout 1640 ms). Trace:
I20260709 13:10:25.382633 20459 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.372135 20466 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:25.428720 15224 rpcz_store.cc:269] 0709 13:10:23.555371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.555524 (+   153us) service_pool.cc:224] Handling call
0709 13:10:25.394045 (+1838521us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54000e74d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:25.394230 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930945280}
I20260709 13:10:25.380906 20579 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.382196 20468 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:25.367785 20593 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:25.403080 20571 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:25.391482 20583 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:25.443365 20447 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:25.429157 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70964.7us
I20260709 13:10:25.449959 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3005) took 1742 ms. Trace:
I20260709 13:10:25.453374 15302 rpcz_store.cc:276] 0709 13:10:23.707944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.952517 (+244573us) service_pool.cc:224] Handling call
0709 13:10:25.449759 (+1497242us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b540025a8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:25.449900 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112304384}
I20260709 13:10:25.456313 15196 leader_election.cc:400] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12.
I20260709 13:10:25.456741 15196 leader_election.cc:403] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.461941 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2441) took 1962 ms. Trace:
I20260709 13:10:25.477643 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:25.477888 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2953) took 1953 ms. Trace:
I20260709 13:10:25.483822 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:25.477602 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:25.543231 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.483909 15379 rpcz_store.cc:276] 0709 13:10:23.524447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.047138 (+522691us) service_pool.cc:224] Handling call
0709 13:10:24.047402 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.047617 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:24.491989 (+444372us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.477325 (+985336us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.477516 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.477568 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:25.477615 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.477709 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.477834 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":730533,"prepare.queue_time_us":601046,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":28,"raft.queue_time_us":702,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":27271,"spinlock_wait_cycles":9293696,"thread_start_us":687118,"threads_started":2,"wal-append.queue_time_us":463653}
I20260709 13:10:25.547117 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.548452 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2952) took 2024 ms. Trace:
I20260709 13:10:25.548908 15377 raft_consensus.cc:2368] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:25.551806 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:25.551795 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.464715 15374 rpcz_store.cc:276] 0709 13:10:23.499407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.939231 (+439824us) service_pool.cc:224] Handling call
0709 13:10:23.939594 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.315691 (+376097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.315741 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.329839 (+ 14098us) log.cc:844] Serialized 26 byte log entry
0709 13:10:24.679975 (+350136us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:24.740360 (+ 60385us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.740667 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.740759 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.461777 (+721018us) raft_consensus.cc:1685] finished
0709 13:10:25.461800 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.461894 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5332,"prepare.queue_time_us":88416,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":176025,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":44092,"spinlock_wait_cycles":43136,"thread_start_us":684215,"threads_started":2,"wal-append.queue_time_us":781991}
W20260709 13:10:25.553027 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72395.9us
I20260709 13:10:25.558195 15379 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:25.557232 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.483050 20486 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:25.483551 20462 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.476423 20583 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:25.561875 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.524461 20421 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:25.565531 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 85956.8us
I20260709 13:10:25.567814 15377 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:25.574198 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.576247 15379 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:25.403406 20569 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.485124 20158 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:10:25.578398 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:25.435796 20602 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:25.611249 15308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 715) took 1519 ms (client timeout 1701 ms). Trace:
W20260709 13:10:25.611886 15308 rpcz_store.cc:269] 0709 13:10:24.091759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.091936 (+   177us) service_pool.cc:224] Handling call
0709 13:10:25.610979 (+1519043us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:25.611172 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114161024}
I20260709 13:10:25.590502 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.600351 20453 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:25.602607 20594 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:25.603927 20601 log.cc:927] Time spent T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:10:25.604965 20604 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:25.608884 20447 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:25.614215 15379 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:25.572762 20560 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:25.643399 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.646515 15379 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:25.579843 20466 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:10:25.653040 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61077.1us
I20260709 13:10:25.625386 20566 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.588785 20475 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:25.651118 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.628958 20594 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:25.638048 20606 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:25.663173 20566 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:25.657989 20458 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:25.577903 20571 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.664536 20458 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.667346 20458 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:25.668495 20602 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:25.668676 20437 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.653825 20453 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:25.672593 20453 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.675069 20579 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.661566 15379 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:25.580302 20583 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:24.980484 15375 rpcz_store.cc:276] 0709 13:10:23.529675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.207515 (+677840us) service_pool.cc:224] Handling call
0709 13:10:24.252974 (+ 45459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.253366 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:24.589061 (+335695us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.957137 (+368076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.957204 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:24.957256 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.957322 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.957449 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":395961,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":2997,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5237,"thread_start_us":654279,"threads_started":2}
I20260709 13:10:25.684682 20609 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:25.663271 20606 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.692384 15348 leader_election.cc:400] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:10:25.693542 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:25.730290 15348 leader_election.cc:403] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.730696 15303 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.731014 15232 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:25.647495 20447 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.701726 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:25.737262 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:25.738618 15305 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:25.741041 15305 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:25.702255 15301 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:25.703509 15300 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:10:25.698375 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44277.3us
I20260709 13:10:25.630684 20282 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:10:25.742441 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 50246.6us
I20260709 13:10:25.705716 20458 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.718431 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:25.656374 20563 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.727000 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:25.727892 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.625018 20468 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:25.718163 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:25.752902 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:25.752216 15303 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:10:25.754012 16003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:25.754743 16003 raft_consensus.cc:606] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:25.698359 20539 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.750373 16002 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.755522 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:25.751756 15379 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:25.658643 20466 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:25.754038 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 99457.9us
I20260709 13:10:25.762210 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.768074 15375 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:25.770011 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.771304 15375 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:25.773991 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.776612 20602 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.776944 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:25.779258 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:25.782192 20606 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:25.786947 20472 consensus_meta.cc:287] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
I20260709 13:10:25.788151 20437 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.789985 20583 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:25.795307 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:25.704028 20158 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:10:25.801054 15375 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:25.795047 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.807945 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.809973 20583 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.811303 20583 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.749452 20442 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:10:25.656899 20560 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.803354 15303 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:25.720064 20475 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:10:25.870682 15999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 509) took 1539 ms (client timeout 1786 ms). Trace:
W20260709 13:10:25.875111 15999 rpcz_store.cc:269] 0709 13:10:24.330797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.330940 (+   143us) service_pool.cc:224] Handling call
0709 13:10:25.870433 (+1539493us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54007026d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:25.870608 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141306624}
I20260709 13:10:25.759536 20568 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:25.887563 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 132165us
I20260709 13:10:25.888929 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:25.823642 15375 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:25.763257 20544 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:10:25.873544 20602 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.759039 20458 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.911939 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:25.792654 20516 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:25.916760 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:25.787560 20472 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.934170 20466 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:25.918653 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 96651us
I20260709 13:10:25.923906 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.763470 20563 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:25.957321 16001 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 8.
I20260709 13:10:25.957321 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:25.961565 20504 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.004s
I20260709 13:10:25.926990 20516 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:25.937098 20458 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:25.939931 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:25.947274 20558 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.948135 15375 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:25.950650 20609 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:25.953730 20304 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.938007 16000 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:25.968047 20563 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:25.972852 20459 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 13:10:25.974563 20579 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:25.924083 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:25.977137 20472 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:25.987713 16002 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
W20260709 13:10:25.990995 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.996093 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:25.999512 15348 leader_election.cc:400] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 11.
I20260709 13:10:25.766685 20539 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.029714 15348 leader_election.cc:403] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.030671 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.029814 15375 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.031569 15300 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:10:25.914501 20568 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:26.044816 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 120869us
I20260709 13:10:26.046739 19918 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:26.053239 20618 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:26.054177 20560 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.054544 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.044838 20467 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 11.
I20260709 13:10:26.055231 15376 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.000718 20304 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.061568 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2513) took 1010 ms. Trace:
I20260709 13:10:26.062052 15229 rpcz_store.cc:276] 0709 13:10:25.051342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.051489 (+   147us) service_pool.cc:224] Handling call
0709 13:10:25.051776 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.193351 (+141575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.193395 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.193441 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:25.194416 (+   975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.061249 (+866833us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002e2f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:26.061303 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.061495 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277179776}
I20260709 13:10:26.063056 20304 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.028090 20459 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.066356 20459 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:25.998813 20609 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:26.067912 20609 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.068609 15382 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:26.069700 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:26.070456 16004 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.071955 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.072273 15228 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:26.073438 15375 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:26.074551 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:26.074793 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.075723 15375 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.076679 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:26.077117 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:26.077436 15231 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:25.925195 20602 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.081588 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:26.105652 16004 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:26.084899 20617 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:26.106280 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60348.3us
I20260709 13:10:26.111857 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:26.091697 16002 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:26.112434 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:26.113137 19713 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.113639 19713 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.110457 15974 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.099859 20447 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:26.114323 19713 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.095260 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.118026 15380 raft_consensus.cc:2368] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:26.119791 15376 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:26.063516 20619 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:10:25.995013 20504 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.121845 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.135046 15376 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:26.139518 15375 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:26.141170 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.142515 15375 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:26.144227 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.120589 20563 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.145800 15375 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:26.147878 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:26.153126 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.127050 20477 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:26.155755 15307 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:26.157421 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.159035 15376 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:26.167703 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.172645 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.173564 15376 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:26.174656 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.176038 20477 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:26.177332 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.177448 20477 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.178392 15376 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:26.179355 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.181061 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.182111 15376 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:26.183265 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.184288 15376 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:26.185803 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.187846 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.188827 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.190416 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.192392 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.191226 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.201938 15308 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:26.150086 20563 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.125995 20472 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:26.192408 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.199728 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.160825 20482 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.203936 15305 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 9: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:26.206182 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.204205 15376 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.209837 15375 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.211746 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.217741 15303 raft_consensus.cc:2368] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:26.217088 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3022) took 1063 ms. Trace:
I20260709 13:10:26.216099 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.203498 20625 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.205905 20563 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.225194 15380 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.224171 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.221221 15306 rpcz_store.cc:276] 0709 13:10:25.153827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.205731 (+ 51904us) service_pool.cc:224] Handling call
0709 13:10:25.206159 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.206395 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:25.224398 (+ 18003us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.408644 (+184246us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.091534 (+682890us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b180026e2a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:10:26.216554 (+125020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.216669 (+   115us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:26.216735 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.216892 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.217027 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120552,"prepare.queue_time_us":42130,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":6201,"raft.queue_time_us":78744,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":14295,"spinlock_wait_cycles":39489792,"thread_start_us":283763,"threads_started":3,"wal-append.queue_time_us":89907}
W20260709 13:10:26.221429 20421 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.635s	user 0.016s	sys 0.000s
I20260709 13:10:26.211185 20472 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:26.238171 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.242063 15375 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:26.242779 15376 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.242622 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:26.236618 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 236474us
I20260709 13:10:26.240965 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.243501 15301 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:26.243634 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.244828 15375 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.247028 15306 raft_consensus.cc:2368] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:10:26.246043 20421 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12.
I20260709 13:10:26.250998 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.254599 15375 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:26.253420 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.246263 20472 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:26.260481 15380 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:26.260880 20472 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.261981 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.262853 15380 raft_consensus.cc:2376] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12. Re-sending same reply.
I20260709 13:10:26.262952 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.264322 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.265843 15380 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.267568 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.268713 15380 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:26.270222 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.271585 15380 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.281647 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.273295 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:26.259243 20614 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.333s	user 0.004s	sys 0.000s
I20260709 13:10:26.282658 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.287490 15376 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:10:26.238415 20560 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.237761 20447 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.288739 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.262472 20472 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.297499 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.299098 15376 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 5: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:26.237339 20625 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.303323 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.303747 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.304492 15301 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:26.304492 15375 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:26.284493 20467 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.308544 15308 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:26.308794 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.310104 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.311141 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:26.311825 15228 raft_consensus.cc:606] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:26.311951 15308 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:26.312235 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.307273 20568 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:26.313388 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.313665 20545 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.314343 15376 raft_consensus.cc:2368] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:26.315562 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.316578 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.317236 15376 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:26.317741 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.279624 20519 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.322320 15345 leader_election.cc:400] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:26.319906 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.320178 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.323166 15308 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.324818 15376 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:26.320026 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.296162 20447 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.312803 20442 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.322728 15345 leader_election.cc:403] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.327355 15376 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:26.327616 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.313009 20574 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.336387 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.336580 20606 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:26.359536 20466 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:26.359817 20606 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.360143 20466 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.360396 20606 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.360638 20466 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.364210 20579 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:26.365942 15308 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:26.338177 20447 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.340957 20609 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.322698 20501 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.351518 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.369413 15302 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:26.318363 20602 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.354642 16002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:26.370457 16002 raft_consensus.cc:606] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:26.354856 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.310690 20467 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.373436 15273 leader_election.cc:400] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:26.373885 15273 leader_election.cc:403] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.355253 15376 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:26.357963 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.367553 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.352473 15224 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:26.378832 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.371393 20519 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.381449 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:26.381821 20584 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.315s	user 0.000s	sys 0.010s
I20260709 13:10:26.382212 15302 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:26.383210 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:26.323858 20566 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:10:26.384608 20602 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:26.384123 20466 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:26.366750 20621 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:10:26.386695 20466 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.387271 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2970) took 1061 ms. Trace:
I20260709 13:10:26.385167 20602 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:26.327237 20568 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.327415 20504 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.391312 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.392393 15308 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.392624 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.387748 15373 rpcz_store.cc:276] 0709 13:10:25.326167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.396876 (+ 70709us) service_pool.cc:224] Handling call
0709 13:10:25.397330 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.085584 (+688254us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:26.085988 (+   404us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.214793 (+128805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.214875 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:26.214943 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.387005 (+172062us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54001b9ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:26.387064 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.387205 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":821,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1401,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":5765,"spinlock_wait_cycles":1582090496,"thread_start_us":127964,"threads_started":1,"wal-append.queue_time_us":228945}
I20260709 13:10:26.395745 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.399256 15305 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:26.399029 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:26.396610 20566 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:26.401432 15302 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:26.401944 15302 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:26.403630 15375 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:26.402725 15302 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.405212 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.405910 15302 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.409435 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:26.382203 20609 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.417613 19713 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.413410 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.416801 15373 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:26.418664 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.419389 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:26.419461 20629 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:26.420130 15228 raft_consensus.cc:606] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:26.420316 20629 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:26.421478 20629 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.423046 20566 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:26.423501 20566 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.423930 20566 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.425364 20605 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:26.425940 20605 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:26.398304 20574 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.442930 15375 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:26.441983 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.443214 15302 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:10:26.443670 15302 pending_rounds.cc:85] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 7
I20260709 13:10:26.444046 15302 pending_rounds.cc:107] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:10:26.444427 15302 raft_consensus.cc:2889] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:26.447769 15225 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:26.448096 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.450963 15308 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:26.453025 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:25.548838 15378 rpcz_store.cc:276] 0709 13:10:23.524149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.046256 (+522107us) service_pool.cc:224] Handling call
0709 13:10:24.046586 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.046798 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:24.485545 (+438747us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.476993 (+991448us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b18002bfc60. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf 00007f2f53b40038
0709 13:10:25.484546 (+  7553us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.548035 (+ 63489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.548095 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:25.548156 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.548233 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.548394 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15204,"prepare.queue_time_us":1205499,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":402,"raft.queue_time_us":6520,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":13366,"spinlock_wait_cycles":19700608,"thread_start_us":712435,"threads_started":2,"wal-append.queue_time_us":482857}
I20260709 13:10:26.456722 19713 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.456238 15380 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:26.401568 20602 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.446662 20504 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.457269 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:26.455929 20501 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:26.459146 20447 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.455446 20579 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:26.457706 20466 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.459189 20609 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:26.469206 20560 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:26.515954 16002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:26.516973 16002 raft_consensus.cc:606] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:26.517565 16002 raft_consensus.cc:614] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:26.468734 20501 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.518188 20501 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.478250 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:26.519366 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50613.9us
I20260709 13:10:26.516620 20609 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.427084 20605 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.464563 20504 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.520419 20447 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.523667 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:26.525041 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:26.555088 15274 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.68:44351 timed out after 1.575s (SENT) [suppressed 38 similar messages]
I20260709 13:10:26.555193 15378 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:26.471648 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:26.520813 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.561230 15380 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.523054 20609 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:26.575321 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54596us
I20260709 13:10:26.577502 15380 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:26.578238 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.523995 20504 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.522660 20605 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.494839 20466 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.522857 20467 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:26.583379 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.585615 20466 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.585127 20563 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.582880 20447 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:26.589578 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2966) took 1268 ms. Trace:
I20260709 13:10:26.602150 15382 rpcz_store.cc:276] 0709 13:10:25.321144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.383395 (+ 62251us) service_pool.cc:224] Handling call
0709 13:10:25.383703 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.069134 (+685431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.589091 (+519957us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540012a7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:26.589460 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574529792}
I20260709 13:10:26.591573 20438 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.580927 20153 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:26.571928 20608 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:26.600646 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.606166 20560 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:26.574515 20625 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.581835 20629 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.611025 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.570494 20579 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.609845 20560 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.616248 20560 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.608986 20608 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:26.616291 20629 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.621522 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.622248 15382 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:26.617429 20608 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.527801 20566 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.623104 15380 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:26.625095 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.602027 20447 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.636080 20447 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.608260 20438 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:26.641994 20636 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:10:26.642490 20594 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.643985 20594 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.607405 20153 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:26.631417 20442 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:26.631845 20563 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.632885 20546 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:26.633661 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:26.655580 15228 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.633834 20539 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:26.644496 20634 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:10:26.657178 15376 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:26.646322 20579 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:26.647883 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:26.628943 15375 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:10:26.613425 20602 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.661003 20608 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.684823 15228 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:26.682197 20546 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:10:26.657178 20442 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:26.693179 20442 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:26.694665 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:26.717478 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2524) took 1240 ms. Trace:
I20260709 13:10:26.705780 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:26.731310 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 120394us
I20260709 13:10:26.724395 15999 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 17. Ops: []
W20260709 13:10:26.729888 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.731449 15224 rpcz_store.cc:276] 0709 13:10:25.477149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.477334 (+   185us) service_pool.cc:224] Handling call
0709 13:10:26.717008 (+1239674us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540009cc54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:26.717213 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781712768}
I20260709 13:10:26.732529 15375 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.704222 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1016) took 1077 ms. Trace:
I20260709 13:10:26.732522 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:26.735888 15377 rpcz_store.cc:276] 0709 13:10:25.627068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.703061 (+1075993us) service_pool.cc:224] Handling call
0709 13:10:26.703539 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.703800 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.703834 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.703887 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:26.703927 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.704001 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.704142 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:26.655689 20501 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:26.725122 20631 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.345s	user 0.004s	sys 0.000s
I20260709 13:10:26.753720 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:26.766058 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:26.767520 15224 raft_consensus.cc:2368] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:10:26.770397 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:26.727752 20438 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.776859 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:26.788699 20221 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:26.792944 20421 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:26.793679 20421 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.796124 20421 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.798036 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:26.802254 20541 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.802906 20541 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.803355 20541 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.756278 20563 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:26.808030 20438 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:26.685889 20153 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.744086 20411 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:10:26.762059 20401 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:10:26.808323 15232 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:26.834100 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:26.860306 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.871636 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:26.872834 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:26.878511 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:26.705349 20606 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.881620 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:26.884506 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:26.886109 19713 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:26.886885 19713 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:26.824612 20153 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.892949 16002 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:26.822824 20574 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.895008 20640 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:26.896376 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 163977us
I20260709 13:10:26.894693 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:26.895676 15973 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:26.908504 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 718) took 1216 ms. Trace:
I20260709 13:10:26.909154 15304 rpcz_store.cc:276] 0709 13:10:25.692220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.695441 (+  3221us) service_pool.cc:224] Handling call
0709 13:10:25.695890 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.761144 (+ 65254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.761176 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.761219 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:25.761375 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.908052 (+1146677us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b540017a054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:26.908136 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.908364 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149480704}
I20260709 13:10:26.910280 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:26.879281 20558 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:26.888015 19713 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.878984 20486 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.905202 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 454) took 1169 ms. Trace:
W20260709 13:10:26.921607 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.943907 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:26.895671 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 212586us
I20260709 13:10:26.903523 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.953096 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.954280 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2511) took 1908 ms. Trace:
W20260709 13:10:26.954610 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46348.8us
I20260709 13:10:26.958644 15381 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:26.958530 15225 rpcz_store.cc:276] 0709 13:10:25.045951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.050338 (+  4387us) service_pool.cc:224] Handling call
0709 13:10:25.059946 (+  9608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.449221 (+1389275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.953889 (+504668us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540033ca54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:26.954191 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3191005568}
I20260709 13:10:26.959298 15273 leader_election.cc:400] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:26.958184 15375 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:26.957357 16001 rpcz_store.cc:276] 0709 13:10:25.735630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.735792 (+   162us) service_pool.cc:224] Handling call
0709 13:10:26.904982 (+1169190us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54006f0ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:26.905125 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468543872}
I20260709 13:10:26.819188 20560 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.966516 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:26.967458 15377 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:26.968549 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:26.969188 15348 leader_election.cc:400] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:10:26.969589 15348 leader_election.cc:403] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.974470 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:26.912608 20640 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:26.948904 20563 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:26.879045 20541 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:26.986770 15225 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:26.899601 20388 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:10:26.995602 20411 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:26.956823 20486 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:26.996706 20486 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.973558 20606 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:26.994663 20563 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:27.025767 15307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3035) took 1565 ms (client timeout 1864 ms). Trace:
I20260709 13:10:26.996212 20411 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:27.012027 20462 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:10:26.991235 20566 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.008860 20442 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:10:26.985733 20640 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:27.031112 15307 rpcz_store.cc:269] 0709 13:10:25.460425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.460588 (+   163us) service_pool.cc:224] Handling call
0709 13:10:27.025539 (+1564951us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54003dccd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:27.025690 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402954496}
I20260709 13:10:27.037299 20443 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:27.045954 15179 auto_rebalancer.cc:629] Failed to schedule move for tablet fec6e03dbf19483e8e0a5c9d25c73def: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:27.015836 20629 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.989400 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:27.057058 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.033659 20563 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:27.074498 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 85208.4us
I20260709 13:10:27.101147 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:27.089506 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:27.083470 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:27.119923 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:27.120249 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.109495 20459 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:27.119848 20573 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.109398 20442 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:27.149137 20501 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.174726 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.179827 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.120002 20574 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:27.110306 20504 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.190624 20519 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.191381 20519 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.195560 20519 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.206440 20504 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:27.255520 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.260298 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.235704 20401 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:27.174400 20573 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:27.279567 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 422509us
W20260709 13:10:27.274371 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 314157us
I20260709 13:10:27.286013 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:27.296104 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.266188 20566 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:27.327378 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:27.232781 20640 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:27.324393 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 432655us
I20260709 13:10:27.277366 20541 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.345342 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:27.346050 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.346166 15373 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:27.346669 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.347203 15382 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:27.347332 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:27.348198 15373 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:27.348486 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:27.353888 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 230025us
I20260709 13:10:27.354681 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:27.354980 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 201219us
I20260709 13:10:27.173616 20411 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:27.304263 20629 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.277016 20623 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:10:27.363759 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:27.365347 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.372066 15373 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:27.423535 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.425789 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.427446 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.429072 20388 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.338611 20401 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:27.329531 20644 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:10:27.367024 20652 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.352203 20566 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:27.445967 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 160874us
I20260709 13:10:27.430022 20388 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.368799 20504 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:27.449782 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.458699 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.431244 20629 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.476084 15225 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:10:27.463804 20153 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.000s
I20260709 13:10:27.482986 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:27.484023 15306 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.484651 15299 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:27.487398 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.494335 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.498163 15304 raft_consensus.cc:2410] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:27.499352 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.501825 15307 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:27.451236 20652 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.505664 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:27.537298 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.495685 20477 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:27.546473 15224 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:27.551110 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45524.4us
I20260709 13:10:27.495198 20461 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:27.552255 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:27.470922 20629 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:27.561331 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 114127us
I20260709 13:10:27.491379 20486 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:27.536603 20501 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:27.557842 20477 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:27.563912 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 186780us
I20260709 13:10:27.580683 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:27.587584 20447 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.951s	user 0.015s	sys 0.001s
W20260709 13:10:27.588052 20654 log.cc:927] Time spent T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:10:27.596370 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 763) took 1527 ms. Trace:
I20260709 13:10:27.596666 20566 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.588183 20447 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.596948 15999 rpcz_store.cc:276] 0709 13:10:26.068632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.069292 (+   660us) service_pool.cc:224] Handling call
0709 13:10:26.724019 (+654727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.732334 (+  8315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.596079 (+863745us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54004edc50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:27.596244 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504661120}
I20260709 13:10:27.598613 20629 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:27.592947 20650 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:10:27.599952 20447 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:27.569846 20605 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.970s	user 0.016s	sys 0.000s
I20260709 13:10:27.601137 15231 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:27.610839 20674 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:27.611980 20570 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:27.671072 15300 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:27.668627 15307 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:27.670091 15299 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:27.588713 20645 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:10:27.567153 20623 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:27.566267 20573 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.654141 20560 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.615099 20674 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.591099 20652 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.560778 20461 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.710098 16001 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:27.661952 20649 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.749682 20649 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.713891 20670 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:27.718672 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.750870 20670 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:27.751289 20442 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:27.751998 20670 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:27.753723 15226 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.591333 20388 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.762319 15300 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:27.726112 20638 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.988s	user 0.003s	sys 0.000s
I20260709 13:10:27.557029 20666 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.148s
W20260709 13:10:27.631855 20642 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:10:27.686844 20640 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.580399 20646 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.156s
W20260709 13:10:27.730746 20594 consensus_meta.cc:287] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.081s	user 0.008s	sys 0.008s
I20260709 13:10:27.666021 20641 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:27.696724 20656 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.195s	user 0.000s	sys 0.004s
W20260709 13:10:27.732520 20563 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.001s
W20260709 13:10:27.733577 20466 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.125s	user 0.012s	sys 0.004s
I20260709 13:10:27.745554 15306 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:27.585471 20501 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.746762 20623 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:27.750095 20486 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:27.752647 20459 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.586568 20504 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.712144 15303 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:27.755508 15304 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:27.722007 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.773782 15300 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.775141 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:27.776716 15307 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:27.780787 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:27.829005 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.829355 15226 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:27.781023 15302 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:27.751968 20442 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.783527 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:27.763651 20574 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.786791 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.788671 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.790817 15233 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:27.792568 15305 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:27.807919 20605 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.855063 15232 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:27.854943 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 71501.4us
I20260709 13:10:27.823226 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:27.856770 15301 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:27.827035 20608 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.097s	user 0.016s	sys 0.000s
I20260709 13:10:27.761051 20674 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:27.831856 15179 auto_rebalancer.cc:629] Failed to schedule move for tablet 7236188a1607470eb04fb303bc4a928b: Illegal state: Replica b0f9eceec749442cb9a06c87f00f3caf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:27.815589 20467 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:27.853802 15306 raft_consensus.cc:2410] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:27.822965 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.881260 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.862496 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:27.772330 20453 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:10:27.866065 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.887084 15302 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:27.870612 15231 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:27.852027 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:27.767105 20593 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:10:27.867681 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:27.793938 20641 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:27.884851 15305 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:27.838944 20477 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.807683 20466 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.908197 15304 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:10:27.908761 15304 pending_rounds.cc:85] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 7
I20260709 13:10:27.909049 15304 pending_rounds.cc:107] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:27.909327 15304 raft_consensus.cc:2889] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.910159 20466 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.790635 20563 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:27.911098 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:27.900530 20519 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:27.912806 20519 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:27.913224 20519 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.914026 20563 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.914515 15304 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:27.915007 15304 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:27.915071 15308 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.916064 15304 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:27.916514 20570 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:27.917140 20649 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.897683 20443 raft_consensus.cc:2764] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:27.918391 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:27.919504 20570 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:27.919929 20570 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:27.919991 20461 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.920686 20461 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:27.921307 20461 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:27.920986 20570 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.922472 20570 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.928148 20579 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:27.929054 20579 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.931866 20579 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:27.864766 20605 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:27.841125 20459 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.875036 15303 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:27.841621 20504 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:27.900910 15307 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:27.876897 20639 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:27.884326 20558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.026s	sys 0.012s
W20260709 13:10:27.972808 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.904472 20501 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:27.904924 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.982725 15300 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:27.984678 15300 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:27.942391 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.947875 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:27.987735 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:27.949600 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:27.950237 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:27.989761 15373 raft_consensus.cc:2368] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:10:27.991364 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:27.951510 15301 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:27.865077 20574 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:28.012214 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 73137.1us
I20260709 13:10:28.016666 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.020054 15376 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:27.975942 15380 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:27.899032 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 318494us
I20260709 13:10:28.002586 15382 raft_consensus.cc:2410] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:28.004401 15300 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:28.027729 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.028642 15382 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.034992 19713 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:28.035993 19713 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.038105 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:27.889621 20467 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:28.125105 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:27.979875 20558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.027s	sys 0.012s
I20260709 13:10:27.972540 20639 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.126513 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:28.146785 15303 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:28.132017 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2455) took 2468 ms. Trace:
I20260709 13:10:27.944449 20579 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:27.960642 20605 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:28.152614 15373 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:28.141038 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.148141 15379 rpcz_store.cc:276] 0709 13:10:25.570948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.757991 (+187043us) service_pool.cc:224] Handling call
0709 13:10:25.758321 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:25.759338 (+  1017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.759370 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:26.689457 (+930087us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b18003e39e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a
0709 13:10:26.691007 (+  1550us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b2c00083318. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:10:26.691688 (+   681us) log.cc:844] Serialized 52 byte log entry
0709 13:10:27.051161 (+359473us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:27.148376 (+ 97215us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.441494 (+293118us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.751052 (+309558us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b18003e39e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f579fa58f 00007f2f50a39571 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd
0709 13:10:27.817841 (+ 66789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.817972 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.039136 (+221164us) raft_consensus.cc:1685] finished
0709 13:10:28.039163 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.039352 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":386630,"prepare.queue_time_us":97092,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":2975,"raft.queue_time_us":462810,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":36556,"spinlock_wait_cycles":109072128,"thread_start_us":649085,"threads_started":2,"wal-append.queue_time_us":577284}
I20260709 13:10:28.155200 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.155889 15379 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:28.126153 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 112286us
I20260709 13:10:28.129853 15299 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:28.157902 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:28.146540 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 411584us
W20260709 13:10:28.162608 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 129925us
I20260709 13:10:28.164848 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:28.123399 20462 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:28.173671 20462 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:28.152195 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.176445 20462 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:28.162854 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.170173 20681 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:28.183175 15379 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.188622 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:28.188997 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:28.011751 20546 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:28.190413 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:27.978719 20466 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
I20260709 13:10:28.199198 19713 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:28.201532 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.207202 15381 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:28.153261 20667 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:10:28.153684 20639 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.140486 20558 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:28.218886 15382 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:28.241494 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.242413 15382 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:28.243642 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.136408 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.132700 20501 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:10:28.245621 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.247272 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.180719 20547 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:28.248787 20547 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.251899 20547 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:28.196364 20605 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.191136 20447 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.140064 20560 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:10:28.194685 20443 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:10:28.190238 20579 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.133442 20461 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:28.300863 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 125196us
I20260709 13:10:28.287143 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2546) took 1031 ms. Trace:
I20260709 13:10:28.211501 20546 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.305270 15378 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:10:28.278652 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61182.6us
I20260709 13:10:28.304878 20605 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.301939 15231 rpcz_store.cc:276] 0709 13:10:27.255904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.618925 (+363021us) service_pool.cc:224] Handling call
0709 13:10:27.619492 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.888202 (+268710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.286729 (+398527us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54003c28d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:28.287036 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576548096}
W20260709 13:10:28.308028 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.313732 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:28.288290 20679 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
W20260709 13:10:28.263897 20642 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:10:28.287456 20649 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.319751 15375 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.342459 15382 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:28.343524 15345 leader_election.cc:400] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 4 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 4. Current term is 5.
I20260709 13:10:28.349975 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:28.352686 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:28.344929 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.366186 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:28.341485 20594 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:10:28.345980 20539 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:10:28.260917 20466 consensus_queue.cc:1243] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:28.369724 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:28.314040 20459 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:28.404104 20574 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:28.405046 20682 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:10:28.335615 20442 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:28.345458 20681 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:10:28.407965 20688 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:10:28.409741 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 2998) took 1065 ms. Trace:
I20260709 13:10:28.410223 15374 rpcz_store.cc:276] 0709 13:10:27.344319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.344511 (+   192us) service_pool.cc:224] Handling call
0709 13:10:27.344929 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.815743 (+470814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.815784 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.816705 (+   921us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.964921 (+148216us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:27.964972 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.965062 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.409436 (+444374us) raft_consensus.cc:1685] finished
0709 13:10:28.409465 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.409659 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":470267,"raft.queue_time_us":473231,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"thread_start_us":147422,"threads_started":1,"wal-append.queue_time_us":373888}
I20260709 13:10:28.376608 20486 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:10:28.413316 20504 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:28.413488 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.414599 15374 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.374110 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:28.299989 20609 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:28.381976 20501 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.386389 20605 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:28.343370 20651 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:28.391618 20443 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.392584 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3003) took 1046 ms. Trace:
I20260709 13:10:28.463337 15374 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:28.463853 15377 rpcz_store.cc:276] 0709 13:10:27.345904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.349155 (+  3251us) service_pool.cc:224] Handling call
0709 13:10:27.349474 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.753154 (+403680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.753194 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.753845 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.211067 (+457222us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:28.211137 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.211423 (+   286us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.392205 (+180782us) raft_consensus.cc:1685] finished
0709 13:10:28.392236 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.392498 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":413053,"raft.queue_time_us":423099,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":15548,"thread_start_us":456691,"threads_started":1,"wal-append.queue_time_us":581827}
I20260709 13:10:28.355863 20547 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:28.341204 20558 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.374452 15378 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:28.308878 20447 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.483299 15379 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:28.497529 15375 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:28.433386 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63819us
W20260709 13:10:28.442523 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68538us
I20260709 13:10:28.442952 19713 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:28.677971 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:28.555341 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.679206 15374 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
W20260709 13:10:28.465476 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 163738us
I20260709 13:10:28.466146 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.414170 20486 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:28.426456 20696 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.443557 20594 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:28.691973 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:28.731824 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.443243 20546 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:28.731603 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:28.760926 15379 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.456648 20641 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:28.449425 20153 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:28.465680 20442 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:28.691545 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.797312 15378 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 7.
I20260709 13:10:28.754038 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:28.732221 20459 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:28.732473 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54225.9us
I20260709 13:10:28.733018 20486 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:28.364778 20669 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.327s
I20260709 13:10:28.363274 20649 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.443279 20609 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:28.664731 20574 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:28.764292 16002 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:28.844031 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:28.767081 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2544) took 1585 ms. Trace:
I20260709 13:10:28.773557 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:28.689723 20672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.020s	sys 0.037s
I20260709 13:10:28.731837 20504 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.790676 15379 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:28.794366 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:28.758680 15374 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.448081 20579 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:28.811496 19713 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:28.433955 20501 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.751407 20547 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.825820 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.827701 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:28.757475 20594 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:28.732002 20605 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:10:28.888844 20486 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.847661 15378 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:28.891021 20486 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.675447 20443 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.892536 15378 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:28.775895 20546 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:28.893633 20546 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.788204 20153 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:28.897073 15378 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:28.896896 20547 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.839020 20670 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:28.897644 20153 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.898171 20670 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.830410 20560 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.899576 20560 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.899942 20579 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:28.845396 15230 rpcz_store.cc:276] 0709 13:10:27.182751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.601612 (+418861us) service_pool.cc:224] Handling call
0709 13:10:27.601991 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.613736 (+ 11745us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:27.614157 (+   421us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.703831 (+ 89674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:27.703891 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:27.704125 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.766621 (+1062496us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b540002fb54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:28.766715 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.766984 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48829,"prepare.queue_time_us":2430,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":15067,"raft.queue_time_us":49533,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"spinlock_wait_cycles":26153728,"thread_start_us":40001,"threads_started":1,"wal-append.queue_time_us":98666,"wal-append.run_cpu_time_us":1380,"wal-append.run_wall_time_us":1001432}
I20260709 13:10:28.865682 15377 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:28.761265 20696 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.900946 20579 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:28.886837 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.904117 20709 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.904814 20709 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.889811 20605 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:28.906487 20605 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:28.907510 20605 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.908936 20605 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.844734 20442 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:28.855195 15999 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:28.849283 20708 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.913797 20708 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:28.918196 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:28.913054 15377 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:28.939298 15378 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:28.940758 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 113241us
I20260709 13:10:28.844203 20609 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:28.940068 15381 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 13:10:28.947543 15381 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:28.963336 15377 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:28.964699 15374 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:28.965080 19713 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:28.965921 15381 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:28.970106 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3049) took 1278 ms. Trace:
I20260709 13:10:28.896186 20546 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:28.970765 15299 rpcz_store.cc:276] 0709 13:10:27.691522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.691669 (+   147us) service_pool.cc:224] Handling call
0709 13:10:28.969894 (+1278225us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54001856d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:28.970029 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696057600}
I20260709 13:10:28.972011 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3020) took 1006 ms. Trace:
I20260709 13:10:28.972827 15377 rpcz_store.cc:276] 0709 13:10:27.965631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.940244 (+974613us) service_pool.cc:224] Handling call
0709 13:10:28.962997 (+ 22753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.971558 (+  8561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.971919 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:29.008442 20547 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:29.013721 20443 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:29.015478 20674 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.128s	user 0.008s	sys 0.007s
W20260709 13:10:29.017153 20519 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.103s	user 0.010s	sys 0.009s
I20260709 13:10:29.017797 20519 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.022374 15233 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:28.926993 20647 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:29.028213 20570 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.105s	user 0.019s	sys 0.002s
I20260709 13:10:29.034426 20447 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.041289 20696 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.041721 15304 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.045691 20519 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.049111 20670 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.051699 20709 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:28.874140 20504 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.054508 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3066) took 1154 ms. Trace:
I20260709 13:10:29.055101 20504 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:28.950841 20462 raft_consensus.cc:2764] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:10:29.068522 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3071) took 1155 ms. Trace:
I20260709 13:10:29.069036 15304 rpcz_store.cc:276] 0709 13:10:27.913426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.913945 (+   519us) service_pool.cc:224] Handling call
0709 13:10:27.914374 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.041229 (+1126855us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b580048e9d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a820aa 00007f2f53b04447 00007f2f53b1cfe7 00007f2f53b1e7de 00007f2f53b28b49 00007f2f53b29416 00007f2f53b25d8f 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4
0709 13:10:29.068082 (+ 26853us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:29.068118 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.068167 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:29.068199 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.068277 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.068448 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50078080}
I20260709 13:10:29.056757 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3025) took 1085 ms. Trace:
I20260709 13:10:29.080997 15382 rpcz_store.cc:276] 0709 13:10:27.970878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.243279 (+272401us) service_pool.cc:224] Handling call
0709 13:10:29.056221 (+812942us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b5400003054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:29.056674 (+   453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80157056}
I20260709 13:10:29.082857 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.084537 15382 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:29.059976 20560 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:28.866740 20574 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.062798 20501 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.063262 20706 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.008749 20153 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.055018 15306 rpcz_store.cc:276] 0709 13:10:27.900306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.901871 (+  1565us) service_pool.cc:224] Handling call
0709 13:10:27.902298 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.001264 (+ 98966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.001297 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.001338 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:28.001377 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.054218 (+1052841us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b540006ccd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:29.054274 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.054430 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227076352}
I20260709 13:10:29.058153 20649 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.016212 20674 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.072446 20641 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.888877 20594 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:28.970156 20461 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:10:29.066593 20579 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:29.107028 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.107052 15273 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.778s (SENT)
I20260709 13:10:29.117551 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:29.115063 20594 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.113883 20674 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.097919 20647 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.104921 20663 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:29.064168 20609 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.116987 20648 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:29.117959 20519 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.126616 20669 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:29.126803 20570 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:29.129338 20461 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.183718 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 491885us
I20260709 13:10:29.185151 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:29.158138 15274 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.056s	sys 0.104s
W20260709 13:10:29.186718 15274 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.056s	sys 0.104s
W20260709 13:10:29.187372 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 565449us
W20260709 13:10:29.149263 20639 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.011s
I20260709 13:10:29.125984 20649 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:29.106709 20706 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.110272 20641 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:29.203487 15274 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Timed out: RequestConsensusVote RPC to 127.13.196.68:44351 timed out after 1.575s (SENT)
I20260709 13:10:29.244415 15274 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:29.243114 20670 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:29.246985 20670 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.251497 20670 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:29.252300 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 48874.9us
I20260709 13:10:29.252605 20501 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:29.254685 20714 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:29.159076 20663 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:29.257511 20711 log.cc:927] Time spent T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:29.201882 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.261758 15304 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:29.265405 15304 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:29.266937 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65199.9us
I20260709 13:10:29.269646 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.151405 20647 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.270779 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:29.277906 15299 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.270246 15304 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:10:29.181542 20674 consensus_queue.cc:1175] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 9 status { last_received { term: 8 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:29.243072 20579 raft_consensus.cc:2764] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:29.301183 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.281953 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.308696 15999 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:29.203364 20609 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:29.266311 20459 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:29.301780 15230 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:29.301185 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.316952 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.299701 20462 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.184187 20519 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.268488 20547 raft_consensus.cc:2764] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:29.190352 20669 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.314098 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.201069 20639 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.325343 15307 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:29.245046 20486 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:10:29.327728 20639 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.176604 20648 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.322973 20516 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:29.332844 20516 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:29.333964 20516 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.334596 20648 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.335361 20648 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:29.335542 15305 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:29.336812 20696 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:29.275576 20574 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.203099 20461 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.201359 20570 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.304536 15299 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:29.321929 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.321676 20459 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.346200 20459 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:29.288470 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.296864 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.349238 15232 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:29.349514 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.351370 15974 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:29.355764 20669 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.355938 20639 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:29.359794 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71486.5us
I20260709 13:10:29.364460 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.335942 20648 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.367578 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:29.366930 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 53853us
I20260709 13:10:29.356261 20651 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:29.359633 20467 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:29.355805 20570 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:29.386893 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 430369us
I20260709 13:10:29.364077 20663 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.388592 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.392180 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:29.378561 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:29.357934 20519 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.395462 20663 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:29.396380 20663 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:29.396860 20663 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.400030 20519 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:29.412588 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 282623us
I20260709 13:10:29.414510 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:29.427102 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62797us
I20260709 13:10:29.428620 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.382524 20651 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.432675 15227 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:29.365952 20639 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:29.442754 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 64299.5us
I20260709 13:10:29.449147 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.452185 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.472527 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.431078 20501 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:29.442394 20651 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.409675 20570 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:10:29.409418 20669 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:10:29.477408 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1033) took 1175 ms. Trace:
I20260709 13:10:29.447749 20447 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.446686 20467 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:29.444221 20560 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:29.444041 20716 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.479743 20443 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:29.480037 20459 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:29.445053 20558 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:10:29.521986 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107586us
I20260709 13:10:29.528702 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:29.478518 20504 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:10:29.508039 20546 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:29.482004 20579 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:29.542132 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3023) took 1575 ms. Trace:
I20260709 13:10:29.485764 20501 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.526460 20641 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.510982 20647 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.479262 20717 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:10:29.550222 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:29.525200 20605 consensus_meta.cc:287] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.013s
I20260709 13:10:29.524528 20447 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.569525 20648 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.577657 20153 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:29.540992 20459 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:29.538995 20462 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:29.580941 20698 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.292s	user 0.005s	sys 0.007s
W20260709 13:10:29.585374 20722 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:29.585762 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.587031 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.591248 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3024) took 1620 ms. Trace:
W20260709 13:10:29.594069 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44027.8us
I20260709 13:10:29.551746 15378 rpcz_store.cc:276] 0709 13:10:27.969708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.946360 (+976652us) service_pool.cc:224] Handling call
0709 13:10:28.946876 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.947122 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:29.384979 (+437857us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.541545 (+156566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.541631 (+    86us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:29.541718 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.541821 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.542065 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15305,"prepare.queue_time_us":540115,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":7514,"thread_start_us":530266,"threads_started":2}
I20260709 13:10:29.611336 15381 rpcz_store.cc:276] 0709 13:10:27.970516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.948404 (+977888us) service_pool.cc:224] Handling call
0709 13:10:28.965715 (+ 17311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.966406 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.590860 (+624454us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b540023ebd0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:29.591128 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38933760}
I20260709 13:10:29.612779 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:29.547541 20718 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:29.613955 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.615345 15381 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:29.619113 15381 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:29.622891 16000 raft_consensus.cc:2410] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 18 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:29.603463 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1034) took 1296 ms. Trace:
W20260709 13:10:29.626569 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 154204us
I20260709 13:10:29.627758 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.593441 20461 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.631104 15378 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:29.634701 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.594038 20641 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:29.640682 20641 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.642938 20737 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:29.643524 20641 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.599902 20504 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.629755 15381 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:29.637004 20716 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:29.635005 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2524) took 1316 ms. Trace:
I20260709 13:10:29.654289 15378 rpcz_store.cc:276] 0709 13:10:28.336765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.623811 (+1287046us) service_pool.cc:224] Handling call
0709 13:10:29.624305 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.634589 (+ 10284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.634856 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:29.655512 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.656702 15378 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:29.657783 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.626976 15377 rpcz_store.cc:276] 0709 13:10:28.307012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.032587 (+725575us) service_pool.cc:224] Handling call
0709 13:10:29.033132 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.033500 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:29.384479 (+350979us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.602867 (+218388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.602954 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.603027 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.603133 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.603345 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2751,"prepare.queue_time_us":504221,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":2926,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":15050,"thread_start_us":564591,"threads_started":2}
I20260709 13:10:29.602864 20647 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.607589 20153 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:29.608354 20519 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.653271 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.662034 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.662400 15381 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:29.619980 20718 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:29.662679 15377 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:29.659632 15378 raft_consensus.cc:2410] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:10:29.611459 20447 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.656989 20574 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:29.622256 20462 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:29.689972 20723 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:29.690146 20501 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.691115 20153 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.692070 20462 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.692332 20153 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.662286 20641 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:29.693056 20641 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.664456 20718 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:29.695267 20641 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.648206 20558 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:29.655426 20504 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.696534 20546 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.697088 20546 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.698016 20504 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.699117 20546 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:29.688712 20459 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.699766 20574 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:29.700780 20574 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.702917 20651 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.705399 20739 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:10:29.656857 20461 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:10:29.721398 20729 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:10:29.688946 20579 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:29.723017 20651 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.723161 20579 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.725544 20579 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:29.727792 20594 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.002s
I20260709 13:10:29.736081 20718 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.737435 20663 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.738421 20718 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.739929 20663 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.739470 20716 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:29.772429 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 373622us
W20260709 13:10:29.782240 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.785784 15230 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:29.805822 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.792883 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.793239 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.794330 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.797439 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.798543 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.799608 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.788653 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.811918 20447 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.827984 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.830874 20740 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.831656 15305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3074) took 1908 ms (client timeout 1542 ms). Trace:
W20260709 13:10:29.832279 15305 rpcz_store.cc:269] 0709 13:10:27.923193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.942069 (+ 18876us) service_pool.cc:224] Handling call
0709 13:10:29.831164 (+1889095us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540006c554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:29.831412 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104197888}
I20260709 13:10:29.832382 20740 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.835717 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2541) took 2690 ms. Trace:
I20260709 13:10:29.835566 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.836781 15226 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:29.837841 16000 raft_consensus.cc:2368] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:29.838991 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.840163 15226 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:29.840541 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.843223 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.836234 15224 rpcz_store.cc:276] 0709 13:10:27.145255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.573070 (+427815us) service_pool.cc:224] Handling call
0709 13:10:27.573506 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.777489 (+203983us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:27.812231 (+ 34742us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.153224 (+340993us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.184304 (+ 31080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.184410 (+   106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:28.184509 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.275246 (+1090737us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b180042c340. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:29.835175 (+559929us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540002f654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:29.835284 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.835551 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81810,"prepare.queue_time_us":46350,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":98,"raft.queue_time_us":31408,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":10202,"spinlock_wait_cycles":495353984,"thread_start_us":340109,"threads_started":1,"wal-append.queue_time_us":1072796}
W20260709 13:10:29.837059 20753 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:10:29.845367 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.848560 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.849489 15224 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
W20260709 13:10:29.851603 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 210714us
I20260709 13:10:29.852631 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.855183 15232 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:29.865109 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.868551 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.871990 20539 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:29.872571 20539 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:29.873409 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.874271 20539 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:29.878621 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.878928 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.879456 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.879657 15301 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 9.
I20260709 13:10:29.880378 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:29.880573 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.881121 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.875183 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.882246 15303 raft_consensus.cc:2376] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16. Re-sending same reply.
I20260709 13:10:29.886330 20639 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:29.881762 20623 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.869505 15348 leader_election.cc:400] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:29.889138 15304 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:29.890156 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.889604 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:29.890156 15348 leader_election.cc:403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:29.497364 15374 rpcz_store.cc:276] 0709 13:10:28.302154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.967351 (+665197us) service_pool.cc:224] Handling call
0709 13:10:28.968184 (+   833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.968542 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:29.379561 (+411019us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.476820 (+ 97259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.476943 (+   123us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.477038 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.477150 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.477328 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44031,"raft.queue_time_us":3173,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":8063,"thread_start_us":438733,"threads_started":2}
I20260709 13:10:29.900470 20411 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:29.901086 20411 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:29.901157 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:29.903111 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.904012 15374 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:29.910725 15224 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:29.914108 20623 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.914512 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:29.915855 20461 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:29.916302 20461 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.916846 20461 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.917148 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:29.918660 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:29.919426 15301 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.909143 15231 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:29.919767 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.918711 15232 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:29.902829 20411 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.924808 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.926367 15232 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:29.929118 20411 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:29.929618 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.931254 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.933914 20659 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:29.934580 20659 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:29.935039 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.935920 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.936830 20539 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.936159 20659 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.940238 20467 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.942936 20716 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:29.943881 20716 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:29.944111 20670 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:29.924873 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.946213 15303 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:29.947696 20716 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:29.932396 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:29.944607 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 79484.1us
I20260709 13:10:29.933960 15232 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:29.936233 15231 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:29.952317 20685 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.742s	user 0.002s	sys 0.000s
I20260709 13:10:29.954522 20659 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.955754 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2579) took 2626 ms. Trace:
I20260709 13:10:29.952144 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.932078 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.956619 15229 rpcz_store.cc:276] 0709 13:10:27.328864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.606028 (+277164us) service_pool.cc:224] Handling call
0709 13:10:27.606483 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:27.698466 (+ 91983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.698523 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:27.701073 (+  2550us) log.cc:844] Serialized 52 byte log entry
0709 13:10:27.889677 (+188604us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:27.889721 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.889791 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.943401 (+2053610us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:29.955100 (+ 11699us) raft_consensus.cc:1685] finished
0709 13:10:29.955127 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.955534 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91179,"raft.queue_time_us":93159,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"spinlock_wait_cycles":14471424,"thread_start_us":142572,"threads_started":1,"wal-append.queue_time_us":250982}
I20260709 13:10:29.965099 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:29.966012 20644 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:29.966677 20701 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.970916 15299 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:29.972597 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.973971 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.975718 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.976720 15306 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:29.978374 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.979198 15303 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
W20260709 13:10:29.979755 15375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2507) took 2029 ms (client timeout 1728 ms). Trace:
I20260709 13:10:29.980166 15379 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:29.982115 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.983791 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:29.984736 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:29.986970 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.987711 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.988428 15230 raft_consensus.cc:2410] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:29.988746 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:29.997756 15231 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:29.998342 15229 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
W20260709 13:10:29.989632 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57482.7us
I20260709 13:10:29.990679 20718 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:29.991283 20740 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:29.995714 15373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3022) took 2029 ms (client timeout 1658 ms). Trace:
W20260709 13:10:29.980201 15375 rpcz_store.cc:269] 0709 13:10:27.950012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.000245 (+ 50233us) service_pool.cc:224] Handling call
0709 13:10:29.979337 (+1979092us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54004056d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:29.979511 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381676288}
I20260709 13:10:30.001271 15198 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:30.013799 20560 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:10:30.014460 20652 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:30.014879 20652 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:30.015043 20560 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:30.004997 15373 rpcz_store.cc:269] 0709 13:10:27.966083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.990933 (+ 24850us) service_pool.cc:224] Handling call
0709 13:10:29.995272 (+2004339us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001fca54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:29.995462 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368653056}
I20260709 13:10:30.004261 20718 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:30.016997 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:30.016041 20652 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.018950 20669 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:30.019358 20652 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:30.019544 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:30.017056 20718 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.017174 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:30.015472 20560 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:30.024415 15301 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:30.024726 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:30.028502 20674 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:30.028852 20560 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.029770 20674 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.030812 20560 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.035486 15375 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:30.036550 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.037497 20674 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:30.037428 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:29.970955 20708 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:30.039723 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:30.042126 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:30.042371 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:30.043016 15300 pending_rounds.cc:85] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 10
I20260709 13:10:30.043375 15300 pending_rounds.cc:107] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:30.043725 15300 raft_consensus.cc:2889] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:30.043437 15973 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:30.042932 15299 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:30.049115 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44551.1us
I20260709 13:10:30.019392 20669 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:30.054427 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53304.7us
I20260709 13:10:30.054847 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:30.054885 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:30.063463 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68620.8us
I20260709 13:10:30.063845 20665 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.017294 20724 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:10:30.067675 20486 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.068459 20486 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.068948 20486 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.064275 20669 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:30.067862 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.068745 20674 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.073477 20674 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.064461 20665 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:30.078903 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:30.070344 20676 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:10:30.067713 20701 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:30.085405 20701 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:30.086788 20701 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.088586 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.089715 20539 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.076470 20665 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.083362 20516 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:30.091989 19713 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:30.094291 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:30.096860 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3062) took 2242 ms. Trace:
I20260709 13:10:30.098416 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2562) took 1709 ms. Trace:
I20260709 13:10:30.100059 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2515) took 2087 ms. Trace:
I20260709 13:10:30.104969 20547 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:30.108819 19713 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:30.109189 15233 rpcz_store.cc:276] 0709 13:10:28.388595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.388794 (+   199us) service_pool.cc:224] Handling call
0709 13:10:28.389212 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.023204 (+633992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.097921 (+1074717us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54000104d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:30.098223 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455309184}
I20260709 13:10:30.115667 15299 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:30.120952 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:30.123121 20649 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:30.123420 20539 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:30.123589 20649 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:30.123478 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61838.4us
I20260709 13:10:30.094635 20674 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:30.124640 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59661.2us
W20260709 13:10:30.128679 16001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 460) took 1294 ms (client timeout 1575 ms). Trace:
I20260709 13:10:30.124039 20649 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:30.131974 16001 rpcz_store.cc:269] 0709 13:10:28.826717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.826927 (+   210us) service_pool.cc:224] Handling call
0709 13:10:30.094019 (+1267092us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800003c98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01eee 0000000000375939 00007f2f58a751e0 00007f2f58b3e0c4 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:10:30.120640 (+ 26621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3577984}
I20260709 13:10:30.109105 15308 rpcz_store.cc:276] 0709 13:10:27.853966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.863680 (+  9714us) service_pool.cc:224] Handling call
0709 13:10:27.864261 (+   581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.915691 (+ 51430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.096358 (+2180667us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b5400430b54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:30.096656 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116237696}
I20260709 13:10:30.142508 20467 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:30.143525 15373 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:30.149119 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.153589 20674 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.154384 20674 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:30.155040 20674 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.160559 20740 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:30.161734 20669 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.163065 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:30.167758 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:30.169723 20676 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:30.171362 20676 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:30.173199 20740 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:30.174295 20740 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:30.175493 20740 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.177045 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2530) took 3125 ms. Trace:
I20260709 13:10:30.109310 15380 rpcz_store.cc:276] 0709 13:10:28.012287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.960074 (+947787us) service_pool.cc:224] Handling call
0709 13:10:28.967765 (+  7691us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:29.010433 (+ 42668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.010467 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:29.015979 (+  5512us) log.cc:844] Serialized 52 byte log entry
0709 13:10:29.366370 (+350391us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:29.510215 (+143845us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.510708 (+   493us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.904410 (+393702us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18003724c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:30.099394 (+194984us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002f0e20. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa1733 00007f2f53b26dbf 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c
0709 13:10:30.099466 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.099621 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.099689 (+    68us) raft_consensus.cc:1685] finished
0709 13:10:30.099700 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.099875 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18078,"prepare.queue_time_us":278013,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":109,"raft.queue_time_us":49595,"raft.run_cpu_time_us":715,"raft.run_wall_time_us":55179,"spinlock_wait_cycles":284352640,"thread_start_us":637982,"threads_started":3,"wal-append.queue_time_us":425868}
I20260709 13:10:30.177433 15227 rpcz_store.cc:276] 0709 13:10:27.051816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.054204 (+  2388us) service_pool.cc:224] Handling call
0709 13:10:27.615483 (+561279us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800002798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:10:27.616077 (+   594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.439751 (+1823674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.176589 (+736838us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400384d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:30.176893 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4181810304}
W20260709 13:10:30.186497 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.189968 15303 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:28.002534 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:30.200515 20665 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:30.203440 20755 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:10:30.205116 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2580) took 2411 ms. Trace:
I20260709 13:10:30.204455 15126 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.205601 15228 rpcz_store.cc:276] 0709 13:10:27.793516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.850430 (+ 56914us) service_pool.cc:224] Handling call
0709 13:10:27.850896 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.851313 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.851344 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.331928 (+480584us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b180003e800. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a
0709 13:10:29.839059 (+1507131us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b2c000014c8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:10:29.839914 (+   855us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.891142 (+ 51228us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.896880 (+  5738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.908634 (+ 11754us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.204759 (+296125us) raft_consensus.cc:1685] finished
0709 13:10:30.204778 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.204939 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5951,"raft.queue_time_us":1972,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":12062,"spinlock_wait_cycles":21977856,"thread_start_us":22862,"threads_started":1,"wal-append.queue_time_us":122061}
I20260709 13:10:30.207118 20547 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.206813 15126 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.209110 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:30.207710 20547 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:30.213279 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.214529 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3012) took 2260 ms. Trace:
I20260709 13:10:30.214936 15379 rpcz_store.cc:276] 0709 13:10:27.954282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.860660 (+906378us) service_pool.cc:224] Handling call
0709 13:10:29.979594 (+1118934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.980746 (+  1152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.214306 (+233560us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54004056d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:30.214458 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2571985792}
W20260709 13:10:30.213431 15179 auto_rebalancer.cc:629] Failed to schedule move for tablet 7f56abc7f6c348d58ce156f066549f7d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:30.226127 20543 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:30.230018 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:30.231727 20543 raft_consensus.cc:2764] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:30.234647 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:30.239181 20716 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.244292 20706 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:30.215155 20547 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:30.264559 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 157733us
I20260709 13:10:30.265774 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.266641 20724 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:30.268242 20724 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:30.248910 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:30.259199 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:30.275098 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:30.275363 15375 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.279950 16003 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:30.239656 19713 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.295375 16000 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:30.295821 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:30.297808 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:30.301770 20543 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.302383 20543 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.303208 20461 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.306542 20461 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:30.308724 19713 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.309724 20665 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:30.310431 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:30.315656 16000 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:30.314460 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:30.316618 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50980.1us
I20260709 13:10:30.324172 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.290717 20547 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:30.327025 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:30.337428 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57650.9us
I20260709 13:10:30.314992 20543 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:30.349390 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:30.302919 20718 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.353262 15379 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:30.358693 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:30.358122 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:30.363989 20740 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:30.364698 20740 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:30.365130 20740 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.367215 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:30.332675 20547 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:30.370090 19713 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:30.372298 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48264.9us
I20260709 13:10:30.347801 15126 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 9, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 9 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:30.355222 20467 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.382457 15227 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:30.385975 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.378899 20547 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.374181 20746 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:30.397984 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:30.397339 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46089.2us
I20260709 13:10:30.348255 20706 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:30.386991 20467 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.387861 20543 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:30.356709 20486 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:30.404604 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66216.5us
I20260709 13:10:30.407529 16004 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:30.402601 20583 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:30.413034 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.413393 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:30.421101 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43726.6us
I20260709 13:10:30.420451 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.438169 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.408665 20467 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.439625 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:30.420470 15228 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:30.451057 19713 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:30.457809 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.464131 15229 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:30.468972 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:30.473209 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.478324 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.479202 15224 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
W20260709 13:10:30.481681 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.475769 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63035.1us
I20260709 13:10:30.485504 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:30.438066 20583 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.506408 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:30.515378 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47882us
W20260709 13:10:30.500094 20570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.031s	sys 0.044s
I20260709 13:10:30.488624 20543 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.517237 15375 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:30.524685 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55839us
I20260709 13:10:30.524685 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:30.529057 20761 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:10:30.518407 20570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.032s	sys 0.044s
I20260709 13:10:30.531555 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:30.533731 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:30.546805 20568 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.547485 20568 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:30.550294 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:30.522799 20543 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:30.531308 20652 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:30.553544 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 151174us
I20260709 13:10:30.548141 20568 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:30.554987 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57237.5us
I20260709 13:10:30.540328 20644 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:30.563125 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:30.563526 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.559124 20706 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.569420 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:30.547526 20765 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:10:30.573432 20716 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:30.553462 20543 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.577080 20486 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:30.581609 20649 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.581960 20560 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:30.596169 20442 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:30.559870 20539 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.587096 20644 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.591375 19713 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:30.593398 20706 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.604259 20644 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.602414 20539 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.624873 20767 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:30.610293 20706 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.625511 20583 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:30.633236 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.613662 20560 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:30.640722 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77676.6us
W20260709 13:10:30.644534 20766 log.cc:927] Time spent T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:10:30.646464 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 77261.2us
I20260709 13:10:30.599223 20442 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.628548 20539 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.653874 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.662554 20442 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:30.630252 20767 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:30.682811 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:30.688622 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 119489us
I20260709 13:10:30.692811 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:30.704785 20442 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:30.706339 20442 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:30.682677 20767 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:30.720682 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.720996 15227 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:30.722671 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:30.715169 20669 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:30.680001 20735 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:10:30.738528 20652 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:30.650580 20467 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.747506 15232 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:30.753226 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 99432.7us
I20260709 13:10:30.763475 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:30.765442 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 86994.8us
I20260709 13:10:30.769320 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:30.766844 20674 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.611s	user 0.015s	sys 0.000s
I20260709 13:10:30.787840 15300 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:30.787972 20568 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.788864 15303 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:30.791895 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:30.792464 20763 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.363s	user 0.005s	sys 0.000s
I20260709 13:10:30.749832 20659 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:10:30.815145 20771 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:10:30.815788 20543 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:30.824213 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2521) took 2506 ms. Trace:
I20260709 13:10:30.825230 20543 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:10:30.819218 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54442.7us
I20260709 13:10:30.840939 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:30.842044 15302 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:30.824745 15382 rpcz_store.cc:276] 0709 13:10:28.317362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.087297 (+769935us) service_pool.cc:224] Handling call
0709 13:10:29.995495 (+908198us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:29.996300 (+   805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:29.996352 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:29.997252 (+   900us) log.cc:844] Serialized 52 byte log entry
0709 13:10:30.055050 (+ 57798us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:30.120623 (+ 65573us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.121271 (+   648us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.128308 (+  7037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.134233 (+  5925us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:30.167648 (+ 33415us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b180044c0e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39557 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:30.173034 (+  5386us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b180044c0e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f
0709 13:10:30.174380 (+  1346us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b480012d158. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:10:30.574370 (+399990us) raft_consensus.cc:1685] finished
0709 13:10:30.574390 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.823837 (+249447us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54001fca50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:30.823998 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41257,"prepare.queue_time_us":98878,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2714,"raft.queue_time_us":17924,"raft.run_cpu_time_us":3320,"raft.run_wall_time_us":75050,"spinlock_wait_cycles":2102692352,"thread_start_us":49045,"threads_started":1,"wal-append.queue_time_us":276464}
I20260709 13:10:30.827646 20724 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:30.850455 20724 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:30.813122 20560 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:30.854204 20560 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:30.875214 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.888513 20706 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.891016 20779 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:30.810866 20674 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.921276 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:30.931727 20718 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:30.888558 20776 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:30.947109 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:30.947754 20776 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:30.949153 20718 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.954635 20718 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.955726 20718 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.945406 15126 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:30.956876 20775 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 13:10:30.953823 20777 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.827397 20649 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:30.967851 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 128358us
W20260709 13:10:30.977449 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 92993.2us
I20260709 13:10:30.878731 20669 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:30.892091 20706 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:30.983661 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:30.984856 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:30.986346 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:31.005741 15227 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.986366 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:30.986812 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:30.993505 20388 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:30.993089 20442 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:30.994483 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.011027 15300 raft_consensus.cc:2410] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:30.996235 20665 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:30.966099 20547 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.514s	user 0.014s	sys 0.001s
I20260709 13:10:30.898126 20568 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:30.899531 20467 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:30.895085 20560 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:31.014994 15379 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:31.022382 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.035964 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.036655 15381 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:31.037029 15300 raft_consensus.cc:2368] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:31.038260 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:31.039963 20701 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.041126 15382 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:10:31.046692 20740 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.681s	user 0.014s	sys 0.000s
I20260709 13:10:31.047335 20740 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.040795 20701 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.050020 20652 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:31.051548 20701 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.013962 20746 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.009872 20388 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:31.012753 20665 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:31.016659 20543 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.892692 20779 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.075275 19713 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:31.008787 20273 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:31.024593 20547 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.102711 19713 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:31.099805 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127442us
I20260709 13:10:31.106141 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:31.111804 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 324603us
I20260709 13:10:30.961473 20724 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.121402 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:31.069756 20467 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.953258 20776 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:31.125754 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.083923 20746 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:30.981124 20777 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.126852 19713 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.052840 20644 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.135644 15373 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:31.136262 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.145668 15233 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:31.147267 15381 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:31.142266 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.144119 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:31.101156 20543 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.161279 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:31.170269 15379 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:31.177150 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.181473 15300 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:31.182302 15302 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:31.184548 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:31.185312 15381 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:31.185472 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:31.138468 20467 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.136144 20273 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.174487 20516 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:31.208796 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.209625 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.221879 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.221982 15300 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:31.233361 15303 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:31.241011 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69725.4us
I20260709 13:10:31.179872 20676 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:10:31.241894 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 94244.9us
I20260709 13:10:31.181773 20701 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:31.246418 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.182749 20767 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.182693 20665 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.209059 20716 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.260460 15302 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: [12.8-14.9]
W20260709 13:10:31.262856 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.269167 20779 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:31.270020 20779 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:31.277690 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.277326 20779 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.243292 20570 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:31.246632 20583 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.206436 20778 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:31.367539 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 123867us
W20260709 13:10:31.368130 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 103222us
I20260709 13:10:31.197611 20388 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.279011 20740 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.283299 20516 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:31.282172 20570 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:31.396998 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:31.391448 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:31.279456 20716 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:31.409731 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 224358us
I20260709 13:10:31.410915 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:31.381057 20547 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.363885 20785 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
W20260709 13:10:31.426339 20783 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:10:31.428243 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1046) took 1110 ms. Trace:
I20260709 13:10:31.428431 20153 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.212s
I20260709 13:10:31.429064 15375 rpcz_store.cc:276] 0709 13:10:30.318053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.538965 (+220912us) service_pool.cc:224] Handling call
0709 13:10:30.558687 (+ 19722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.756481 (+197794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.756516 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.776622 (+ 20106us) log.cc:844] Serialized 26 byte log entry
0709 13:10:31.097804 (+321182us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:31.097848 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.097932 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.427769 (+329837us) raft_consensus.cc:1685] finished
0709 13:10:31.427808 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.428097 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49223,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":455974,"threads_started":2,"wal-append.queue_time_us":382502}
I20260709 13:10:31.389942 20442 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.394032 20570 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:31.380934 20778 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:31.421118 20789 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:10:31.423630 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.381552 20795 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:31.428005 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109008us
I20260709 13:10:31.373992 20583 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:31.405786 20539 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.713s	user 0.015s	sys 0.001s
I20260709 13:10:31.450770 15303 raft_consensus.cc:2410] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:10:31.410175 20706 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:31.413496 20659 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.415804 20644 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.458098 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.435727 20665 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.421126 20273 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.443837 20785 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.401543 20790 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:10:31.458199 20659 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.446719 20153 consensus_queue.cc:1243] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:31.461133 20547 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.447158 20798 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.471160 20740 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.495586 15299 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:31.490846 15381 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:31.490998 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.461010 20777 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.467307 20746 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.481154 20543 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.446990 20442 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.553203 15307 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:31.553304 15308 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:31.556689 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 133272us
I20260709 13:10:31.460505 20539 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.492492 20792 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.505519 20659 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.493113 20706 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.579478 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3034) took 1290 ms. Trace:
I20260709 13:10:31.582801 15373 rpcz_store.cc:276] 0709 13:10:30.288650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.295496 (+  6846us) service_pool.cc:224] Handling call
0709 13:10:31.579277 (+1283781us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54001a95d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:31.579403 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929343872}
I20260709 13:10:31.584440 15300 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:31.575568 20543 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:31.585352 20774 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.837s	user 0.008s	sys 0.000s
I20260709 13:10:31.586130 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:31.592619 20467 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.595238 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:31.599452 15308 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:31.585853 20543 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.596330 15303 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.564114 20644 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:31.543953 20547 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.591571 20701 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:31.609232 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3038) took 1297 ms. Trace:
I20260709 13:10:31.625903 20539 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.626183 20706 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:31.505764 20516 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.491750 20795 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.643162 19713 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.643836 19713 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.626955 20644 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.546473 20798 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.629786 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:31.632012 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 56418.4us
I20260709 13:10:31.627475 20779 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.660972 15306 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:31.676362 20805 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:10:31.575548 20792 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.683142 20792 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:31.689059 20787 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:10:31.691756 20781 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:31.693703 20780 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.651s	user 0.004s	sys 0.011s
I20260709 13:10:31.696648 20543 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.698779 20442 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.701161 20547 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.705440 20812 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.706248 20812 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.629009 20810 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.707930 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.708032 20810 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.710731 20810 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.712956 20778 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.644735 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.717293 15308 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:31.717476 20583 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:31.718603 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:31.719648 20795 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.637310 15376 rpcz_store.cc:276] 0709 13:10:30.311493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.313028 (+  1535us) service_pool.cc:224] Handling call
0709 13:10:30.313459 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:30.313940 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.313970 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:30.314794 (+   824us) log.cc:844] Serialized 52 byte log entry
0709 13:10:30.538531 (+223737us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:30.560363 (+ 21832us) log.cc:844] Serialized 14 byte log entry
0709 13:10:30.685229 (+124866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.685367 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.584409 (+899042us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:31.600159 (+ 15750us) raft_consensus.cc:1685] finished
0709 13:10:31.608889 (+  8730us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.609148 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2732,"prepare.queue_time_us":384292,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":65,"raft.queue_time_us":61408,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":5588,"spinlock_wait_cycles":4467456,"thread_start_us":343374,"threads_started":2,"wal-append.queue_time_us":336061}
I20260709 13:10:31.696842 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3042) took 1383 ms. Trace:
I20260709 13:10:31.706594 15301 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:31.723055 15378 rpcz_store.cc:276] 0709 13:10:30.313036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.537812 (+224776us) service_pool.cc:224] Handling call
0709 13:10:30.559599 (+ 21787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.715423 (+155824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.715478 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.720603 (+  5125us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.865347 (+144744us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:30.865409 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.865524 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.692675 (+827151us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:31.696452 (+  3777us) raft_consensus.cc:1685] finished
0709 13:10:31.696480 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.696768 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46041,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3636,"spinlock_wait_cycles":24089984,"thread_start_us":295885,"threads_started":2,"wal-append.queue_time_us":321056}
I20260709 13:10:31.724242 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.725555 20716 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:31.725821 15301 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:31.727137 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:31.728133 15301 raft_consensus.cc:2368] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:31.638392 20767 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.729321 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.729712 20539 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.731261 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.732215 15301 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:31.643998 20701 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.735471 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.720028 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:31.651108 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 240301us
I20260709 13:10:31.739298 15301 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 5.
I20260709 13:10:31.739562 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:31.743656 15308 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:31.744678 19713 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:31.648526 15227 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.001s
I20260709 13:10:31.748307 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:31.749311 15227 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:10:31.752724 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.753518 15301 raft_consensus.cc:2410] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:31.744190 20781 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:31.757330 15274 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:31.743932 20795 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.731899 20539 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.784600 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:31.792205 20797 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:31.793462 20797 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:31.796900 20706 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.797739 20706 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:31.798280 20539 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.806216 20776 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.766068 20798 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.798313 20706 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.819283 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.820171 15233 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:31.767882 20795 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.829684 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:31.813840 20812 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.822588 20740 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:31.822963 20701 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:31.841634 15971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.549s (SENT) [suppressed 18 similar messages]
W20260709 13:10:31.843606 20718 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.841s	user 0.016s	sys 0.000s
I20260709 13:10:31.843982 20815 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:31.858904 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.859174 15303 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:31.847605 20740 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:31.875097 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.877866 15306 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:31.885857 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 112233us
I20260709 13:10:31.875655 20539 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.864055 20815 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:31.897027 16003 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:31.879765 20740 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.899725 20539 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.882570 20644 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:31.904963 20819 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:10:31.910075 20799 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:10:31.911846 20795 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.861164 20718 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:31.923089 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81496.4us
I20260709 13:10:31.920253 20815 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.938011 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:31.898458 20659 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.942435 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:31.942718 15233 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:31.943986 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:31.937047 20814 log.cc:927] Time spent T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.190s	user 0.001s	sys 0.001s
I20260709 13:10:31.842865 20781 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:31.946668 15233 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:31.946898 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:31.941279 20583 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:31.924476 20644 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:31.945128 20795 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.965042 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:31.965416 20795 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.965936 15230 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.967363 20388 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:31.967800 20795 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.968940 20583 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:31.969636 20718 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.970868 20539 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.970526 20583 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:31.972770 15225 raft_consensus.cc:2368] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:31.951478 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.952860 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.954203 20659 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:31.955914 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.946791 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.958220 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.979354 15232 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:31.977811 15228 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:31.981346 15226 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:31.993930 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:31.994936 15233 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:32.009045 15231 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:31.965137 20781 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:32.010360 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.011111 15374 raft_consensus.cc:2410] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:32.015089 15233 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:32.013115 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:32.022491 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.025231 15303 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:32.025231 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:32.026422 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.023517 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.023267 15229 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:32.021216 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.029034 15305 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:32.031445 15231 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.045188 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:32.047283 20570 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.590s	user 0.013s	sys 0.002s
I20260709 13:10:32.047531 20815 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.047894 20570 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.049221 15227 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:32.050580 20776 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:32.057515 15348 leader_election.cc:400] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:32.057996 15348 leader_election.cc:403] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:32.063007 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.055878 20623 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.064625 15230 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:32.068769 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.064472 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.070437 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.085839 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.078377 15301 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:32.090025 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.090283 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.091372 15307 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:32.091899 15305 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:32.092548 15308 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:32.093272 20442 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:32.093755 20442 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:32.094198 20442 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.080051 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.099470 15303 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:32.060492 20649 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.059798 20716 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:32.072011 20547 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.067096 20776 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.108632 20543 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.072213 20778 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:32.109078 20835 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:32.068183 20623 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:10:32.118709 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 95266.4us
I20260709 13:10:32.121348 15307 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:32.117688 20649 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.105409 20560 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.136601 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.114399 20570 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:32.097818 20706 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.131634 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.118927 20547 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.129331 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.110215 20716 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:32.123521 20543 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.141927 15299 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:32.122314 20835 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:32.145974 15308 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:32.143643 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:32.150362 15303 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:32.130656 20778 consensus_queue.cc:1243] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:32.133378 20560 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.120437 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.155555 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.158424 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.146827 20547 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.164094 15307 raft_consensus.cc:2410] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:32.149353 20543 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.165196 15308 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:32.167671 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:32.170867 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50606.1us
I20260709 13:10:32.161062 20560 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.173979 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:32.172662 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.174466 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3049) took 1101 ms. Trace:
I20260709 13:10:32.178395 15374 rpcz_store.cc:276] 0709 13:10:31.073159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.099154 (+ 25995us) service_pool.cc:224] Handling call
0709 13:10:32.173574 (+1074420us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b540014d2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:32.174377 (+   803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027043200}
I20260709 13:10:32.204072 15301 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:32.174386 20815 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.177081 20778 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:32.196036 20583 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:32.219352 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46238.1us
I20260709 13:10:32.181023 20649 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:32.208405 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.168833 20740 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.175334 20623 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.234107 20623 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.236766 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.213315 20778 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.224949 20583 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.202407 20716 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.259771 20740 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:32.204264 20835 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.277391 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:32.302642 20813 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.723s	user 0.000s	sys 0.003s
I20260709 13:10:32.306404 20779 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:32.307236 20779 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:32.276625 20583 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.254226 20778 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:32.316673 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.318416 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:32.331857 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109340us
I20260709 13:10:32.332207 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:32.322000 20716 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.309960 20543 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.335140 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:32.318516 20843 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:32.308285 20779 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.346529 20779 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:32.349066 20847 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.349829 20847 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.355540 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 784) took 1242 ms. Trace:
I20260709 13:10:32.356158 16003 rpcz_store.cc:276] 0709 13:10:31.113181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.126311 (+ 13130us) service_pool.cc:224] Handling call
0709 13:10:32.355325 (+1229014us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54004f3654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:32.355456 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592242560}
I20260709 13:10:32.358335 15233 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:32.371888 20543 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.373924 20442 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.377465 20785 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.378304 20785 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:32.383121 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:32.385416 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.384472 15300 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:32.395653 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:32.398351 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66251.2us
I20260709 13:10:32.398788 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.401279 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.405398 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.405951 15306 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:32.406183 20674 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:32.406831 20797 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.409132 20676 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.409786 20676 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.338557 20740 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:32.417256 20560 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.417963 20676 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.421392 20847 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.383033 20776 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:32.424748 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.425747 15303 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:32.428586 20659 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.429307 20659 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.429909 20442 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.432658 20659 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.433985 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:32.436964 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 423954us
I20260709 13:10:32.438529 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:32.440606 20807 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.440783 20486 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:32.441284 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.441313 20669 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:32.442044 15304 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:10:32.442828 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.441115 20807 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:32.454790 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3051) took 1321 ms. Trace:
I20260709 13:10:32.455389 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.443508 15299 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:32.436692 20547 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.438414 20779 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:32.445343 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.465090 15307 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:32.462497 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.455317 15382 rpcz_store.cc:276] 0709 13:10:31.133762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.134112 (+   350us) service_pool.cc:224] Handling call
0709 13:10:31.150893 (+ 16781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.151151 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:31.164074 (+ 12923us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.320717 (+1156643us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b1800319a20. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf 00007f2f53b40038
0709 13:10:32.321023 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.405057 (+ 84034us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.443855 (+ 38798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.443928 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:32.443999 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.444070 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.454685 (+ 10615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1182869,"prepare.queue_time_us":1181259,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":2739,"raft.queue_time_us":14008,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":13773,"spinlock_wait_cycles":8657152,"thread_start_us":80056,"threads_started":1}
I20260709 13:10:32.415482 20785 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.467098 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.467540 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.471020 15233 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:32.461761 20153 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.462459 20807 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.461843 20740 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:32.476513 15305 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:32.493487 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.469111 20442 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:32.500321 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.500620 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.502301 20676 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:32.503366 20815 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:32.503947 20815 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:32.504570 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.504818 20676 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:32.505334 15224 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:32.505373 20676 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:32.495236 20644 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.506356 20644 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.507707 20644 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.507956 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:32.506808 20676 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.507082 20784 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:32.504930 20815 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.510537 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:32.512015 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68325.1us
I20260709 13:10:32.514128 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:32.519161 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.527514 20676 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.527741 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:32.537680 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.545050 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.545260 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.545879 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.547870 15231 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:32.506431 20785 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.549822 15226 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:32.549979 15232 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:32.551805 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:32.555994 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.556923 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.558765 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:32.560737 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.561300 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.562664 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.562767 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:32.564550 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.564968 20830 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:32.565434 20623 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.565567 20830 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:32.565950 20623 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.566421 20623 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.566831 20830 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.497803 20674 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.568766 20674 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.571779 20674 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:32.488230 20153 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.574792 20153 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:32.581182 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:32.477129 20778 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:32.584573 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48770us
I20260709 13:10:32.585577 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.528034 20547 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.618273 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:32.620759 15231 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:32.621121 15229 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:32.622447 15231 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:32.627151 20835 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.545282 20784 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:32.528700 20767 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:10:32.652809 15230 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
W20260709 13:10:32.647838 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54545.7us
I20260709 13:10:32.648197 20797 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:32.649147 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.614112 20735 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.670554 15233 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:32.684729 15232 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:32.686440 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.655616 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.688613 20547 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:32.636425 20543 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:32.696038 20784 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:32.705633 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50200.8us
I20260709 13:10:32.707283 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.614614 20795 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:10:32.707123 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.721009 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:32.720220 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 385822us
I20260709 13:10:32.683876 20735 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:32.727939 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.723954 20543 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:32.719547 20801 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:32.670528 20486 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:32.716063 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.735729 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.734261 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.721581 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2359) took 1340 ms. Trace:
I20260709 13:10:32.740353 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.733105 20735 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.738231 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.708139 20797 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:32.714854 20778 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.742367 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.742764 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.679622 20583 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.722196 20674 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:32.744897 20539 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.691372 20659 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:32.748603 15345 leader_election.cc:400] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
W20260709 13:10:32.793622 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45193.8us
I20260709 13:10:32.724474 20794 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:10:32.749294 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.795894 15229 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.749353 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:32.753517 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.768281 15228 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:32.769660 20834 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:32.773391 15230 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:32.777004 15226 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:32.708046 20808 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:32.729673 20560 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:32.743927 20547 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:32.794857 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.750295 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:32.739182 15302 rpcz_store.cc:276] 0709 13:10:31.367438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.367765 (+   327us) service_pool.cc:224] Handling call
0709 13:10:31.368260 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.410732 (+ 42472us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:31.570947 (+160215us) log.cc:844] Serialized 14 byte log entry
0709 13:10:31.738746 (+167799us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:32.489970 (+751224us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b18003e27e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a
0709 13:10:32.685862 (+195892us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b2c00080928. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:10:32.686506 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.686730 (+   224us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:32.687026 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.706716 (+ 19690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.706975 (+   259us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.707039 (+    64us) raft_consensus.cc:1685] finished
0709 13:10:32.707055 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.707214 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740,"prepare.queue_time_us":156970,"prepare.run_cpu_time_us":337,"prepare.run_wall_time_us":336,"raft.queue_time_us":30766,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":35316,"spinlock_wait_cycles":9603840,"thread_start_us":261457,"threads_started":2,"wal-append.queue_time_us":236878}
I20260709 13:10:32.797354 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.810385 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:32.786568 20543 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.786540 20779 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:32.812068 20543 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.813589 20583 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.796962 20778 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:32.814793 20778 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.815090 20543 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.786358 20674 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.786773 20716 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.816725 20847 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:32.817601 20804 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:32.818058 20847 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.818229 20804 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.818572 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.818647 20847 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.819550 15382 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:32.819772 20781 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:32.820668 20781 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.822064 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.822764 20781 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:32.823419 20781 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:32.812139 20563 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.824702 20623 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.825102 15374 raft_consensus.cc:1217] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[12.8-17.10]   Dedup: 12.8->[15.9-17.10]
I20260709 13:10:32.825762 15374 pending_rounds.cc:85] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 8
I20260709 13:10:32.826031 15374 pending_rounds.cc:107] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:10:32.826267 15374 raft_consensus.cc:2889] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:32.815969 20674 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:32.828040 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:32.832774 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:32.816843 20716 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.798731 20831 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:10:32.868692 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.869122 20716 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.869936 15378 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:32.870152 20797 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.871083 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.871887 15373 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:32.806715 20740 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:10:32.834445 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.794500 20539 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.847388 15375 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:32.866112 20804 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:32.816951 20778 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:32.871508 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.878959 15377 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:32.879154 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.822711 15380 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:32.815932 20659 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:32.879884 15375 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:32.874142 15229 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:32.823904 20781 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.881469 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:32.883158 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72892.1us
I20260709 13:10:32.886740 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:32.774065 20786 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:10:32.888168 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.872673 20644 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.827994 20834 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.888851 15375 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
W20260709 13:10:32.889815 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 92516.7us
I20260709 13:10:32.900465 15373 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:32.881314 20659 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:10:32.900192 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 65867.4us
I20260709 13:10:32.908305 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.882302 20539 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.912700 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.882586 20153 raft_consensus.cc:2764] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:32.920552 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.914250 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.913911 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.918601 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.919443 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:32.899037 20583 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.926636 15381 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:32.925800 15307 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:32.825057 20563 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:32.935423 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.936563 15231 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:32.938792 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.943341 15224 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:32.910233 20560 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.903069 20834 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:32.907902 20669 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:32.909402 20837 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:32.956949 20779 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:32.957585 20837 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:32.937901 15274 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:32.922886 20843 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:32.908880 20831 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.910017 20804 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:32.964597 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 199852us
I20260709 13:10:32.953315 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.954321 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:32.969877 15381 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:32.916535 20649 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.970531 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:32.971733 20779 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:32.972998 20779 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:32.973595 20779 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:32.974152 20779 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:32.960904 15227 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:32.928829 20583 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:32.944612 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 217867us
I20260709 13:10:32.988157 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:32.950328 20570 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:32.950913 20560 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:32.959357 20776 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:32.946604 20778 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:33.016562 20847 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:33.015910 20560 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.017949 20560 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.019055 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:32.956647 20836 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:33.020743 20836 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.022575 20676 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:32.951619 20827 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:10:33.026412 20563 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.027478 20718 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.028321 20718 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:32.995517 20583 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.971196 20649 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.035038 20649 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.035719 20649 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:32.963527 20843 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:32.978901 20804 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.946394 20856 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.006106 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.007057 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.002915 20623 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:33.009640 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.010718 15382 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:33.011374 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.046818 15375 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:33.012713 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.047503 15381 raft_consensus.cc:2368] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:33.015308 20781 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:32.969236 20855 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:33.055059 20855 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:33.056188 20855 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:33.059073 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.995751 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:33.045727 20649 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.063373 20649 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.069679 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.071759 15378 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:32.988583 20784 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:33.072906 20784 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.073616 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.075637 20784 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.077386 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:32.992758 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:33.039230 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 266320us
I20260709 13:10:33.079967 15224 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.080783 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.081754 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.082140 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.082564 15381 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:33.082675 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.083688 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.047251 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:33.084724 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.085399 15376 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.081766 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.086329 15382 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:33.087687 20870 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:33.088788 15378 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:33.090852 20870 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:33.091163 15378 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:33.091979 20870 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.092877 20870 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:33.093026 20857 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:33.094301 15376 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:33.094735 20644 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.095722 20834 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.096985 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.097304 20834 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.097981 15376 raft_consensus.cc:2410] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:33.098919 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.099627 15376 raft_consensus.cc:2368] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:33.100462 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.101655 20570 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.102453 15376 raft_consensus.cc:2368] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:33.078773 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:32.988821 20831 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.028780 20706 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.045542 15377 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:33.104537 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.105229 20831 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.103363 15375 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.037051 20837 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.016007 20778 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.105645 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.109429 15377 raft_consensus.cc:2376] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12. Re-sending same reply.
I20260709 13:10:33.110493 20778 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:33.110590 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.052897 16002 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:33.102077 15224 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:33.082839 15379 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:32.990578 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:33.134842 15375 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:33.151566 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.148960 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.152486 15375 raft_consensus.cc:2368] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:10:33.116190 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:33.121426 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:33.159432 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 168935us
I20260709 13:10:33.160953 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:33.162170 15224 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:33.157188 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.156658 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.167135 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.169131 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.046092 20843 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:33.174044 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.162341 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.036600 20776 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:33.177724 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.185902 15376 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.102185 20570 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.186805 15380 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:33.193729 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:33.111101 20669 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.179837 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.186687 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:33.045939 20804 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:33.162916 20815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.050s	sys 0.100s
I20260709 13:10:33.197543 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:33.199106 16003 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:33.200661 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:33.185174 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.207317 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.149427 20801 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:33.215184 20867 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:33.215741 20867 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.216094 20867 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.217116 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.199982 20831 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.219844 20868 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:33.220925 20868 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:33.220747 20831 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.222107 20868 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.224568 20831 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.231135 20867 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.234403 20867 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.236048 20867 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:33.235977 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.245846 15379 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:10:33.247026 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.247715 15379 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.165141 20623 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:33.257295 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72223.6us
W20260709 13:10:33.279067 15273 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.515s (SENT)
I20260709 13:10:33.279749 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:33.180565 20778 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:33.232177 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:33.334998 15379 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:33.336706 15379 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:33.196375 20706 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:33.192019 20776 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.255049 20867 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.338500 20784 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:33.344919 20785 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:33.348646 20784 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.208642 20856 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:33.349618 20856 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.349282 20785 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.350045 20856 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.354791 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.360991 20718 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.361830 20784 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.211575 20779 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.344540 15373 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:33.191704 20836 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.209065 20669 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.345463 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:33.366770 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44841.4us
I20260709 13:10:33.319468 20781 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:33.395500 20781 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.240041 20735 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.397104 20856 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.346344 20442 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.397975 20767 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:33.398470 20767 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:33.398298 20442 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.399219 20735 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.399461 20767 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.402314 20767 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:33.403620 20442 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.406371 20801 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.179323 20870 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.409675 20785 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.411020 20870 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.411586 20781 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.414324 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:33.328740 20847 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:33.415339 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 136335us
W20260709 13:10:33.417006 20807 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.897s	user 0.013s	sys 0.000s
I20260709 13:10:33.417464 20807 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.419693 20807 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.426362 15305 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:33.400784 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:33.412041 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:33.428216 16008 raft_consensus.cc:2393] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:33.432011 15376 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:33.446189 15375 raft_consensus.cc:2368] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:33.452692 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.454082 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.454944 15376 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:33.457105 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:33.459298 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46145.4us
I20260709 13:10:33.348090 20867 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:33.476616 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:33.347565 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:33.366322 20778 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:33.429731 20669 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:33.493414 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 409781us
W20260709 13:10:33.460291 20835 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.828s	user 0.005s	sys 0.010s
I20260709 13:10:33.455260 20644 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.496907 20583 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.498785 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.499428 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:33.479939 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.519248 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.521826 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:33.458810 20706 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:33.479156 20831 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.524431 15301 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
W20260709 13:10:33.505625 20674 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.678s	user 0.005s	sys 0.006s
I20260709 13:10:33.491664 20836 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.542866 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:33.545043 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:33.551820 15308 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:33.545221 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.553658 15300 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.548872 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.489835 20847 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:33.555095 15374 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:33.556216 15376 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:33.509904 20785 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.566713 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.576002 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:33.568881 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.031s	sys 0.116s
W20260709 13:10:33.578056 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.031s	sys 0.116s
I20260709 13:10:33.578171 15307 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:33.542750 20827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.019s	sys 0.027s
I20260709 13:10:33.581696 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.582942 15308 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.523198 20779 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:33.581820 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.585418 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.586755 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.586673 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.590003 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:33.590972 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 356204us
W20260709 13:10:33.587838 20827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.019s	sys 0.028s
I20260709 13:10:33.558409 20674 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:33.594455 20539 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.001s
W20260709 13:10:33.590658 20560 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.001s
I20260709 13:10:33.615666 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.625052 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.625504 15300 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:33.626420 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.627099 15300 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:33.600171 20701 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:33.633504 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2379) took 1266 ms. Trace:
I20260709 13:10:33.628499 15374 raft_consensus.cc:2368] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:33.581452 20785 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.642187 20674 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.634142 15301 rpcz_store.cc:276] 0709 13:10:32.366823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.395204 (+ 28381us) service_pool.cc:224] Handling call
0709 13:10:33.633217 (+1238013us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003e26d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:33.633390 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592517376}
I20260709 13:10:33.637815 20659 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.643224 20706 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.642473 15231 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:33.644236 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.650815 15308 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:33.617838 20779 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.642288 20785 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.566046 20847 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.664495 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:33.666138 15381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.023s	sys 0.046s
W20260709 13:10:33.667465 15381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.023s	sys 0.046s
I20260709 13:10:33.659999 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.646354 20701 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.652540 20659 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.718448 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.645962 20875 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:33.725620 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:33.726917 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.728201 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 311609us
W20260709 13:10:33.729528 15273 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.591s (SENT)
I20260709 13:10:33.730820 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:33.624495 20539 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.740260 15308 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:33.746563 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.724937 20701 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:33.762144 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.617183 20778 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.772516 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.773540 16004 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:33.734045 20560 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:33.723225 20856 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:33.774433 15229 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:33.723057 20767 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:33.726217 20870 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:33.669845 20779 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.743206 20785 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:33.718807 20776 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.799067 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.774946 20807 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:33.834826 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 207874us
W20260709 13:10:33.843811 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 114330us
W20260709 13:10:33.844537 15273 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.606s (SENT)
I20260709 13:10:33.835393 20767 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:33.845973 15273 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.657s (SENT)
I20260709 13:10:33.846028 20767 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:33.846431 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:33.847242 16008 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:33.784503 20827 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:33.848649 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 106237us
I20260709 13:10:33.856586 15373 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:33.738220 20875 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.859671 15374 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.858069 20874 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:33.875779 20804 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.003s
W20260709 13:10:33.883122 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.878701 15273 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.728s (SENT)
I20260709 13:10:33.853101 20583 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.800904 20867 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.826016 20560 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.901374 20797 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:33.892206 20883 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:10:33.903172 20878 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:10:33.890779 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:33.898766 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.849931 20785 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.858283 20870 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:33.882200 20807 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:33.905823 20876 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:10:33.922022 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.922978 15300 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.930066 20870 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.920723 20874 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:33.933432 20779 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.934862 20669 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.935554 15374 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:33.937706 20560 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.938483 20867 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:33.912194 20834 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.004s
I20260709 13:10:33.939193 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.938642 20807 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.940078 15381 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:33.941136 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:33.942106 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.943228 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:33.944573 20843 consensus_meta.cc:287] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.754s	user 0.013s	sys 0.000s
I20260709 13:10:33.945228 20843 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:33.951699 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 73052.5us
W20260709 13:10:33.953907 15273 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.754s (SENT)
I20260709 13:10:33.954203 20875 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.954691 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:33.898658 20804 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:33.957580 15377 raft_consensus.cc:2368] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:10:33.958581 20804 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:33.943920 20785 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:33.958397 20834 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.961130 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.961971 15381 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:33.964263 15273 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.788s (SENT)
I20260709 13:10:33.966777 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.967572 15301 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:33.967046 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50314.1us
I20260709 13:10:33.968637 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:33.968998 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:33.969311 15299 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.974045 15300 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:33.976385 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.977007 15381 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:33.979202 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:33.970238 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:33.960865 20843 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:33.978727 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:33.978859 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:33.981675 15381 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:33.962090 20669 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:33.994135 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:33.990305 16008 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:33.988615 20834 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.012929 15380 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:34.006405 20735 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:34.014336 15380 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:34.015743 15307 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:34.017377 20701 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:33.990505 20767 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:34.025086 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60880.2us
I20260709 13:10:34.025691 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:34.030804 15273 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.790s (SENT)
I20260709 13:10:34.031311 15228 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.031241 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.034528 15299 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:33.995316 20539 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:34.042847 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.044555 16000 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:34.042847 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.003832 20884 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:34.042999 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.048997 15999 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:34.020313 20570 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.000s
I20260709 13:10:34.049196 15301 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:34.062836 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.064045 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.059614 15228 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:34.060734 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.020550 20674 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:34.022449 20767 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:34.076910 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:34.044423 20735 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.081161 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:34.076880 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43772.9us
I20260709 13:10:34.084628 15198 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.062879 20834 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:34.066668 20786 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.009s	sys 0.013s
I20260709 13:10:34.090909 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.092233 16001 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:34.062714 20570 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.099427 16008 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:34.097563 15126 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 98) took 10287 ms. Trace:
I20260709 13:10:34.100538 20884 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.100672 15126 rpcz_store.cc:276] 0709 13:10:23.810254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.810506 (+   252us) service_pool.cc:224] Handling call
0709 13:10:34.097478 (+10286972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:31.408752 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:31.501236 (+ 92484us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:31.501329 (+    93us) write_op.cc:435] Acquired schema lock
0709 13:10:31.501369 (+    40us) tablet.cc:662] Decoding operations
0709 13:10:31.624222 (+122853us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:31.624402 (+   180us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:31.624459 (+    57us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:10:31.625203 (+   744us) tablet.cc:701] Row locks acquired
0709 13:10:31.625260 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:10:31.625539 (+   279us) write_op.cc:270] Start()
0709 13:10:31.625775 (+   236us) write_op.cc:276] Timestamp: P: 1783602631625444 usec, L: 0
0709 13:10:31.625819 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:10:31.626836 (+  1017us) log.cc:844] Serialized 1686 byte log entry
0709 13:10:31.956491 (+329655us) op_driver.cc:464] REPLICATION: finished
0709 13:10:31.984509 (+ 28018us) write_op.cc:301] APPLY: starting
0709 13:10:31.984637 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:32.110523 (+125886us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:32.110694 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:32.293479 (+182785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:32.294530 (+  1051us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:10:32.294622 (+    92us) write_op.cc:312] APPLY: finished
0709 13:10:32.295057 (+   435us) log.cc:844] Serialized 49 byte log entry
0709 13:10:32.295486 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:32.295620 (+   134us) write_op.cc:454] Released schema lock
0709 13:10:32.296069 (+   449us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:32.344995 (+ 48926us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:32.345051 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3702656,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":27609,"apply.run_cpu_time_us":15305,"apply.run_wall_time_us":347423,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20831,"num_ops":4,"prepare.queue_time_us":277409,"prepare.run_cpu_time_us":17475,"prepare.run_wall_time_us":385598,"raft.queue_time_us":123384,"raft.run_cpu_time_us":13188,"raft.run_wall_time_us":48672,"replication_time_us":315234,"thread_start_us":274615,"threads_started":4,"wal-append.queue_time_us":173064,"wal-append.run_cpu_time_us":17194,"wal-append.run_wall_time_us":1519502}]]}
W20260709 13:10:34.093518 20786 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.009s	sys 0.013s
I20260709 13:10:34.110312 20649 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:34.111042 20649 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:34.112702 20895 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 13:10:34.114104 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.114410 15379 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:34.115329 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.115512 15379 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:34.117440 20735 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.120532 20827 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.121415 20827 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.122087 20827 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:34.123531 20860 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.548s	user 0.000s	sys 0.002s
I20260709 13:10:34.125454 15381 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:34.127947 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.128643 16005 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:34.112327 20649 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:34.131211 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46688.5us
I20260709 13:10:34.140921 15273 leader_election.cc:400] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:10:34.078157 20706 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.077986 20701 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.131918 20718 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:34.141973 15273 leader_election.cc:403] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.142264 20718 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.144711 20874 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:10:34.101609 20884 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:34.145787 20864 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.801s	user 0.002s	sys 0.000s
I20260709 13:10:34.143759 20718 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.151964 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2641) took 1199 ms. Trace:
I20260709 13:10:34.155838 20649 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:34.143803 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.078491 20674 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:34.131456 20843 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.158851 20674 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.160669 20786 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.155514 15231 rpcz_store.cc:276] 0709 13:10:32.952815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.959125 (+  6310us) service_pool.cc:224] Handling call
0709 13:10:34.151536 (+1192411us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54000e79d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.151835 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337462144}
I20260709 13:10:34.162796 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:34.165247 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.135463 20776 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.159519 20843 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.140822 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:34.145828 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54125.1us
I20260709 13:10:34.158126 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.173607 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:34.175328 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.177109 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:34.192827 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.193957 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:34.198558 16002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 788) took 1687 ms (client timeout 2076 ms). Trace:
W20260709 13:10:34.199285 16002 rpcz_store.cc:269] 0709 13:10:32.511653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.527383 (+ 15730us) service_pool.cc:224] Handling call
0709 13:10:34.198286 (+1670903us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b540064f5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.198467 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951664000}
I20260709 13:10:34.202142 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.203115 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.212291 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.214619 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.216841 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:34.219177 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.220469 15228 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:34.221349 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:34.222585 15233 raft_consensus.cc:2368] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:34.225112 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.227267 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:34.231326 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.234035 15224 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:34.235512 15224 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:34.230578 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:34.237353 15348 leader_election.cc:400] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:34.237717 15348 leader_election.cc:403] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.239331 20442 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:34.229983 20804 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:34.191965 20847 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:34.241016 20847 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.241398 20847 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.241887 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.242787 15226 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:34.196676 20706 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.244635 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.246165 15227 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:34.239451 20781 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:34.246860 20781 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.247291 20781 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:34.247848 20890 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 13:10:34.253314 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.253501 20706 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:34.254186 16002 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:34.254541 20706 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:34.255321 20866 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.255975 20866 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.257822 15228 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:34.258102 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:34.247188 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:34.259634 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:34.260787 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62292.7us
I20260709 13:10:34.262149 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:34.262686 20843 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.262826 16005 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:34.263613 20583 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:34.264021 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:34.265609 20867 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:34.266286 20781 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.239926 20442 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:34.268303 20442 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:34.268728 20866 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:34.203709 20785 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.270714 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:34.272599 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 68529.4us
W20260709 13:10:34.274911 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72895us
I20260709 13:10:34.229094 20776 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:34.202240 20834 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.196599 20652 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.275897 20781 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:34.197233 20877 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.280757 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2546) took 1183 ms. Trace:
I20260709 13:10:34.278416 15373 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:34.281822 20881 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:34.296802 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3083) took 1217 ms. Trace:
I20260709 13:10:34.288503 20831 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:10:34.299453 20831 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:34.301338 20885 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.432s	user 0.001s	sys 0.003s
I20260709 13:10:34.279951 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2557) took 1027 ms. Trace:
I20260709 13:10:34.279134 20874 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.303301 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.278666 15224 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:34.231902 20767 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.235268 20779 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.297274 15382 rpcz_store.cc:276] 0709 13:10:33.079784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.086975 (+  7191us) service_pool.cc:224] Handling call
0709 13:10:33.087358 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.118901 (+ 31543us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:33.165949 (+ 47048us) log.cc:844] Serialized 14 byte log entry
0709 13:10:33.511251 (+345302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.511345 (+    94us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:33.511437 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.296534 (+785097us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54001ab3d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:34.296584 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:34.296728 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12618,"prepare.queue_time_us":47347,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":11830,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":15697,"spinlock_wait_cycles":71975808,"thread_start_us":333108,"threads_started":1,"wal-append.queue_time_us":556824}
I20260709 13:10:34.280526 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2554) took 1180 ms. Trace:
I20260709 13:10:34.311467 15375 rpcz_store.cc:276] 0709 13:10:33.099977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.153094 (+ 53117us) service_pool.cc:224] Handling call
0709 13:10:34.280328 (+1127234us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54001b99d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.280475 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560131456}
I20260709 13:10:34.305464 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.278499 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.302090 15378 rpcz_store.cc:276] 0709 13:10:33.252670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.254391 (+  1721us) service_pool.cc:224] Handling call
0709 13:10:34.279760 (+1025369us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54003f2d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.279898 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487712128}
I20260709 13:10:34.308676 15233 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:34.300014 20831 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:34.318746 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.306461 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.289247 15377 rpcz_store.cc:276] 0709 13:10:33.097449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.110333 (+ 12884us) service_pool.cc:224] Handling call
0709 13:10:34.277036 (+1166703us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b540023dcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.280705 (+  3669us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933222272}
I20260709 13:10:34.315447 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.278194 20785 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:34.332448 20785 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.333088 20834 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:34.336490 20776 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.321789 20442 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.327904 20905 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:10:34.330899 20847 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:34.353221 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74884.6us
I20260709 13:10:34.314244 20623 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:34.357275 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.359129 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.363313 20623 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:34.363813 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:34.364590 16003 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.364428 20623 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.364923 20830 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:34.367455 15229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2634) took 1456 ms (client timeout 1940 ms). Trace:
W20260709 13:10:34.367965 15229 rpcz_store.cc:269] 0709 13:10:32.911491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.919158 (+  7667us) service_pool.cc:224] Handling call
0709 13:10:34.367197 (+1448039us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540007a154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.367368 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957516032}
I20260709 13:10:34.369479 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:34.370229 15233 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.370428 15348 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:34.360666 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45363.8us
I20260709 13:10:34.373052 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.289628 20843 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:34.377372 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.368783 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:34.374516 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:34.386220 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.367492 20827 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.316996 20767 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.390300 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.362023 20869 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:34.397091 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.361395 20781 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:34.346181 20652 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:34.405289 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:34.447902 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 57736.5us
I20260709 13:10:34.446229 20778 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:34.450887 20778 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.362290 20486 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:10:34.452381 20735 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:10:34.452776 20781 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.453168 20778 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.453357 20781 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:34.446455 20856 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.460662 20781 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.379621 20583 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.462548 20583 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.461467 20827 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.463150 20583 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.463567 20827 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.464360 20781 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.462574 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2561) took 1096 ms. Trace:
I20260709 13:10:34.466625 15379 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:34.454906 20797 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.454512 20659 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:34.467598 20797 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:34.467804 20659 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.468132 20797 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.468364 20659 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.457580 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.454921 20740 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:34.471531 20740 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:34.471951 20847 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:34.459367 15232 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:34.459352 20873 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:34.478468 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:34.461493 20856 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:10:34.483196 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.483680 20856 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:34.485002 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:34.485661 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:34.486322 15303 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.486814 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.466619 15376 rpcz_store.cc:276] 0709 13:10:33.365789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.479087 (+113298us) service_pool.cc:224] Handling call
0709 13:10:34.462305 (+983218us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54001aaed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.462496 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82145024}
I20260709 13:10:34.448949 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.492121 20740 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.460747 20767 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:34.493544 20740 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.461797 20830 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:34.461714 20442 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:34.408573 20718 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:34.504158 15303 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:34.421309 16003 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:34.509171 15233 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:34.520993 15232 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:34.529500 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:34.382555 20795 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:34.545769 15227 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:34.546731 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:34.400579 20866 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:34.550583 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.551817 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:34.403095 20869 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.553369 15299 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:34.408839 20706 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:34.574478 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 201489us
I20260709 13:10:34.395692 20563 consensus_queue.cc:1059] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.160s
I20260709 13:10:34.576195 15273 leader_election.cc:400] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:34.583102 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.532229 20153 raft_consensus.cc:2764] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:34.550559 20847 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:34.552701 20866 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:34.591351 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.402369 20801 consensus_queue.cc:1059] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.169s
I20260709 13:10:34.596268 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:34.602327 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 197110us
I20260709 13:10:34.569744 20869 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:34.612789 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 163946us
I20260709 13:10:34.613287 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.614571 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.601298 20778 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:34.571993 20827 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:34.616277 20539 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.619406 20915 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:34.620883 20884 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:34.621414 20884 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.621860 20884 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.616181 20778 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.624375 20652 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:34.625114 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:34.625303 20779 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:34.625783 20779 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.611653 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:34.627931 20779 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.628944 20767 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:34.628623 15128 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 9, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.629664 20767 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.630541 15128 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.631523 20831 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.634842 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:34.635489 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:34.636199 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 108337us
I20260709 13:10:34.630837 20767 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.638703 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:34.587404 20442 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:34.587124 20830 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.606663 20905 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.650955 16005 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:10:34.590029 20718 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.609854 20866 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.566126 20674 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.664662 20442 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.665689 15232 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:34.669137 20893 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:34.660180 20830 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.675525 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:34.677037 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1068) took 1094 ms. Trace:
I20260709 13:10:34.708725 15379 rpcz_store.cc:276] 0709 13:10:33.582574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.116161 (+533587us) service_pool.cc:224] Handling call
0709 13:10:34.466377 (+350216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.467177 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.676743 (+209566us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54001aaed0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:34.676944 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679620864}
I20260709 13:10:34.654487 20779 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:34.681567 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68398.2us
I20260709 13:10:34.718617 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.688149 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:34.689446 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.689635 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:34.693292 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:34.676506 20870 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:34.597597 20836 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:10:34.705329 15128 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 10, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.608454 20795 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.710733 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:34.711457 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:34.715863 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:34.727847 15374 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:34.726876 15382 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.646255 20778 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.715867 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:34.732234 15376 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:34.732753 15376 pending_rounds.cc:85] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 5
I20260709 13:10:34.733011 15376 pending_rounds.cc:107] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:34.733269 15376 raft_consensus.cc:2889] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.733677 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:34.724603 15127 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 202) took 50587 ms (client timeout 15000 ms). Trace:
W20260709 13:10:34.736486 15127 rpcz_store.cc:269] 0709 13:09:44.061508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.107564 (+ 46056us) service_pool.cc:224] Handling call
0709 13:10:34.612244 (+50504680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:21.837085 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:22.057978 (+220893us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:22.058080 (+   102us) write_op.cc:435] Acquired schema lock
0709 13:10:22.058100 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:22.059291 (+  1191us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:22.059412 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:22.059438 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:10:22.060327 (+   889us) tablet.cc:701] Row locks acquired
0709 13:10:22.166851 (+106524us) write_op.cc:260] PREPARE: finished
0709 13:10:22.190917 (+ 24066us) write_op.cc:270] Start()
0709 13:10:22.218141 (+ 27224us) write_op.cc:276] Timestamp: P: 1783602622179613 usec, L: 0
0709 13:10:22.239521 (+ 21380us) op_driver.cc:348] REPLICATION: starting
0709 13:10:22.388048 (+148527us) log.cc:844] Serialized 3646 byte log entry
0709 13:10:23.807065 (+1419017us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:24.455685 (+648620us) op_driver.cc:464] REPLICATION: finished
0709 13:10:25.062134 (+606449us) write_op.cc:301] APPLY: starting
0709 13:10:25.062253 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:25.242219 (+179966us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:25.242282 (+    63us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:25.669777 (+427495us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:25.670208 (+   431us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:10:25.670270 (+    62us) write_op.cc:312] APPLY: finished
0709 13:10:25.670774 (+   504us) log.cc:844] Serialized 89 byte log entry
0709 13:10:25.671073 (+   299us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:25.671236 (+   163us) write_op.cc:454] Released schema lock
0709 13:10:25.671311 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:25.671835 (+   524us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:25.671866 (+    31us) write_op.cc:454] Released schema lock
0709 13:10:25.683880 (+ 12014us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b180019d2c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
Metrics: {"mutex_wait_us":1682368,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":605968,"apply.run_cpu_time_us":21221,"apply.run_wall_time_us":609784,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41711,"num_ops":9,"prepare.queue_time_us":422665,"prepare.run_cpu_time_us":47879,"prepare.run_wall_time_us":993050,"raft.queue_time_us":645176,"raft.run_cpu_time_us":32624,"raft.run_wall_time_us":367167,"replication_time_us":2215939,"spinlock_wait_cycles":49522176,"thread_start_us":1158666,"threads_started":4,"wal-append.queue_time_us":318792,"wal-append.run_cpu_time_us":36869,"wal-append.run_wall_time_us":3362017}]]}
I20260709 13:10:34.740939 15375 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:34.714437 20847 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:34.727022 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.728019 15378 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.716112 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:34.743054 15381 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.745508 15233 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:34.712363 20831 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.722368 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:34.715214 20735 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:34.753226 20735 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:34.754484 20735 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.712023 20776 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.757387 15377 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:34.770668 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:34.731242 20843 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:34.779376 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62850.4us
I20260709 13:10:34.772768 15128 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.741734 20874 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:34.741094 20779 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:34.805224 15128 catalog_manager.cc:5697] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.740024 20797 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.767400 20560 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.763386 20868 raft_consensus.cc:3055] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:34.769057 20915 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:34.823212 15128 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 6 to 9, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 9 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:34.825623 15377 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:34.794647 20875 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:34.829141 15128 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 14, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:34.767946 20706 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:34.804287 20834 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:34.814419 20836 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:34.836618 15273 leader_election.cc:400] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:34.838980 15128 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 13, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 13 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:34.846182 15273 leader_election.cc:403] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.816596 20843 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:10:34.842841 20649 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.006s
I20260709 13:10:34.822867 20868 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:34.794433 20652 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:10:34.863286 15377 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:34.822506 20778 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:10:34.767313 16005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:34.878620 15305 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:34.822728 20785 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.870922 15128 catalog_manager.cc:5697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.842877 20836 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:34.835692 20915 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:34.884157 20776 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:34.880327 16005 raft_consensus.cc:606] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:34.885663 20933 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:34.888031 20779 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.893121 20868 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.895422 15382 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:34.911690 15381 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:10:34.913779 20918 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 13:10:34.914757 20926 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:10:34.915406 20911 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
W20260709 13:10:34.915648 20920 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:10:34.916603 20921 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:10:34.917171 20912 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:10:34.916993 20583 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.918125 20674 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:34.875034 20834 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11.
I20260709 13:10:34.895270 20442 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.862020 20827 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:10:34.946435 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 111214us
I20260709 13:10:34.897336 20570 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:34.947432 15128 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 9, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:34.952543 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 152670us
I20260709 13:10:34.849278 20795 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.825909 20718 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.929742 20836 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.976943 20863 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.977730 20863 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:34.961184 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 122812us
I20260709 13:10:34.918844 20740 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:34.966439 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:34.966084 15128 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:34.967444 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 131099us
I20260709 13:10:34.981988 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:34.879186 20847 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.896247 20916 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:10:34.960199 20870 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:34.983683 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.943993 20776 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.979400 20740 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:34.986826 20863 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:34.987166 15128 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.994933 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:35.028405 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.030692 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:35.009655 20659 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.004s
I20260709 13:10:35.011245 20834 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:35.014277 20801 raft_consensus.cc:3055] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:35.015172 20560 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:35.060113 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78217.5us
I20260709 13:10:35.061522 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:35.034039 15128 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 10, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.998602 20778 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.043308 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.033627 15301 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:35.004305 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 270761us
I20260709 13:10:35.066854 15378 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:35.071657 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.072727 15308 raft_consensus.cc:2368] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:35.072052 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.075738 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.078441 15302 raft_consensus.cc:2410] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:35.075477 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.074905 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.080391 15299 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:35.077981 15128 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.021184 20570 raft_consensus.cc:2764] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:35.036789 20652 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.086959 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.083873 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.089993 15128 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.091403 15299 raft_consensus.cc:2368] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:35.079512 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.086138 15306 raft_consensus.cc:2368] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:10:35.082983 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.074723 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.096060 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.097110 15307 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:35.095954 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 246115us
I20260709 13:10:35.066025 20797 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.111598 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:35.059712 20560 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:35.086221 20827 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.101236 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.127450 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.096776 15128 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.053025 20801 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:35.000988 20843 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:34.981040 20915 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.021544 20869 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.127918 15299 raft_consensus.cc:2368] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13.
I20260709 13:10:35.060271 20834 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:35.137961 15128 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.050505 20659 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:35.067525 20924 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.078830 20778 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.157527 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:35.147531 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56656.1us
W20260709 13:10:35.139946 20884 consensus_meta.cc:287] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.004s
I20260709 13:10:35.159431 15128 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.164728 15128 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 11, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.162899 15303 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:35.172616 15128 catalog_manager.cc:5697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.174855 15128 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 11, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.176558 15128 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.181491 15128 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 9, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:35.187378 20936 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:10:35.188222 20935 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:10:35.168848 20560 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:35.189368 15299 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:35.166658 20941 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:35.212327 20583 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:35.212626 20941 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:35.213666 20941 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.199255 20801 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:35.202406 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.216106 15306 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:35.166986 20916 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:10:35.217100 20868 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:35.204721 16001 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:35.156615 20785 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:35.208320 15229 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.102085 20870 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.210536 20659 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.228319 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.229242 15306 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.221333 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:35.208840 15307 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:35.230312 15380 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.218387 20776 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:35.168509 20884 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.308025 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:35.290120 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 196797us
I20260709 13:10:35.309212 15128 catalog_manager.cc:5697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.315330 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:35.316723 15128 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 10, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 10 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:35.318673 15232 raft_consensus.cc:2368] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:35.319232 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:35.322813 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.323575 15307 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:35.324144 15299 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:35.216120 20866 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:35.165576 20924 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:35.321233 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 229382us
I20260709 13:10:35.302093 20938 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.326537 15179 auto_rebalancer.cc:629] Failed to schedule move for tablet 0952b977f0484de9aeb6cb7ca74a0580: Illegal state: Replica 0ec140f610ed4500ba58208c0e5519bb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:10:35.365614 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 140219us
W20260709 13:10:35.369503 15345 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.631s (SENT)
I20260709 13:10:35.364274 15128 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.370141 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.373622 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.377511 15307 raft_consensus.cc:2410] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:35.381282 16002 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:35.383208 15376 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.023s
W20260709 13:10:35.383579 15376 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.000s	sys 0.023s
W20260709 13:10:35.385336 15345 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.730s (SENT)
I20260709 13:10:35.385012 15128 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:35.385820 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.386591 15128 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 6 to 7, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.327778 20740 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:35.377146 20877 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.067s	user 0.014s	sys 0.002s
I20260709 13:10:35.315470 20881 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:10:35.412320 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:35.374152 20776 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.432818 15374 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:10:35.434125 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48800.2us
W20260709 13:10:35.435302 15345 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.758s (SENT)
I20260709 13:10:35.435482 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:35.320845 20735 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:10:35.353055 20830 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:10:35.398456 20905 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.000s
I20260709 13:10:35.464303 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.437222 15374 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:10:35.437948 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 338017us
W20260709 13:10:35.480394 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.437225 15378 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:35.485277 15378 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:35.488911 15307 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:10:35.489480 15307 pending_rounds.cc:85] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 12
I20260709 13:10:35.489770 15307 pending_rounds.cc:107] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:10:35.490052 15307 raft_consensus.cc:2889] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.491118 15128 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.396994 20785 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.493568 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.493654 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:35.494727 15304 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:35.516129 15376 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.519730 20866 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.522409 20884 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.493294 20905 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.467015 20847 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:35.532087 15380 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:35.533299 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.534402 15128 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 9, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 9 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.515295 15378 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.540755 15306 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:35.541441 15378 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.549332 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.550377 15306 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:35.379674 20938 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.437543 20877 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.556806 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:35.541321 20949 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:10:35.557983 15345 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.883s (SENT)
I20260709 13:10:35.569718 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.557703 15128 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:35.495666 20936 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:35.556814 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.517753 20834 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:35.468210 20776 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.532146 20869 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.578369 15128 catalog_manager.cc:5697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 10, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.547313 20865 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:35.579576 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.582641 15378 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:35.585157 15229 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:35.593302 15306 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:35.590595 15299 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:35.590981 15225 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:35.595134 15378 pending_rounds.cc:85] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 7
W20260709 13:10:35.595093 15345 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.916s (SENT)
I20260709 13:10:35.599860 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:35.600184 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.598434 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.599339 15378 pending_rounds.cc:107] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:35.601265 15378 raft_consensus.cc:2889] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.606725 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:35.590624 20785 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.618568 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.619439 15305 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:35.620815 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.621760 15299 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:35.622288 20938 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.622763 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.561611 20943 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.235s
W20260709 13:10:35.623273 20948 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.317s	user 0.000s	sys 0.002s
W20260709 13:10:35.606419 20919 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.903s	user 0.003s	sys 0.000s
I20260709 13:10:35.620815 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.654876 15376 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:35.655817 15300 raft_consensus.cc:2368] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:35.636668 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.639375 20776 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:35.640620 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:35.610427 15345 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.931s (SENT)
I20260709 13:10:35.658749 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.648902 15305 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:35.651190 16004 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:35.661494 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.668920 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:35.699049 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88674.1us
W20260709 13:10:35.706224 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.708879 15345 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.955s (SENT)
W20260709 13:10:35.709870 15345 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.956s (SENT)
I20260709 13:10:35.598222 20865 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:35.710064 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.609827 20847 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.711386 15305 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:35.648690 20834 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.713662 15300 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:35.713801 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.717272 15302 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
W20260709 13:10:35.718336 15345 leader_election.cc:336] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.993s (SENT)
I20260709 13:10:35.719015 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.706255 20779 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:35.730034 20827 consensus_meta.cc:287] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:10:35.730665 20827 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:35.732728 20836 consensus_meta.cc:287] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.005s
I20260709 13:10:35.733309 20836 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:35.723556 20834 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.739109 20834 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.740257 20735 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:35.741123 20865 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:35.712548 20649 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.744635 20649 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:35.747509 20649 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:35.749495 20706 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:35.749536 15306 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:35.751186 15308 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:35.751623 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:35.752774 20964 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:10:35.753834 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.755384 20951 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.113s
W20260709 13:10:35.758266 20956 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:10:35.764629 20914 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.147s	user 0.004s	sys 0.000s
W20260709 13:10:35.769578 20966 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:10:35.772490 20965 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:35.780988 15227 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:35.780880 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:35.781662 15233 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:10:35.782269 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:35.781697 15226 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:35.784155 15224 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:35.787206 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2610) took 1562 ms. Trace:
I20260709 13:10:35.750144 20706 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:35.793232 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:35.787711 15225 rpcz_store.cc:276] 0709 13:10:34.225045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.236902 (+ 11857us) service_pool.cc:224] Handling call
0709 13:10:34.237198 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.594879 (+1357681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.786905 (+192026us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003ffcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:35.787120 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3112808192}
I20260709 13:10:35.785919 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:35.805058 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86763.9us
I20260709 13:10:35.805171 15304 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
W20260709 13:10:35.807583 15345 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.068s (SENT)
I20260709 13:10:35.804189 15305 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:35.816722 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.818760 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.821378 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.822283 15306 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.764138 20778 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:35.819759 15304 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:35.826009 20865 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:35.830981 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.831542 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.818529 20945 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.836207 20388 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:10:35.806635 20442 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:35.839978 15305 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:35.812836 20776 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:35.841526 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.839198 20836 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:35.806438 20649 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:35.855578 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.845463 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.893121 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:35.857486 15305 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:35.884382 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 797) took 1360 ms. Trace:
I20260709 13:10:35.897264 16001 rpcz_store.cc:276] 0709 13:10:34.523522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.523676 (+   154us) service_pool.cc:224] Handling call
0709 13:10:34.550232 (+ 26556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.222257 (+672025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.883993 (+661736us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54004f3654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:35.884250 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497337600}
I20260709 13:10:35.886413 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3097) took 1197 ms. Trace:
I20260709 13:10:35.901257 15304 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.901499 15373 rpcz_store.cc:276] 0709 13:10:34.689170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.689330 (+   160us) service_pool.cc:224] Handling call
0709 13:10:35.886109 (+1196779us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400224f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:35.886325 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502015872}
I20260709 13:10:35.882086 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:35.871068 20776 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:35.882284 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.905093 20669 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:35.896373 15306 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:35.909644 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.904165 20954 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.910243 15305 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:35.877245 20969 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:10:35.857933 20973 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:10:35.853519 20932 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:35.923775 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.847150 20778 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:35.860155 20868 consensus_meta.cc:287] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.007s
I20260709 13:10:35.933897 15305 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:35.934129 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:35.941553 15304 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:35.900770 20847 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.913183 20831 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.943536 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:35.948527 15305 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:35.854264 20779 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:10:35.853699 20442 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:10:35.951376 15306 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:35.955544 15305 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:10:35.939504 20808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.035s	sys 0.030s
I20260709 13:10:35.989979 15305 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:36.005712 15305 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:35.950856 20932 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.009233 15306 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:10:36.003934 20808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.036s	sys 0.030s
I20260709 13:10:36.003069 20843 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:10:36.014007 20920 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:36.028081 15304 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:36.031160 15225 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:35.955569 20831 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.042694 15306 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:36.068045 15229 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:36.088768 20388 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:10:36.103185 20442 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:36.132833 20442 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:36.134707 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.135485 20442 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:36.051209 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 158160us
I20260709 13:10:36.069789 20649 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.136682 20486 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:36.137234 20486 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:36.137084 20649 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.138453 20486 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.140807 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:36.080283 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.141256 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:36.057045 20874 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:36.139851 20649 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:36.143445 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:36.144506 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:36.144912 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:36.145334 20486 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.145066 20978 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:36.145953 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:36.030135 20843 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:36.060050 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:36.152415 15225 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:36.147678 20933 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:36.158740 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98812.4us
I20260709 13:10:36.043678 20776 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:36.154001 16005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40990 (request call id 12) took 1440 ms. Trace:
I20260709 13:10:36.159878 15224 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:36.159789 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.159632 16005 rpcz_store.cc:276] 0709 13:10:34.715405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.725127 (+  9722us) service_pool.cc:224] Handling call
0709 13:10:36.110504 (+1385377us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54004ed7a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa3520 00007f2f53b20652 00007f2f58aee60a 00007f2f520747d4 00007f2f52074762 00007f2f52074691 00007f2f5207460c 00007f2f520738c2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:36.146289 (+ 35785us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316019584}
I20260709 13:10:36.127297 20808 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:36.165803 15345 leader_election.cc:400] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
W20260709 13:10:36.166435 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.166987 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:36.159468 20649 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:36.176226 20649 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:36.177234 20649 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.172951 15348 leader_election.cc:400] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:36.174939 20785 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:36.166399 20984 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.161168 20767 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:36.162967 20978 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.177227 20924 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:36.178364 15348 leader_election.cc:403] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:36.165858 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:36.159116 20933 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:36.154505 20874 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.200662 20867 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:36.201293 20867 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:36.201570 20962 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.640s	user 0.001s	sys 0.001s
I20260709 13:10:36.201711 20867 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:36.204008 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:36.205309 20977 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.198s	user 0.000s	sys 0.002s
I20260709 13:10:36.205513 20984 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:36.205819 20947 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:36.206341 20947 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:36.206142 20984 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.207257 20947 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.208461 20984 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:36.210847 15179 auto_rebalancer.cc:629] Failed to schedule move for tablet 872a48310a1f4a28b75d05f83ce6b20b: Illegal state: Replica 0ec140f610ed4500ba58208c0e5519bb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:36.212980 20984 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.213388 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.215556 20776 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:36.219055 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53284.1us
I20260709 13:10:36.181190 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.180944 20779 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:36.184098 20767 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:36.178802 20785 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:36.179131 20808 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:36.178566 20649 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.185998 20978 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:36.194862 20976 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:10:36.221603 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.245187 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.246250 20847 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:36.252766 20945 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:36.253249 20847 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.253666 20847 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.254535 20967 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:36.255528 16002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 543) took 1777 ms (client timeout 1998 ms). Trace:
W20260709 13:10:36.247778 20955 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.643s	user 0.002s	sys 0.000s
W20260709 13:10:36.256166 16002 rpcz_store.cc:269] 0709 13:10:34.477886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.478155 (+   269us) service_pool.cc:224] Handling call
0709 13:10:36.255185 (+1777030us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400635454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:36.255424 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073913600}
I20260709 13:10:36.256847 20877 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:10:36.257972 20779 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:36.257988 16008 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:36.260802 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:36.262578 20801 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.264825 20779 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:36.265379 20779 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.265800 20779 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.265564 20767 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.269292 20915 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:36.272845 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.274294 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.248435 20933 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.250625 20560 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.252440 20830 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:36.282256 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:36.322623 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:36.284621 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:36.327198 16000 raft_consensus.cc:2393] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:36.288000 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:36.328233 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88241.7us
I20260709 13:10:36.329692 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:36.289438 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:36.321610 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.323014 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:36.336409 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:36.321004 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.231281 20785 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.228396 20442 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:36.260028 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:36.340548 16001 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:36.327834 20830 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:36.326543 15999 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
W20260709 13:10:36.345805 15379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3109) took 1637 ms (client timeout 2021 ms). Trace:
W20260709 13:10:36.346405 15379 rpcz_store.cc:269] 0709 13:10:34.711659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.718198 (+  6539us) service_pool.cc:224] Handling call
0709 13:10:36.341109 (+1622911us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540023dcd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:36.345715 (+  4606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551196416}
I20260709 13:10:36.347432 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:36.347939 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59009.1us
I20260709 13:10:36.354655 15303 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:36.319644 20937 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.352012 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:36.188001 20843 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.371876 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:36.341336 20945 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:36.372210 20831 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:36.356323 20961 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:10:36.373356 20933 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:36.360954 20922 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:36.237188 20808 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.350633 20877 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:36.345351 20442 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:36.396502 16001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe"
dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:40990
I20260709 13:10:36.402294 16001 raft_consensus.cc:606] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:36.403817 16001 raft_consensus.cc:614] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:36.381443 20865 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:36.405333 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53426.6us
I20260709 13:10:36.409969 15301 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:36.350265 20967 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:10:36.358276 20868 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:10:36.372608 20874 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:36.358043 20797 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:10:36.408871 20986 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:10:36.372474 20952 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:36.383337 20674 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:10:36.459465 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.406235 20442 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:36.446228 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.461436 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:36.462498 15374 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:36.397765 20922 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:36.473965 15373 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.382670 20937 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.418450 20881 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:36.483973 15373 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:36.485698 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:36.486698 15378 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:36.486558 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:36.427173 20831 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:36.495306 15374 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:36.426625 20924 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.498721 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.421615 20877 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:36.500658 15375 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:36.512225 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:36.512956 15378 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:10:36.516598 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 227273us
I20260709 13:10:36.424317 20539 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:10:36.480051 20776 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:36.411538 20830 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:36.532819 20988 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.136s	user 0.001s	sys 0.002s
W20260709 13:10:36.537706 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 263491us
I20260709 13:10:36.497215 20831 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:36.542990 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d55ea5972868497eb17221413640fbea"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:36.504177 20881 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:36.544729 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.502091 20989 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.595090 15228 raft_consensus.cc:606] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:36.606669 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62003us
I20260709 13:10:36.526484 20978 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:36.535111 20776 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:36.504899 20922 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:36.638047 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 266222us
I20260709 13:10:36.594295 20831 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:36.509258 20924 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:36.660979 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 269237us
I20260709 13:10:36.658854 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:36.594728 20649 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.535779 20153 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:10:36.605820 20967 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.541090 20388 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:10:36.678983 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:36.639120 20953 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.655586 20486 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.639576 20830 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.655157 20776 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.655534 20989 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:36.676870 20987 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.432s	user 0.003s	sys 0.000s
I20260709 13:10:36.688000 15382 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:36.609516 20867 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.688432 20916 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.685403 20874 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.605361 20847 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:36.804441 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.677898 20779 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.682569 20649 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.690028 20967 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.770808 20994 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.699298 20953 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.776305 20995 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.677147 20706 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:36.853087 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 263194us
I20260709 13:10:36.854249 15373 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:36.859323 15378 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:36.819149 20674 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:36.862555 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:36.866725 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:36.839103 20808 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:36.859023 20975 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.803s	user 0.004s	sys 0.004s
I20260709 13:10:36.790335 20486 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.731220 20877 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.827404 20874 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:36.759184 20881 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.886029 20706 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.923888 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 796) took 2391 ms. Trace:
I20260709 13:10:36.924530 16008 rpcz_store.cc:276] 0709 13:10:34.523127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.523746 (+   619us) service_pool.cc:224] Handling call
0709 13:10:36.257628 (+1733882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.259579 (+  1951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.914366 (+654787us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400635450. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:36.914605 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3922686336}
I20260709 13:10:36.874946 20674 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.953975 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 803) took 1205 ms. Trace:
I20260709 13:10:36.849025 20994 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.957566 15382 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:36.959046 20994 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:36.954743 16004 rpcz_store.cc:276] 0709 13:10:35.748255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.748421 (+   166us) service_pool.cc:224] Handling call
0709 13:10:35.748769 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.749135 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.749169 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.749695 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.900510 (+150815us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:35.902590 (+  2080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.902672 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.543217 (+640545us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:36.953411 (+410194us) raft_consensus.cc:1685] finished
0709 13:10:36.953453 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.953852 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1937,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":9614592,"thread_start_us":150303,"threads_started":1,"wal-append.queue_time_us":265637}
I20260709 13:10:36.926926 21006 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.980803 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 114206us
I20260709 13:10:36.923415 20989 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:36.864866 20995 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:36.929325 20808 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:36.989212 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 167480us
W20260709 13:10:36.981665 20992 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.326s	user 0.000s	sys 0.002s
I20260709 13:10:36.982069 20998 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.016645 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
W20260709 13:10:37.005558 20996 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.186s	user 0.000s	sys 0.002s
I20260709 13:10:37.005863 20388 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:36.997997 20153 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:37.026068 20486 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:36.968719 21005 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:10:37.006762 20952 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:37.036919 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:37.045127 15303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.010s	sys 0.014s
W20260709 13:10:37.048626 15303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.011s	sys 0.014s
I20260709 13:10:36.993322 20808 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.049032 15377 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:37.028183 20924 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:37.040833 20990 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 13:10:37.042802 20994 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:36.988534 20989 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.038497 20388 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.043179 20967 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.058094 20779 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:37.045291 20847 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:36.990688 21006 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.050351 20952 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.072753 21012 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.101143 20994 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.101594 21012 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.103742 20994 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:37.072499 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.092177 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.116679 15380 raft_consensus.cc:2368] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12.
I20260709 13:10:37.118300 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:37.119040 15377 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.140000 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:37.043442 20153 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.145653 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.147610 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.060428 21004 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:37.086966 20785 consensus_meta.cc:287] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
I20260709 13:10:37.079839 20674 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:37.097314 21011 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:37.100281 20952 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.027379 20998 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.141341 20953 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:37.153066 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 490373us
I20260709 13:10:37.099431 21006 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:37.139499 20984 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.926s	user 0.013s	sys 0.002s
I20260709 13:10:37.082921 20388 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:37.155123 15273 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.525s (SENT)
I20260709 13:10:37.149410 21012 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:37.087303 20560 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.753s	user 0.007s	sys 0.006s
W20260709 13:10:37.150959 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 376136us
I20260709 13:10:37.116549 20649 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.078573 20989 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:37.081073 21016 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:37.094458 21007 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:37.171439 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.172122 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:37.172298 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:37.235473 15300 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:37.091439 20991 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 13:10:37.097450 21001 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 13:10:37.178217 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.158360 21004 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:10:37.175354 15345 connection.cc:256] RPC call timeout handler was delayed by -1.1557561920001262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:10:37.194347 16001 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:37.247859 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.197427 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:37.202529 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.154150 20785 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.248801 15299 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:37.257753 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.258296 15381 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.258792 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:37.172781 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.261184 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.262130 15306 raft_consensus.cc:2410] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:37.235471 15303 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 8: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:37.173391 20984 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
W20260709 13:10:37.229655 20915 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.960s	user 0.016s	sys 0.000s
I20260709 13:10:37.263671 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.263671 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.189299 20836 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.265882 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:37.270232 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 105228us
I20260709 13:10:37.271853 15306 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.268571 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.274484 15300 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:37.275969 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:37.242509 20933 consensus_meta.cc:287] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.842s	user 0.015s	sys 0.000s
I20260709 13:10:37.269475 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:37.270817 15305 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:37.278872 15381 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:37.285969 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.287858 15307 raft_consensus.cc:2410] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:10:37.288452 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.294028 15305 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:37.300750 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.302078 15304 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:37.303570 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.304814 15304 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:37.283480 15303 raft_consensus.cc:2376] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10. Re-sending same reply.
I20260709 13:10:37.265600 20978 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.316004 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:37.316447 15273 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.607s (SENT)
I20260709 13:10:37.317302 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:37.317099 15305 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:37.319263 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.526s (SENT) [suppressed 26 similar messages]
W20260709 13:10:37.322440 15273 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.643s (SENT)
W20260709 13:10:37.323295 15273 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.659s (SENT)
I20260709 13:10:37.323644 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:37.280414 21027 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.282879 20836 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:37.291535 20997 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.331115 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:37.298038 20989 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:37.333501 15306 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:37.341952 15303 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:10:37.349903 15376 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:37.349814 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.350889 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.351820 15303 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:37.344110 15305 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:37.355506 21033 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.356683 21033 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.361191 21033 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.320324 20560 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.328212 20649 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:37.327953 21024 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.328378 21012 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:37.373387 15303 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:37.362991 20968 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:37.241472 21016 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.314834 21005 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:37.385552 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:37.341039 20995 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:37.378504 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.393064 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:37.398941 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67952.7us
I20260709 13:10:37.400483 21026 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.401496 21026 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.396571 16004 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:37.399241 15303 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:37.318887 20978 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:37.309132 21004 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.409857 20153 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.410408 20924 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:37.373013 20915 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:37.412969 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 140390us
W20260709 13:10:37.413213 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93972.1us
I20260709 13:10:37.421715 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:37.407205 20776 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.654s	user 0.014s	sys 0.000s
I20260709 13:10:37.427771 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.366541 20989 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.345427 20997 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.435050 15377 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:37.377465 20560 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:37.436987 21022 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
W20260709 13:10:37.439431 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.412160 20830 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:37.427498 20153 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:37.430862 20922 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.754s	user 0.015s	sys 0.001s
I20260709 13:10:37.453104 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.454468 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.455025 15377 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:37.455766 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.457492 15306 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:37.458470 15377 raft_consensus.cc:2410] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:37.459743 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.465148 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:37.469206 21037 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.470108 20953 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:37.338618 21027 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.475224 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.443517 21012 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:37.470265 21037 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.405186 20968 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.431437 20776 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:37.457664 21018 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
W20260709 13:10:37.452204 20801 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.189s	user 0.014s	sys 0.005s
I20260709 13:10:37.494812 20995 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.512048 20995 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.513094 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:37.448123 21033 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:37.516794 21033 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.446249 20649 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:37.520865 20649 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.418570 20924 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.526743 20924 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.527593 20924 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:37.487733 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.538307 15377 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:37.488066 21026 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.503260 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3127) took 1015 ms. Trace:
I20260709 13:10:37.506363 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:37.539765 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.540184 15305 raft_consensus.cc:2368] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15.
I20260709 13:10:37.411041 20836 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.500161 15228 raft_consensus.cc:606] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:37.539695 15373 rpcz_store.cc:276] 0709 13:10:36.488257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.497301 (+  9044us) service_pool.cc:224] Handling call
0709 13:10:36.497839 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.860807 (+362968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.503017 (+642210us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540014cdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:37.503197 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812390656}
I20260709 13:10:37.543840 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.544062 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:37.538887 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3129) took 1050 ms. Trace:
I20260709 13:10:37.542799 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.547215 15377 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 6: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:37.545608 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:37.545802 15374 rpcz_store.cc:276] 0709 13:10:36.488751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.498858 (+ 10107us) service_pool.cc:224] Handling call
0709 13:10:36.499352 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.698187 (+198835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.698223 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.733577 (+ 35354us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.985202 (+251625us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:36.985311 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.987217 (+  1906us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.538495 (+551278us) raft_consensus.cc:1685] finished
0709 13:10:37.538518 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.538792 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9663,"raft.queue_time_us":388566,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":9059,"thread_start_us":343864,"threads_started":2,"wal-append.queue_time_us":257507}
I20260709 13:10:37.551172 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.553987 15373 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:37.558312 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:37.558552 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:37.524151 20649 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.458941 20153 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.452538 20830 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.571379 15375 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:37.577673 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.578908 20968 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.451249 21028 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
I20260709 13:10:37.398284 21024 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.510251 20998 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.588742 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:37.593914 15305 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:37.530925 20623 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.605108 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3123) took 1119 ms. Trace:
I20260709 13:10:37.605671 15381 rpcz_store.cc:276] 0709 13:10:36.485656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.485994 (+   338us) service_pool.cc:224] Handling call
0709 13:10:37.604846 (+1118852us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54001aa4d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:37.605012 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755845632}
W20260709 13:10:37.607029 20442 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.107s	user 0.016s	sys 0.001s
I20260709 13:10:37.607326 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.607614 20442 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:37.609143 15307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2408) took 2110 ms (client timeout 1663 ms). Trace:
I20260709 13:10:37.609409 20560 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:37.610237 15299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2423) took 1990 ms (client timeout 1526 ms). Trace:
I20260709 13:10:37.559360 21033 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.613775 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.461548 20922 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.574934 21026 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:37.502228 21012 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:37.638195 15299 rpcz_store.cc:269] 0709 13:10:35.619933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.622489 (+  2556us) service_pool.cc:224] Handling call
0709 13:10:37.610036 (+1987547us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003e17d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:37.610159 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3737760512}
I20260709 13:10:37.625906 20153 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:37.627744 21013 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:10:37.586555 20836 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.626304 21024 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:37.632400 15307 rpcz_store.cc:269] 0709 13:10:35.498399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.532959 (+ 34560us) service_pool.cc:224] Handling call
0709 13:10:37.608874 (+2075915us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b540025a3d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:37.609030 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4019386112}
I20260709 13:10:37.640044 15379 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:37.640108 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:37.629933 20706 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.007s
I20260709 13:10:37.611286 20649 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:37.575479 20924 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.641609 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.620507 20998 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:37.641618 20989 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:37.648188 21048 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.676510 15373 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:37.620628 20623 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.681016 21055 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.678817 20649 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.682963 21027 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:37.684126 20924 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.684595 20998 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.685642 21012 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.684150 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.636909 20953 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:37.669600 20929 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.717526 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.720124 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 775) took 1033 ms. Trace:
I20260709 13:10:37.689198 20153 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.719957 15381 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:37.723757 15308 rpcz_store.cc:276] 0709 13:10:36.686277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.686402 (+   125us) service_pool.cc:224] Handling call
0709 13:10:36.686705 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.687011 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.687033 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.687456 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.034863 (+347407us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:37.034919 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.034998 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.719854 (+684856us) raft_consensus.cc:1685] finished
0709 13:10:37.719875 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.720048 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":209957,"spinlock_wait_cycles":9410944,"thread_start_us":339590,"threads_started":1,"wal-append.queue_time_us":456866}
I20260709 13:10:37.723090 15373 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:37.739424 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 183996us
I20260709 13:10:37.740528 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:37.742987 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:37.702980 21048 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.757130 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.780078 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:37.787632 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3139) took 1287 ms. Trace:
I20260709 13:10:37.788264 15381 rpcz_store.cc:276] 0709 13:10:36.500778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.782228 (+1281450us) service_pool.cc:224] Handling call
0709 13:10:37.786884 (+  4656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.787143 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.787181 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.787238 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:37.787287 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.787360 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.787536 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.792650 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:37.736508 21026 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.810038 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.740281 20153 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:37.830605 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:37.710706 21042 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:10:37.778898 20929 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.840404 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3140) took 1332 ms. Trace:
I20260709 13:10:37.841001 15373 rpcz_store.cc:276] 0709 13:10:36.507991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.793722 (+1285731us) service_pool.cc:224] Handling call
0709 13:10:37.839518 (+ 45796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.839833 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.839873 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.839938 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:37.839999 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.840081 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.840269 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.782934 20995 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:37.786020 21048 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.846011 21056 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.834611 20153 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.852478 21050 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:37.853142 21036 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:37.830955 21033 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:37.884410 21033 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.884940 21033 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.854581 20776 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:37.865602 20831 consensus_meta.cc:287] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.183s	user 0.014s	sys 0.004s
I20260709 13:10:37.869082 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.870911 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:37.895402 15377 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:37.845237 20929 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.873060 20153 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.874254 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3130) took 1385 ms. Trace:
I20260709 13:10:37.874706 21037 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.826450 21016 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.718626 21055 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.895931 20735 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:37.913398 20735 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:37.914486 20735 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.875543 21050 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.918674 21050 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.880306 20922 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:37.835286 21026 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:37.920236 20843 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.881703 20649 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.881707 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:37.921231 15302 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.890585 20830 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:37.922278 21026 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.890822 20937 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.907373 20442 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:37.892556 20808 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.833776 21047 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:37.883261 21036 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:37.903025 15377 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:37.904837 15373 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:37.927657 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3141) took 1415 ms. Trace:
I20260709 13:10:37.905588 15375 rpcz_store.cc:276] 0709 13:10:36.488952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.506871 (+ 17919us) service_pool.cc:224] Handling call
0709 13:10:36.533574 (+ 26703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.573688 (+1040114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.873929 (+300241us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400224554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:37.874180 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385984768}
I20260709 13:10:37.908921 15374 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:37.928105 15373 rpcz_store.cc:276] 0709 13:10:36.512110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.859726 (+1347616us) service_pool.cc:224] Handling call
0709 13:10:37.904317 (+ 44591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.925926 (+ 21609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.927601 (+  1675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.933923 15377 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:10:38.015909 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.924376 21047 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:37.926774 21036 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.089166 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3120) took 1605 ms. Trace:
I20260709 13:10:38.090535 20442 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:38.091858 20778 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.092803 21006 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:37.899422 20831 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:38.103462 15379 rpcz_store.cc:276] 0709 13:10:36.483393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.484449 (+  1056us) service_pool.cc:224] Handling call
0709 13:10:36.484767 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.670026 (+1185259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.088218 (+418192us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400224a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:38.089076 (+   858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2656406400}
W20260709 13:10:38.102866 15273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.040s	sys 0.102s
W20260709 13:10:38.106058 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.938172 20998 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:37.898898 21056 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:38.128262 15197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.007s	sys 0.019s
W20260709 13:10:38.176148 15197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.007s	sys 0.019s
I20260709 13:10:38.154589 21009 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:38.159987 15273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.041s	sys 0.102s
W20260709 13:10:38.180729 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 635172us
I20260709 13:10:38.181774 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:38.199559 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.025s
W20260709 13:10:38.200176 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.000s	sys 0.025s
W20260709 13:10:38.200641 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 614590us
W20260709 13:10:38.214502 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.221761 15229 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:10:38.224360 15225 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:38.225735 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.228057 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:38.229318 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.230713 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:38.229833 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.088s	sys 0.173s
W20260709 13:10:38.233493 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.088s	sys 0.173s
I20260709 13:10:38.243310 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.202152 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:38.246196 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:38.242573 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:38.235453 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.250900 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.125871 20442 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:38.235108 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 724215us
I20260709 13:10:38.155445 20776 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.204438 20968 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.229795 20767 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:38.239966 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:38.247921 20998 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:38.324522 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78002.4us
I20260709 13:10:38.323802 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:38.129242 20778 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:38.128424 21034 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.013s	sys 0.033s
I20260709 13:10:38.294451 15231 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:10:38.353101 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:38.230962 21027 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.341727 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.229535 20706 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:38.344864 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 105043us
I20260709 13:10:38.241549 21056 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:38.360220 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:38.329998 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.129055 21006 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:38.357395 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:38.362349 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:38.325448 21012 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:38.349907 20836 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.679s	user 0.015s	sys 0.000s
I20260709 13:10:38.383098 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:38.359582 21034 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.014s	sys 0.034s
I20260709 13:10:38.390085 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.392275 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.348551 20915 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:38.397061 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:38.340391 20937 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:38.351761 20998 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:38.339887 20938 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:38.347193 20776 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:38.366248 20830 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:38.405779 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.228642 21009 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:38.412983 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:38.387271 20808 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.431843 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.351114 20767 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:38.350498 20968 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:10:38.455152 15302 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.005s
I20260709 13:10:38.403223 21026 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:38.437969 15305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.000s	sys 0.027s
W20260709 13:10:38.455276 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 98006.6us
I20260709 13:10:38.456701 15302 raft_consensus.cc:2410] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:38.452656 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:38.456930 15305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.001s	sys 0.027s
I20260709 13:10:38.373733 21027 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:38.417070 20938 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.392362 20706 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:10:38.462842 15231 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:38.464509 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2451) took 1228 ms. Trace:
I20260709 13:10:38.507308 15302 rpcz_store.cc:276] 0709 13:10:37.236839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.292792 (+ 55953us) service_pool.cc:224] Handling call
0709 13:10:37.881516 (+588724us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b58000a1d98. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:10:38.464398 (+582882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6940032}
I20260709 13:10:38.415156 20998 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.505481 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.427124 20830 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.519780 15229 raft_consensus.cc:2410] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:38.505190 15230 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:38.527158 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.530170 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.426362 20808 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:38.536831 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.547601 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.551144 21056 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:38.551174 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.554912 20486 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.555287 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.555693 20843 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 13:10:38.583052 20843 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:38.560549 20943 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.518116 20797 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:38.462162 21052 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.442997 20153 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:38.416687 20937 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:38.506369 20938 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:38.583794 15382 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:38.534446 20830 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:38.464362 21026 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:38.624312 15301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.016s	sys 0.014s
W20260709 13:10:38.657595 15301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.016s	sys 0.014s
W20260709 13:10:38.635227 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.571357 20808 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:38.623775 15307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.010s	sys 0.017s
W20260709 13:10:38.664878 15307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.010s	sys 0.018s
I20260709 13:10:38.581151 20831 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:38.623275 20674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.011s	sys 0.019s
I20260709 13:10:38.635996 20843 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:38.601511 20486 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:38.584790 21056 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:38.687175 15308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.011s	sys 0.029s
I20260709 13:10:38.642280 20797 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:38.642045 20943 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:38.673717 21047 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:38.670176 20674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.011s	sys 0.020s
W20260709 13:10:38.646654 21033 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.011s
W20260709 13:10:38.702625 20877 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.009s	sys 0.042s
W20260709 13:10:38.721083 15374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.026s	sys 0.048s
W20260709 13:10:38.722735 15374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.027s	sys 0.048s
I20260709 13:10:38.693432 20442 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:38.699747 21004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.009s	sys 0.034s
W20260709 13:10:38.711325 15308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.011s	sys 0.030s
W20260709 13:10:38.733655 15224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.038s	sys 0.060s
W20260709 13:10:38.739524 15224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.038s	sys 0.060s
W20260709 13:10:38.720974 20388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.020s	sys 0.015s
W20260709 13:10:38.712199 20940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.015s	sys 0.026s
W20260709 13:10:38.733546 20877 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.009s	sys 0.043s
I20260709 13:10:38.717572 20778 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:38.739934 21006 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:38.712154 20785 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:38.751396 20388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.021s	sys 0.015s
W20260709 13:10:38.738508 21004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.009s	sys 0.035s
W20260709 13:10:38.751329 20929 consensus_meta.cc:287] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.004s
W20260709 13:10:38.753140 20940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.017s	sys 0.027s
I20260709 13:10:38.755337 20776 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:38.843677 20968 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:38.732625 21029 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.485s	user 0.029s	sys 0.026s
W20260709 13:10:38.897475 15377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.038s	sys 0.094s
W20260709 13:10:38.969918 15377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.042s	sys 0.105s
W20260709 13:10:38.911615 15373 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.034s	sys 0.093s
I20260709 13:10:38.747624 21053 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:38.951838 15375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.013s	sys 0.055s
W20260709 13:10:38.972395 15375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.014s	sys 0.055s
W20260709 13:10:38.952437 15348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.018s	sys 0.020s
W20260709 13:10:38.717928 20881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.014s	sys 0.032s
W20260709 13:10:38.973517 15348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.019s	sys 0.020s
I20260709 13:10:38.976564 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.977921 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:38.968559 15379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.013s
W20260709 13:10:38.971112 15373 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.039s	sys 0.098s
I20260709 13:10:38.978092 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.981871 21026 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:38.982556 20843 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:38.983188 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:38.964128 21061 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.311s	user 0.000s	sys 0.005s
I20260709 13:10:38.737314 21033 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:38.967060 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.984234 15224 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
W20260709 13:10:39.015235 15379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.005s	sys 0.013s
W20260709 13:10:38.969709 21029 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.722s	user 0.029s	sys 0.026s
I20260709 13:10:39.015162 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:39.013455 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:38.991148 15229 raft_consensus.cc:2410] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:39.034554 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:38.945317 21034 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.045694 15232 raft_consensus.cc:2393] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:39.033172 21026 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.047302 21026 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:39.049990 21026 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:39.033713 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:39.056910 20797 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:39.035280 15231 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:10:39.062899 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3215) took 1812 ms. Trace:
I20260709 13:10:38.985381 21027 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:39.064424 21047 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.065022 21047 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:39.067641 21047 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:39.072670 20938 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:38.975028 20881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.015s	sys 0.033s
I20260709 13:10:39.084273 21034 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:39.090720 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3219) took 1825 ms. Trace:
I20260709 13:10:38.980245 20767 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:39.094867 21048 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.202s	user 0.012s	sys 0.008s
I20260709 13:10:39.095474 21048 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.097369 20486 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:38.957538 20929 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.099280 15233 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:39.099527 20938 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:39.100589 21034 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:38.984229 21053 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:39.108307 21053 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.091254 15307 rpcz_store.cc:276] 0709 13:10:37.265389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.667212 (+401823us) service_pool.cc:224] Handling call
0709 13:10:37.667736 (+   524us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:37.668297 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.668358 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:37.669174 (+   816us) log.cc:844] Serialized 52 byte log entry
0709 13:10:38.670531 (+1001357us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:38.670586 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.670689 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.090418 (+419729us) raft_consensus.cc:1685] finished
0709 13:10:39.090447 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.090642 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9191,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":13580,"thread_start_us":1000844,"threads_started":1,"wal-append.queue_time_us":1364898}
I20260709 13:10:39.063491 15305 rpcz_store.cc:276] 0709 13:10:37.250782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.613153 (+362371us) service_pool.cc:224] Handling call
0709 13:10:37.626922 (+ 13769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.627428 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.627464 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.628111 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.459244 (+831133us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:38.459343 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.459442 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.062635 (+603193us) raft_consensus.cc:1685] finished
0709 13:10:39.062659 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.062819 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2372,"raft.queue_time_us":15965,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":6552,"thread_start_us":830587,"threads_started":1,"wal-append.queue_time_us":1432406}
I20260709 13:10:39.132612 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.133226 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:39.143720 15307 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.143779 15305 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:39.154637 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:39.155417 15306 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:39.155679 15302 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:39.159775 15345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.016s	sys 0.084s
W20260709 13:10:39.160449 15345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.016s	sys 0.084s
I20260709 13:10:39.161571 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.035481 20874 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:39.110208 20937 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:39.100172 20929 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:39.132165 21055 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:39.175426 15346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.030s	sys 0.043s
W20260709 13:10:39.183409 15346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.030s	sys 0.044s
I20260709 13:10:39.179531 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:39.162679 21027 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.228999 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:39.234371 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:39.239560 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.240552 15305 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:39.201627 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:39.203831 15302 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:10:39.252579 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51102.6us
I20260709 13:10:39.254189 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:39.256628 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:39.249338 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:39.258111 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.261554 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:39.272754 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:39.257040 21082 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.257144 20778 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.274449 20938 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:39.275097 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.275719 20776 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:39.257565 21036 consensus_meta.cc:287] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.131s	user 0.017s	sys 0.000s
I20260709 13:10:39.276561 21004 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:39.278210 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.279587 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:39.281523 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3216) took 2030 ms. Trace:
I20260709 13:10:39.282423 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3135) took 2792 ms. Trace:
W20260709 13:10:39.396468 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 117015us
I20260709 13:10:39.396716 15378 rpcz_store.cc:276] 0709 13:10:36.489835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.691147 (+201312us) service_pool.cc:224] Handling call
0709 13:10:36.770830 (+ 79683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.861185 (+ 90355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.282076 (+2420891us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54001a95d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:39.282305 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202807680}
I20260709 13:10:39.284829 21009 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:39.286268 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.399865 15307 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:39.287276 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59848 (request call id 44) took 2271 ms. Trace:
I20260709 13:10:39.400763 15228 rpcz_store.cc:276] 0709 13:10:37.016283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.016468 (+   185us) service_pool.cc:224] Handling call
0709 13:10:39.287050 (+2270582us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540009d154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b20853 00007f2f58aee60a 00007f2f520747d4 00007f2f52074762 00007f2f52074691 00007f2f5207460c 00007f2f520738c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:39.287167 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100998016}
W20260709 13:10:39.301419 21070 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:10:39.309521 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 777) took 2129 ms. Trace:
I20260709 13:10:39.189479 20442 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.325985 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 995) took 1583 ms. Trace:
I20260709 13:10:39.186626 21005 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.361294 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88631.6us
I20260709 13:10:39.378328 20486 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.380630 15305 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:39.246801 20843 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.395757 15299 rpcz_store.cc:276] 0709 13:10:37.251132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.655712 (+404580us) service_pool.cc:224] Handling call
0709 13:10:37.656270 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.737112 (+ 80842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.737180 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.737252 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:37.737302 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.281086 (+1543784us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b540017aa54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:39.281150 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.281447 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185042304}
I20260709 13:10:39.398911 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:39.477115 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:39.406814 15376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3122) took 2911 ms (client timeout 2723 ms). Trace:
W20260709 13:10:39.478734 15376 rpcz_store.cc:269] 0709 13:10:36.485289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.485431 (+   142us) service_pool.cc:224] Handling call
0709 13:10:39.396205 (+2910774us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54003f2354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:39.396415 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826412416}
I20260709 13:10:39.259940 21029 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.408571 15300 rpcz_store.cc:276] 0709 13:10:37.180545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.313508 (+132963us) service_pool.cc:224] Handling call
0709 13:10:37.314052 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.417520 (+103468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.417557 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.417599 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:37.417629 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.309172 (+1891543us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400185bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:39.309236 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.309438 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237402368}
I20260709 13:10:39.395224 20776 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.389205 20938 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:39.440691 20808 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.763s	user 0.014s	sys 0.000s
I20260709 13:10:39.402134 20778 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.466555 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3237) took 1096 ms. Trace:
I20260709 13:10:39.493731 15305 rpcz_store.cc:276] 0709 13:10:38.369958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.274717 (+904759us) service_pool.cc:224] Handling call
0709 13:10:39.466452 (+191735us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:39.496683 21078 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:10:39.490103 21083 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:39.532169 15198 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.020s	sys 0.081s
W20260709 13:10:39.534008 15198 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.020s	sys 0.081s
I20260709 13:10:39.491012 20938 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:39.457731 15232 rpcz_store.cc:276] 0709 13:10:37.742890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.756697 (+ 13807us) service_pool.cc:224] Handling call
0709 13:10:39.311508 (+1554811us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002d0d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:39.325841 (+ 14333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2869264128}
I20260709 13:10:39.521379 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:39.486770 20486 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:39.401854 21036 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.483918 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.484791 15376 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:39.547115 15299 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 6.
I20260709 13:10:39.551370 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:39.552313 15299 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:39.554544 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1086) took 2374 ms. Trace:
I20260709 13:10:39.555253 15376 rpcz_store.cc:276] 0709 13:10:37.180057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.479773 (+2299716us) service_pool.cc:224] Handling call
0709 13:10:39.480141 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.547530 (+ 67389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.554428 (+  6898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.390790 21027 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:39.486621 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 87797.5us
I20260709 13:10:39.564245 15376 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:39.565666 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3152) took 2143 ms. Trace:
I20260709 13:10:39.566125 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:39.534425 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 804257us
I20260709 13:10:39.474298 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.567464 15303 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:39.540169 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47986.4us
I20260709 13:10:39.568699 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.569689 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:39.570066 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:39.571579 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.566715 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3218) took 2314 ms. Trace:
I20260709 13:10:39.566190 15376 rpcz_store.cc:276] 0709 13:10:37.422580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.556464 (+2133884us) service_pool.cc:224] Handling call
0709 13:10:39.563044 (+  6580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.565268 (+  2224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.565578 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.573000 15301 rpcz_store.cc:276] 0709 13:10:37.251851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.661729 (+409878us) service_pool.cc:224] Handling call
0709 13:10:37.662160 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.662642 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.662688 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.664239 (+  1551us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.658367 (+994128us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:38.658442 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.658560 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.566457 (+907897us) raft_consensus.cc:1685] finished
0709 13:10:39.566484 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.566646 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11499,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":11330,"thread_start_us":956605,"threads_started":1,"wal-append.queue_time_us":1273419}
I20260709 13:10:39.575482 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.581486 15376 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:39.586910 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3154) took 2163 ms. Trace:
I20260709 13:10:39.457224 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3148) took 2281 ms. Trace:
I20260709 13:10:39.541285 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.589598 15378 rpcz_store.cc:276] 0709 13:10:37.176031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.411917 (+2235886us) service_pool.cc:224] Handling call
0709 13:10:39.456333 (+ 44416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.456674 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.456717 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.456787 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.456840 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.456936 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.457127 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.491930 21029 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:39.559128 21069 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:10:39.607952 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:39.478403 21005 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:39.521298 21083 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.490571 20776 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.579020 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:39.625272 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46331.4us
I20260709 13:10:39.626166 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:39.585744 15301 raft_consensus.cc:2410] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:39.627687 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:39.628485 15301 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:39.592068 21084 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:39.570796 15303 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.541698 15300 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:39.588690 15305 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:39.538808 21048 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:39.594827 15225 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:39.498059 20808 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:39.598798 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.601207 15348 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.010s	sys 0.018s
I20260709 13:10:39.603230 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3156) took 2163 ms. Trace:
I20260709 13:10:39.646072 15378 rpcz_store.cc:276] 0709 13:10:37.440070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.601946 (+2161876us) service_pool.cc:224] Handling call
0709 13:10:39.602447 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.602726 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.602766 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.602832 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:39.602880 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.602961 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.603145 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.614395 20674 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:39.614601 21027 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:39.482342 20442 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:39.616290 21054 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.278s	user 0.002s	sys 0.010s
I20260709 13:10:39.623332 15299 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:39.630206 15301 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:39.657790 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3226) took 2387 ms. Trace:
I20260709 13:10:39.658463 20808 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:39.659651 15379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.026s	sys 0.031s
W20260709 13:10:39.660192 15379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.026s	sys 0.031s
I20260709 13:10:39.658373 15301 rpcz_store.cc:276] 0709 13:10:37.270761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.629410 (+2358649us) service_pool.cc:224] Handling call
0709 13:10:39.629797 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.657430 (+ 27633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.657720 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.632647 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:39.621840 21076 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:39.587442 15376 rpcz_store.cc:276] 0709 13:10:37.423212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.574790 (+2151578us) service_pool.cc:224] Handling call
0709 13:10:39.580613 (+  5823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.586389 (+  5776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.586812 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.629446 21081 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:39.629067 21083 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:39.634997 20830 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.966s	user 0.012s	sys 0.004s
I20260709 13:10:39.648829 15302 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:39.682296 15232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:39.683079 15232 raft_consensus.cc:606] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
W20260709 13:10:39.665231 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.665699 15348 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.010s	sys 0.018s
W20260709 13:10:39.689956 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 711794us
W20260709 13:10:39.667713 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49233.4us
I20260709 13:10:39.669981 15301 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:39.664422 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:39.626523 21042 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.675307 15305 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:10:39.670295 21072 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.268s	user 0.001s	sys 0.001s
I20260709 13:10:39.692911 15303 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:39.693210 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3230) took 2324 ms. Trace:
I20260709 13:10:39.656504 20674 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:39.679297 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3221) took 2413 ms. Trace:
I20260709 13:10:39.695997 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:39.700876 15301 rpcz_store.cc:276] 0709 13:10:37.368969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.661917 (+2292948us) service_pool.cc:224] Handling call
0709 13:10:39.662281 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.692844 (+ 30563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.693131 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.696427 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2455) took 2380 ms. Trace:
W20260709 13:10:39.703441 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.670125 20843 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.704547 15274 connection.cc:256] RPC call timeout handler was delayed by -1.9531520110000429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:10:39.673352 21027 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:39.673632 21081 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:39.745374 15305 rpcz_store.cc:276] 0709 13:10:37.315894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.648928 (+2333034us) service_pool.cc:224] Handling call
0709 13:10:39.674954 (+ 26026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.695963 (+ 21009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.696303 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.747489 15308 rpcz_store.cc:276] 0709 13:10:37.265990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.789765 (+523775us) service_pool.cc:224] Handling call
0709 13:10:37.790680 (+   915us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.808860 (+ 18180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.808913 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.809664 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.738978 (+929314us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:38.739063 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.739177 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.679026 (+939849us) raft_consensus.cc:1685] finished
0709 13:10:39.679053 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.679224 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25037,"raft.queue_time_us":44371,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":13990,"thread_start_us":892442,"threads_started":1,"wal-append.queue_time_us":1307485}
I20260709 13:10:39.777958 15300 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:39.779362 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3143) took 2604 ms. Trace:
I20260709 13:10:39.807072 15377 rpcz_store.cc:276] 0709 13:10:37.174474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.935306 (+760832us) service_pool.cc:224] Handling call
0709 13:10:37.935755 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.938026 (+  2271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.938899 (+   873us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.939658 (+   759us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.970588 (+1030930us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:38.970669 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.970783 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.778869 (+808086us) raft_consensus.cc:1685] finished
0709 13:10:39.778907 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.779262 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4678,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":14441,"thread_start_us":1030379,"threads_started":1,"wal-append.queue_time_us":1377318}
I20260709 13:10:39.816702 15308 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:39.817895 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3235) took 1455 ms. Trace:
I20260709 13:10:39.818356 15308 rpcz_store.cc:276] 0709 13:10:38.362712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.810869 (+1448157us) service_pool.cc:224] Handling call
0709 13:10:39.811284 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.817518 (+  6234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.817803 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.705860 21082 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:39.699301 21042 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.821144 21042 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.821029 21082 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.823840 21082 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:39.745488 20674 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:39.833160 21082 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:39.751740 21054 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:10:39.834064 21082 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.835834 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2444) took 2662 ms. Trace:
I20260709 13:10:39.836300 15304 rpcz_store.cc:276] 0709 13:10:37.173421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.306174 (+132753us) service_pool.cc:224] Handling call
0709 13:10:37.306747 (+   573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.307437 (+   690us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:37.512522 (+205085us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.690479 (+177957us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.703050 (+ 12571us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.703250 (+   200us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:37.703568 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.705186 (+  1618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.705319 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.545803 (+1840484us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:39.835537 (+289734us) raft_consensus.cc:1685] finished
0709 13:10:39.835565 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.835760 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12483,"prepare.queue_time_us":484237,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":11333,"raft.run_cpu_time_us":584,"raft.run_wall_time_us":25504,"spinlock_wait_cycles":7459712,"thread_start_us":363497,"threads_started":2,"wal-append.queue_time_us":666066}
I20260709 13:10:39.841521 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3241) took 1434 ms. Trace:
I20260709 13:10:39.842233 15304 rpcz_store.cc:276] 0709 13:10:38.406724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.839787 (+1433063us) service_pool.cc:224] Handling call
0709 13:10:39.840692 (+   905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.840962 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.841031 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.841097 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:39.841149 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.841232 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.841436 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.846626 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3242) took 1439 ms. Trace:
I20260709 13:10:39.847345 15304 rpcz_store.cc:276] 0709 13:10:38.407475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.845349 (+1437874us) service_pool.cc:224] Handling call
0709 13:10:39.845857 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.846130 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.846172 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.846236 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:39.846291 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.846386 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.846543 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:39.841537 15373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.025s	sys 0.055s
W20260709 13:10:39.850339 15373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.026s	sys 0.055s
I20260709 13:10:39.862264 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3238) took 1457 ms. Trace:
I20260709 13:10:39.863251 15300 rpcz_store.cc:276] 0709 13:10:38.404421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.860591 (+1456170us) service_pool.cc:224] Handling call
0709 13:10:39.861111 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.861421 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.861465 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.861771 (+   306us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:39.861826 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.861927 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.862163 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.865136 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2589) took 2869 ms. Trace:
I20260709 13:10:39.897616 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3245) took 1473 ms. Trace:
I20260709 13:10:39.898625 15300 rpcz_store.cc:276] 0709 13:10:38.424612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.896023 (+1471411us) service_pool.cc:224] Handling call
0709 13:10:39.896752 (+   729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.897054 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.897095 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.897171 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:39.897227 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.897317 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.897509 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69504}
I20260709 13:10:39.897615 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3243) took 1489 ms. Trace:
I20260709 13:10:39.902066 15304 rpcz_store.cc:276] 0709 13:10:38.408211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.896020 (+1487809us) service_pool.cc:224] Handling call
0709 13:10:39.896751 (+   731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.897055 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.897111 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.897172 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:39.897228 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.897317 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.897509 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172800}
I20260709 13:10:39.865803 15373 rpcz_store.cc:276] 0709 13:10:36.995436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.937427 (+941991us) service_pool.cc:224] Handling call
0709 13:10:38.101257 (+163830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.101543 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:38.979852 (+878309us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.864603 (+884751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.864686 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.864770 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.864878 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.865049 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13567,"prepare.queue_time_us":1156092,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":893,"thread_start_us":1748491,"threads_started":2}
W20260709 13:10:39.858986 21077 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.400s	user 0.000s	sys 0.002s
I20260709 13:10:39.679221 20486 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.802179 21081 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.811746 20442 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:39.867503 20998 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.294s	user 0.012s	sys 0.006s
I20260709 13:10:39.701721 20830 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.913830 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3248) took 1352 ms. Trace:
I20260709 13:10:39.779289 20843 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:39.901342 21084 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:39.904623 20778 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:39.950153 15300 rpcz_store.cc:276] 0709 13:10:38.561590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.911748 (+1350158us) service_pool.cc:224] Handling call
0709 13:10:39.913078 (+  1330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.913359 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.913393 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.913455 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:39.913501 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.913581 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.913743 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.908461 21036 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:39.922472 21009 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:39.918604 21082 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:39.945761 20937 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:39.946257 20808 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:40.002640 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3249) took 1428 ms. Trace:
I20260709 13:10:39.926471 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3246) took 1495 ms. Trace:
I20260709 13:10:39.954741 20442 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:40.019678 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.018513 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.018795 15304 rpcz_store.cc:276] 0709 13:10:38.430648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.910592 (+1479944us) service_pool.cc:224] Handling call
0709 13:10:39.914726 (+  4134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.925860 (+ 11134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.925908 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.925985 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.926034 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.926151 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.926373 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.946636 21032 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:10:40.018563 15300 rpcz_store.cc:276] 0709 13:10:38.574460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.962830 (+1388370us) service_pool.cc:224] Handling call
0709 13:10:40.001814 (+ 38984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.002072 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.002100 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.002148 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.002182 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.002397 (+   215us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.002560 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.955950 20998 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.109005 16008 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:40.116721 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.117256 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.116897 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:40.120425 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 458279us
I20260709 13:10:40.126078 15300 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:40.127779 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3251) took 1393 ms. Trace:
I20260709 13:10:40.128235 15300 rpcz_store.cc:276] 0709 13:10:38.734783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.108406 (+1373623us) service_pool.cc:224] Handling call
0709 13:10:40.125699 (+ 17293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.126936 (+  1237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.127684 (+   748us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.128851 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.130080 15228 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:40.130679 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.137063 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.146354 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.017040 21029 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.149652 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2588) took 3154 ms. Trace:
I20260709 13:10:40.022346 21067 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:39.970971 21084 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.152510 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.027019 21009 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:10:40.168984 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 504670us
I20260709 13:10:40.158631 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.160068 15300 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:40.165853 15304 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:40.165158 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 469202us
I20260709 13:10:40.168444 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.156023 15375 rpcz_store.cc:276] 0709 13:10:36.995175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.933683 (+938508us) service_pool.cc:224] Handling call
0709 13:10:38.081649 (+147966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.081945 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.081974 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.082561 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.973021 (+890460us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:38.973092 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.973208 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.149423 (+1176215us) raft_consensus.cc:1685] finished
0709 13:10:40.149447 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.149579 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":889962,"threads_started":1,"wal-append.queue_time_us":1185629}
I20260709 13:10:40.175127 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:40.175419 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:40.173333 15231 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:10:40.169514 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.023962 20937 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.172205 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.022126 20808 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.171092 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.032914 20442 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:40.195577 15971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.019s	sys 0.014s
W20260709 13:10:40.195719 15274 connection.cc:256] RPC call timeout handler was delayed by -1.8332449810001208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:10:40.196151 15971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.019s	sys 0.014s
W20260709 13:10:40.169806 15299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.018s
W20260709 13:10:40.196971 15299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.008s	sys 0.018s
I20260709 13:10:40.185708 15345 leader_election.cc:400] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15.
I20260709 13:10:40.179725 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3254) took 1153 ms. Trace:
I20260709 13:10:40.197568 15345 leader_election.cc:403] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:10:40.175832 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 520884us
W20260709 13:10:40.196770 15274 connection.cc:256] RPC call timeout handler was delayed by -1.5168958600000906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:10:40.165908 21029 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.198348 15274 connection.cc:256] RPC call timeout handler was delayed by -1.2792335270000876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 13:10:40.169103 21005 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:40.199040 15274 connection.cc:256] RPC call timeout handler was delayed by -1.1795023690000335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:10:40.197732 15300 rpcz_store.cc:276] 0709 13:10:39.026566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.152706 (+1126140us) service_pool.cc:224] Handling call
0709 13:10:40.153055 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.179353 (+ 26298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.179666 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.205200 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:40.164629 21027 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:40.206384 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:40.206717 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 539896us
W20260709 13:10:40.191139 21053 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.082s	user 0.009s	sys 0.007s
I20260709 13:10:40.168234 21067 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.180240 21082 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 13:10:40.230654 21087 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:10:40.208123 21029 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.263166 20998 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:40.265118 21088 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:10:40.253819 21053 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.268725 20843 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.269465 21053 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.243153 20978 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:40.246800 20929 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:10:40.234187 21005 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:40.243358 21009 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.272547 21005 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:40.272845 20995 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:40.207911 21048 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.273656 20995 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.269526 20843 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.208065 21094 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:40.236997 20916 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.272145 20943 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.287883 21005 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:40.276291 20995 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.279191 21042 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.277091 21023 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15.
I20260709 13:10:40.324113 21056 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:40.319417 21042 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.278717 21094 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:40.325043 21004 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.923s	user 0.013s	sys 0.004s
I20260709 13:10:40.325387 21094 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.320303 20997 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.330233 21012 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:40.503342 21012 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:40.177572 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:40.504652 20998 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:40.333727 21027 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.419752 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:40.423298 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.424604 15233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2687) took 2165 ms (client timeout 2172 ms). Trace:
I20260709 13:10:40.427503 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2689) took 2081 ms. Trace:
I20260709 13:10:40.231096 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3257) took 1051 ms. Trace:
W20260709 13:10:40.572974 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.572752 15233 rpcz_store.cc:269] 0709 13:10:38.252150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.300469 (+ 48319us) service_pool.cc:224] Handling call
0709 13:10:40.415160 (+2114691us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540043c454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:40.415810 (+   650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710445440}
W20260709 13:10:40.447134 15302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2461) took 2047 ms (client timeout 2182 ms). Trace:
I20260709 13:10:40.573416 15300 rpcz_store.cc:276] 0709 13:10:39.180056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.229992 (+1049936us) service_pool.cc:224] Handling call
0709 13:10:40.230403 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.230623 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.230712 (+    89us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.230762 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:40.230796 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.230853 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.231014 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:40.574532 15302 rpcz_store.cc:269] 0709 13:10:38.399910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.277840 (+877930us) service_pool.cc:224] Handling call
0709 13:10:40.446324 (+1168484us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54003e1cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:40.446779 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582589184}
I20260709 13:10:40.576669 21100 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:40.577913 21100 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.574288 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:40.452450 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3223) took 3185 ms. Trace:
I20260709 13:10:40.453734 15308 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:40.580214 21062 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:40.460747 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 219785us
I20260709 13:10:40.582615 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3239) took 2177 ms. Trace:
I20260709 13:10:40.583086 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.583191 15308 rpcz_store.cc:276] 0709 13:10:38.405124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.819959 (+1414835us) service_pool.cc:224] Handling call
0709 13:10:40.453076 (+633117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.580647 (+127571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.582287 (+  1640us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003e1cd0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:40.582517 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454726016}
I20260709 13:10:40.459434 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3144) took 3284 ms. Trace:
I20260709 13:10:40.579672 15306 rpcz_store.cc:276] 0709 13:10:37.266546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.154544 (+887998us) service_pool.cc:224] Handling call
0709 13:10:38.155072 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.156271 (+1001199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.451750 (+1295479us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b540025b2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:40.452193 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299800320}
W20260709 13:10:40.462438 15382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3150) took 3285 ms (client timeout 1652 ms). Trace:
I20260709 13:10:40.585126 20808 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.281247 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:40.585621 15382 rpcz_store.cc:269] 0709 13:10:37.176486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.421415 (+244929us) service_pool.cc:224] Handling call
0709 13:10:40.461798 (+3040383us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001fe354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:40.462133 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668779392}
I20260709 13:10:40.586792 15999 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:40.587201 20998 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.503252 20997 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.588778 20997 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.173374 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:40.343127 21068 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.098s	user 0.004s	sys 0.000s
I20260709 13:10:40.590415 20998 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.289970 20869 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:40.591117 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 417663us
I20260709 13:10:40.591851 20997 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:40.347546 21083 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 13:10:40.572858 15225 rpcz_store.cc:276] 0709 13:10:38.345847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.346072 (+   225us) service_pool.cc:224] Handling call
0709 13:10:38.346470 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.642165 (+1295695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.426471 (+784306us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003c2dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:40.427146 (+   675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870311296}
I20260709 13:10:40.593281 21083 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.595337 21036 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.333035 21029 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.596143 21036 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:40.417722 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.596944 21036 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.322245 21067 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.359853 21084 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.278162 21103 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:40.327973 21105 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:10:40.530159 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65621.5us
I20260709 13:10:40.502063 20978 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.601198 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:40.540522 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 336432us
I20260709 13:10:40.601673 20978 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.304733 20916 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.602988 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:40.551383 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 778) took 3221 ms. Trace:
I20260709 13:10:40.551203 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3236) took 2181 ms. Trace:
I20260709 13:10:40.552999 15232 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:40.604619 21053 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.325794 21004 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:40.605693 21053 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.606462 21103 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.606752 21004 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:40.580542 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2467) took 1341 ms. Trace:
I20260709 13:10:40.607358 21004 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:40.607447 15307 rpcz_store.cc:276] 0709 13:10:39.206152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.448951 (+1242799us) service_pool.cc:224] Handling call
0709 13:10:40.449898 (+   947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.517404 (+ 67506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.517470 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.517549 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.517613 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.517751 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.524331 (+  6580us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98076,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":537,"thread_start_us":66381,"threads_started":1}
I20260709 13:10:40.588831 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.281651 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.533841 21012 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.591462 20869 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:40.605696 16003 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
W20260709 13:10:40.357827 21075 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.904s	user 0.000s	sys 0.002s
W20260709 13:10:40.331768 21092 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
W20260709 13:10:40.519567 15347 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.000s	sys 0.017s
I20260709 13:10:40.272976 20442 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.604532 15305 rpcz_store.cc:276] 0709 13:10:38.369103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.810674 (+1441571us) service_pool.cc:224] Handling call
0709 13:10:39.815738 (+  5064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.816071 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:40.207274 (+391203us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.550042 (+342768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.550293 (+   251us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.550461 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.550588 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.550888 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66704,"prepare.queue_time_us":497519,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":25540,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":209,"thread_start_us":614456,"threads_started":2}
I20260709 13:10:40.606935 21103 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.604027 15299 rpcz_store.cc:276] 0709 13:10:37.329712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.655957 (+2326245us) service_pool.cc:224] Handling call
0709 13:10:39.656412 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.656686 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:10:40.204450 (+547764us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.550366 (+345916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.550467 (+   101us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:40.550632 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.550768 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.551070 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17445,"prepare.queue_time_us":582664,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":5155,"raft.queue_time_us":19878,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":186,"thread_start_us":867921,"threads_started":2,"wal-append.queue_time_us":322117}
I20260709 13:10:40.601297 21048 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:40.612329 21012 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.572481 21064 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:40.450052 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3250) took 1787 ms. Trace:
I20260709 13:10:40.281612 20830 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.278496 20843 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:40.616137 15347 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.000s	sys 0.018s
W20260709 13:10:40.615088 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 195970us
I20260709 13:10:40.615850 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3142) took 3441 ms. Trace:
I20260709 13:10:40.616870 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 549) took 2688 ms. Trace:
W20260709 13:10:40.611927 20938 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.049s	user 0.015s	sys 0.001s
I20260709 13:10:40.620875 15304 rpcz_store.cc:276] 0709 13:10:38.662781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.035343 (+1372562us) service_pool.cc:224] Handling call
0709 13:10:40.035881 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.178143 (+142262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.449263 (+271120us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540025a8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:40.449778 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298192256}
I20260709 13:10:40.618619 21103 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.572059 21033 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:40.664310 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3263) took 1199 ms. Trace:
I20260709 13:10:40.665472 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.666199 15302 rpcz_store.cc:276] 0709 13:10:39.464809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.576547 (+1111738us) service_pool.cc:224] Handling call
0709 13:10:40.577259 (+   712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.578151 (+   892us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:40.578661 (+   510us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.663853 (+ 85192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.663933 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.663997 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.664077 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.664239 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":75254,"threads_started":1}
I20260709 13:10:40.667760 20978 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:40.665551 15303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.011s	sys 0.030s
W20260709 13:10:40.669304 15303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.012s	sys 0.031s
I20260709 13:10:40.670320 21064 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:40.670761 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3231) took 3297 ms. Trace:
I20260709 13:10:40.672686 20442 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.672626 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.673193 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.673941 15373 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:40.674213 15381 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:40.673839 20442 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.675179 21125 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:40.667512 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:40.676061 21125 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.677457 20843 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.613200 20869 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.681025 20442 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.671232 15303 rpcz_store.cc:276] 0709 13:10:37.373908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.701245 (+2327337us) service_pool.cc:224] Handling call
0709 13:10:39.800594 (+ 99349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.670129 (+869535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.670208 (+    79us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.670291 (+    83us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.670341 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.670440 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.670692 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149239,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":19972,"thread_start_us":868061,"threads_started":1}
I20260709 13:10:40.658780 21083 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.619266 21048 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.633283 15374 rpcz_store.cc:276] 0709 13:10:37.174218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.929301 (+755083us) service_pool.cc:224] Handling call
0709 13:10:37.929786 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.930510 (+   724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.930556 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.931254 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.725196 (+793942us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:38.725271 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.725391 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.356484 (+1631093us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:40.614896 (+258412us) raft_consensus.cc:1685] finished
0709 13:10:40.614988 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.615553 (+   565us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35328,"raft.queue_time_us":1397,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":131,"spinlock_wait_cycles":3266816,"thread_start_us":793415,"threads_started":1,"wal-append.queue_time_us":1465205}
I20260709 13:10:40.636966 16004 rpcz_store.cc:276] 0709 13:10:37.929101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.929281 (+   180us) service_pool.cc:224] Handling call
0709 13:10:38.072962 (+143681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.073898 (+   936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.073992 (+    94us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.076395 (+  2403us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.493394 (+1416999us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b1800133fc0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:39.938618 (+445224us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:39.938681 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.938793 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.330917 (+392124us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:40.616066 (+285149us) raft_consensus.cc:1685] finished
0709 13:10:40.616136 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.616501 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2754,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":47186048,"thread_start_us":444877,"threads_started":1,"wal-append.queue_time_us":2096450}
I20260709 13:10:40.687213 21048 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.689734 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:40.692696 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:40.693722 20867 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:40.694177 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50760.2us
I20260709 13:10:40.665716 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.584605 15379 rpcz_store.cc:276] 0709 13:10:37.174755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.127034 (+952279us) service_pool.cc:224] Handling call
0709 13:10:38.134532 (+  7498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.027217 (+892685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.027265 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.087965 (+ 60700us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.660654 (+572689us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.660704 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.458136 (+797432us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54001ac2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:40.458277 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.458435 (+   158us) raft_consensus.cc:1685] finished
0709 13:10:40.458458 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.459066 (+   608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204,"raft.queue_time_us":441554,"raft.run_cpu_time_us":8760,"raft.run_wall_time_us":133804,"spinlock_wait_cycles":583522176,"thread_start_us":1209642,"threads_started":2,"wal-append.queue_time_us":878293}
I20260709 13:10:40.613044 21004 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.654703 20938 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.631640 20997 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:40.661512 21053 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.564186 20735 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.695580 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:40.736721 21105 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:40.737370 21105 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.737754 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3234) took 3358 ms. Trace:
I20260709 13:10:40.699499 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.699780 20978 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:40.738397 15301 rpcz_store.cc:276] 0709 13:10:37.379301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.795063 (+2415762us) service_pool.cc:224] Handling call
0709 13:10:39.795845 (+   782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.796438 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:40.195393 (+398955us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.736771 (+541378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.736938 (+   167us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.737032 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.737177 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.737495 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":495671,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"thread_start_us":766363,"threads_started":2,"wal-append.queue_time_us":492135}
I20260709 13:10:40.700132 21001 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:40.700191 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.741325 21100 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.700623 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:40.669387 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68589.1us
I20260709 13:10:40.704083 20623 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.743021 16003 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:40.706152 21004 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.701747 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:40.744103 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:40.744726 16002 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:40.746814 21113 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:40.748838 20952 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:40.709059 16005 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 6.
I20260709 13:10:40.750716 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:40.725407 20937 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.730744 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.733098 15376 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:40.732796 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:40.724903 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 151132us
I20260709 13:10:40.714555 21114 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:40.737802 21105 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:40.808391 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:40.734748 21119 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.065s	user 0.002s	sys 0.002s
W20260709 13:10:40.850313 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 158209us
W20260709 13:10:40.811385 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50527.4us
I20260709 13:10:40.820375 15199 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:40.759671 21114 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:40.726323 20778 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:40.765280 21001 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:40.816726 15374 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:40.671167 21064 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:40.818181 21125 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:40.840513 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 422398us
I20260709 13:10:40.710554 20938 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:40.699056 20916 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:40.769711 20952 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:40.843369 15379 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:40.863663 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:40.863662 21114 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.748924 21113 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
W20260709 13:10:40.843263 20776 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.202s	user 0.015s	sys 0.007s
W20260709 13:10:40.877138 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 57042.8us
I20260709 13:10:40.871773 20778 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:40.894984 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86965us
I20260709 13:10:40.900621 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3262) took 1436 ms. Trace:
I20260709 13:10:40.827924 21105 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.910643 15376 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:10:40.912202 20674 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.030s	user 0.012s	sys 0.013s
I20260709 13:10:40.912827 20674 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.909442 21033 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:40.915452 21033 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.915762 20674 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:40.899417 20776 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.919098 20776 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.912734 21001 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.921658 21105 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:40.924588 20830 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:40.915891 21033 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:40.924806 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61359.7us
I20260709 13:10:40.924618 21062 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:10:40.928296 21062 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:40.908545 21114 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:40.928918 21062 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:40.930244 21062 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.931643 21062 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.902385 15300 rpcz_store.cc:276] 0709 13:10:39.464454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.575170 (+1110716us) service_pool.cc:224] Handling call
0709 13:10:40.575822 (+   652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.576506 (+   684us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:40.577248 (+   742us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.896409 (+319161us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.899976 (+  3567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.900063 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:40.900169 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.900294 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.900528 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3240,"prepare.queue_time_us":515,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":104,"raft.queue_time_us":15663,"spinlock_wait_cycles":12544,"thread_start_us":299008,"threads_started":1}
I20260709 13:10:40.934098 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.934899 15376 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:40.935074 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:40.903218 21012 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:40.936400 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.024s
I20260709 13:10:40.928496 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:40.943029 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:40.943686 15382 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:40.944589 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.011s	sys 0.024s
I20260709 13:10:40.947506 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.950477 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.952366 21125 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:40.949580 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.963428 21103 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.967382 15374 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:10:40.967795 21094 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.641s	user 0.016s	sys 0.006s
I20260709 13:10:40.967919 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:40.968446 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.969332 15374 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:40.970441 21064 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.968281 21094 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:40.972633 21040 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.972713 21036 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:40.973682 21040 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.975020 21094 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.975219 21036 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:40.977160 15226 raft_consensus.cc:2410] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:10:40.977609 21081 consensus_meta.cc:287] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.011s	user 0.011s	sys 0.012s
I20260709 13:10:40.978291 21081 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.982635 21081 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:40.945765 20830 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:40.993753 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.997784 20830 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:40.992897 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:41.009310 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.009730 21125 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:41.010221 21125 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:41.010622 21125 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.010566 15379 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:41.016124 20952 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:41.024720 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.003896 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:40.969539 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:41.030259 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 127608us
I20260709 13:10:41.031598 15373 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:40.979125 15226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2681) took 2759 ms (client timeout 1971 ms). Trace:
W20260709 13:10:40.959440 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 809919us
W20260709 13:10:41.037111 15226 rpcz_store.cc:269] 0709 13:10:38.219736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.219909 (+   173us) service_pool.cc:224] Handling call
0709 13:10:40.978767 (+2758858us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b54000e7ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:40.979013 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6269746560}
W20260709 13:10:41.043555 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 51159.4us
I20260709 13:10:41.042667 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.049086 15379 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:41.052309 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.053489 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.054299 15374 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:41.056854 15379 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:41.050416 20869 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.064030 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.063390 21103 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:41.066449 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.067241 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:41.067328 15379 raft_consensus.cc:2376] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12. Re-sending same reply.
I20260709 13:10:41.062628 15373 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:41.095618 15374 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:41.095494 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.098042 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.108472 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.110998 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34282 (request call id 2) took 3934 ms. Trace:
I20260709 13:10:41.111418 15380 rpcz_store.cc:276] 0709 13:10:37.176765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.627226 (+2450461us) service_pool.cc:224] Handling call
0709 13:10:41.110481 (+1483255us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540012acd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2c735 00007f2f58aecd29 00007f2f5206b1d4 00007f2f5206b162 00007f2f5206b091 00007f2f5206b00c 00007f2f5206a2c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:41.110749 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3109068032}
I20260709 13:10:41.116429 15377 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:41.116506 15379 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:41.075714 21040 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.125932 15382 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:41.110999 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.133508 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:41.133721 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.124413 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.137194 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.139545 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.146736 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.152688 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.151541 20778 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.158763 15300 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.153090 15302 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:10:41.145638 21012 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:41.163134 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:41.176964 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.179591 16002 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.177655 15376 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:41.180317 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.162909 15380 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
W20260709 13:10:41.184791 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 377847us
I20260709 13:10:41.185074 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:41.165086 21033 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.193007 15374 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:41.165952 21012 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.210592 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:41.213153 21128 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:41.219295 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.221390 15374 raft_consensus.cc:2368] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
W20260709 13:10:41.222223 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.225929 16005 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:41.214928 21012 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.231257 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.192937 20486 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:10:41.254755 21132 log.cc:927] Time spent T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:10:41.222831 21062 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:41.258781 21027 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:41.266348 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 342509us
W20260709 13:10:41.275055 21130 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:10:41.169344 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:41.300951 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 87793.3us
I20260709 13:10:41.308130 21033 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:41.315416 15226 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:41.321777 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 210912us
I20260709 13:10:41.325138 16002 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:41.328958 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:41.335525 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:41.336933 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.308329 20778 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:41.342756 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.345520 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.345813 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.346342 15376 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:41.348780 15380 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:41.350996 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.354770 15302 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:41.357249 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.344318 21033 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:10:41.359071 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.364801 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.369282 15233 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:10:41.363510 21048 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:41.371309 15306 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:41.370499 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.369701 15233 pending_rounds.cc:85] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 10
I20260709 13:10:41.374073 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.372622 15233 pending_rounds.cc:107] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:10:41.376370 15233 raft_consensus.cc:2889] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.377007 15380 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.375274 21036 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:10:41.380446 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.379308 15302 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:10:41.380455 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.382103 15225 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:41.383687 15376 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.382645 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.381731 21048 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.388406 21048 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:41.390164 21133 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:10:41.389307 15373 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:41.390636 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.393597 15232 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:41.397239 15374 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:41.399585 21040 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.399637 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.400172 21040 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:41.399438 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.401167 15306 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 6.
I20260709 13:10:41.408200 15380 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:41.409348 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.413339 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.414258 15380 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
W20260709 13:10:41.416590 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.413439 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:41.423167 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.426834 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.398850 21036 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:41.436647 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.401100 21040 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.449705 15226 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:41.456612 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.456990 15225 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:41.458071 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.459416 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:41.459776 15380 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:41.460093 16005 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.459322 15375 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:41.463831 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:41.458428 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.429862 20867 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:41.464993 15376 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:41.477077 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.476025 15300 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:41.482620 16005 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:41.484930 21033 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:41.485421 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.486354 21005 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.486673 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.487474 21005 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:41.487967 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.489097 15381 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:41.493628 20867 consensus_queue.cc:1243] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:41.493952 20938 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:41.495293 15380 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
W20260709 13:10:41.496654 15179 auto_rebalancer.cc:629] Failed to schedule move for tablet bb3022274b1549eb806d68dc808a6ceb: Illegal state: Replica 0ec140f610ed4500ba58208c0e5519bb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:41.497022 20952 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.497483 20952 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:41.498401 20952 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.498994 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.499775 20952 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.501127 21040 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.501675 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:41.493052 21140 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:10:41.506618 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.508325 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.509189 15374 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:41.511364 20674 raft_consensus.cc:993] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:10:41.512233 21005 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.512362 20938 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.512925 20938 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:41.513980 20938 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.514430 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.515384 20938 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.522007 21005 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.529510 21033 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:41.530467 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.531114 15375 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:41.523926 15199 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:41.529682 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.535846 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.536677 15380 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:41.538475 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 71523.7us
I20260709 13:10:41.543728 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.535892 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:41.544633 15377 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:41.546355 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.549606 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.550225 15376 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.530850 21033 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.548508 15382 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:41.548626 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.529615 21048 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:41.553020 15379 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:41.533315 21094 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:41.553817 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:41.554425 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 58443.9us
I20260709 13:10:41.552843 21048 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.548614 20929 raft_consensus.cc:1081] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:10:41.546952 15198 connection.cc:256] RPC call timeout handler was delayed by -1.3632705159999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:10:41.557271 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.558928 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:41.554883 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58709.2us
I20260709 13:10:41.558030 21064 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:41.548949 21012 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.558457 15374 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:41.544515 15127 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 13 to 18, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 18 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.562084 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.564767 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.560101 15377 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:41.559568 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55589.1us
I20260709 13:10:41.565301 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.571731 15375 raft_consensus.cc:2410] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:10:41.559903 15198 connection.cc:256] RPC call timeout handler was delayed by -1.3632705159999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:10:41.566871 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.579651 15376 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:41.573084 15127 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 14 to 17, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 17 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.564782 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:41.582118 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49980us
I20260709 13:10:41.564126 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.565714 21083 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.586758 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.570856 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.587252 21083 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.587301 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:41.565240 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.588295 15227 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:41.565512 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.588408 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:41.589057 15231 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:41.564955 15225 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:41.589746 15233 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:41.590827 21004 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:41.591288 21004 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:41.591709 21004 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.587416 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.566005 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.600798 15377 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:41.601423 15230 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:41.603283 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.570276 21012 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.567593 21048 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.609797 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.607764 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:41.610677 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.612924 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.592454 21064 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:41.598181 20778 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:41.614488 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.614853 15376 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:41.566277 21094 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.621974 15377 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:41.622470 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.622135 21064 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:41.623590 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.624929 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.613282 21062 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:10:41.624621 15127 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 4 to 8, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 8 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:41.626768 15127 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.628284 15127 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.629793 15127 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 11 to 13, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:41.631407 15127 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.632753 15230 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:41.633924 21094 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.618032 20778 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:41.634809 20778 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.633857 15127 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.635949 15127 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:41.637166 21144 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:41.637570 15127 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.598361 21005 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:10:41.641131 21083 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:41.641564 21083 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:41.642424 21083 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.643442 21012 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.643667 21083 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.645076 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.645186 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.645942 21146 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:41.646533 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.649812 15380 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:10:41.628185 21125 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.018s
W20260709 13:10:41.653607 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82740.2us
I20260709 13:10:41.614367 21048 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:41.661311 21048 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.662039 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.662250 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.663215 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.663453 21048 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.663801 15374 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:10:41.663451 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.664323 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.664515 15381 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:41.664753 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.665482 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.666028 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.666718 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.667155 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.665482 15382 raft_consensus.cc:2368] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:10:41.665560 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.671093 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.671490 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.672883 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.676440 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.677095 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.655784 21012 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:41.678179 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.680172 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.687322 15377 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:41.680459 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.681020 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.681784 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.682555 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.682963 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.684700 21048 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.686028 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.686482 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.688961 15376 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:41.692759 15233 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:10:41.694244 15274 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.700474 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:41.702759 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 93022.4us
I20260709 13:10:41.705935 15225 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:41.687206 21062 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.686983 21012 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.711475 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.714876 15377 raft_consensus.cc:2410] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:41.715699 21153 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:41.715910 15232 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:41.716225 21153 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.716825 21153 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.669034 21125 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.720927 15304 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:41.721807 21004 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.722848 21125 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:41.724161 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:41.724709 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51881.3us
I20260709 13:10:41.725808 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.728112 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.729099 15378 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:10:41.725171 15348 connection.cc:256] RPC call timeout handler was delayed by -1.1891118079998932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:10:41.730511 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:41.731379 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.709151 21048 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:41.732026 15303 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.713212 21062 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:41.733928 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.734169 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:41.734624 15377 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:41.734706 21062 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.736047 21062 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.724661 21012 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.737625 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.737946 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.739993 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.741350 15306 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:41.741990 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.760416 15302 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.744472 21149 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:41.736603 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61776.3us
I20260709 13:10:41.746253 15307 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:41.747339 15304 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:41.750082 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.750590 21153 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.750931 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.751389 21146 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:41.751569 21148 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.755391 15303 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
W20260709 13:10:41.757596 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.724220 21004 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:41.764528 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 60453.6us
I20260709 13:10:41.773211 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:41.776479 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 46028.2us
I20260709 13:10:41.774041 21146 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.777693 21146 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.778277 21156 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:41.778724 21156 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:41.779469 21156 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:41.765348 20778 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.778719 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.786542 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.787763 15300 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:10:41.759459 21005 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.790436 15306 raft_consensus.cc:2410] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:41.791260 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.793689 15301 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:41.794131 21146 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.796269 21146 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.796783 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.800699 21155 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:41.801175 21155 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:41.802000 21155 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.803267 21155 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.804839 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.805763 15307 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.808929 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.808935 21156 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:41.812276 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:41.812477 15199 consensus_peers.cc:597] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0066b5a9791e4a30856433ed14864d2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.815088 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.812124 21156 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.816941 21147 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:10:41.817407 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.763458 21149 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.821209 21149 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:41.825711 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.826164 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.816956 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.810001 15308 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:41.834968 15198 connection.cc:256] RPC call timeout handler was delayed by -1.300270515999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:10:41.835420 15198 connection.cc:256] RPC call timeout handler was delayed by -1.2921705159999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:10:41.835726 15198 connection.cc:256] RPC call timeout handler was delayed by -1.0527705159998959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
I20260709 13:10:41.830423 15229 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
W20260709 13:10:41.836777 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50321.5us
I20260709 13:10:41.841084 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.841943 15304 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:41.843971 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.844136 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.844022 15306 raft_consensus.cc:2410] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:41.848600 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:41.853343 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:41.856690 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.859236 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.859517 16004 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:41.860579 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:41.862257 21153 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.859999 15308 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:41.867465 15307 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:41.872822 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.873620 15300 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:41.878198 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.886121 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:41.887236 16008 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:41.888015 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.888854 15306 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:41.894583 16001 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:41.895825 21158 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:41.896306 21158 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:41.896605 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.898295 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:41.899549 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.899729 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.900375 15307 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:41.901116 15307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:10:41.901808 15307 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.902168 15307 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.902555 15308 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:41.904667 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:41.905341 15377 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:41.893395 21048 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.905776 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:41.906183 21048 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.907393 15379 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:41.905503 15230 raft_consensus.cc:2368] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:10:41.896675 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:41.908473 15374 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:41.908854 15374 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:41.908952 16000 raft_consensus.cc:2393] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:41.900261 15300 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:41.909830 15374 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.910912 15374 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.910976 15300 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:10:41.892642 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:41.914361 21152 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.221s	user 0.004s	sys 0.000s
I20260709 13:10:41.916426 15300 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:41.920766 15300 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:41.905385 15306 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:41.864114 21157 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:41.929713 16004 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:10:41.938658 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.939333 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.935859 15307 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:41.876412 20778 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:41.976019 15302 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:10:41.977733 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 136441us
I20260709 13:10:41.946305 15307 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:41.978760 15304 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:10:41.947896 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:41.974373 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 180642us
I20260709 13:10:41.957162 21048 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:41.958760 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60554.8us
I20260709 13:10:41.959561 20952 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:41.947203 21161 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:10:41.954047 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:41.978936 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 185122us
I20260709 13:10:41.980353 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.863960 21146 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:10:41.936285 21157 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.981509 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.988826 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:41.984823 15301 raft_consensus.cc:2410] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:10:41.986935 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 292782us
I20260709 13:10:41.987155 15374 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:10:41.990885 15374 pending_rounds.cc:85] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 6
I20260709 13:10:41.987953 15300 raft_consensus.cc:2368] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:10:41.991279 15374 pending_rounds.cc:107] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:10:41.991557 15374 raft_consensus.cc:2889] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.991811 15302 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:41.992774 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.993093 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:41.994788 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47001.5us
I20260709 13:10:41.996253 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.997241 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:41.997861 21005 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:41.998375 21005 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:41.998798 21005 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.998919 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.000002 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.000650 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:42.016907 15380 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:42.001308 21004 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.020983 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:42.002506 21048 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:42.003415 15306 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:10:42.004717 21125 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:42.004886 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.005630 21159 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:42.006961 21158 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.008430 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:41.990628 21157 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:42.000676 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46743.4us
I20260709 13:10:42.009903 15303 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:42.010241 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:42.010711 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:42.014200 21005 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:42.016181 15128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 203) took 35987 ms (client timeout 15000 ms). Trace:
I20260709 13:10:41.990017 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.017253 15232 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.001843 21166 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:41.998107 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:42.020718 21004 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:42.037977 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.039911 15304 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:42.040761 15974 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.040954 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:42.043778 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.056659 15229 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:42.057252 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.044983 15306 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:42.046402 21172 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:42.047191 20867 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:42.047322 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:42.048820 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 157578us
I20260709 13:10:42.050132 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:42.050925 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46169.7us
I20260709 13:10:42.016491 20778 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:42.051942 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:42.002559 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.060132 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:42.060966 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.061317 21164 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:42.061492 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.061867 21164 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.062552 21040 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:42.063340 21040 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:42.063694 21040 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.064034 21040 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.056972 15229 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:42.066901 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:42.053689 21161 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:42.066219 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:42.064299 15274 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.065608 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:42.079239 15196 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.057631 21004 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.089058 21147 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.089720 15307 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:42.088843 21171 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:10:42.088902 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48220.1us
I20260709 13:10:42.100471 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.103135 15232 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:42.107282 21175 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.108985 21004 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.111155 21004 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:42.059231 20867 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:42.120200 20952 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:42.121088 20867 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.122299 20867 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.125422 21157 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.126902 16002 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 7: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:42.128872 21157 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.129347 21167 raft_consensus.cc:2764] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:42.129593 21005 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:42.130435 15999 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:10:42.131002 21168 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:42.133366 21149 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.090698 15229 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.064415 20778 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:42.093564 15198 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.652s (SENT)
I20260709 13:10:42.116834 21147 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:42.118633 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.119843 21164 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:42.138969 15302 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:42.137337 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:10:42.113505 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 115463us
W20260709 13:10:42.147078 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 157135us
I20260709 13:10:42.147821 15973 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:42.112185 20830 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:42.150074 21147 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:42.150600 21147 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:42.152614 15229 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:42.102849 21094 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:42.112645 21161 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:42.154611 21161 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.112373 20929 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:42.156713 20929 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:42.157199 20929 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.141757 21158 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:42.167305 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48828.3us
I20260709 13:10:42.168184 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:42.165452 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:42.142431 20778 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:42.172052 21048 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:42.181036 20830 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.180925 21048 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.181659 21137 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:42.180744 21166 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:42.183959 21166 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:42.171983 21167 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:42.180805 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 87284.7us
I20260709 13:10:42.143411 21175 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:42.186867 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 135002us
I20260709 13:10:42.151615 21147 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.188898 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.189105 21040 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.189657 21178 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:42.190115 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.190327 21178 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.190913 21178 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.191089 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.192015 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.193794 21181 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.193938 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.194670 21181 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.195060 21177 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:42.195616 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:42.197675 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49939.3us
I20260709 13:10:42.174682 21062 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:42.203986 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61980.7us
I20260709 13:10:42.200587 21175 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.209477 21184 raft_consensus.cc:2764] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:10:42.209627 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.174225 21094 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:42.213477 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.177539 21164 raft_consensus.cc:2764] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:10:42.198695 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.211551 21159 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:10:42.234071 21155 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:42.234462 21155 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:10:42.053660 15128 rpcz_store.cc:269] 0709 13:10:06.028636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.028875 (+   239us) service_pool.cc:224] Handling call
0709 13:10:42.015843 (+35986968us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:35.946504 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:36.081435 (+134931us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:36.085504 (+  4069us) write_op.cc:435] Acquired schema lock
0709 13:10:36.090590 (+  5086us) tablet.cc:662] Decoding operations
0709 13:10:36.116652 (+ 26062us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:36.116726 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:36.116758 (+    32us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:10:36.119652 (+  2894us) tablet.cc:701] Row locks acquired
0709 13:10:36.119682 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:10:36.120110 (+   428us) write_op.cc:270] Start()
0709 13:10:36.120281 (+   171us) write_op.cc:276] Timestamp: P: 1783602636120011 usec, L: 0
0709 13:10:36.120306 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:10:36.155361 (+ 35055us) log.cc:844] Serialized 12552 byte log entry
0709 13:10:37.060214 (+904853us) op_driver.cc:464] REPLICATION: finished
0709 13:10:37.246946 (+186732us) write_op.cc:301] APPLY: starting
0709 13:10:37.247045 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:39.198518 (+1951473us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:39.326219 (+127701us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:40.748310 (+1422091us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:40.749102 (+   792us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=64,mrs_lookups=0
0709 13:10:40.749215 (+   113us) write_op.cc:312] APPLY: finished
0709 13:10:40.851377 (+102162us) log.cc:844] Serialized 276 byte log entry
0709 13:10:41.179479 (+328102us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:41.191039 (+ 11560us) write_op.cc:454] Released schema lock
0709 13:10:41.191143 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:41.191784 (+   641us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:41.191818 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8793,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":180620,"apply.run_cpu_time_us":185553,"apply.run_wall_time_us":3944805,"cfile_cache_hit":130,"cfile_cache_hit_bytes":137759,"num_ops":32,"prepare.queue_time_us":191330,"prepare.run_cpu_time_us":14781,"prepare.run_wall_time_us":293012,"raft.queue_time_us":326454,"raft.run_cpu_time_us":19054,"raft.run_wall_time_us":139774,"replication_time_us":916294,"thread_start_us":698666,"threads_started":6,"wal-append.queue_time_us":564877,"wal-append.run_cpu_time_us":10976,"wal-append.run_wall_time_us":1532023}]]}
I20260709 13:10:42.235308 21155 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.201116 20952 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:42.233455 21164 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.241782 15229 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:42.171705 21012 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.248298 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.224882 21184 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:42.251753 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:42.255988 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.241997 21181 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:42.248942 21147 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:42.266767 15305 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:42.241516 21177 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:42.243846 21164 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.272415 15302 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:42.273206 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:42.259172 20952 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:42.279215 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80609.3us
I20260709 13:10:42.279670 21173 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.279927 21012 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:42.265163 21181 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.268857 21149 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:42.253657 21036 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:10:42.273769 21167 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.201422 21166 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.274374 21164 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.274428 21155 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:42.310636 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 246379us
I20260709 13:10:42.292901 21062 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:42.326033 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.288385 21181 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:42.322712 15198 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.062s (SENT) [suppressed 33 similar messages]
I20260709 13:10:42.309477 21125 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:42.337423 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.340963 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.280264 21173 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.314698 21186 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:42.357404 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43533.9us
I20260709 13:10:42.369956 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.371371 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.372771 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.373456 15379 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.376786 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.377635 15375 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 7: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:42.378969 15378 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:42.380498 15376 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:42.389703 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 116592us
I20260709 13:10:42.390899 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.287787 21094 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:10:42.410563 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.412705 15379 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:42.414031 16002 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:42.398808 21040 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.402747 20952 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.408188 21062 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.423271 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:42.423939 15305 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.457034 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.389837 21177 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:42.489627 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83147.2us
I20260709 13:10:42.493546 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:42.476068 21194 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:10:42.494923 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 155306us
I20260709 13:10:42.432809 21180 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.466744 21004 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:42.498806 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.480003 21184 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.425729 21185 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:10:42.435034 21196 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
W20260709 13:10:42.511672 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 144181us
I20260709 13:10:42.498601 21005 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:42.498358 21153 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:42.436286 21125 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.481707 21190 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:10:42.525589 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.520437 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63547.4us
I20260709 13:10:42.518070 21199 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.536509 21182 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:10:42.545892 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.510774 21004 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.555315 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.560995 20778 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.527319 21153 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:42.567801 21178 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.508790 21180 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:42.574481 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44716.4us
I20260709 13:10:42.577638 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.563119 20778 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:42.570871 21173 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:42.615162 15304 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:42.550850 21199 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.616415 21173 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:42.624409 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46886.2us
I20260709 13:10:42.612025 21178 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.638926 15348 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:42.649351 21206 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:10:42.629981 20867 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:42.653635 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.653957 15305 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:42.655442 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.644924 21203 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:42.644595 21173 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.678115 21175 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.682950 21175 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:42.686789 21062 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:42.687708 15198 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:42.685564 21202 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:10:42.670822 20929 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.005s
I20260709 13:10:42.690408 20929 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.680307 21203 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:42.692596 21203 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:42.693717 21203 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.695499 21203 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.675949 20830 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.684188 21199 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.678115 21181 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.697732 15301 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:42.699725 21181 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.700753 21036 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:42.701390 21036 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:42.702047 21199 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.702426 21036 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.703029 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:42.640159 21153 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.705693 15376 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:42.707616 21064 raft_consensus.cc:2764] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:42.707918 21166 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:42.708371 21064 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:42.715287 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.727021 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 73471.6us
I20260709 13:10:42.728152 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.729187 21175 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.730753 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.731834 21175 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.733772 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.734812 21175 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:42.737591 21175 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:42.739454 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.742134 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.738683 21175 consensus_queue.cc:1243] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:10:42.721354 21158 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.008s
I20260709 13:10:42.712409 21171 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:42.750713 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.757653 20929 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.760586 21175 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.761667 21172 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:42.762235 21172 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.762729 21172 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.769860 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:42.747874 21005 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:42.775812 15348 leader_election.cc:400] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:10:42.777477 15348 leader_election.cc:403] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.778175 21171 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:10:42.748379 21004 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:42.790160 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:42.790051 16000 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:42.790910 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:42.793941 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.790777 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.795537 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.796634 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.797124 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.798153 15225 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:42.799116 16002 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:42.801028 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:42.791123 21180 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:42.806385 21164 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.808660 15299 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:42.810063 15228 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:42.810199 16004 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:42.781175 21094 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:42.823268 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:42.811295 21171 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:42.827302 15229 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:42.818028 21005 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:42.829301 21094 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:42.831898 21197 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.830935 21064 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.857643 21189 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:42.857182 21197 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.857854 21064 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.858649 21189 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:42.859160 21189 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:42.859514 21189 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.836309 20952 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:42.838004 21036 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:42.841806 20867 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:42.845800 15380 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:42.864235 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 473400us
I20260709 13:10:42.865113 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:42.866577 21193 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:42.866778 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.846210 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:42.846729 15376 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:42.847396 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:42.848294 15378 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:42.848939 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.849582 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.850646 15374 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:10:42.850591 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 509680us
I20260709 13:10:42.870828 15379 raft_consensus.cc:2376] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14. Re-sending same reply.
I20260709 13:10:42.872788 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:42.871436 15375 raft_consensus.cc:2376] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16. Re-sending same reply.
I20260709 13:10:42.871083 15378 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:42.883562 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:42.898792 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:42.902161 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:42.902840 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:42.866777 21199 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:42.905678 15307 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:42.905390 15303 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:42.910015 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:42.910768 15377 raft_consensus.cc:2376] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15. Re-sending same reply.
I20260709 13:10:42.896205 15302 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:10:42.864292 21195 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:42.921882 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55187.8us
W20260709 13:10:42.922111 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 107556us
I20260709 13:10:42.922734 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.891368 21164 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.887939 21149 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.908845 15378 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:42.927656 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54948.7us
I20260709 13:10:42.929387 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.931820 15381 raft_consensus.cc:2376] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14. Re-sending same reply.
I20260709 13:10:42.941942 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.880496 21094 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:42.947052 15378 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.924928 21146 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:42.950297 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:42.924995 21004 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.925295 21197 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.929466 21195 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.948288 21064 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.955591 21180 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.944764 21125 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.958153 21125 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.958083 21180 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.958817 21125 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.957464 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.961934 15273 leader_election.cc:400] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 6 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7.
I20260709 13:10:42.963382 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.929401 21149 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.966605 21188 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:42.967483 21188 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:42.967872 21188 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:42.968400 21188 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.973117 21094 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:42.956223 21004 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.976919 21178 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:42.977727 21178 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:42.978811 21178 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:42.982081 21149 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:42.973372 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.993948 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:42.948432 21012 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.004621 15377 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:42.955910 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:42.929927 21175 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:43.007256 15378 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:10:43.007853 15378 pending_rounds.cc:85] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 11
I20260709 13:10:43.008077 15378 pending_rounds.cc:107] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:10:43.008314 15378 raft_consensus.cc:2889] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:42.952589 21181 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:43.009443 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53612.5us
I20260709 13:10:42.951148 21146 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:43.005209 21177 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:43.052075 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58219.4us
I20260709 13:10:43.044322 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:43.046166 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:43.058624 21202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47284 (request call id 3) took 1488 ms. Trace:
I20260709 13:10:43.060253 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.059378 21202 rpcz_store.cc:276] 0709 13:10:41.560805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.562917 (+  2112us) service_pool.cc:224] Handling call
0709 13:10:41.591920 (+ 29003us) log.cc:844] Serialized 506 byte log entry
0709 13:10:41.748487 (+156567us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5400203620. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53aa6b26 00007f2f53aa049a 00007f2f53a9f714 00007f2f53a7feaa 00007f2f53a86d53 00007f2f53a86cd9 00007f2f53a86c69 00007f2f53a86c31 00007f2f53a85dfd 000000000038f354
0709 13:10:41.753490 (+  5003us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5400203620. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a9f142 00007f2f53a7feaa 00007f2f53a86d53 00007f2f53a86cd9 00007f2f53a86c69 00007f2f53a86c31 00007f2f53a85dfd 000000000038f354 000000000038f199 00007f2f50a39475
0709 13:10:41.755209 (+  1719us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b18001fe7c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:43.043720 (+1288511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38670,"raft.queue_time_us":114622,"raft.run_cpu_time_us":4087,"raft.run_wall_time_us":184822,"spinlock_wait_cycles":55659520,"thread_start_us":27694,"threads_started":1,"wal-append.queue_time_us":91827,"wal-append.run_cpu_time_us":2319,"wal-append.run_wall_time_us":1034993}
I20260709 13:10:43.061839 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.059046 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:43.055960 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45371.4us
I20260709 13:10:43.039362 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.064527 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.023196 21173 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.990389 21195 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:43.043772 21083 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:10:43.041400 21149 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:43.023296 21193 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.041692 21004 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.043506 20778 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.083762 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:43.084051 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:43.085599 15377 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:43.067408 21181 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.089586 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:43.026206 21197 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:10:43.069448 21048 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.023389 21203 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:10:43.071362 21187 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:43.026589 20867 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:10:43.072973 21214 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.091414 20778 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:43.100292 21236 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:43.105581 20778 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.089126 21173 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.107237 21173 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.086534 21149 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:43.108767 21149 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.109324 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:43.110527 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:43.111063 15375 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:10:43.111958 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.114565 21173 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.118171 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.120815 21187 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:43.121160 21233 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:10:43.122934 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.125299 21187 raft_consensus.cc:2764] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:43.134387 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:43.135638 15377 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:43.143573 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.146677 15345 leader_election.cc:400] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:10:43.148759 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.150254 21173 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.153232 21188 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.089082 21146 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.158211 21188 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.159024 21146 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.159430 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:43.160303 15377 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:43.162019 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:43.162091 21040 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:43.162985 21040 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.165640 21040 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:43.168524 15377 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.170095 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.180958 15300 raft_consensus.cc:1240] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:43.180802 21214 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:43.171002 21137 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.182046 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:43.178532 21187 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:43.183754 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.198890 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:43.183928 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 94449.6us
I20260709 13:10:43.185316 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:43.185702 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:43.189059 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:43.190259 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:43.203537 15229 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.203714 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:43.191182 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.206435 15228 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:43.191262 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:43.191561 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:43.183014 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:43.183570 15307 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:43.208287 15381 raft_consensus.cc:2410] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:10:43.211782 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.213483 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.177559 21173 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.215406 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:43.223613 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.184424 21204 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:43.228284 15300 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:43.184177 21083 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.182639 21188 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.231151 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.231151 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.232910 15303 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:43.231467 15305 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:43.193022 21064 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.193714 21177 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.238533 15381 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:43.239332 15229 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:43.212798 20867 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:10:43.218564 21184 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.244318 15307 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:43.245898 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.249540 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.255834 15377 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
W20260709 13:10:43.168138 21167 consensus_queue.cc:1175] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0f9eceec749442cb9a06c87f00f3caf" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 13:10:43.250696 15227 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:43.257230 15381 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:43.193215 20830 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:43.184073 20778 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:43.235574 21004 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:43.259752 15300 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:43.193114 21187 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.231019 21175 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.272306 15377 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:43.239123 21064 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.238826 21204 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:43.245601 21184 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.186509 21189 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.299487 15381 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:43.229444 21173 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.185011 21214 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.228211 21125 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:43.302726 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69711.3us
I20260709 13:10:43.304011 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.312309 15274 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:43.298427 21094 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:43.314599 21094 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:43.315687 21094 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.317273 21094 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.318214 21125 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.298029 21064 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.321396 21214 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:43.245011 21188 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.323885 21188 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.331470 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.335863 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:43.342645 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 105241us
I20260709 13:10:43.343703 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.256498 21172 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:43.379571 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49750.6us
I20260709 13:10:43.337093 21149 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:43.308128 20867 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:10:43.302405 21175 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:43.389838 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 54087.8us
I20260709 13:10:43.391045 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.330302 21177 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:10:43.388526 21203 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:43.379263 21201 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:10:43.400120 21173 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.384320 21202 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.403878 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3302) took 1141 ms. Trace:
I20260709 13:10:43.404572 21177 consensus_queue.cc:1243] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:43.402114 21202 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:43.405172 21202 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.408658 21173 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.409235 21173 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.411198 21173 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.404384 15306 rpcz_store.cc:276] 0709 13:10:42.262873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.263038 (+   165us) service_pool.cc:224] Handling call
0709 13:10:42.263354 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.313733 (+ 50379us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:42.327057 (+ 13324us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.848518 (+521461us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b18002ec960. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f579fa58f 00007f2f50a39571 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd
0709 13:10:42.989426 (+140908us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b18002ec960. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:10:43.233612 (+244186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.275806 (+ 42194us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.276023 (+   217us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:43.276062 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.276139 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.403531 (+127392us) raft_consensus.cc:1685] finished
0709 13:10:43.403556 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.403758 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14839,"prepare.queue_time_us":13133,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":58218,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":10925,"spinlock_wait_cycles":28406912,"thread_start_us":278298,"threads_started":2,"wal-append.queue_time_us":907320}
I20260709 13:10:43.388643 20778 consensus_queue.cc:1243] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:43.382985 21190 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.441049 21114 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:43.441628 21114 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:43.446979 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55998.9us
I20260709 13:10:43.384531 21033 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:10:43.414630 21149 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:43.457967 21200 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.464316 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.435436 21083 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:43.413327 21064 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.567214 21193 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.567827 21193 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.568522 21171 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.568704 21064 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.569085 21171 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.569787 15229 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:43.571543 21193 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.571658 21171 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.468447 21200 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.572579 21171 consensus_queue.cc:1059] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:43.574716 21200 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:43.568032 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:43.505231 21149 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:43.507426 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.574754 20778 raft_consensus.cc:3055] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:43.579387 20778 raft_consensus.cc:740] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:43.580439 20778 consensus_queue.cc:260] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:43.498782 21243 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:10:43.513233 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.522276 15382 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:43.524286 15306 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:43.511293 21187 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:43.453291 21204 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.528962 21212 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.589694 21212 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.591802 21212 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.529492 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.593122 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:43.594168 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.530584 15230 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:43.595911 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.596505 15230 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:43.597138 21189 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.597429 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:43.598461 15230 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:43.531242 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.531970 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:43.602407 15127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 99) took 2640 ms. Trace:
I20260709 13:10:43.533217 20486 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:43.533998 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.612051 15232 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:43.536094 15226 pending_rounds.cc:85] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 8
I20260709 13:10:43.537633 21094 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.548074 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.548985 15378 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:43.536139 21180 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.554886 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:43.555130 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:43.555588 21153 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.462397 21114 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.556239 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:43.556699 16004 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:43.557879 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:43.558108 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:43.559754 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.564284 21172 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.588696 20778 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.455453 21203 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.578374 21246 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:43.525972 21175 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:43.584637 15374 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:43.587751 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:43.532694 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:43.605155 21195 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.005s
I20260709 13:10:43.605641 15230 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:10:43.607318 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 223380us
I20260709 13:10:43.610502 15225 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:43.594877 15227 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:43.613176 15226 pending_rounds.cc:107] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 13.9
W20260709 13:10:43.629890 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 285299us
I20260709 13:10:43.636747 16001 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 11: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:43.639433 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 79739us
I20260709 13:10:43.638726 15999 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:43.659109 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.565986 21196 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.643323 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:43.611580 20486 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:43.621821 21171 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.663350 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.658332 15226 raft_consensus.cc:2889] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:43.649817 21247 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:43.603699 21202 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.641799 21212 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.676769 15308 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:43.677819 15299 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:43.671337 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:43.807008 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 135789us
I20260709 13:10:43.644492 21083 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:10:43.654511 21114 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:43.766204 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.654232 21246 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:43.644119 21153 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.607993 15127 rpcz_store.cc:276] 0709 13:10:41.011617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.011925 (+   308us) service_pool.cc:224] Handling call
0709 13:10:43.602321 (+2590396us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:41.964840 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:41.965722 (+   882us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:41.965784 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:10:41.965827 (+    43us) tablet.cc:662] Decoding operations
0709 13:10:41.967245 (+  1418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:41.967365 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:41.967407 (+    42us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:10:42.048478 (+ 81071us) tablet.cc:701] Row locks acquired
0709 13:10:42.054164 (+  5686us) write_op.cc:260] PREPARE: finished
0709 13:10:42.080306 (+ 26142us) write_op.cc:270] Start()
0709 13:10:42.108777 (+ 28471us) write_op.cc:276] Timestamp: P: 1783602642066488 usec, L: 0
0709 13:10:42.108814 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:10:42.109442 (+   628us) log.cc:844] Serialized 3984 byte log entry
0709 13:10:42.556778 (+447336us) op_driver.cc:464] REPLICATION: finished
0709 13:10:42.688760 (+131982us) write_op.cc:301] APPLY: starting
0709 13:10:42.688878 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:42.758790 (+ 69912us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:42.758955 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:42.980018 (+221063us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:42.980286 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:10:42.980330 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:43.057080 (+ 76750us) log.cc:844] Serialized 97 byte log entry
0709 13:10:43.069322 (+ 12242us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:43.082755 (+ 13433us) write_op.cc:454] Released schema lock
0709 13:10:43.084657 (+  1902us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:43.102943 (+ 18286us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:43.102993 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121721,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":131665,"apply.run_cpu_time_us":19749,"apply.run_wall_time_us":414116,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":226280,"prepare.run_cpu_time_us":5786,"prepare.run_wall_time_us":144972,"replication_time_us":447786,"thread_start_us":214053,"threads_started":2}]]}
I20260709 13:10:43.655400 15381 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:10:43.648460 21203 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.657223 21172 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.800473 21193 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.683146 21171 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.847965 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.649529 21180 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:10:43.697678 21146 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:43.640091 21094 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.822391 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:43.833757 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 170523us
I20260709 13:10:43.877734 15380 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:43.834527 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:43.813100 15299 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:43.668161 21195 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.817175 21167 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:43.849555 15378 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:43.824193 21177 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:43.669911 21064 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.166s
I20260709 13:10:43.877959 15308 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.879230 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.860250 16008 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:10:43.842233 21203 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.685535 21196 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.879060 15300 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:43.820150 21255 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:10:43.684598 21189 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.824669 21212 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:43.900509 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.843482 21033 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.854373 21171 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.910655 15304 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:43.911417 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 252371us
I20260709 13:10:43.930436 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.891289 21180 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:43.944303 15380 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:43.949903 15224 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:43.857642 21172 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.853736 21214 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.852425 21193 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.910411 21177 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:43.940157 21184 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.005s
I20260709 13:10:43.934302 21005 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:43.959877 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.910385 21189 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.897645 21149 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:43.970140 21189 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.970649 21005 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:43.985239 21005 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:43.986397 21005 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.988025 21094 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:43.964584 21214 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:43.990756 21214 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:43.951041 21167 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:43.992462 15305 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
W20260709 13:10:43.994455 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 387574us
I20260709 13:10:43.881183 20486 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.002521 15230 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:43.996564 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:44.004328 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:43.933919 21033 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.032954 21153 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.034200 21033 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.035719 21175 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:44.036098 21175 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:44.036911 21175 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.039898 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.042219 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1114) took 1172 ms. Trace:
I20260709 13:10:44.042621 15374 rpcz_store.cc:276] 0709 13:10:42.870229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.114045 (+243816us) service_pool.cc:224] Handling call
0709 13:10:43.584441 (+470396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.654193 (+ 69752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.042021 (+387828us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b540023f5d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:44.042161 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081140480}
I20260709 13:10:44.043443 21033 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:43.966756 21253 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:44.025723 15375 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:44.030915 21036 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:44.045392 21036 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:44.045993 21036 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.995440 21149 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.045114 21177 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.050783 21149 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.052902 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:44.053640 15224 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:44.055157 21040 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:44.055769 21040 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:44.056775 21040 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.060959 21033 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:44.044005 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:44.062090 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3227) took 1070 ms. Trace:
I20260709 13:10:44.062615 21064 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:44.063112 21064 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:44.062561 15377 rpcz_store.cc:276] 0709 13:10:42.991793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.304862 (+313069us) service_pool.cc:224] Handling call
0709 13:10:43.339815 (+ 34953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.341520 (+  1705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.341574 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.377503 (+ 35929us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.817827 (+440324us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:43.817866 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.817929 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.061842 (+243913us) raft_consensus.cc:1685] finished
0709 13:10:44.061867 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.062024 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1185,"raft.queue_time_us":39508,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":3179,"thread_start_us":416845,"threads_started":1,"wal-append.queue_time_us":640769}
I20260709 13:10:44.064220 21064 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.066304 21195 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.070667 21172 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.072151 21196 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:44.074648 21252 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:10:43.979997 21184 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:44.075219 21235 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:44.074432 21266 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:10:44.062142 15374 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:44.070739 21175 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:44.093871 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.068068 21193 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:44.102031 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:44.023340 21083 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:44.143128 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:44.145732 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:44.146347 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:44.147491 15229 raft_consensus.cc:2410] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:44.151290 15228 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:44.153198 15303 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:44.122991 15382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.012s	sys 0.006s
I20260709 13:10:44.134853 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3229) took 1112 ms. Trace:
W20260709 13:10:44.159641 15382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.012s	sys 0.006s
W20260709 13:10:44.160844 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58966.3us
I20260709 13:10:44.166602 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:44.173530 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:44.160458 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:44.175079 15999 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:10:44.160326 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:44.156509 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:44.197814 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.184369 15303 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:44.157401 15373 rpcz_store.cc:276] 0709 13:10:43.022863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.504748 (+481885us) service_pool.cc:224] Handling call
0709 13:10:43.505249 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.506018 (+   769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.506052 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.506620 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.927448 (+420828us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:43.969327 (+ 41879us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.969570 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.969668 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.134592 (+164924us) raft_consensus.cc:1685] finished
0709 13:10:44.134614 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.134751 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15259,"prepare.queue_time_us":42665,"prepare.run_cpu_time_us":201,"prepare.run_wall_time_us":201,"raft.queue_time_us":19290,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"thread_start_us":420269,"threads_started":1,"wal-append.queue_time_us":518120}
I20260709 13:10:44.140475 21172 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.150789 21083 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.222124 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:44.180027 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:44.227283 15301 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:44.219573 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:44.220023 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46582.7us
I20260709 13:10:44.218155 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:44.161347 20867 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:44.232904 21252 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:10:44.217566 21214 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:44.270836 15299 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:44.264245 15225 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:44.271948 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:44.234050 21235 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:10:44.266687 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.262877 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3329) took 1133 ms. Trace:
I20260709 13:10:44.163373 21195 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:10:44.217682 21273 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.217309 21267 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.233919 21083 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.274765 15304 rpcz_store.cc:276] 0709 13:10:43.129762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.130346 (+   584us) service_pool.cc:224] Handling call
0709 13:10:43.130868 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.934059 (+803191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.262501 (+328442us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54001874d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:44.262788 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792861056}
I20260709 13:10:44.132725 20830 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:10:44.277191 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:44.292604 15374 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:44.166499 21193 consensus_queue.cc:1059] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:10:44.286417 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:44.295611 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:44.283947 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:44.302995 15301 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
W20260709 13:10:44.304234 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 425081us
I20260709 13:10:44.233525 21172 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:44.322285 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.295655 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:44.324510 15373 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:44.323346 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:44.283870 21214 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:44.329253 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3228) took 1323 ms. Trace:
I20260709 13:10:44.329862 15381 rpcz_store.cc:276] 0709 13:10:43.006304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.300844 (+294540us) service_pool.cc:224] Handling call
0709 13:10:43.333018 (+ 32174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.333531 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:43.333831 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.467527 (+133696us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.470370 (+  2843us) log.cc:844] Serialized 506 byte log entry
0709 13:10:43.655241 (+184871us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:43.970208 (+314967us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.970532 (+   324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.970647 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.328946 (+358299us) raft_consensus.cc:1685] finished
0709 13:10:44.328977 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.329179 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10610,"prepare.queue_time_us":451,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":26245,"raft.queue_time_us":19639,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":14001,"thread_start_us":133243,"threads_started":1,"wal-append.queue_time_us":317201}
I20260709 13:10:44.305044 15301 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:44.308071 21269 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:44.339630 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53289.2us
I20260709 13:10:44.317332 21155 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:44.350723 16000 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:44.323328 21004 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.356395 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:44.284112 21137 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:10:44.365458 16003 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:44.313913 21196 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:10:44.308228 21274 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:10:44.299154 21267 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.348178 21149 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.348763 21203 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.394097 21270 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:44.395754 21172 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.397285 21202 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:44.375828 21004 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.347649 21192 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:44.404860 21036 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.355566 21155 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.406031 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:44.493619 15227 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:10:44.360605 21269 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:44.407229 21262 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:10:44.408211 21212 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:44.338605 21214 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:44.412729 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.415269 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:44.417205 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:44.417433 21064 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.514286 15233 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:44.342545 15308 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:44.520964 21203 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.496515 21155 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.440016 21267 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.337383 21180 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:44.436882 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:44.437297 21196 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.441546 21197 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:44.442963 15378 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:44.444950 21083 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:44.447338 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.309082 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:44.456547 21272 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 13:10:44.371585 20830 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
W20260709 13:10:44.432660 21252 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:44.386864 21157 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.482095 21199 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:44.483662 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49955.5us
I20260709 13:10:44.495543 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:44.507422 16005 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:44.484221 21184 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.532626 16002 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:44.497735 21192 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.546969 15380 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:10:44.545861 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 236878us
I20260709 13:10:44.452373 21149 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.435258 21189 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:44.550144 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54728us
I20260709 13:10:44.559199 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:44.570322 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:44.573544 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.541103 21196 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:44.594511 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:44.598430 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:44.535142 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 317235us
I20260709 13:10:44.567289 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:44.573294 21175 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:44.548961 21199 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:44.550170 21180 consensus_queue.cc:1243] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:44.549445 21270 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.562376 21192 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.565807 21172 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:44.526980 21202 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:10:44.548213 21157 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.604910 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:44.651582 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46742us
I20260709 13:10:44.652786 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:44.634442 15227 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:44.602995 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:44.565055 20830 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:10:44.599466 21171 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 13:10:44.625221 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:44.626163 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.608309 21036 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.625975 21189 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.597934 21167 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:10:44.672323 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69467.3us
I20260709 13:10:44.672837 15999 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:44.604231 20778 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.946s	user 0.003s	sys 0.011s
I20260709 13:10:44.597764 21173 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.653581 21153 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.658272 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:44.657755 21270 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.667680 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:44.658629 21175 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.614727 21212 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:44.605645 21114 consensus_meta.cc:287] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.770s	user 0.016s	sys 0.000s
I20260709 13:10:44.597388 21276 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.601610 21268 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.629841 21172 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.690526 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:44.667316 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 298239us
I20260709 13:10:44.674711 21005 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.668301 21180 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.691398 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:44.668115 21171 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.717799 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.606390 21199 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:44.720957 15379 raft_consensus.cc:2410] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:44.694304 21212 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.733150 15376 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:44.698256 21153 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.722311 21172 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:44.699054 20778 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.699321 21190 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.698489 21161 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:44.764091 21161 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.702270 21267 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:10:44.759557 21153 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.760138 21171 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.761134 20867 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.762213 21083 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.754901 21173 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.770780 21161 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.771243 21173 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.773165 21199 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.774159 21173 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.774786 21199 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.762635 20778 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.777968 20778 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.755084 21190 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:44.779455 21190 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.781134 21190 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:44.787144 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.766880 21269 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.770282 21157 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.738373 21212 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.801028 21189 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.801717 21189 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:44.797468 21204 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.806447 21246 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.808177 21193 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.808836 21193 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.811365 21193 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.738711 21005 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.814046 21188 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.814766 21188 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.815668 21005 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.817030 21149 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.734993 21180 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.819751 21180 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:44.820358 21146 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.821151 21146 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.725380 21004 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:44.766000 21286 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:10:44.789125 21294 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:44.790745 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:44.797623 21288 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.825748 21288 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.827907 21149 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:44.828580 21149 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:44.830736 21273 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.004s
I20260709 13:10:44.831296 21273 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:44.851219 21200 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.833941 21250 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:44.852779 21040 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.854681 21177 raft_consensus.cc:3055] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:44.862021 21177 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:44.863044 21177 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.853750 21200 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:44.865422 21200 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.866964 21200 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.868643 21212 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.869980 21177 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:44.871678 21212 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.855218 21250 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:44.878021 21255 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.877611 21250 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.879500 21250 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.878942 21255 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.895179 21255 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:44.895833 20486 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.901068 21161 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.902518 21214 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.905186 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2682) took 1371 ms. Trace:
I20260709 13:10:44.905743 15233 rpcz_store.cc:276] 0709 13:10:43.533674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.534565 (+   891us) service_pool.cc:224] Handling call
0709 13:10:43.534838 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.527536 (+992698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.904869 (+377333us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b540002f654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:44.905106 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251880320}
I20260709 13:10:44.908291 15230 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:44.880288 21149 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.880754 21137 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:44.782893 21172 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:44.882761 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:44.883082 21188 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:44.945218 15380 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:44.690636 21196 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:44.852306 21288 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:44.831591 21189 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:44.951049 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.951861 15378 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.951898 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.955432 15376 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:44.946270 21187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.020s	sys 0.058s
I20260709 13:10:44.959267 15377 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:44.962994 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.963804 15379 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.966825 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:44.965468 15382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.001s	sys 0.022s
W20260709 13:10:44.970243 15382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.001s	sys 0.022s
W20260709 13:10:44.961910 21187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.021s	sys 0.058s
I20260709 13:10:44.974861 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.978734 15373 raft_consensus.cc:2368] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:10:44.974610 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:44.983985 15377 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.986048 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:44.987244 15375 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:44.994717 15373 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:44.968626 20952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.008s	sys 0.010s
I20260709 13:10:45.004009 15378 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:45.007251 21146 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.010134 15378 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:45.012182 20952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.009s	sys 0.011s
I20260709 13:10:44.994411 21161 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.008522 21255 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.038446 15378 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:10:45.024806 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 291850us
I20260709 13:10:45.015228 21005 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:45.048173 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.051584 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.056913 15376 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:45.057498 15230 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:45.028077 15379 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:45.064085 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:45.065253 15379 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:45.064864 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:45.066336 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 391540us
I20260709 13:10:45.067667 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3344) took 1393 ms. Trace:
I20260709 13:10:45.063421 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.077306 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:45.072260 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:45.077960 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.078377 15230 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.079011 15225 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:45.066673 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:45.047698 21296 ts_tablet_manager.cc:933] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:10:45.080389 15233 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:45.080639 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.079984 15377 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:45.099697 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.086931 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.115173 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:45.116185 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
W20260709 13:10:45.118676 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.064070 21064 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 13:10:45.027387 21155 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.082993 15307 rpcz_store.cc:276] 0709 13:10:43.674444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.678213 (+  3769us) service_pool.cc:224] Handling call
0709 13:10:43.814272 (+136059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.814541 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:44.264731 (+450190us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.583499 (+318768us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.795280 (+211781us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b18003a6420. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:10:44.906557 (+111277us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18003a6420. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:45.067190 (+160633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.067251 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:45.067306 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.067405 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.067580 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40768,"prepare.queue_time_us":500092,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":9146,"raft.queue_time_us":231978,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":34936,"spinlock_wait_cycles":16909952,"thread_start_us":1021024,"threads_started":3,"wal-append.queue_time_us":476256}
I20260709 13:10:45.229504 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.122035 21175 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.122071 21036 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:45.138463 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.234968 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.036616 21197 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:10:45.239352 15224 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:45.048049 21255 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.220808 15379 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:45.241323 15375 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:45.221837 15377 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:10:45.223084 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.063671 21005 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.242923 21214 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:45.244316 21005 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:45.251190 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.254139 21033 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:45.254596 21033 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:45.256778 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.223583 21246 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.257614 15380 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.225651 21297 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:45.259573 21297 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:45.261937 21297 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.264055 21155 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:45.244191 21094 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:45.264226 21255 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:45.281875 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.282622 15231 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:45.282811 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.283650 15228 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:45.255672 21033 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.284739 21033 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.086810 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.130362 21187 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:45.125339 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:45.225399 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 426750us
I20260709 13:10:45.230211 15373 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.230922 15230 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:10:45.231208 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.297434 15233 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:45.297704 15381 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:45.232872 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.298383 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:45.298818 15227 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:45.299155 15232 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.299386 15380 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:45.235805 15225 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:10:45.299464 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.238972 21036 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.048503 21192 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.239262 21175 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.229183 20952 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:45.267477 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:45.314620 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47246us
I20260709 13:10:45.270653 21094 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:45.270998 21172 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:45.274192 21177 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.278240 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.285679 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.324222 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.286024 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:45.324942 15381 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:45.325239 15379 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:45.224208 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.016s	sys 0.025s
W20260709 13:10:45.224818 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.232878 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:45.326399 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.016s	sys 0.026s
I20260709 13:10:45.326751 15376 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:45.324268 15377 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:45.327675 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 240964us
I20260709 13:10:45.300590 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:45.303213 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 177964us
I20260709 13:10:45.329936 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:45.304276 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.306169 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.315953 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:45.330842 15230 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:45.331295 15380 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:45.316860 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:45.231670 21203 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:45.333722 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:45.334326 15232 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:45.313601 21036 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:45.295923 21187 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.347113 20486 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.366777 21187 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:45.339249 21293 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.347044 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.367630 21293 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.368074 21293 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.368716 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.369676 15224 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:45.348269 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:45.370069 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.370637 15232 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:45.371201 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.372689 21172 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.373317 21172 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:45.374557 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:45.375046 21307 raft_consensus.cc:2764] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:10:45.378510 21196 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.368676 15125 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 8 to 11, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 11 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:45.337800 21155 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.354862 15307 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.315150 21255 raft_consensus.cc:2764] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:10:45.404795 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.358582 21004 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:45.370301 21291 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:10:45.382905 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:45.346805 20830 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.383435 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.351428 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:45.374450 21172 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.384214 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:45.385921 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:45.386646 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:45.423019 15305 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:10:45.386943 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:45.387573 21309 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.387523 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70746.1us
I20260709 13:10:45.388443 21146 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:45.389271 21297 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.425969 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:45.390755 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:45.391139 15232 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:10:45.351140 15377 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:45.426960 15308 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.403620 21306 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.340006 21153 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.337143 21180 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.347177 21167 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:10:45.383124 21175 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:45.404371 21005 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.419029 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:45.326310 20952 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.390604 21203 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:45.403177 21155 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.427574 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:45.408273 21004 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.428148 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.340847 21177 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.429955 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.432881 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:45.412485 15303 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.434149 15379 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
W20260709 13:10:45.436743 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.531209 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 103733us
I20260709 13:10:45.532021 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:45.537079 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3237) took 2011 ms. Trace:
I20260709 13:10:45.537210 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:45.537600 15382 rpcz_store.cc:276] 0709 13:10:43.525271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.585301 (+ 60030us) service_pool.cc:224] Handling call
0709 13:10:43.590194 (+  4893us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:44.180582 (+590388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.180628 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:44.221013 (+ 40385us) log.cc:844] Serialized 52 byte log entry
0709 13:10:44.972738 (+751725us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:45.216697 (+243959us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.224712 (+  8015us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.225082 (+   370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.225149 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.536815 (+311666us) raft_consensus.cc:1685] finished
0709 13:10:45.536834 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.536969 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34783,"prepare.queue_time_us":332912,"prepare.run_cpu_time_us":233,"prepare.run_wall_time_us":234,"raft.queue_time_us":79814,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":61811,"spinlock_wait_cycles":1268096,"thread_start_us":1450591,"threads_started":3,"wal-append.queue_time_us":870454}
I20260709 13:10:45.539842 21153 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.540846 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:45.542711 21177 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:45.543321 15306 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:45.544691 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:45.540262 21153 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:45.546072 21153 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:45.549950 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 117187us
I20260709 13:10:45.550827 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:45.552748 21149 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.553596 21149 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:45.557046 21204 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:45.557608 21204 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.556243 15273 leader_election.cc:400] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:10:45.440497 15381 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:45.563012 16004 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:45.421875 21307 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.420895 20486 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:45.543927 20952 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:45.433635 21189 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.422605 21250 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:45.427287 21146 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.435753 21267 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.561800 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 133723us
W20260709 13:10:45.634117 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.634905 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.525084 21255 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:45.566653 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:45.440002 15308 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:10:45.528570 21004 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.574955 15303 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:45.423709 20830 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:45.518433 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.575899 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.439200 21306 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.583228 21212 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.579988 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.658203 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:45.627497 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.526904 21155 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.581630 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:45.630388 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.582902 15230 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:10:45.434309 21187 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:45.570770 15373 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:45.448246 21180 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:45.623759 21291 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:10:45.642879 15224 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.652573 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.622654 21137 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.673187 21212 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:45.620990 21310 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:10:45.677543 21212 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.678393 21310 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.679075 21310 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:45.679368 21153 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.643510 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.622941 21258 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.624401 21307 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.640399 21293 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.592286 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.632997 21146 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:45.443027 21309 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.639073 21303 raft_consensus.cc:2764] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:45.576815 21149 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:10:45.577486 21195 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:10:45.667116 15377 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:45.668053 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.614354 21296 tablet_copy_client.cc:323] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.65:44011
I20260709 13:10:45.676631 21137 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.592612 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.711819 15225 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:10:45.516464 21005 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.572188 21177 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:10:45.701628 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58180.5us
W20260709 13:10:45.668215 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 86737.7us
I20260709 13:10:45.435175 21094 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.709756 15233 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:45.639356 21267 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.683337 21189 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:45.745631 15232 raft_consensus.cc:2368] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:45.681304 21175 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:45.743667 15374 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:45.652563 21255 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.665531 21187 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:45.740979 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:45.710958 21305 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.673241 21190 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:45.803001 21267 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.807422 21005 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:45.807703 21309 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.666332 21203 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.745299 21297 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:10:45.711683 21258 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.744938 21033 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.072s
I20260709 13:10:45.667536 20486 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.780259 16008 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:45.777784 21187 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:45.772768 21189 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:45.744572 21177 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:45.784626 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 43781.9us
I20260709 13:10:45.776983 21175 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:45.815569 21201 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:45.844691 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 268866us
I20260709 13:10:45.809780 21153 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:45.680264 21310 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.812631 21305 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:45.829217 21204 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.812702 20830 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.809875 21306 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.864782 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:45.825301 21149 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.814744 21258 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:45.789043 21246 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.856719 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:45.862090 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 295492us
I20260709 13:10:45.864800 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:45.865353 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.870067 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:45.875703 15233 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
W20260709 13:10:45.872219 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.872675 21204 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:45.875571 16004 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:10:45.875684 15227 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:45.874881 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:45.871802 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:45.859375 21005 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:45.870388 21036 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
W20260709 13:10:45.860463 21300 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.014s
W20260709 13:10:45.885562 21300 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.013s	sys 0.015s
W20260709 13:10:45.886262 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.886641 20830 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:45.868561 21149 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:45.888572 21149 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.886345 21033 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:45.890560 21033 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:45.891026 21033 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.879133 21246 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:45.887521 20830 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:45.900853 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:45.899179 15302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.018s
W20260709 13:10:45.904538 15302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.009s	sys 0.018s
I20260709 13:10:45.906215 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:45.910851 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3252) took 1611 ms. Trace:
I20260709 13:10:45.911538 15374 rpcz_store.cc:276] 0709 13:10:44.299937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.300119 (+   182us) service_pool.cc:224] Handling call
0709 13:10:44.300526 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.747868 (+1447342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.909119 (+161251us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540014cdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:45.910735 (+  1616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3317980032}
I20260709 13:10:45.913100 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:45.913982 15374 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:45.915458 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:45.916252 15374 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:45.917757 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:45.918516 15374 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:45.897524 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 467655us
I20260709 13:10:45.943351 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:45.949617 15380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.034s
W20260709 13:10:45.950191 15380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.034s
I20260709 13:10:45.952924 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:45.954383 15382 raft_consensus.cc:2410] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:45.894481 21204 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:45.890579 21255 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:45.966602 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:45.968174 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:45.950078 21267 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.933176 21214 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:45.973491 15303 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.897264 21005 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.894330 21036 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.972378 21064 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.029707 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:45.952473 21295 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:46.123514 15226 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 13:10:46.036005 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.124656 15308 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:46.126008 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.126984 15308 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:46.128460 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:46.054234 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82108.4us
W20260709 13:10:46.054081 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86261.1us
I20260709 13:10:46.031328 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:46.148368 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:45.981769 21167 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:45.947000 21189 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.148550 16004 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.997838 21293 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.095440 21334 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:46.074525 21180 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:45.985083 21175 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:46.153277 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 278543us
I20260709 13:10:46.097190 21307 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:46.001971 21267 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.182927 16004 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:46.184522 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.150717 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:46.074682 21329 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.158674 15229 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:46.133442 21192 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.147377 15303 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:46.002004 21137 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:46.197126 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.960311 21305 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:46.208859 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48836.1us
I20260709 13:10:46.212813 21005 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.053207 20830 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.213986 21300 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.214192 20867 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:46.214967 20867 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:46.214035 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65819.2us
I20260709 13:10:46.215902 20867 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.138185 21064 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.225245 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:46.227428 15303 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:46.207531 21318 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:10:46.230486 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.156404 21167 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.185035 21177 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.230000 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.251945 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.150889 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.253609 15308 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:46.254587 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.142618 21204 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:45.973734 15125 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:10:46.255041 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69646.7us
I20260709 13:10:46.255672 15308 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:46.259936 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:46.025202 21330 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.272s
I20260709 13:10:46.300179 16002 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
W20260709 13:10:46.296759 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 146133us
I20260709 13:10:46.308044 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:46.309845 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:46.310393 15308 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.311040 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.311901 15301 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
W20260709 13:10:46.313098 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83197.7us
I20260709 13:10:46.313292 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:46.331743 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.203444 21329 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.309401 21306 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:46.309190 21199 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:46.350240 15303 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:46.352825 15301 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:46.297137 21246 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:46.221212 21334 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.334563 21300 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:46.363726 15308 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:46.329972 21189 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.262547 21192 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
W20260709 13:10:46.370507 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.371778 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:46.381742 15380 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.369112 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:46.373219 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:46.383342 15377 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 7.
I20260709 13:10:46.372675 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:46.375950 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.385501 15973 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:46.384642 15382 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:46.344028 21258 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:46.393082 15308 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:46.397927 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.334095 21177 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:46.348949 21306 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.311558 21337 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.421074 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3258) took 1148 ms. Trace:
I20260709 13:10:46.425076 15380 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:46.370414 21300 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.373737 21036 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.370131 21199 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:46.374970 21267 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.370030 21189 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.430374 15376 rpcz_store.cc:276] 0709 13:10:45.272724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.327655 (+ 54931us) service_pool.cc:224] Handling call
0709 13:10:45.328045 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.339413 (+ 11368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.339460 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.367273 (+ 27813us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.775455 (+408182us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:45.775547 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.775661 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.420738 (+645077us) raft_consensus.cc:1685] finished
0709 13:10:46.420766 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.420991 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16818,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":407623,"threads_started":1,"wal-append.queue_time_us":531945}
I20260709 13:10:46.390722 21192 consensus_queue.cc:1243] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:46.396433 21258 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.433845 21337 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.408231 21339 raft_consensus.cc:2764] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:10:46.433187 21306 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:46.468310 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 155121us
I20260709 13:10:46.443646 21300 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.472227 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:46.460115 21189 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:46.488173 21319 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:10:46.463608 21196 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:46.461421 21258 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.497282 21005 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.498356 21335 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:46.498093 21005 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:46.499976 21331 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:10:46.503055 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1127) took 1228 ms. Trace:
I20260709 13:10:46.503551 15379 rpcz_store.cc:276] 0709 13:10:45.274876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.530009 (+255133us) service_pool.cc:224] Handling call
0709 13:10:45.548762 (+ 18753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.939745 (+390983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.939775 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.952503 (+ 12728us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.253147 (+300644us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:46.253194 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.253269 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.502747 (+249478us) raft_consensus.cc:1685] finished
0709 13:10:46.502776 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.502979 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196542,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":25448,"thread_start_us":617126,"threads_started":2,"wal-append.queue_time_us":372615}
I20260709 13:10:46.504499 21337 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.505295 21329 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:46.506104 21328 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:10:46.507984 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 804) took 1122 ms. Trace:
I20260709 13:10:46.509099 21354 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:46.517263 15302 rpcz_store.cc:276] 0709 13:10:45.385112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.388070 (+  2958us) service_pool.cc:224] Handling call
0709 13:10:45.388421 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:45.388742 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.388773 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:45.389324 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 13:10:45.905568 (+516244us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:45.905626 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.905719 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.507674 (+601955us) raft_consensus.cc:1685] finished
0709 13:10:46.507699 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.507909 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6413,"raft.queue_time_us":999,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8440,"thread_start_us":515822,"threads_started":1,"wal-append.queue_time_us":806107}
I20260709 13:10:46.522945 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:46.474635 21137 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.550041 16002 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:46.515854 21196 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.530949 21337 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.529888 21214 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.549610 21354 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.554255 21064 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.554625 21177 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.566126 21196 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:46.585212 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:46.586141 15379 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:46.587880 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:46.589438 21348 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:10:46.615051 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 142908us
W20260709 13:10:46.589814 21336 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 13:10:46.590137 21321 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
W20260709 13:10:46.590449 21332 log.cc:927] Time spent T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.303s	user 0.001s	sys 0.001s
I20260709 13:10:46.616379 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:46.617331 21360 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:46.617641 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 808) took 1231 ms. Trace:
I20260709 13:10:46.617786 21360 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.618199 21360 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.618014 15307 rpcz_store.cc:276] 0709 13:10:45.386155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.422348 (+ 36193us) service_pool.cc:224] Handling call
0709 13:10:45.437105 (+ 14757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.525141 (+ 88036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.525185 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.565190 (+ 40005us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.949366 (+384176us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:45.949426 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.949522 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.617387 (+667865us) raft_consensus.cc:1685] finished
0709 13:10:46.617418 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.617583 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6152,"raft.queue_time_us":87642,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2338,"thread_start_us":288599,"threads_started":1,"wal-append.queue_time_us":513670}
I20260709 13:10:46.592378 21334 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.592883 21349 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:46.595521 15125 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 5 to 6, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 6 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:46.620276 21349 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:46.620941 15125 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 9 to 10, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 10 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:46.553817 21137 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:46.598827 21004 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.943s	user 0.015s	sys 0.000s
I20260709 13:10:46.626062 21189 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.626346 21004 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:46.627903 21187 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.772s	user 0.014s	sys 0.000s
W20260709 13:10:46.603065 21155 consensus_meta.cc:287] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.003s
I20260709 13:10:46.628297 21187 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.628770 21155 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.629572 15300 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:46.605484 21146 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.003s
I20260709 13:10:46.525758 21357 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:10:46.611230 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3371) took 1262 ms. Trace:
I20260709 13:10:46.621277 21349 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.626083 21137 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:46.602138 21033 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.005s
I20260709 13:10:46.632457 21033 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.631841 15299 rpcz_store.cc:276] 0709 13:10:45.349253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.349854 (+   601us) service_pool.cc:224] Handling call
0709 13:10:45.350147 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.388172 (+ 38025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.388200 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.388647 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.861382 (+472735us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:45.861432 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.861502 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.610929 (+749427us) raft_consensus.cc:1685] finished
0709 13:10:46.610954 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.611135 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37640,"raft.queue_time_us":38936,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":157,"thread_start_us":472321,"threads_started":1,"wal-append.queue_time_us":711978}
I20260709 13:10:46.634874 21004 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.634999 21187 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.637773 21189 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.571234 21005 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:46.655814 21153 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:46.638854 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 476950us
W20260709 13:10:46.639462 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51677.6us
W20260709 13:10:46.640311 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.575951 21167 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.655555 20867 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:46.656563 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:46.578455 21337 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.663908 21267 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.554286 21199 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.661934 21306 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.631065 21146 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.579654 21354 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:46.666921 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.667387 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.668262 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.658394 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:46.669126 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.670311 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.678617 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:46.679840 15376 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:46.694382 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:46.694952 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.673277 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.695861 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.695182 15381 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:46.686694 15382 pending_rounds.cc:85] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 7
I20260709 13:10:46.698145 15382 pending_rounds.cc:107] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:46.698446 15382 raft_consensus.cc:2889] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.685650 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.699288 15224 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:46.683389 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.681321 15380 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:10:46.700639 15380 pending_rounds.cc:85] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 6
I20260709 13:10:46.700641 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.701208 15380 pending_rounds.cc:107] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:46.702060 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:46.652037 21157 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:46.711429 21323 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.711522 21157 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.702042 21033 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.712450 21157 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.712711 21320 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:46.712954 21337 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:46.713413 21320 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:46.675726 21189 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:46.711596 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.714699 21189 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:46.715103 21189 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:46.715503 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:46.685490 21366 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:10:46.685545 21300 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.687948 20867 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.718652 21300 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.719678 20867 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.720772 21306 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.721372 21187 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:46.721908 21187 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:46.722761 21187 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.676154 21167 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.724634 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.724778 21167 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.725483 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.726902 21167 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.726648 21360 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.674427 21153 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.729921 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.730829 21192 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:46.692443 21155 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.732090 21203 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:46.694200 15228 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:10:46.702991 15377 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:46.704219 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:46.705878 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:46.708446 21310 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.709690 21214 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.678743 21352 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:10:46.710870 15302 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:46.710757 21326 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.713991 21320 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.680735 21064 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.705796 15233 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:46.703013 15380 raft_consensus.cc:2889] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.613554 21177 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.732556 21203 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.737802 15226 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:46.737563 21005 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.734714 15381 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:46.737213 15305 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:46.800799 21005 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.801386 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:46.802112 15226 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:46.803596 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:46.803771 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.805080 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.805857 15305 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:46.761996 21323 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.806674 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.807296 15305 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:10:46.735484 15232 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.624047 15125 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 9 to 10, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 10 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:46.744159 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:46.746322 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.750666 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:46.765161 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.726691 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.715893 21189 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.809049 21064 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.822304 21064 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.814782 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.815217 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.825305 15233 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:10:46.816418 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.827111 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.813446 21005 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:46.749027 21214 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:46.828250 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.829639 15302 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:46.830497 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.830930 21214 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.831046 15302 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:46.832242 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.833304 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.808297 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.726924 21363 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:46.769060 21341 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 13:10:46.768854 21146 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:46.770017 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2705) took 1131 ms. Trace:
I20260709 13:10:46.875726 15229 rpcz_store.cc:276] 0709 13:10:45.638171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.638503 (+   332us) service_pool.cc:224] Handling call
0709 13:10:45.638932 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.195624 (+556692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.769720 (+574096us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54003c28d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:46.769951 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194656128}
I20260709 13:10:46.770206 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.877204 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:46.877905 15302 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:46.771574 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.776108 21246 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.779073 21354 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.784192 21153 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:46.911265 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:46.912086 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:46.785768 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.913888 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:46.914454 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.915454 15301 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:46.787007 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 807) took 1401 ms. Trace:
I20260709 13:10:46.915918 15306 rpcz_store.cc:276] 0709 13:10:45.385940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.386723 (+   783us) service_pool.cc:224] Handling call
0709 13:10:46.786789 (+1400066us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400185bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:46.786927 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274834304}
I20260709 13:10:46.835587 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.831207 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:46.917364 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 86247.1us
I20260709 13:10:46.816879 15307 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:46.819764 15232 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:46.880944 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:46.914726 16004 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:46.917364 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 81878.9us
I20260709 13:10:46.797943 21303 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:46.920248 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:46.881039 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:46.732604 21267 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.969878 15274 leader_election.cc:400] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:46.816499 21323 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:46.826627 21157 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:46.940292 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.970676 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:46.972369 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53898.3us
I20260709 13:10:46.869169 21349 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.742367 21310 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.014016 21310 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:46.928248 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47412.6us
I20260709 13:10:47.015111 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:47.015255 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.015951 15381 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:10:46.846658 21203 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.991852 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:46.817513 21189 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.991942 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:46.815908 21172 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.994382 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.073786 15307 raft_consensus.cc:2410] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:46.912549 21363 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.874004 21273 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.998834 21360 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.076061 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:46.933519 21334 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:46.932240 21370 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:46.993597 21357 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:47.002168 21157 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.007759 15302 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:10:47.007912 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:47.095387 15379 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:47.077253 21351 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:10:46.896517 21214 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:47.083488 21315 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.184s	user 0.004s	sys 0.000s
I20260709 13:10:47.011628 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:47.016505 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.017671 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2710) took 1152 ms. Trace:
I20260709 13:10:47.105381 15225 rpcz_store.cc:276] 0709 13:10:45.865283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.865498 (+   215us) service_pool.cc:224] Handling call
0709 13:10:45.865856 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.874465 (+  8609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.874524 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.875095 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.138172 (+263077us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:46.138217 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.138298 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.768303 (+630005us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:47.017361 (+249058us) raft_consensus.cc:1685] finished
0709 13:10:47.017380 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.017612 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11808,"raft.queue_time_us":8254,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":15924,"spinlock_wait_cycles":3490176,"thread_start_us":236992,"threads_started":1,"wal-append.queue_time_us":610045}
I20260709 13:10:47.019537 21149 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.020780 15243 tablet_copy_service.cc:140] P b0f9eceec749442cb9a06c87f00f3caf: Received BeginTabletCopySession request for tablet 0066b5a9791e4a30856433ed14864d2f from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:46420)
I20260709 13:10:47.020454 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:47.109642 15376 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.021456 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.022152 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:47.021816 21300 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:46.878355 21196 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:47.128608 21354 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:47.130446 21267 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.131031 21196 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.025578 15299 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:47.097350 21309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.000s	sys 0.008s
I20260709 13:10:47.093353 21370 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.027323 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:46.933013 21362 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:46.973836 21004 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:47.028683 16008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 570) took 1610 ms (client timeout 1781 ms). Trace:
I20260709 13:10:47.028430 21349 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.031544 21094 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.032557 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:47.035836 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:47.141412 16008 rpcz_store.cc:269] 0709 13:10:45.418523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.418707 (+   184us) service_pool.cc:224] Handling call
0709 13:10:47.028441 (+1609734us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54006f0ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:47.028577 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789701376}
W20260709 13:10:47.039043 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47300.7us
I20260709 13:10:47.146737 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:47.041630 16004 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:47.040025 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:47.150981 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 111058us
I20260709 13:10:47.153331 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:47.051752 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.154898 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.158484 15300 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:46.990857 21322 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.700s	user 0.004s	sys 0.000s
I20260709 13:10:47.073904 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.166599 16005 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:47.167040 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.944078 21303 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:46.996323 21323 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:46.932034 21246 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.008664 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:47.183924 15377 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:47.184530 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:47.095872 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:46.867579 21326 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:47.074008 21146 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:47.104493 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:47.192575 15374 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:47.104959 15999 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:47.074908 21195 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:47.079281 21040 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.111128 15233 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:47.076686 21363 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.083014 21334 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.041574 21337 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:10:46.976603 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.157895 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.112383 21214 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.183684 21323 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.930475 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:47.151729 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:47.161091 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:47.155923 15379 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
W20260709 13:10:47.161790 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 129341us
I20260709 13:10:47.162616 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:47.217011 15232 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.083166 21273 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.167891 15198 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:47.081586 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.165341 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:47.170500 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:47.140516 21309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.000s	sys 0.009s
W20260709 13:10:47.237967 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 307596us
I20260709 13:10:47.232204 15299 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:10:47.239374 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:47.240657 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 89020.6us
I20260709 13:10:47.169368 15376 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:47.079610 21172 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.185387 15308 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.140904 21370 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.192489 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:47.166247 21310 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:47.199430 15974 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.016s	sys 0.008s
W20260709 13:10:47.256058 15974 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.016s	sys 0.008s
W20260709 13:10:47.207871 21250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.549s	user 0.013s	sys 0.016s
I20260709 13:10:47.289054 15305 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:10:47.158171 15227 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:10:47.172560 21153 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:47.209523 15229 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:47.211253 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.149019 15243 tablet_copy_service.cc:161] P b0f9eceec749442cb9a06c87f00f3caf: Beginning new tablet copy session on tablet 0066b5a9791e4a30856433ed14864d2f from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:46420: session id = 5c70ddb5aae14b059dc90fd40125b034-0066b5a9791e4a30856433ed14864d2f
I20260709 13:10:47.226332 15300 raft_consensus.cc:2368] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19.
I20260709 13:10:47.205557 21297 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:47.185967 21004 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.239404 15307 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 20: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:47.191818 21146 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:46.813481 15125 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 7 to 8, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 8 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.148298 21362 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.200402 21334 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.254935 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3254) took 1998 ms. Trace:
I20260709 13:10:47.257143 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:47.327323 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 70353.2us
I20260709 13:10:47.292176 21153 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.291851 21267 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:47.212984 21195 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:47.257666 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92468.6us
I20260709 13:10:47.326793 15378 rpcz_store.cc:276] 0709 13:10:45.256127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.268108 (+ 11981us) service_pool.cc:224] Handling call
0709 13:10:45.268600 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.269133 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.269177 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.269953 (+   776us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.690856 (+420903us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:45.690929 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.691043 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.003875 (+1312832us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:47.234686 (+230811us) raft_consensus.cc:1685] finished
0709 13:10:47.234715 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.254819 (+ 20104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1686,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":8518400,"thread_start_us":420268,"threads_started":1,"wal-append.queue_time_us":597383}
I20260709 13:10:47.236711 21323 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.336397 21196 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:47.336977 21196 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.200736 21380 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.337659 21196 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.236130 15232 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
W20260709 13:10:47.288231 21250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.632s	user 0.014s	sys 0.016s
I20260709 13:10:47.340013 21250 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:47.314845 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.334177 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3373) took 1984 ms. Trace:
I20260709 13:10:47.315817 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.318050 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:47.287741 21167 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.344462 15307 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:47.201035 21040 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:47.357745 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.285022 21310 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:47.328218 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.321379 21146 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.342556 15304 rpcz_store.cc:276] 0709 13:10:45.349754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.351917 (+  2163us) service_pool.cc:224] Handling call
0709 13:10:45.352226 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:45.403343 (+ 51117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.403373 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:45.407377 (+  4004us) log.cc:844] Serialized 52 byte log entry
0709 13:10:45.843067 (+435690us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:45.843110 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.843186 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.823146 (+979960us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:47.327452 (+504306us) raft_consensus.cc:1685] finished
0709 13:10:47.327478 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.334052 (+  6574us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43972,"raft.queue_time_us":55260,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9222,"spinlock_wait_cycles":8082176,"thread_start_us":326662,"threads_started":1,"wal-append.queue_time_us":548321}
I20260709 13:10:47.166872 21197 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:47.321975 21004 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.335839 21153 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.331610 21354 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:47.347154 21199 raft_consensus.cc:2764] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
W20260709 13:10:47.379155 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 51031.4us
I20260709 13:10:47.382406 21157 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:47.451998 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 281698us
I20260709 13:10:47.357316 21167 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:47.380944 21379 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:10:47.325222 21297 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.255527 21303 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.387408 21310 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.463248 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:47.484941 21381 log.cc:927] Time spent T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:10:47.333729 21382 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:47.380434 21005 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:47.376956 21308 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.378309 21267 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:47.495187 20830 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.552819 20830 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:47.380290 21187 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:47.379814 21376 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:47.506754 15999 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:47.508656 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.585397 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.585559 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:47.509895 15125 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 11 to 12, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 12 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:10:47.504403 21250 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.488819 21167 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.505039 21303 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.568320 21306 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:47.348577 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:47.590819 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:47.612484 15379 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:47.611116 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.597481 15305 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:47.594408 15307 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:47.586608 15378 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.589919 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:47.593667 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 577175us
W20260709 13:10:47.599869 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 249817us
I20260709 13:10:47.549297 21308 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.654608 15376 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:10:47.456542 21354 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.656801 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.658370 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:47.618767 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.662699 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.663748 15232 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:10:47.665009 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.672631 15308 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:47.585870 21376 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.674598 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:47.681159 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.689271 15229 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.573275 21005 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:47.609822 21382 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.694017 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 477549us
I20260709 13:10:47.697814 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:47.701664 16008 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:47.698662 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:47.707186 15378 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:47.692657 21337 consensus_queue.cc:1243] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:47.708024 21367 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:10:47.711172 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 543343us
I20260709 13:10:47.716661 15308 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:47.717010 16008 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:10:47.674641 21308 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.739190 15229 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:10:47.743525 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:47.728075 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:47.745893 15999 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:47.674587 21214 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.674988 21342 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.727288 15379 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:10:47.732617 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:47.768553 16004 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:47.679466 21172 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:47.751331 15380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.015s
W20260709 13:10:47.764019 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.765620 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:47.766041 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:47.770555 15380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.015s
W20260709 13:10:47.766426 15348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.020s	sys 0.007s
W20260709 13:10:47.772629 15348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.021s	sys 0.007s
W20260709 13:10:47.773270 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 533965us
W20260709 13:10:47.776793 15348 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.68:44351 timed out after 1.781s (SENT) [suppressed 9 similar messages]
I20260709 13:10:47.788600 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:47.694510 21376 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.659894 21343 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 13:10:47.803795 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:47.595489 21187 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:47.726454 21293 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:10:47.805434 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.021s	sys 0.018s
I20260709 13:10:47.659665 21306 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:47.805013 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:47.679260 21161 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:10:47.747099 21040 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.831131 15308 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:47.833122 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.021s	sys 0.028s
I20260709 13:10:47.748967 21273 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.790983 21349 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:47.833388 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 148929us
I20260709 13:10:47.741598 21201 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:10:47.806553 21246 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:47.841567 20867 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:47.879140 15380 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:47.806003 21172 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.890195 15973 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:47.844902 20952 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:47.832858 21293 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:47.900637 15379 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:47.803015 21064 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:10:47.865685 21177 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.865701 21343 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:47.915035 15308 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:47.883244 21040 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:47.766716 21267 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:47.897392 21246 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.880508 21195 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.868439 20830 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:47.920535 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.882576 21362 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:47.893227 20867 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.901742 21175 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.927971 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 247009us
I20260709 13:10:47.895680 21396 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.731642 21382 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.962809 15379 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:47.930933 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.931591 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.901747 21326 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:47.937690 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.932919 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:47.932107 21388 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:47.925967 21258 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.395s	user 0.019s	sys 0.004s
I20260709 13:10:47.916123 21349 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:47.952597 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.984367 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:47.950107 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 173272us
I20260709 13:10:47.985183 15374 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:47.955897 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.945647 21293 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:47.957522 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.958544 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:47.992404 15376 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:47.992923 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:47.993726 15379 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:47.994035 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:47.954927 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:47.966686 15232 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:47.935617 21246 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.932809 20952 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:47.949361 21189 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.873s	user 0.012s	sys 0.020s
I20260709 13:10:47.936739 21342 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:47.943603 20867 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:47.973585 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62158.3us
W20260709 13:10:47.969393 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.910523 21172 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:47.887715 21005 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:47.958165 21387 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
W20260709 13:10:47.981827 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.982506 15373 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:47.984285 15233 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:47.934198 21343 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:47.947727 21384 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.955127 21297 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:48.001821 21246 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.009855 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:48.009892 15303 raft_consensus.cc:2410] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:47.967734 21397 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:48.012976 15973 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:48.014742 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60783.8us
I20260709 13:10:48.038195 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.952701 21175 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.022022 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:47.995260 21326 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:48.001053 21349 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:48.036324 21153 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.007s
I20260709 13:10:47.984308 21258 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.018153 21157 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:48.044811 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:48.044894 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:48.011165 21342 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.002892 21114 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:48.020207 21378 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.032s	sys 0.052s
I20260709 13:10:47.968577 21396 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.005113 21406 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:48.005988 21354 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:48.027385 21161 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.019510 21388 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:48.020076 21389 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:48.069321 21040 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:48.078363 15232 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:48.076891 21187 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:48.051385 21395 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.072203 21342 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:48.049849 21405 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.069823 21326 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:10:48.132943 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.150159 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 105430us
I20260709 13:10:48.118920 21388 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.115259 21384 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.160055 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:48.142009 15304 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.011s	sys 0.027s
W20260709 13:10:48.170451 15304 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.011s	sys 0.028s
W20260709 13:10:48.171085 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 158171us
I20260709 13:10:48.070869 21153 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.171938 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:48.120972 21157 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:48.109776 21114 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.125109 21406 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:48.150274 21306 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:48.052160 21397 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.120872 21161 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:48.239060 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 194244us
I20260709 13:10:48.173530 21395 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.167986 21388 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:48.238039 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 66859.3us
I20260709 13:10:48.253801 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:48.258752 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:48.264101 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:48.118453 20952 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.225107 21384 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:48.280045 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:48.261101 21401 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:10:48.285830 16002 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:48.286749 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:48.154867 21343 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.297106 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:48.303159 15301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.066s	sys 0.074s
W20260709 13:10:48.303661 15301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.066s	sys 0.074s
I20260709 13:10:48.289111 21250 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.294662 21395 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:48.256635 21040 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.293573 21382 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:48.328740 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2510) took 1621 ms. Trace:
I20260709 13:10:48.331804 15301 rpcz_store.cc:276] 0709 13:10:46.707353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.357333 (+649980us) service_pool.cc:224] Handling call
0709 13:10:47.357774 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.358278 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:47.693441 (+335163us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.328241 (+634800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.328306 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:48.328423 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.328502 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.328666 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":542178,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":21842,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":97,"thread_start_us":932825,"threads_started":2}
W20260709 13:10:48.329550 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 145602us
I20260709 13:10:48.334851 16002 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:48.340174 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3412) took 1139 ms. Trace:
I20260709 13:10:48.344141 15301 rpcz_store.cc:276] 0709 13:10:47.201315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.339356 (+1138041us) service_pool.cc:224] Handling call
0709 13:10:48.339686 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.339856 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.339880 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.339917 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:48.339949 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.340008 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.340109 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.346239 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3413) took 1138 ms. Trace:
I20260709 13:10:48.346693 15301 rpcz_store.cc:276] 0709 13:10:47.207858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.345336 (+1137478us) service_pool.cc:224] Handling call
0709 13:10:48.345680 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.345871 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.345900 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.345945 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:48.345977 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.346045 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.346178 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.324004 21395 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:48.352913 21395 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.334208 21175 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:48.338795 21392 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
I20260709 13:10:48.362914 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3284) took 1684 ms. Trace:
I20260709 13:10:48.364491 15382 rpcz_store.cc:276] 0709 13:10:46.678666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.685946 (+  7280us) service_pool.cc:224] Handling call
0709 13:10:46.686385 (+   439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:46.739708 (+ 53323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.739745 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:46.740679 (+   934us) log.cc:844] Serialized 52 byte log entry
0709 13:10:47.497437 (+756758us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b180027a360. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:47.688855 (+191418us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:47.688907 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.690511 (+  1604us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:48.351168 (+660657us) raft_consensus.cc:1685] finished
0709 13:10:48.351194 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.362824 (+ 11630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50323,"raft.queue_time_us":42445,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":16624,"spinlock_wait_cycles":83351936,"thread_start_us":191160,"threads_started":1,"wal-append.queue_time_us":1140011}
I20260709 13:10:48.333274 21204 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:10:48.371340 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 107368us
I20260709 13:10:48.374183 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:48.380589 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.383270 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:48.342403 21349 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:48.342399 21258 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:48.349287 21382 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:48.400568 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.385681 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:48.360941 21407 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.382597 21175 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.370536 21204 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:10:48.432791 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.353443 21033 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:10:48.392225 21389 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:48.393378 21396 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:48.425424 21349 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.420765 21382 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.275964 21384 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.331588 21406 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:48.441425 21402 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
W20260709 13:10:48.468789 21419 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:10:48.479676 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 141688us
I20260709 13:10:48.381891 21414 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.196s
I20260709 13:10:48.426151 21420 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.511912 15243 tablet_copy_source_session.cc:215] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:48.512938 21424 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:10:48.513638 15243 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:46420 (request call id 1036) took 1667 ms. Trace:
I20260709 13:10:48.514183 15243 rpcz_store.cc:276] 0709 13:10:46.990608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.020514 (+ 29906us) service_pool.cc:224] Handling call
0709 13:10:48.513492 (+1492978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.515379 21418 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:48.516670 21422 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:10:48.516193 21418 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.519732 21418 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:48.522651 21146 consensus_meta.cc:287] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.067s	user 0.009s	sys 0.005s
I20260709 13:10:48.523360 21146 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.471956 21389 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.473941 21421 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.484292 21423 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:10:48.460978 21153 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:48.510628 21149 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.378s	user 0.007s	sys 0.018s
I20260709 13:10:48.444602 21326 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:48.560679 21415 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 13:10:48.495687 21161 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:48.571360 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.572669 21397 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:48.575141 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:48.576620 21204 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.814734 21204 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.483901 21349 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.821429 21349 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:48.600919 21384 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:48.603042 21428 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:10:48.481680 21114 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:48.488528 21382 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.502435 21407 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:48.632675 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3395) took 1581 ms. Trace:
W20260709 13:10:48.633775 21363 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.424s	user 0.017s	sys 0.006s
W20260709 13:10:48.635277 21320 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.799s	user 0.010s	sys 0.016s
W20260709 13:10:48.635409 15303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2517) took 1925 ms (client timeout 1590 ms). Trace:
W20260709 13:10:48.844372 15303 rpcz_store.cc:269] 0709 13:10:46.709549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.715165 (+  5616us) service_pool.cc:224] Handling call
0709 13:10:48.635110 (+1919945us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003e30d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:48.635318 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973989632}
I20260709 13:10:48.621410 21414 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.636924 21004 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:48.504005 21427 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:48.639034 21094 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.491s	user 0.019s	sys 0.005s
W20260709 13:10:48.640709 21196 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.302s	user 0.036s	sys 0.026s
I20260709 13:10:48.643019 15348 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:48.856132 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 213201us
W20260709 13:10:48.650317 21203 consensus_meta.cc:287] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.570s	user 0.019s	sys 0.017s
W20260709 13:10:48.650856 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.650969 21187 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.655633 21323 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.319s	user 0.008s	sys 0.015s
W20260709 13:10:48.661818 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.691285 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:48.691949 21250 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.694486 21396 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:48.682905 21296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0066b5a9791e4a30856433ed14864d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:48.673576 21172 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:48.696991 21272 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:48.698426 21197 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:48.698830 15300 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:48.700655 21201 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:48.663874 21293 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:48.705590 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 938622us
I20260709 13:10:48.673996 21305 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:48.708323 21295 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.710289 21367 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.712970 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.716243 15232 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:48.882944 21357 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:48.719048 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:48.719113 21192 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:48.721190 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:48.721303 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:48.937445 15230 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:48.698428 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:48.945417 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 247067us
I20260709 13:10:48.946316 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:48.947681 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:48.898238 21427 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:48.655164 21167 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.002s	user 0.015s	sys 0.000s
W20260709 13:10:48.778472 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.752184 21310 consensus_meta.cc:287] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.247s	user 0.012s	sys 0.004s
W20260709 13:10:48.752661 21303 consensus_meta.cc:287] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.081s	user 0.012s	sys 0.005s
W20260709 13:10:48.683238 21380 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.345s	user 0.010s	sys 0.014s
I20260709 13:10:48.811436 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:48.841053 15299 rpcz_store.cc:276] 0709 13:10:47.051268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.509937 (+458669us) service_pool.cc:224] Handling call
0709 13:10:47.510348 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.700134 (+189786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.700173 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.700233 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:47.700271 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.632365 (+932094us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54004119d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:48.632431 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.632594 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435853568}
W20260709 13:10:48.826584 21334 consensus_meta.cc:287] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.484s	user 0.018s	sys 0.007s
W20260709 13:10:48.841842 21370 consensus_meta.cc:287] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.540s	user 0.022s	sys 0.003s
I20260709 13:10:48.860854 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:48.843847 21157 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.038s	sys 0.084s
I20260709 13:10:48.874883 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:48.996093 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 121327us
W20260709 13:10:48.886832 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.887578 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:48.892513 15308 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:10:48.997963 15308 pending_rounds.cc:85] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 11
I20260709 13:10:48.998267 15308 pending_rounds.cc:107] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:10:48.998548 15308 raft_consensus.cc:2889] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:48.909668 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:48.908210 15300 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:48.865070 21407 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.895669 21378 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.882519 21004 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.071152 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:49.072124 15382 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.929860 15196 leader_election.cc:400] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19.
W20260709 13:10:49.082406 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 164176us
I20260709 13:10:48.717726 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:48.897122 21349 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.762497 21421 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.903841 21420 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:48.950533 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:49.111461 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:48.961447 21339 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.962103 21161 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:49.129514 21376 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.291s	user 0.019s	sys 0.003s
I20260709 13:10:49.130172 21376 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:49.105840 21246 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.057s	user 0.012s	sys 0.003s
I20260709 13:10:49.040738 21370 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.132779 21246 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.135038 21370 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.135294 21246 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:48.850340 21363 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.972916 15381 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:10:48.934573 21388 consensus_meta.cc:287] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.001s
I20260709 13:10:48.980907 15232 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:10:48.850164 21320 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.884708 21196 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.921388 21305 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:48.899142 21203 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.000279 15300 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.172103 15300 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.953276 21357 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.965358 21197 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:49.180989 21197 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.908247 21250 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:48.942595 21192 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:48.902525 21323 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.952524 21367 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.902253 21187 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.963258 21094 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:48.911806 21396 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:48.963992 21114 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:48.852437 21414 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:49.013422 21157 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.038s	sys 0.084s
I20260709 13:10:48.983562 21427 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.087626 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.223398 15226 raft_consensus.cc:2368] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13.
I20260709 13:10:49.224772 15375 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:48.963887 21405 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 13:10:49.011336 21354 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.944664 21295 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.096596 21349 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:49.100244 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.057530 21407 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.144260 21398 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:10:49.112118 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 161665us
I20260709 13:10:48.994488 21310 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.125664 21339 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.138427 15302 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:49.144814 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.265998 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.137332 15373 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:10:49.145211 15304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.088s	sys 0.106s
W20260709 13:10:49.268128 15304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.089s	sys 0.107s
I20260709 13:10:49.268626 16002 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:49.071370 21303 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:49.144014 15345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.098s	sys 0.276s
W20260709 13:10:49.275434 15345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.098s	sys 0.277s
I20260709 13:10:48.985638 21167 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:49.276443 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 890841us
I20260709 13:10:49.170719 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.277966 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.225126 21146 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:49.284260 15375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 1141) took 2277 ms (client timeout 1503 ms). Trace:
W20260709 13:10:49.177600 21175 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.004s
I20260709 13:10:49.184101 15306 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
W20260709 13:10:49.146253 20867 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.120s	user 0.008s	sys 0.013s
I20260709 13:10:49.109221 21004 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.137090 21326 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.136471 21420 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:10:49.214931 15231 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:49.321202 15306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2535) took 2438 ms (client timeout 1684 ms). Trace:
I20260709 13:10:49.332990 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:49.322254 15999 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:49.322574 15305 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:49.325201 15302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3408) took 2120 ms (client timeout 1602 ms). Trace:
W20260709 13:10:49.335937 15302 rpcz_store.cc:269] 0709 13:10:47.168755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.192162 (+ 23407us) service_pool.cc:224] Handling call
0709 13:10:49.289296 (+2097134us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540017a554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:49.289470 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4351223040}
W20260709 13:10:49.336838 15271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.064s	sys 0.094s
W20260709 13:10:49.331890 15306 rpcz_store.cc:269] 0709 13:10:46.882541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.939839 (+ 57298us) service_pool.cc:224] Handling call
0709 13:10:49.320921 (+2381082us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54001856d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:49.321077 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5048760576}
I20260709 13:10:49.301554 21396 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:49.354218 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:49.184986 21395 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.001s
I20260709 13:10:49.221740 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3410) took 2033 ms. Trace:
I20260709 13:10:49.362850 15308 rpcz_store.cc:276] 0709 13:10:47.187929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.054087 (+866158us) service_pool.cc:224] Handling call
0709 13:10:48.054491 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.999063 (+944572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.221259 (+222196us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54003e1cd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:49.221617 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925867904}
I20260709 13:10:49.332777 21004 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.309738 21414 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:49.181712 21197 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.182775 21357 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:49.229326 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.347503 21326 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.002449 21380 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:49.207520 21094 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:49.186474 21342 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.020s	user 0.009s	sys 0.007s
I20260709 13:10:49.213291 21114 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:49.262701 15378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.050s	sys 0.077s
I20260709 13:10:49.338914 20867 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:49.265393 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.274382 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2511) took 2566 ms. Trace:
I20260709 13:10:49.001514 21334 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.222373 21157 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:49.281790 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.417483 15373 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:49.418962 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:49.159132 21388 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:49.284979 15375 rpcz_store.cc:269] 0709 13:10:47.006758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.035505 (+ 28747us) service_pool.cc:224] Handling call
0709 13:10:49.283946 (+2248441us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b540027b0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:49.284153 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4786165632}
I20260709 13:10:49.295380 21427 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:49.295413 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.427191 15374 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:49.376857 21153 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:49.298997 21196 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:49.300534 21250 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:49.301631 21187 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:49.276984 21149 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:49.251086 21354 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.276100 21305 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.254333 21033 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:10:49.218917 16008 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:49.355796 15379 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:49.356979 15381 raft_consensus.cc:2410] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:49.361116 15300 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:10:49.157361 21308 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.388s	user 0.010s	sys 0.014s
I20260709 13:10:49.314157 21367 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:49.321916 21167 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.464285 21308 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.315580 21295 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:49.071533 21378 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.465682 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:49.466488 16002 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:49.466846 21308 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.467813 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3396) took 2416 ms. Trace:
I20260709 13:10:49.316500 21175 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:49.338619 21339 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.306493 21363 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.340456 21391 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:49.337374 21320 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.304301 21349 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.312251 21310 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:49.337390 15271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.064s	sys 0.094s
W20260709 13:10:49.229471 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 113790us
I20260709 13:10:49.337857 21376 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:49.372886 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.364481 20952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.006s	sys 0.013s
I20260709 13:10:49.176311 15382 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:10:49.386637 15999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 858) took 1473 ms (client timeout 1645 ms). Trace:
I20260709 13:10:49.387331 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2725) took 1441 ms. Trace:
I20260709 13:10:49.389248 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2722) took 1457 ms. Trace:
W20260709 13:10:49.393702 15378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.050s	sys 0.077s
I20260709 13:10:49.259195 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:49.397090 15377 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:49.407310 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3398) took 2354 ms. Trace:
I20260709 13:10:49.402505 15304 rpcz_store.cc:276] 0709 13:10:46.707651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.454750 (+747099us) service_pool.cc:224] Handling call
0709 13:10:47.455157 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.455438 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:48.172858 (+717420us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.273605 (+1100747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.273865 (+   260us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.273953 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.274095 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.274289 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4904,"prepare.queue_time_us":445268,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":108157,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":6877,"thread_start_us":1789168,"threads_started":2}
I20260709 13:10:49.275833 21192 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.420184 15373 raft_consensus.cc:2368] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:10:49.485024 21303 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:49.378743 21326 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.389634 21094 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.439121 21203 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:49.475519 21005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.006s	sys 0.009s
W20260709 13:10:49.475891 15125 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.002s	sys 0.018s
I20260709 13:10:49.297499 21323 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:49.429879 15225 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:49.428300 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.369176 21395 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.404160 21114 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.451160 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.444916 21157 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.450935 15376 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:49.483058 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:49.484202 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:49.489579 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46152 (request call id 509) took 1764 ms. Trace:
I20260709 13:10:49.468333 15300 rpcz_store.cc:276] 0709 13:10:47.051534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.661593 (+610059us) service_pool.cc:224] Handling call
0709 13:10:47.662037 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.698701 (+1036664us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b54000e1120. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53a9ddc0 00007f2f53b281c0 00007f2f53b29231 00007f2f53b25d8f 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c
0709 13:10:49.467477 (+768776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.467729 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107285248}
I20260709 13:10:49.459869 21149 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:49.476038 21406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.013s
I20260709 13:10:49.539640 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:49.395638 21342 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:49.546485 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 461173us
I20260709 13:10:49.548669 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:49.575734 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.548301 15305 rpcz_store.cc:276] 0709 13:10:47.052548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.675943 (+623395us) service_pool.cc:224] Handling call
0709 13:10:47.676277 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.335303 (+1659026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.385395 (+ 50092us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540006ccd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:49.407203 (+ 21808us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3785604352}
W20260709 13:10:49.564306 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 305143us
W20260709 13:10:49.687737 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.550082 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:49.557057 15374 raft_consensus.cc:2368] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:10:49.569063 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:49.562204 15232 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:49.544111 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.558662 15375 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
W20260709 13:10:49.570655 15380 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.033s
I20260709 13:10:49.745417 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:49.745920 15380 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.010s	sys 0.070s
I20260709 13:10:49.746146 15375 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
W20260709 13:10:49.739323 15273 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.529s (SENT)
I20260709 13:10:49.739461 15382 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.747628 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:49.558147 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2723) took 1626 ms. Trace:
I20260709 13:10:49.749364 15225 rpcz_store.cc:276] 0709 13:10:47.931958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.932526 (+   568us) service_pool.cc:224] Handling call
0709 13:10:47.932811 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.556022 (+1623211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.557744 (+  1722us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540035b454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:49.558051 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3442427264}
I20260709 13:10:49.561563 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.546952 15226 rpcz_store.cc:276] 0709 13:10:47.933894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.934022 (+   128us) service_pool.cc:224] Handling call
0709 13:10:49.375264 (+1441242us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001c7354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:49.375455 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2888982912}
I20260709 13:10:49.751400 15376 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:49.752521 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.664321 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3306) took 1748 ms. Trace:
I20260709 13:10:49.753659 15377 rpcz_store.cc:276] 0709 13:10:47.915553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.915683 (+   130us) service_pool.cc:224] Handling call
0709 13:10:47.918838 (+  3155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.563817 (+1644979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.664005 (+100188us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001ab3d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:49.664253 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3398942592}
W20260709 13:10:49.543651 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.755774 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.547124 15231 rpcz_store.cc:276] 0709 13:10:47.931617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.931772 (+   155us) service_pool.cc:224] Handling call
0709 13:10:47.932160 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.331622 (+1399462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.388800 (+ 57178us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540043b054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:49.389142 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949209472}
I20260709 13:10:49.759303 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:49.761101 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.011s	sys 0.048s
W20260709 13:10:49.761631 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.011s	sys 0.048s
W20260709 13:10:49.762079 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 710926us
W20260709 13:10:49.762786 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 223305us
W20260709 13:10:49.656546 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91697us
I20260709 13:10:49.760866 16008 rpcz_store.cc:276] 0709 13:10:47.725452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.765274 (+ 39822us) service_pool.cc:224] Handling call
0709 13:10:49.489229 (+1723955us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54004182d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:49.489477 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3330651904}
I20260709 13:10:49.564281 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:49.760550 15381 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:49.762995 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:49.486697 21040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.008s	sys 0.007s
W20260709 13:10:49.743337 21406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.000s	sys 0.022s
I20260709 13:10:49.773051 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.559275 21395 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:49.755892 21323 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:49.757614 21310 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.805717 21323 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.806071 21310 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.808831 21323 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:49.567775 21293 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.004s
W20260709 13:10:49.809473 21040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.009s	sys 0.007s
I20260709 13:10:49.773418 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.770063 21250 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:49.800228 21203 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:49.741261 15125 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.003s	sys 0.019s
W20260709 13:10:49.546094 20952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.006s	sys 0.013s
W20260709 13:10:49.811244 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47346.8us
I20260709 13:10:49.776839 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.898898 15375 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:49.554248 21005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.006s	sys 0.009s
W20260709 13:10:49.797346 21433 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:10:49.861730 21436 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:10:49.468132 21378 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:49.852955 15197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.021s	sys 0.041s
W20260709 13:10:49.843492 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 86507.3us
W20260709 13:10:49.918259 15197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.021s	sys 0.041s
W20260709 13:10:49.490267 21360 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:10:49.770638 21405 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:49.769011 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.859145 16001 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:10:49.861131 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 121873us
W20260709 13:10:49.931143 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.006s	sys 0.020s
W20260709 13:10:49.931625 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.006s	sys 0.020s
I20260709 13:10:49.886670 21161 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.932008 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 741226us
W20260709 13:10:49.934525 15273 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.536s (SENT)
I20260709 13:10:49.935241 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:49.887497 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:49.887292 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 124388us
I20260709 13:10:49.936530 15376 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:49.938058 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.938395 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:49.782160 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.939446 15300 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:10:49.940059 15377 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:10:49.764004 21300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.029s	sys 0.030s
I20260709 13:10:49.452123 21153 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.565392 21398 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:49.651779 21146 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.662446 21033 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.262s
I20260709 13:10:49.651846 21305 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.809378 21310 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:49.816033 21267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.008s	sys 0.048s
W20260709 13:10:49.864097 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.771008 21437 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:49.546789 15999 rpcz_store.cc:269] 0709 13:10:47.912912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.913065 (+   153us) service_pool.cc:224] Handling call
0709 13:10:49.386329 (+1473264us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54006301d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:49.386544 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3115774336}
I20260709 13:10:49.663184 21376 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.906615 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:49.660913 21384 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:50.046180 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:50.047188 15302 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:49.551047 21175 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:49.484892 21391 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:49.804653 16000 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:49.943893 15305 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:10:50.015168 21267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.012s	sys 0.054s
I20260709 13:10:49.901521 21203 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.944059 21405 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:49.945597 20952 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:49.946630 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:49.949450 21308 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:10:49.955879 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:49.995347 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:49.997741 15382 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
W20260709 13:10:49.998711 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.550422 21303 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.702838 21421 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:50.015816 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.013293 21146 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:49.923584 21420 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:10:49.949585 21300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.035s	sys 0.032s
I20260709 13:10:50.035193 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:49.921222 21451 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:49.926097 21334 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:49.862263 21395 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.131s
I20260709 13:10:49.905829 21250 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:50.043589 21204 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.228s	user 0.017s	sys 0.000s
W20260709 13:10:50.004832 21434 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:10:49.993692 21398 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:49.540730 21407 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:49.993266 21388 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.009658 21441 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:50.052954 15345 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.009s	sys 0.019s
I20260709 13:10:49.948544 21040 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.099s
W20260709 13:10:49.951069 15273 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.586s (SENT)
I20260709 13:10:50.054186 15300 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:50.059538 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 420637us
I20260709 13:10:50.140725 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:50.126396 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3302) took 2212 ms. Trace:
W20260709 13:10:50.141839 15345 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.009s	sys 0.019s
I20260709 13:10:50.064002 15375 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:10:50.055626 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:50.142927 15305 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.083317 15377 raft_consensus.cc:2368] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13.
I20260709 13:10:50.087615 15306 raft_consensus.cc:3060] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:50.088779 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:50.089762 16005 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:50.053558 21175 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:50.010936 21396 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.009s	sys 0.018s
I20260709 13:10:50.049759 20867 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:49.993947 21161 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.101768 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:50.052465 21203 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:50.106467 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 150745us
I20260709 13:10:50.105073 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:50.142274 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 706614us
I20260709 13:10:50.051239 21449 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:10:50.106025 21451 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:50.208916 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:50.208794 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:50.169123 21438 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:10:50.209198 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:50.209527 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:50.176819 21310 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.192544 21204 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.124138 21201 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:50.181113 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 860) took 1894 ms. Trace:
I20260709 13:10:50.193471 16004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 862) took 1503 ms. Trace:
W20260709 13:10:50.137014 21389 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.396s	user 0.009s	sys 0.006s
I20260709 13:10:50.184882 21398 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:50.189688 16001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 577) took 1910 ms (client timeout 1983 ms). Trace:
I20260709 13:10:50.177762 21342 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.171988 15305 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
W20260709 13:10:50.177235 21343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.447s	user 0.099s	sys 0.142s
I20260709 13:10:50.209817 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:50.161018 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:50.217428 21094 consensus_meta.cc:287] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.002s
I20260709 13:10:50.217545 15230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1046) took 1485 ms. Trace:
I20260709 13:10:50.050243 21384 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.166141 15300 raft_consensus.cc:2410] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:50.166599 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:50.141852 15378 rpcz_store.cc:276] 0709 13:10:47.914101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.914249 (+   148us) service_pool.cc:224] Handling call
0709 13:10:47.914655 (+   406us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:47.915088 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.915121 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:47.923195 (+  8074us) log.cc:844] Serialized 78 byte log entry
0709 13:10:48.489759 (+566564us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18003c1360. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:49.547556 (+1057797us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:49.547626 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.547739 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.108926 (+561187us) raft_consensus.cc:1685] finished
0709 13:10:50.108963 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.126269 (+ 17306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13338,"raft.queue_time_us":14275,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":19397,"spinlock_wait_cycles":3029760,"thread_start_us":1057478,"threads_started":1,"wal-append.queue_time_us":1525470}
W20260709 13:10:50.234910 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.197932 21445 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:50.540614 15232 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:10:50.145202 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 194199us
W20260709 13:10:50.474510 15380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.011s	sys 0.006s
I20260709 13:10:50.274363 15381 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
W20260709 13:10:50.538887 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.016s	sys 0.023s
W20260709 13:10:50.496799 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.408139 16005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 857) took 2900 ms. Trace:
W20260709 13:10:50.545125 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.016s	sys 0.023s
W20260709 13:10:50.303252 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.545511 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 642868us
I20260709 13:10:50.524574 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.523648 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.262996 15306 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
W20260709 13:10:50.522480 15274 connection.cc:256] RPC call timeout handler was delayed by -2.0012806680000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:10:50.542989 15380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.015s	sys 0.006s
W20260709 13:10:50.275790 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 460854us
W20260709 13:10:50.541584 15345 connection.cc:256] RPC call timeout handler was delayed by -1.9175003880000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31770000000000004s for a response
I20260709 13:10:50.519731 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:50.241484 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:50.302862 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.549256 15345 connection.cc:256] RPC call timeout handler was delayed by -1.2767003879999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3889s for a response
I20260709 13:10:50.541079 16004 rpcz_store.cc:276] 0709 13:10:48.690177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.690343 (+   166us) service_pool.cc:224] Handling call
0709 13:10:48.690739 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.287959 (+597220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.287996 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.288575 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.813629 (+525054us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:49.813678 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.192873 (+379195us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b5400850f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:50.192948 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.193018 (+    70us) raft_consensus.cc:1685] finished
0709 13:10:50.193041 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.193382 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20413,"raft.queue_time_us":22523,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":11273,"spinlock_wait_cycles":1325419904,"thread_start_us":447441,"threads_started":1,"wal-append.queue_time_us":786619}
W20260709 13:10:50.552548 15345 connection.cc:256] RPC call timeout handler was delayed by -1.0752818480000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:10:50.548946 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.553535 15382 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:50.547052 15273 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.613s (SENT)
I20260709 13:10:50.555311 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:50.550242 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.542325 16000 rpcz_store.cc:276] 0709 13:10:48.287108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.287333 (+   225us) service_pool.cc:224] Handling call
0709 13:10:48.307504 (+ 20171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.051443 (+1743939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.180734 (+129291us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400635454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:50.180984 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3442375424}
I20260709 13:10:50.551321 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.546008 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:50.548629 15375 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:50.558183 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2714) took 1127 ms. Trace:
I20260709 13:10:50.552402 15233 raft_consensus.cc:1217] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Deduplicated request from leader. Original: 11.8->[12.9-14.10]   Dedup: 14.10->[]
I20260709 13:10:50.560698 15233 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 13:10:50.543627 15377 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:50.553988 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:50.561791 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2712) took 1191 ms. Trace:
I20260709 13:10:50.541883 15230 rpcz_store.cc:276] 0709 13:10:48.732428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.963053 (+230625us) service_pool.cc:224] Handling call
0709 13:10:48.963609 (+   556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.990907 (+ 27298us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:49.057165 (+ 66258us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.469361 (+412196us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.491641 (+ 22280us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.492957 (+  1316us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:49.493033 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.493149 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.217295 (+724146us) raft_consensus.cc:1685] finished
0709 13:10:50.217323 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.217476 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6982,"prepare.queue_time_us":65970,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":11094,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":126002,"thread_start_us":411514,"threads_started":1,"wal-append.queue_time_us":1158045}
I20260709 13:10:50.562291 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:50.562366 15375 rpcz_store.cc:276] 0709 13:10:49.431198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.166315 (+735117us) service_pool.cc:224] Handling call
0709 13:10:50.558127 (+391812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.563078 15307 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:50.539973 20867 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:50.540844 16001 rpcz_store.cc:269] 0709 13:10:48.279194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.279358 (+   164us) service_pool.cc:224] Handling call
0709 13:10:50.189340 (+1909982us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540068d654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:50.189593 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3589506432}
I20260709 13:10:50.132639 21421 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:50.179440 21004 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.800s	user 0.016s	sys 0.000s
W20260709 13:10:50.554332 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.521483 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:50.377090 21334 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:50.123219 21420 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:50.545416 16005 rpcz_store.cc:276] 0709 13:10:47.508191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.508397 (+   206us) service_pool.cc:224] Handling call
0709 13:10:47.508787 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.224470 (+2715683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.407445 (+182975us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b540064e954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:50.408046 (+   601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5935060224}
I20260709 13:10:50.558509 15305 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:10:50.583093 15305 pending_rounds.cc:85] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 10
I20260709 13:10:50.583382 15305 pending_rounds.cc:107] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:10:50.568428 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:50.297156 21367 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:50.583839 15305 raft_consensus.cc:2889] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.568993 15307 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:50.519937 21192 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.559985 15306 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:50.616012 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:50.616885 15306 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:50.540083 21354 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.548659 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3315) took 1486 ms. Trace:
I20260709 13:10:50.627616 15380 rpcz_store.cc:276] 0709 13:10:49.062128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.062289 (+   161us) service_pool.cc:224] Handling call
0709 13:10:49.062657 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.062934 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:49.746694 (+683760us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.548326 (+801632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.548398 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:50.548441 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.548505 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.548613 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":948531,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":78,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14957,"spinlock_wait_cycles":21193984,"thread_start_us":1481538,"threads_started":2,"wal-append.queue_time_us":807090}
W20260709 13:10:50.626623 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.629815 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:50.238646 21396 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.011s	sys 0.018s
I20260709 13:10:50.194978 21405 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.571990 21267 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:50.456295 21382 consensus_meta.cc:287] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.619s	user 0.017s	sys 0.000s
W20260709 13:10:50.541863 21343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.811s	user 0.104s	sys 0.154s
I20260709 13:10:50.562296 15377 rpcz_store.cc:276] 0709 13:10:49.370529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.144908 (+774379us) service_pool.cc:224] Handling call
0709 13:10:50.561730 (+416822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.564445 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.564546 21137 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.615011 21367 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:50.202903 21149 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.564586 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:50.574944 21004 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.622929 21250 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.565877 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.566165 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.630527 21460 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.563659 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:50.661589 15375 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:50.661993 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:50.579454 21464 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:10:50.555150 21114 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.997s	user 0.011s	sys 0.003s
I20260709 13:10:50.567049 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:50.583328 21421 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.582072 15376 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:10:50.196909 21153 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.567858 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:50.569998 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.544198 15299 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:50.611915 21420 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:50.658713 21300 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.018s	sys 0.002s
I20260709 13:10:50.558135 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:50.554044 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2690) took 1272 ms. Trace:
I20260709 13:10:50.618148 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:50.679351 15306 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:50.679474 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 121434us
I20260709 13:10:50.679836 15373 raft_consensus.cc:2368] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:50.678673 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.682204 16004 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:50.656409 21267 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:50.568583 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.586406 15226 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:50.570078 15301 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:50.612200 21308 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.692317 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:50.692541 21308 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.692984 15301 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 8.
I20260709 13:10:50.572517 21370 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:50.693869 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:50.622488 21199 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:50.694403 15301 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:50.694257 21370 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.694741 21308 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.694577 21199 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.326121 21395 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.695644 21395 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.696388 21370 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.696791 21199 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:50.623569 15308 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.021s	sys 0.027s
W20260709 13:10:50.697395 15308 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.022s	sys 0.027s
I20260709 13:10:50.697693 21395 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:50.573328 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.570552 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.624215 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:50.698552 15307 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:50.699008 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:50.699415 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.700490 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.701508 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:50.625833 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:50.702306 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:50.357899 21197 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.973s	user 0.011s	sys 0.002s
I20260709 13:10:50.570926 21407 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.730948 15307 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:50.713557 15301 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:50.707983 15225 raft_consensus.cc:2410] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:10:50.581297 21398 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.581228 21449 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.638952 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:50.568322 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:50.583945 21172 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:50.612511 21360 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.572396 21334 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:50.654065 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2709) took 1354 ms. Trace:
I20260709 13:10:50.126817 21391 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.612208 21175 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:50.633499 21448 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.080s	user 0.005s	sys 0.002s
W20260709 13:10:50.633342 21459 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.082s	user 0.002s	sys 0.006s
I20260709 13:10:50.656188 15303 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:50.564640 21040 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:10:50.638268 21457 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.086s	user 0.001s	sys 0.006s
I20260709 13:10:50.576687 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:50.658198 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:50.660616 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:50.673137 21464 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:50.753974 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 95855.9us
I20260709 13:10:50.567307 21094 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.566970 21389 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.565956 20867 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.567377 21204 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:50.458021 21326 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.908s	user 0.013s	sys 0.000s
I20260709 13:10:50.640074 21146 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.641168 21405 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.774263 21094 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:50.571285 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49925.3us
I20260709 13:10:50.774941 21094 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.771133 21343 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:10:50.775444 21094 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:50.681221 21300 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.018s	sys 0.003s
I20260709 13:10:50.640224 21354 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:10:50.747977 21367 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.776911 21354 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:50.777282 21367 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.777318 21354 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:50.735422 15380 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:50.778633 21354 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.764955 21196 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.779985 21354 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.744329 21449 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.782361 21449 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.669653 21451 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.686964 15382 rpcz_store.cc:276] 0709 13:10:49.281863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.241179 (+959316us) service_pool.cc:224] Handling call
0709 13:10:50.553982 (+312803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.785306 21421 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.785537 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:50.786146 15382 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.787964 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2710) took 1487 ms. Trace:
I20260709 13:10:50.788390 15376 rpcz_store.cc:276] 0709 13:10:49.339565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.937614 (+598049us) service_pool.cc:224] Handling call
0709 13:10:50.787798 (+850184us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b540014d2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:50.787905 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478924032}
I20260709 13:10:50.656064 21382 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.737854 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2691) took 1455 ms. Trace:
I20260709 13:10:50.743644 15381 rpcz_store.cc:276] 0709 13:10:49.300081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.768609 (+468528us) service_pool.cc:224] Handling call
0709 13:10:50.653894 (+885285us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540023e6d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:50.654007 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789197056}
I20260709 13:10:50.661525 21441 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:10:50.789543 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:50.790297 15376 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:50.790169 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:50.790206 21441 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:50.736088 21197 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.677557 21310 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:50.730432 21199 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:50.801429 21305 consensus_meta.cc:287] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.000s
I20260709 13:10:50.801306 21199 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.730260 21303 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.790678 21382 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.769459 21407 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:50.803498 21407 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.673600 21460 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.754568 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2701) took 1456 ms. Trace:
I20260709 13:10:50.804876 15377 rpcz_store.cc:276] 0709 13:10:49.297687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.657691 (+1360004us) service_pool.cc:224] Handling call
0709 13:10:50.754504 (+ 96813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.805625 21407 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.679235 21114 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.816166 21114 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.816967 21334 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.827718 15382 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:50.770761 15971 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:50.770872 15999 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
W20260709 13:10:50.834427 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64438.6us
I20260709 13:10:50.745525 21172 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.835465 15971 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:50.836441 21146 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:50.836827 21172 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.774618 21326 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:50.689213 21447 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.511s	user 0.005s	sys 0.003s
W20260709 13:10:50.688853 21458 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:50.790947 15381 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.840672 15379 raft_consensus.cc:2368] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
W20260709 13:10:50.841951 15379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2685) took 1561 ms (client timeout 1613 ms). Trace:
W20260709 13:10:50.842406 15379 rpcz_store.cc:269] 0709 13:10:49.280255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.544508 (+264253us) service_pool.cc:224] Handling call
0709 13:10:50.841714 (+1297206us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003f2354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:50.841868 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2523665152}
I20260709 13:10:50.745407 21360 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.793615 20867 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.683064 21293 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:50.767102 21308 consensus_queue.cc:1175] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 17 status { last_received { term: 16 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:50.761278 21175 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.795020 21267 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.796754 21420 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.796871 21464 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.794128 21441 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:50.862357 21300 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:50.862183 21441 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.862864 21300 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:50.863644 21441 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.863721 21300 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.865098 21300 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:50.730628 21395 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:50.811046 21389 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.812589 21384 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.793852 21204 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.819070 21161 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.764690 21004 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.824105 21197 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.823287 21296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46140 (request call id 837) took 6534 ms. Trace:
I20260709 13:10:50.870585 21296 rpcz_store.cc:276] 0709 13:10:44.302700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.311497 (+  8797us) service_pool.cc:224] Handling call
0709 13:10:45.122741 (+811244us) ts_tablet_manager.cc:934] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
0709 13:10:48.681250 (+3558509us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:50.630584 (+1949334us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:50.638449 (+  7865us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:50.822296 (+183847us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:50.822636 (+   340us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:50.822993 (+   357us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:50.823066 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":169228,"tablet-copy.queue_time_us":626331,"thread_start_us":444018,"threads_started":2}
I20260709 13:10:50.872398 21296 tablet_copy_client.cc:806] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:50.873194 21296 tablet_copy_client.cc:670] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:50.823276 21199 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.836947 21146 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:50.874744 21146 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.854880 21196 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.839942 21326 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.837059 21430 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:50.858124 21293 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:50.857942 21175 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.879637 21293 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:50.880645 21175 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:50.804504 21094 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.806248 21460 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.865722 21395 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.882966 21395 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:50.862183 21360 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:50.860224 21391 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:50.857617 21203 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:50.739089 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:50.688823 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.674595 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.009507 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.009634 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.011162 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:50.672703 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.013136 15233 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:10:50.555531 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:50.685483 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:50.686259 15300 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:50.690138 15306 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:50.784721 15373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2705) took 1485 ms (client timeout 1690 ms). Trace:
I20260709 13:10:50.806025 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:50.668401 15375 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:10:50.789263 15378 rpcz_store.cc:276] 0709 13:10:49.282131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.568045 (+1285914us) service_pool.cc:224] Handling call
0709 13:10:50.737806 (+169761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:50.791226 15374 raft_consensus.cc:2368] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13.
I20260709 13:10:50.849535 15381 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:51.061990 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.063015 16004 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:10:50.955930 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:50.844761 15971 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:50.963013 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.964908 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1054) took 1484 ms. Trace:
I20260709 13:10:50.963553 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.004664 15229 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:51.006526 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:10:51.007139 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.019176 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.018965 21396 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:51.020519 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 473253us
I20260709 13:10:51.060148 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.017306 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.023452 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1048) took 2262 ms. Trace:
I20260709 13:10:51.076603 15224 rpcz_store.cc:276] 0709 13:10:48.760999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.980148 (+219149us) service_pool.cc:224] Handling call
0709 13:10:48.980598 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.966350 (+1985752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.966406 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.966470 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:50.966526 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.022933 (+ 56407us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540007a654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:51.022998 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.023223 (+   225us) inbound_call.cc:177] Queueing success response
0709 13:10:51.042885 (+ 19662us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b4800002958. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
Metrics: {"mutex_wait_us":28271,"raft.queue_time_us":14585,"raft.run_cpu_time_us":3167,"raft.run_wall_time_us":62190,"spinlock_wait_cycles":4574533248}
I20260709 13:10:51.078923 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.040588 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:51.044518 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.080847 16005 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:10:51.080060 15224 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:51.084113 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.044752 21203 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:51.044862 21094 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:51.054461 15373 rpcz_store.cc:269] 0709 13:10:49.298866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.772712 (+473846us) service_pool.cc:224] Handling call
0709 13:10:50.784527 (+1011815us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54001aa9d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:50.784664 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012240768}
I20260709 13:10:51.086961 21094 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:51.055300 15377 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.089329 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.090515 21094 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:51.056609 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1051) took 1983 ms. Trace:
I20260709 13:10:51.049846 15303 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:51.069198 15379 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:51.077445 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.028219 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3321) took 1840 ms. Trace:
W20260709 13:10:51.049345 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 449712us
I20260709 13:10:51.091712 15303 pending_rounds.cc:85] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 7
W20260709 13:10:51.098160 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.093577 15382 rpcz_store.cc:276] 0709 13:10:49.187787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.026384 (+1838597us) service_pool.cc:224] Handling call
0709 13:10:51.027052 (+   668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.027528 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.027574 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.027646 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.027688 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.027797 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.027949 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.050827 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:51.096637 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2678) took 1815 ms. Trace:
I20260709 13:10:51.091365 15228 rpcz_store.cc:276] 0709 13:10:49.072773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.092548 (+ 19775us) service_pool.cc:224] Handling call
0709 13:10:49.093017 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.965187 (+1872170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.965256 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.965321 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:50.965384 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.050431 (+ 85047us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4800002958. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:10:51.056070 (+  5639us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54000f0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:51.056145 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.056409 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23248,"raft.queue_time_us":11476,"raft.run_cpu_time_us":1228,"raft.run_wall_time_us":65571,"spinlock_wait_cycles":4306472576}
I20260709 13:10:51.100080 15379 rpcz_store.cc:276] 0709 13:10:49.278152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.068209 (+1790057us) service_pool.cc:224] Handling call
0709 13:10:51.068774 (+   565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.093303 (+ 24529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.093505 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.105568 21146 raft_consensus.cc:2804] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:51.088153 15373 raft_consensus.cc:1217] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Deduplicated request from leader. Original: 11.8->[12.9-14.10]   Dedup: 14.10->[]
I20260709 13:10:51.106320 15373 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 13:10:51.106267 21146 raft_consensus.cc:697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:51.107293 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2688) took 1826 ms. Trace:
I20260709 13:10:51.108871 15233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
W20260709 13:10:51.112273 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.107774 15373 rpcz_store.cc:276] 0709 13:10:49.281202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.087114 (+1805912us) service_pool.cc:224] Handling call
0709 13:10:51.087737 (+   623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:51.106956 (+ 19219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.107220 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.115100 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 109218us
I20260709 13:10:51.098205 15303 pending_rounds.cc:107] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:10:51.115967 15303 raft_consensus.cc:2889] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:51.106107 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 261289us
I20260709 13:10:51.120244 15382 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:10:51.122818 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2696) took 1826 ms. Trace:
I20260709 13:10:51.123239 15382 rpcz_store.cc:276] 0709 13:10:49.296085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.119233 (+1823148us) service_pool.cc:224] Handling call
0709 13:10:51.119751 (+   518us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:51.122350 (+  2599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.122720 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.125000 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74520.8us
I20260709 13:10:51.127771 21396 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:51.137140 21395 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.138144 21395 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:51.139746 15973 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:51.127993 21153 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.140571 21153 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:51.141083 21153 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.147414 21296 tablet_copy_client.cc:538] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:51.071502 15227 rpcz_store.cc:276] 0709 13:10:49.480081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.481389 (+  1308us) service_pool.cc:224] Handling call
0709 13:10:49.651832 (+170443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.652172 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.652218 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.722845 (+ 70627us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.104120 (+381275us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:50.104193 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.104320 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.964174 (+859854us) raft_consensus.cc:1685] finished
0709 13:10:50.964220 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.964618 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":315038,"threads_started":1,"wal-append.queue_time_us":761553}
I20260709 13:10:51.149688 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:51.168260 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.174463 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58228.9us
I20260709 13:10:51.171856 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:51.166968 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.161293 15225 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:10:51.159677 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:51.154395 15374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2708) took 1854 ms (client timeout 1714 ms). Trace:
I20260709 13:10:51.185107 21203 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:51.161047 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:51.192215 15377 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:51.159142 21395 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:51.190502 15374 rpcz_store.cc:269] 0709 13:10:49.299784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.773115 (+473331us) service_pool.cc:224] Handling call
0709 13:10:51.154047 (+1380932us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54001b99d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:51.154204 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073882880}
I20260709 13:10:51.158398 21196 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:51.198019 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.200064 21203 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:51.201299 15300 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:51.201972 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:51.202494 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:51.204210 21196 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:51.201560 21203 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:51.199235 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.108009 21146 consensus_queue.cc:237] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:51.211308 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:51.212426 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.213574 21199 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:51.214051 21197 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:51.214718 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:51.215050 16005 raft_consensus.cc:2410] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:10:51.215478 15198 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:51.218529 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.219848 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.220830 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 820) took 1274 ms. Trace:
I20260709 13:10:51.221184 15300 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:51.221481 21334 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.223124 15232 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:51.231534 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.231868 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3324) took 2013 ms. Trace:
I20260709 13:10:51.232993 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.233629 21196 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:51.234048 15305 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:51.233981 21481 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:10:51.237416 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.232416 15378 rpcz_store.cc:276] 0709 13:10:49.218531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.057416 (+1838885us) service_pool.cc:224] Handling call
0709 13:10:51.057970 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.058471 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:51.181798 (+123327us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.231283 (+ 49485us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.231429 (+   146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.231467 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:51.231523 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.231582 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.231699 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":150474,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":248,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":211,"spinlock_wait_cycles":46976,"thread_start_us":157837,"threads_started":2}
I20260709 13:10:51.234956 21483 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:51.251065 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44301.2us
I20260709 13:10:51.249876 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.235885 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.235332 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.229811 15308 rpcz_store.cc:276] 0709 13:10:49.946200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.947325 (+  1125us) service_pool.cc:224] Handling call
0709 13:10:49.947668 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.947953 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:10:50.697827 (+749874us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.216795 (+518968us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.220172 (+  3377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.220257 (+    85us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:51.220403 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.220512 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.220622 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253197,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":99,"raft.queue_time_us":6407,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":5085,"thread_start_us":1143114,"threads_started":2,"wal-append.queue_time_us":422492}
I20260709 13:10:51.239710 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.241119 21153 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:51.241820 15233 raft_consensus.cc:606] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:51.244520 21430 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.253491 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.254463 15233 raft_consensus.cc:614] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.255834 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.264125 15230 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:10:51.264086 21094 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:51.256639 21430 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:51.296687 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.298066 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.300326 15374 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:51.299079 21430 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:51.304252 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93248.5us
I20260709 13:10:51.304940 21483 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:51.305548 21094 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:51.307169 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3323) took 2096 ms. Trace:
I20260709 13:10:51.308442 15379 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:10:51.312964 15225 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:51.316725 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 155669us
I20260709 13:10:51.316936 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.317692 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.322803 21153 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:51.317727 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.303220 21450 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:51.324597 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:51.325690 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.331133 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:51.333256 15229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 1056) took 1794 ms (client timeout 1552 ms). Trace:
I20260709 13:10:51.334537 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.336627 15232 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:10:51.336012 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:51.342068 15229 rpcz_store.cc:269] 0709 13:10:49.538618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.541347 (+  2729us) service_pool.cc:224] Handling call
0709 13:10:51.332907 (+1791560us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400284bd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:51.333120 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771581312}
I20260709 13:10:51.351382 15299 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.358799 15374 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:51.359382 21094 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:51.361301 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.359946 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.360958 21483 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:51.362422 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.368858 15233 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.369150 15228 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:51.370114 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.370973 21296 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:10:51.371376 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.373060 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.374413 15229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "168b77c528554771b17206e0062bd8cc"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:51.375108 15229 raft_consensus.cc:606] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:51.376534 15224 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:51.377126 15374 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:51.375818 15378 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:51.373062 15226 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:51.380915 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.378458 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.349371 21450 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.384595 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.387584 15308 raft_consensus.cc:2410] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 22 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:10:51.387574 15233 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:51.384943 15227 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:51.341378 15375 rpcz_store.cc:276] 0709 13:10:49.210913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.055643 (+1844730us) service_pool.cc:224] Handling call
0709 13:10:51.056266 (+   623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.069837 (+ 13571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.069872 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.070669 (+   797us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.186733 (+116064us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:51.186770 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.186848 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.306806 (+119958us) raft_consensus.cc:1685] finished
0709 13:10:51.306825 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.306995 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19190,"raft.queue_time_us":34496,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":2162,"thread_start_us":115522,"threads_started":1,"wal-append.queue_time_us":195655}
W20260709 13:10:51.404047 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.388809 21450 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.409029 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.403339 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.410934 15378 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:51.420984 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3325) took 2185 ms. Trace:
I20260709 13:10:51.421487 15381 rpcz_store.cc:276] 0709 13:10:49.228710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.062593 (+1833883us) service_pool.cc:224] Handling call
0709 13:10:51.063291 (+   698us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:51.103948 (+ 40657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.103983 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:51.119937 (+ 15954us) log.cc:844] Serialized 52 byte log entry
0709 13:10:51.284496 (+164559us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.339871 (+ 55375us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.410624 (+ 70753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.410700 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.413554 (+  2854us) raft_consensus.cc:1685] finished
0709 13:10:51.413574 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.413755 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95946,"prepare.queue_time_us":55063,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":1394,"raft.queue_time_us":113423,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":285,"thread_start_us":164090,"threads_started":1,"wal-append.queue_time_us":287147}
I20260709 13:10:51.423333 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.423753 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.424571 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:51.416791 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.409055 15374 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:51.433431 15306 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:51.434445 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.437067 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:51.438578 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.439785 15380 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:51.452926 15381 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.454157 15229 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:51.460321 15229 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:51.460570 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.462642 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:51.464557 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55339.8us
I20260709 13:10:51.465745 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:51.467671 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53819.6us
I20260709 13:10:51.484731 15299 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:51.496061 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 166096us
I20260709 13:10:51.498162 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.497754 15381 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
W20260709 13:10:51.504558 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.493402 15375 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:51.512497 15374 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:51.518546 16005 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:51.451542 21153 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:10:51.524375 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2702) took 2218 ms. Trace:
I20260709 13:10:51.531172 15374 rpcz_store.cc:276] 0709 13:10:49.297969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.463858 (+2165889us) service_pool.cc:224] Handling call
0709 13:10:51.471819 (+  7961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.515813 (+ 43994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.516086 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.533561 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:51.534288 15232 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:51.542367 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.547266 15381 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:51.547909 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2704) took 2249 ms. Trace:
I20260709 13:10:51.548214 15381 rpcz_store.cc:276] 0709 13:10:49.298547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.512026 (+2213479us) service_pool.cc:224] Handling call
0709 13:10:51.535815 (+ 23789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.547679 (+ 11864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.547859 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.551538 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:51.558669 16005 raft_consensus.cc:2393] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:51.562557 15375 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:51.559026 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:51.564416 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2706) took 2265 ms. Trace:
I20260709 13:10:51.564813 15375 rpcz_store.cc:276] 0709 13:10:49.299190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.527393 (+2228203us) service_pool.cc:224] Handling call
0709 13:10:51.558620 (+ 31227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.563043 (+  4423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.564325 (+  1282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.569411 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.577983 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1156) took 2176 ms. Trace:
I20260709 13:10:51.578459 15381 rpcz_store.cc:276] 0709 13:10:49.401482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.550568 (+2149086us) service_pool.cc:224] Handling call
0709 13:10:51.561901 (+ 11333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.577588 (+ 15687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.577620 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.577716 (+    96us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:51.577761 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.577818 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.577931 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5334}
I20260709 13:10:51.574249 21199 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:51.580024 21199 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:51.581132 21199 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:51.578217 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:51.592664 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:51.596940 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.598951 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46292us
I20260709 13:10:51.602286 21395 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.615456 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.616273 15304 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:51.619333 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2689) took 2337 ms. Trace:
I20260709 13:10:51.620669 15374 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.621546 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2713) took 2226 ms. Trace:
I20260709 13:10:51.621950 15374 rpcz_store.cc:276] 0709 13:10:49.395202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.546037 (+2150835us) service_pool.cc:224] Handling call
0709 13:10:51.584760 (+ 38723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.621228 (+ 36468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.621459 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.619891 15379 rpcz_store.cc:276] 0709 13:10:49.281503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.114136 (+1832633us) service_pool.cc:224] Handling call
0709 13:10:51.308105 (+193969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.341596 (+ 33491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.619017 (+277421us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003c3f50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:51.619232 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444808448}
I20260709 13:10:51.626287 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1158) took 2224 ms. Trace:
I20260709 13:10:51.627517 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.627406 15375 rpcz_store.cc:276] 0709 13:10:49.402006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.565565 (+2163559us) service_pool.cc:224] Handling call
0709 13:10:51.576550 (+ 10985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.604965 (+ 28415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.604992 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.622269 (+ 17277us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:51.625981 (+  3712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.626068 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.626207 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.629459 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:51.614230 21395 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:51.640939 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 204066us
I20260709 13:10:51.641784 16008 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.643814 15299 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.642604 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:51.636291 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:51.635450 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:51.650368 15227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "720e51950072462e9d16f75b27995387"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:51.653951 21360 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:51.655164 21395 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:51.655169 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:51.657678 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:51.661556 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.664875 21250 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.658989 21360 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:51.655378 21451 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.668010 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.661782 21334 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:51.690589 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:51.692816 21395 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:51.696188 21395 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:51.696310 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1161) took 1496 ms. Trace:
I20260709 13:10:51.696780 21395 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.696844 15379 rpcz_store.cc:276] 0709 13:10:50.200309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.630115 (+1429806us) service_pool.cc:224] Handling call
0709 13:10:51.681907 (+ 51792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.695791 (+ 13884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.695846 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.695945 (+    99us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:51.696007 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.696106 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.696241 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.698597 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:51.699659 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 130037us
I20260709 13:10:51.700711 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:51.702847 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.703177 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:51.693332 21250 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:51.712893 21250 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:51.713804 15377 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:51.714774 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.715443 15377 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:51.715176 21395 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:51.716748 15304 raft_consensus.cc:2410] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:10:51.717046 21334 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:51.719411 21334 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:51.685508 21360 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.685382 21451 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.724138 21451 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.662523 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2694) took 2375 ms. Trace:
I20260709 13:10:51.726764 15373 rpcz_store.cc:276] 0709 13:10:49.283085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.115517 (+1832432us) service_pool.cc:224] Handling call
0709 13:10:51.116088 (+   571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:51.184502 (+ 68414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.184535 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:51.207378 (+ 22843us) log.cc:844] Serialized 52 byte log entry
0709 13:10:51.364358 (+156980us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:51.396835 (+ 32477us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.414761 (+ 17926us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.441478 (+ 26717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.441683 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.658178 (+216495us) raft_consensus.cc:1685] finished
0709 13:10:51.658208 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.658403 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45977,"prepare.queue_time_us":55593,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":94,"raft.queue_time_us":47787,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":1697,"thread_start_us":79980,"threads_started":1,"wal-append.queue_time_us":303774}
I20260709 13:10:51.683130 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1160) took 1978 ms. Trace:
I20260709 13:10:51.730010 15374 rpcz_store.cc:276] 0709 13:10:49.705161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.622952 (+1917791us) service_pool.cc:224] Handling call
0709 13:10:51.631956 (+  9004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.671998 (+ 40042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.672027 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.682759 (+ 10732us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:51.682820 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.682926 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.683064 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.731930 15374 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:51.682225 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1162) took 1473 ms. Trace:
I20260709 13:10:51.732749 15375 rpcz_store.cc:276] 0709 13:10:50.208896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.628946 (+1420050us) service_pool.cc:224] Handling call
0709 13:10:51.652900 (+ 23954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.681728 (+ 28828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.681768 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.681841 (+    73us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:51.681893 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.681979 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.682143 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.686973 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2782) took 1110 ms. Trace:
I20260709 13:10:51.734006 15226 rpcz_store.cc:276] 0709 13:10:50.576949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.738850 (+161901us) service_pool.cc:224] Handling call
0709 13:10:51.666772 (+927922us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54003129d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:51.686904 (+ 20132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787749760}
I20260709 13:10:51.735167 15229 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:51.737993 15299 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:51.741231 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.699950 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.748749 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3327) took 1048 ms. Trace:
I20260709 13:10:51.750326 15373 rpcz_store.cc:276] 0709 13:10:50.700103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.728886 (+1028783us) service_pool.cc:224] Handling call
0709 13:10:51.729363 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.742719 (+ 13356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.742747 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.748400 (+  5653us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:51.748469 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.748544 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.748677 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.753863 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:51.755689 21153 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:51.756165 21153 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.749635 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3330) took 1046 ms. Trace:
I20260709 13:10:51.756603 21153 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:51.757964 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:51.756685 15231 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.759404 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2737) took 1207 ms. Trace:
I20260709 13:10:51.757212 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:51.760821 21204 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:51.749504 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3328) took 1046 ms. Trace:
I20260709 13:10:51.763303 15374 rpcz_store.cc:276] 0709 13:10:50.700331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.731077 (+1030746us) service_pool.cc:224] Handling call
0709 13:10:51.731456 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.732272 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.746784 (+ 14512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.759811 15231 rpcz_store.cc:276] 0709 13:10:50.551583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.118795 (+567212us) service_pool.cc:224] Handling call
0709 13:10:51.747293 (+628498us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800002798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:10:51.756462 (+  9169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.759068 (+  2606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.759320 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4735872}
I20260709 13:10:51.756599 15380 rpcz_store.cc:276] 0709 13:10:50.700860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.731759 (+1030899us) service_pool.cc:224] Handling call
0709 13:10:51.732279 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.735474 (+  3195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.735501 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.742334 (+  6833us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.747233 (+  4899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.747303 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.747406 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.760939 15379 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:51.786986 15377 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:10:51.792133 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:51.761504 21204 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.807801 15373 raft_consensus.cc:2368] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:10:51.809118 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:51.816946 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 161917us
I20260709 13:10:51.817451 15374 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 12: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:51.811373 21204 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:51.821738 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.785806 21430 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:51.815263 21310 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:51.831998 15373 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:51.835111 15227 raft_consensus.cc:606] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:51.846482 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3337) took 1100 ms. Trace:
I20260709 13:10:51.846932 15373 rpcz_store.cc:276] 0709 13:10:50.746225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.813768 (+1067543us) service_pool.cc:224] Handling call
0709 13:10:51.831772 (+ 18004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.846196 (+ 14424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.846420 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.844226 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3332) took 1142 ms. Trace:
I20260709 13:10:51.847991 15380 rpcz_store.cc:276] 0709 13:10:50.701384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.808264 (+1106880us) service_pool.cc:224] Handling call
0709 13:10:51.823731 (+ 15467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.843866 (+ 20135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.843895 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.843945 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:51.843980 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.844038 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.844163 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.829128 15345 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.678s (SENT)
I20260709 13:10:51.833652 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3331) took 1132 ms. Trace:
I20260709 13:10:51.851539 15375 rpcz_store.cc:276] 0709 13:10:50.701107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.746372 (+1045265us) service_pool.cc:224] Handling call
0709 13:10:51.810962 (+ 64590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.833134 (+ 22172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.833195 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.833270 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:51.833326 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.833418 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.833573 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.858425 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:51.842242 21203 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.898020 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3335) took 1168 ms. Trace:
I20260709 13:10:51.898533 15379 rpcz_store.cc:276] 0709 13:10:50.730031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.811213 (+1081182us) service_pool.cc:224] Handling call
0709 13:10:51.842123 (+ 30910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.897657 (+ 55534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.897688 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.897737 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:51.897774 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.897837 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.897958 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.907716 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 207126us
W20260709 13:10:51.920897 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.922297 15373 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:51.923002 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3339) took 1170 ms. Trace:
I20260709 13:10:51.923416 15373 rpcz_store.cc:276] 0709 13:10:50.752557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.847765 (+1095208us) service_pool.cc:224] Handling call
0709 13:10:51.891562 (+ 43797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.922713 (+ 31151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.922932 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:51.927332 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 107490us
I20260709 13:10:51.926054 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3341) took 1173 ms. Trace:
I20260709 13:10:51.929699 15375 rpcz_store.cc:276] 0709 13:10:50.753107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.852566 (+1099459us) service_pool.cc:224] Handling call
0709 13:10:51.894910 (+ 42344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.925725 (+ 30815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.925754 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.925798 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.925829 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.925888 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.925998 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.916616 21334 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.934422 15379 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:51.942866 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2781) took 1366 ms. Trace:
I20260709 13:10:51.921907 21395 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:51.941998 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3338) took 1192 ms. Trace:
W20260709 13:10:51.945370 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 60063.4us
I20260709 13:10:51.946288 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3342) took 1179 ms. Trace:
I20260709 13:10:51.947471 15374 rpcz_store.cc:276] 0709 13:10:50.749158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.820736 (+1071578us) service_pool.cc:224] Handling call
0709 13:10:51.891460 (+ 70724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.934995 (+ 43535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.935021 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.941682 (+  6661us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:51.941745 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.941806 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.941934 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.948778 15377 rpcz_store.cc:276] 0709 13:10:50.766933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.873735 (+1106802us) service_pool.cc:224] Handling call
0709 13:10:51.922474 (+ 48739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.945951 (+ 23477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.945987 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.946034 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:51.946065 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.946129 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.946237 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:51.940142 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2749) took 1353 ms. Trace:
W20260709 13:10:51.953837 21504 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:10:51.954392 21516 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:51.955945 21507 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:10:51.960716 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 136678us
I20260709 13:10:51.963174 15273 leader_election.cc:400] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13.
I20260709 13:10:51.963658 15273 leader_election.cc:403] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:51.940965 21481 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.969249 15377 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:51.927961 21094 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:51.973194 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:51.975368 21524 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:51.975849 21524 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.976256 21524 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:51.923557 21450 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:51.977914 21495 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.577s	user 0.000s	sys 0.007s
I20260709 13:10:51.979691 21450 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:51.980680 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1159) took 2565 ms. Trace:
I20260709 13:10:51.982143 15374 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:51.981155 15381 rpcz_store.cc:276] 0709 13:10:49.415766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.590566 (+2174800us) service_pool.cc:224] Handling call
0709 13:10:51.631422 (+ 40856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.643347 (+ 11925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.643382 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.660200 (+ 16818us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.815681 (+155481us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:51.815730 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.815822 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.980412 (+164590us) raft_consensus.cc:1685] finished
0709 13:10:51.980440 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.980612 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":121608,"threads_started":1,"wal-append.queue_time_us":236022}
I20260709 13:10:51.983695 21430 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:51.984818 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.985852 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:51.987232 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2787) took 1408 ms. Trace:
I20260709 13:10:51.997447 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:52.001214 21360 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.007262 21517 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:52.010957 21514 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.011587 21514 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:52.012063 21514 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.987589 15225 rpcz_store.cc:276] 0709 13:10:50.578466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.380501 (+802035us) service_pool.cc:224] Handling call
0709 13:10:51.429251 (+ 48750us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:51.510020 (+ 80769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.510051 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:51.545666 (+ 35615us) log.cc:844] Serialized 52 byte log entry
0709 13:10:51.736014 (+190348us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:51.736053 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.736136 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.987018 (+250882us) raft_consensus.cc:1685] finished
0709 13:10:51.987037 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.987181 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10954,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":14638,"spinlock_wait_cycles":1445760,"thread_start_us":175213,"threads_started":1,"wal-append.queue_time_us":262774}
I20260709 13:10:51.943694 15224 rpcz_store.cc:276] 0709 13:10:50.576643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.377338 (+800695us) service_pool.cc:224] Handling call
0709 13:10:51.377727 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.377966 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:51.378391 (+   425us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.942192 (+563801us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.942307 (+   115us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:51.942385 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.942513 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.942772 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16541,"prepare.queue_time_us":278,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":74065,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5824,"spinlock_wait_cycles":811136,"thread_start_us":540556,"threads_started":2}
I20260709 13:10:52.015112 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:52.016716 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52399.6us
I20260709 13:10:52.017282 15233 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:52.025215 21481 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:51.952767 15228 rpcz_store.cc:276] 0709 13:10:50.587104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.391092 (+803988us) service_pool.cc:224] Handling call
0709 13:10:51.411385 (+ 20293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.494110 (+ 82725us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:51.529761 (+ 35651us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.816607 (+286846us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b18003b1fa0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:10:51.939794 (+123187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.939845 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:51.939889 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.939969 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.940085 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6313,"prepare.queue_time_us":23729,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":4763,"raft.queue_time_us":17216,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5271,"spinlock_wait_cycles":7816448,"thread_start_us":108795,"threads_started":1}
I20260709 13:10:52.019587 15127 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.027187 21396 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13.
I20260709 13:10:52.027381 21517 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:52.027877 21517 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:52.028265 21517 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:52.025871 21481 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.030019 21094 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.030501 21094 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.030843 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:52.031862 21300 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:52.029117 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:52.032760 21203 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:52.030862 21094 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.036211 21203 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.040457 21197 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:52.040930 21197 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:52.041306 21197 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:52.046651 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3322) took 2842 ms. Trace:
I20260709 13:10:52.045454 21451 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.047049 15376 rpcz_store.cc:276] 0709 13:10:49.204597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.054026 (+1849429us) service_pool.cc:224] Handling call
0709 13:10:51.054696 (+   670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.063840 (+  9144us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:51.352467 (+288627us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.811799 (+459332us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.846581 (+ 34782us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.846735 (+   154us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:51.846768 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.846837 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.046265 (+199428us) raft_consensus.cc:1685] finished
0709 13:10:52.046291 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.046467 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22594,"prepare.queue_time_us":115907,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":29,"raft.queue_time_us":6766,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":7202,"thread_start_us":655109,"threads_started":2,"wal-append.queue_time_us":641406}
I20260709 13:10:52.049486 15382 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:52.004199 21360 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.051638 21204 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.055166 21153 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.058110 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2700) took 2760 ms. Trace:
I20260709 13:10:52.066903 21197 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.095153 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:52.068516 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 437361us
W20260709 13:10:52.075626 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.095134 15382 rpcz_store.cc:276] 0709 13:10:49.297399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.124276 (+1826877us) service_pool.cc:224] Handling call
0709 13:10:52.049211 (+924935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.049964 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.057892 (+  7928us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54001fca50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:52.058042 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125319552}
I20260709 13:10:52.099967 15378 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:52.065888 21203 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.105429 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:52.106057 21203 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.106737 21203 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.107100 21203 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:52.107472 21203 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.108976 21199 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:52.109499 21199 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:52.110435 21199 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.078209 21310 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:52.113401 21514 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.114269 21310 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.113258 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:52.119225 21395 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:52.120745 21514 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.107788 21481 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.108091 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:52.124560 21300 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:52.154824 21482 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:52.156853 15127 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 12 to 15, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:10:52.158766 15127 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.157311 21482 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:52.165149 21203 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.167776 21203 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.168494 21203 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:52.168859 21203 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:52.170171 21481 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.169786 21203 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.171352 21203 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.172755 21204 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:52.174010 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:52.177421 21483 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:52.178002 21483 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:52.179047 15304 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:52.178917 21483 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:52.179728 21510 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
I20260709 13:10:52.180605 15303 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:52.181481 21451 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.184470 21094 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.187202 21094 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.192888 21153 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:52.147049 21524 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.199888 15378 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:10:52.200410 15378 pending_rounds.cc:85] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 8
I20260709 13:10:52.200709 15378 pending_rounds.cc:107] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:10:52.201016 15378 raft_consensus.cc:2889] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:52.163631 21517 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.143059 21516 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:52.205247 15382 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:52.197222 21197 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:52.211400 15308 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:52.212056 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:52.230657 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 117788us
I20260709 13:10:52.230861 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.239755 15300 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:52.240016 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.240849 15308 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.245126 21197 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.260510 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48571.3us
I20260709 13:10:52.310372 15306 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:52.239827 15301 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:52.312331 15306 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:52.317795 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 331934us
I20260709 13:10:52.318704 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:52.328706 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 84353.3us
I20260709 13:10:52.356593 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:52.360109 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3345) took 1221 ms. Trace:
I20260709 13:10:52.362350 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:52.366567 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.368149 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:52.377949 15308 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:52.363796 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.386185 21529 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.387053 21529 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:52.383853 15306 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.372016 21481 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:10:52.361408 21395 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:52.401090 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 452454us
I20260709 13:10:52.323658 21197 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.400831 15306 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:52.403689 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50740us
I20260709 13:10:52.413491 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.403896 21334 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.416610 15300 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
W20260709 13:10:52.418445 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 264082us
W20260709 13:10:52.418526 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.389307 21360 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.439452 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:52.431645 21395 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:52.442085 21395 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.399755 21203 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:10:52.390851 21526 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.448969 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77928.2us
I20260709 13:10:52.389436 21450 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:10:52.451427 15308 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:52.452648 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 101461us
I20260709 13:10:52.389601 21391 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:10:52.454188 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:52.417205 21334 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:52.477438 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:52.481688 15300 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:52.403275 21516 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.466579 21250 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:10:52.496821 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3340) took 1744 ms. Trace:
I20260709 13:10:52.497359 21523 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.498258 21523 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.497473 15380 rpcz_store.cc:276] 0709 13:10:50.752840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.848996 (+1096156us) service_pool.cc:224] Handling call
0709 13:10:51.875953 (+ 26957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.922672 (+ 46719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.922704 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.953150 (+ 30446us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.362626 (+409476us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:52.362678 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.362748 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.496485 (+133737us) raft_consensus.cc:1685] finished
0709 13:10:52.496517 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.496734 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6319,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4932,"thread_start_us":293448,"threads_started":1,"wal-append.queue_time_us":378688}
I20260709 13:10:52.501528 21197 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.505080 21537 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.505671 21537 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:52.506685 21537 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:52.517234 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.476045 21360 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.467980 21517 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:52.523326 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 83989.1us
I20260709 13:10:52.526772 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:52.484138 21334 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:52.531036 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53680.6us
I20260709 13:10:52.531684 15306 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:52.451905 21196 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:10:52.532166 15306 pending_rounds.cc:85] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 7
I20260709 13:10:52.535458 15306 pending_rounds.cc:107] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 11.8
W20260709 13:10:52.535109 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 119023us
I20260709 13:10:52.535987 15306 raft_consensus.cc:2889] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:52.388317 21529 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:52.540717 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 89062.6us
W20260709 13:10:52.541270 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 55377.2us
I20260709 13:10:52.543838 15299 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:52.547075 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:52.544838 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:52.556733 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70523.8us
W20260709 13:10:52.545856 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 88065.8us
I20260709 13:10:52.560913 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:52.565204 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:52.539714 21537 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:52.568102 21153 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:10:52.361847 15373 rpcz_store.cc:276] 0709 13:10:51.138856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.924512 (+785656us) service_pool.cc:224] Handling call
0709 13:10:51.938239 (+ 13727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.944485 (+  6246us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:51.962210 (+ 17725us) log.cc:844] Serialized 14 byte log entry
0709 13:10:52.145648 (+183438us) log.cc:844] Serialized 14 byte log entry
0709 13:10:52.190035 (+ 44387us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b18003103c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:52.240247 (+ 50212us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b18003103c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:52.324599 (+ 84352us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b18003103c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf 00007f2f53b40038
0709 13:10:52.327573 (+  2974us) log.cc:844] Serialized 14 byte log entry
0709 13:10:52.359153 (+ 31580us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18003103c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:10:52.359449 (+   296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:52.359525 (+    76us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:52.359598 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.359724 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.360012 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200792,"prepare.queue_time_us":202517,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":110,"raft.queue_time_us":36298,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":244,"spinlock_wait_cycles":380013184,"thread_start_us":179929,"threads_started":1,"wal-append.queue_time_us":372306}
I20260709 13:10:52.574262 21250 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.574798 21250 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.575183 21250 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.576565 21146 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:52.580314 21536 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:52.580937 21536 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.581321 21536 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:52.596585 21391 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:52.524817 21526 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.563715 21514 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:52.606511 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45396.3us
I20260709 13:10:52.568392 21310 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.615736 21203 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:52.621711 21524 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.598817 21517 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:52.568161 21537 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.568429 21523 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:52.634824 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 94685.6us
I20260709 13:10:52.564594 21527 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:10:52.651480 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 104486us
I20260709 13:10:52.610174 21391 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:52.653522 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:52.658824 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:52.671577 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 110375us
I20260709 13:10:52.674288 15308 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:10:52.681267 15301 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:52.640870 21528 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.215s
I20260709 13:10:52.684417 21548 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:52.684834 21548 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:52.685659 21548 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.687095 21548 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.694324 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.645961 21517 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:52.696089 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.696110 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.650315 21537 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:52.699702 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:52.702576 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 49189.5us
I20260709 13:10:52.705132 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:52.707213 15308 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:52.709360 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:52.709844 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.710175 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.710595 15224 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:52.710856 15233 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:52.711694 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.715276 15301 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:52.720548 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.722698 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:52.723426 16004 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:52.723526 16005 raft_consensus.cc:2368] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:10:52.724493 21557 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:52.704780 21517 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.709106 21250 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.732391 21391 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:10:52.731526 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50566.7us
I20260709 13:10:52.733608 21391 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.734158 21250 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:52.735101 15305 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:52.707355 21483 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.738081 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:52.709371 21451 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.713703 21395 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:10:52.724977 21532 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.771943 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:52.725069 21557 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.778810 21524 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:52.779672 21450 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:52.788673 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 83686.3us
I20260709 13:10:52.752053 21360 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:52.807343 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 73031.3us
I20260709 13:10:52.752367 21516 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:52.776180 21300 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:52.753521 21451 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.818560 15274 leader_election.cc:400] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:10:52.821203 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:52.823693 15274 leader_election.cc:403] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.830063 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:52.774151 21395 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:52.836567 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 86917.9us
I20260709 13:10:52.832942 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:52.838521 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.774609 21532 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.842208 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:52.843191 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51636.8us
I20260709 13:10:52.844576 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:52.842006 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.848615 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:52.809600 21196 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:10:52.853009 15226 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:52.858855 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.859755 15227 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:52.865245 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:52.861033 15348 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.68:44351 timed out after 1.909s (SENT) [suppressed 35 similar messages]
I20260709 13:10:52.872385 21533 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:52.873211 21533 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:52.834250 21334 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.880162 21334 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:52.880738 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.881354 21568 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:52.892143 21553 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:10:52.895455 21541 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:52.900720 15307 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:52.873736 21533 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:52.871143 15348 connection.cc:256] RPC call timeout handler was delayed by -1.0846623630000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 13:10:52.891718 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 97323.9us
I20260709 13:10:52.906288 21536 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:52.907368 15301 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:10:52.907869 21557 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:52.909374 21558 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:52.910089 21526 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:52.911737 21395 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:52.905613 21562 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.936650 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.937423 15227 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:52.937937 15301 raft_consensus.cc:1275] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:52.939138 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.941895 15225 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:52.922690 21541 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:52.951784 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:52.941294 21562 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:52.952731 21536 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:52.954751 21562 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:52.956239 15301 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:52.885344 21547 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.134s
I20260709 13:10:52.958359 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:52.985410 15230 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 21: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:52.987586 15345 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.590s (SENT)
W20260709 13:10:52.988721 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.994494 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:53.006412 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 48181.3us
I20260709 13:10:53.006800 21395 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.008177 21532 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:53.010644 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:53.011138 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:53.010705 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:53.016119 15226 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:53.021485 21250 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.021857 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:53.022646 15229 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:10:53.024673 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:53.025451 15233 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:53.029579 21571 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:53.030165 21571 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.031360 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:53.044950 15224 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:53.030553 21571 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.022320 21250 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:53.048724 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:53.054500 15233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:53.055228 15233 raft_consensus.cc:606] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:53.062740 15307 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:53.072696 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:53.045876 21568 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:53.057096 21296 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:10:53.083774 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:53.056403 21548 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:53.094478 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:53.101399 15381 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.095010 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:53.096027 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:53.099843 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:53.100386 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:53.102983 15376 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:53.108040 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:53.114209 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:53.115145 16005 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 21: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:53.115381 15305 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:10:53.117574 15382 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:53.116091 15378 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:53.090095 21568 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.126199 15379 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:53.098469 21334 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:53.115854 15305 pending_rounds.cc:85] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 9
I20260709 13:10:53.141611 21555 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:53.156736 21555 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:53.156406 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:53.158501 15379 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:53.158524 21555 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:53.159487 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:53.160171 15379 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:53.161339 15379 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:53.161501 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 191572us
W20260709 13:10:53.163192 15345 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.631s (SENT)
I20260709 13:10:53.141623 21334 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.090598 21395 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:53.152850 15301 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:53.130545 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:53.064770 21450 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:10:53.155241 15305 pending_rounds.cc:107] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:10:53.087972 21562 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:10:53.153154 15198 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:53.185290 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 65645.8us
I20260709 13:10:53.030790 21541 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:53.187497 15305 raft_consensus.cc:2889] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:53.192317 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:53.156157 21567 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:53.222599 15381 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:53.128620 21568 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:53.235041 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82065us
I20260709 13:10:53.186527 21334 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:53.241906 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 111462us
I20260709 13:10:53.259112 21395 consensus_queue.cc:1243] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:53.242560 21562 consensus_queue.cc:1243] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:53.275236 15230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:53.276142 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3469) took 1057 ms. Trace:
I20260709 13:10:53.276652 15299 rpcz_store.cc:276] 0709 13:10:52.218283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.378677 (+160394us) service_pool.cc:224] Handling call
0709 13:10:52.409407 (+ 30730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.544494 (+135087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.275821 (+731327us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540025add4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:53.276077 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295330560}
W20260709 13:10:53.313459 21573 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:10:53.315217 15229 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:10:53.315757 21552 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:53.316586 21569 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:53.317643 21563 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:53.330799 21334 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:53.331678 21517 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.001s
I20260709 13:10:53.333132 21517 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:53.335521 21517 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:53.336727 15374 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:53.375852 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:53.345583 21546 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:53.389909 21296 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:53.384196 21514 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:53.399102 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:53.269965 21567 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:53.353423 21557 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:10:53.533816 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 730669us
W20260709 13:10:53.542706 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.400924 21532 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:53.401744 21310 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:53.546149 21537 consensus_meta.cc:287] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.825s	user 0.012s	sys 0.001s
W20260709 13:10:53.556375 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 707838us
W20260709 13:10:53.547152 15227 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:10:53.538947 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:53.406818 21514 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:53.407763 21334 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:53.537079 21533 consensus_meta.cc:287] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.006s
W20260709 13:10:53.614920 15376 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:10:53.615470 15376 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:53.617268 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54264.9us
I20260709 13:10:53.569701 15227 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:10:53.574265 21522 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:10:53.575217 21204 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:53.576478 21587 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:10:53.576402 21576 consensus_queue.cc:1048] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:53.540066 21250 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:53.548023 21532 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:53.581727 21583 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:10:53.595183 21296 tablet_bootstrap.cc:492] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
W20260709 13:10:53.589708 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 343535us
I20260709 13:10:53.649499 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:53.551870 21310 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:53.572223 21537 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:53.592451 21146 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:53.590986 21555 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:53.701406 21555 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:53.702654 21537 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:53.702458 21555 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:53.667460 15230 raft_consensus.cc:606] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:53.703971 15230 raft_consensus.cc:614] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:53.704316 15228 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:10:53.650357 21533 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:53.667906 15376 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:10:53.669008 21590 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
W20260709 13:10:53.668926 21593 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 13:10:53.669579 21591 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:10:53.667147 21532 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:53.665307 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.705672 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:53.713227 16005 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:53.594343 21514 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:53.730274 21529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.000s	sys 0.015s
I20260709 13:10:53.711653 21296 ts_tablet_manager.cc:1403] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 2.341s	user 0.049s	sys 0.016s
W20260709 13:10:53.731436 21529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.015s
I20260709 13:10:53.735122 21555 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:53.764024 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.765061 21557 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:53.765621 21557 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:53.769290 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 119914us
I20260709 13:10:53.770819 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:53.788533 21594 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.105s
I20260709 13:10:53.799750 16008 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:53.802784 21204 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:53.803679 21204 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:53.806352 21204 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:53.807613 15225 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:53.809340 15273 leader_election.cc:400] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:53.809834 15273 leader_election.cc:403] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.813027 15273 leader_election.cc:400] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13.
I20260709 13:10:53.813544 15273 leader_election.cc:403] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:53.809437 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.802917 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:53.740396 21598 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.755800 21514 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.819000 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:53.820329 16005 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:10:53.820676 21360 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:53.822171 21605 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:53.819623 21204 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:53.827311 21528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.000s	sys 0.022s
W20260709 13:10:53.837996 21528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.000s	sys 0.022s
I20260709 13:10:53.816706 21524 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:53.824504 21529 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:53.759861 21146 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:53.847890 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:53.852376 21603 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13.
W20260709 13:10:53.853381 21601 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:10:53.855037 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:53.869508 21611 consensus_queue.cc:1059] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:53.870208 21197 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:53.870558 21204 raft_consensus.cc:3055] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:53.870721 21197 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:53.870996 21204 raft_consensus.cc:740] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:53.871743 21197 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:53.875444 21533 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:53.878769 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65919us
I20260709 13:10:53.849159 21567 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:53.894259 21568 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 13:10:53.894806 21568 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:53.896991 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56186.2us
I20260709 13:10:53.908002 15229 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:53.915169 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:53.939458 15225 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:53.950798 21541 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:53.952917 21523 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:53.953444 21523 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:53.954646 21523 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:53.974432 21571 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.912s	user 0.009s	sys 0.004s
I20260709 13:10:53.987586 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2757) took 1291 ms. Trace:
I20260709 13:10:53.992524 16005 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:53.988305 15228 rpcz_store.cc:276] 0709 13:10:52.695992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.698134 (+  2142us) service_pool.cc:224] Handling call
0709 13:10:52.709480 (+ 11346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.710319 (+1000839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.987065 (+276746us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54001c6954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:53.987486 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287265536}
I20260709 13:10:54.000985 21555 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.026328 15377 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:54.054682 21555 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.042302 15380 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:54.057384 21555 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:53.995278 21296 raft_consensus.cc:359] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:54.080714 21296 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:10:54.082468 21296 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:54.089257 15377 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:54.089987 15377 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:54.091130 15377 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.064647 21523 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.025420 15374 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:54.010526 21451 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:54.096571 21555 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:54.097146 21568 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:53.975312 21571 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.060206 21146 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.075393 21532 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.126406 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:54.127252 15374 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:54.130463 15377 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.119468 21569 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.119097 21555 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:54.145105 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.154407 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:54.154531 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:54.128024 21451 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:54.156637 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:54.157418 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:54.156708 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:54.160136 15231 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:54.160502 15363 tablet_service.cc:1558] Processing DeleteTablet for tablet 362d7a17088a4e86a51428b5ee97346e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:43900
I20260709 13:10:54.160562 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:54.129199 21526 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:54.150214 21199 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.174619 15232 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:54.176807 15231 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:54.180784 15226 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:54.182886 21310 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.500s	user 0.012s	sys 0.002s
I20260709 13:10:54.183458 21310 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.184422 21199 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.184823 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:54.189544 15377 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:54.156205 21250 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.205112 21296 ts_tablet_manager.cc:1434] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.467s	user 0.006s	sys 0.006s
W20260709 13:10:54.205621 15125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 196) took 39658 ms (client timeout 15000 ms). Trace:
I20260709 13:10:54.148869 21569 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.204520 21250 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.212743 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:54.216620 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:54.229312 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.211229 21514 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:54.243573 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:54.244223 15377 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
W20260709 13:10:54.241598 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57000us
I20260709 13:10:54.260156 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.261664 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:54.267534 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:54.275005 21250 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.280403 15225 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
W20260709 13:10:54.206282 15125 rpcz_store.cc:269] 0709 13:10:14.488723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.489017 (+   294us) service_pool.cc:224] Handling call
0709 13:10:54.146801 (+39657784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:49.726370 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:49.729884 (+  3514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:49.730079 (+   195us) write_op.cc:435] Acquired schema lock
0709 13:10:49.730160 (+    81us) tablet.cc:662] Decoding operations
0709 13:10:49.900865 (+170705us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:49.905761 (+  4896us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:49.913608 (+  7847us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:10:50.131990 (+218382us) tablet.cc:701] Row locks acquired
0709 13:10:50.142353 (+ 10363us) write_op.cc:260] PREPARE: finished
0709 13:10:50.218409 (+ 76056us) write_op.cc:270] Start()
0709 13:10:50.218531 (+   122us) write_op.cc:276] Timestamp: P: 1783602650218356 usec, L: 0
0709 13:10:50.218553 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:50.360250 (+141697us) log.cc:844] Serialized 2866 byte log entry
0709 13:10:50.898274 (+538024us) op_driver.cc:464] REPLICATION: finished
0709 13:10:50.900066 (+  1792us) write_op.cc:301] APPLY: starting
0709 13:10:50.900154 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:51.000952 (+100798us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:51.001194 (+   242us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:51.123641 (+122447us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:51.124071 (+   430us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:10:51.124175 (+   104us) write_op.cc:312] APPLY: finished
0709 13:10:51.124946 (+   771us) log.cc:844] Serialized 73 byte log entry
0709 13:10:51.125235 (+   289us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:51.125630 (+   395us) write_op.cc:454] Released schema lock
0709 13:10:51.125722 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:51.129374 (+  3652us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:51.129429 (+    55us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1823,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":1516,"apply.run_cpu_time_us":16757,"apply.run_wall_time_us":229121,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":1152942,"prepare.run_cpu_time_us":43434,"prepare.run_wall_time_us":969508,"raft.queue_time_us":204119,"raft.run_cpu_time_us":1791,"raft.run_wall_time_us":1884,"replication_time_us":679498,"thread_start_us":1788943,"threads_started":4,"wal-append.queue_time_us":311129,"wal-append.run_cpu_time_us":18732,"wal-append.run_wall_time_us":1438474}]]}
I20260709 13:10:54.285073 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:54.285825 15226 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:10:54.263948 21451 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.283911 21310 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:54.292400 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:54.255519 21547 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.294144 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:54.292699 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:54.301806 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.308617 21532 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:54.296905 21571 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:54.314043 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:54.315339 15377 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:54.300275 21569 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.305158 21250 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:54.301337 21547 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.333321 21532 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:54.331080 21250 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.350479 15377 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:54.350222 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:54.340085 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:54.355129 15374 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:54.365942 15373 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:54.368860 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:54.367671 21523 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:54.355448 21578 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:10:54.351794 21532 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:54.379972 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:54.359500 21250 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:54.380672 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.378386 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3379) took 1288 ms. Trace:
I20260709 13:10:54.382539 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.383659 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:54.353628 21569 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:54.389957 21541 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:54.382593 21532 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.382920 21523 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:54.396629 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:54.383229 15382 rpcz_store.cc:276] 0709 13:10:53.090426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.652013 (+561587us) service_pool.cc:224] Handling call
0709 13:10:53.653497 (+  1484us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:53.698729 (+ 45232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.698766 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:53.748678 (+ 49912us) log.cc:844] Serialized 78 byte log entry
0709 13:10:54.118814 (+370136us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:54.236331 (+117517us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.377975 (+141644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.378055 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.378102 (+    47us) raft_consensus.cc:1685] finished
0709 13:10:54.378116 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.378321 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214253,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1289,"raft.queue_time_us":45856,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":6580,"thread_start_us":567819,"threads_started":3,"wal-append.queue_time_us":395773}
I20260709 13:10:54.404958 21482 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:54.418190 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3486) took 1762 ms. Trace:
I20260709 13:10:54.387545 21571 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:10:54.394850 21310 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:54.424042 15345 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.645s (SENT)
I20260709 13:10:54.429836 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.433370 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 362d7a17088a4e86a51428b5ee97346e (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
I20260709 13:10:54.418798 15306 rpcz_store.cc:276] 0709 13:10:52.655594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.739100 (+ 83506us) service_pool.cc:224] Handling call
0709 13:10:52.763137 (+ 24037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.373698 (+610561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.373753 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.395073 (+ 21320us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.708559 (+313486us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:53.708615 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.417519 (+708904us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b54002fb054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:54.417606 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.417683 (+    77us) raft_consensus.cc:1685] finished
0709 13:10:54.417704 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.418091 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":659286,"raft.queue_time_us":554841,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":4842,"spinlock_wait_cycles":167980928,"thread_start_us":170758,"threads_started":1,"wal-append.queue_time_us":339723}
I20260709 13:10:54.391532 21618 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:10:54.401028 21541 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:54.415274 21204 consensus_queue.cc:260] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.443190 21204 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:54.439527 21626 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:54.443238 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.434679 21576 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:10:54.458614 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2821) took 1109 ms. Trace:
I20260709 13:10:54.459102 15229 rpcz_store.cc:276] 0709 13:10:53.349579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.349734 (+   155us) service_pool.cc:224] Handling call
0709 13:10:54.458299 (+1108565us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b540007b054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:54.458534 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196303104}
W20260709 13:10:54.469024 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45057us
I20260709 13:10:54.435365 21250 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.537405 15376 raft_consensus.cc:2368] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 15. Current term is 16.
I20260709 13:10:54.545706 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:54.546736 15229 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.547029 21547 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:54.474881 21618 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:54.550290 21618 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:54.468639 21310 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:54.565928 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:54.566921 16008 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.567829 15273 leader_election.cc:400] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:10:54.539824 21250 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.571794 15229 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:10:54.459110 21541 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.575784 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:54.585741 21555 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.586743 21557 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:54.568631 21310 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:54.551704 21618 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:54.610371 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 208504us
I20260709 13:10:54.600128 21310 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.618251 15307 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:54.618829 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 147692us
W20260709 13:10:54.622143 15345 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.862s (SENT)
I20260709 13:10:54.623405 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.624629 15301 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:54.627920 15302 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:54.606087 21451 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.633472 16005 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:10:54.615129 21571 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:54.642035 21482 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:54.629559 21618 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.649698 15307 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:54.650547 15302 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:54.627370 21514 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:54.671257 15308 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:54.622649 21569 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:54.635193 21563 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:54.677739 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 286281us
I20260709 13:10:54.682723 15302 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:54.686815 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:54.686836 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64744.6us
W20260709 13:10:54.687855 15345 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.867s (SENT)
I20260709 13:10:54.688395 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:54.646514 21536 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:54.713699 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.729697 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.735468 15304 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:54.736901 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.739858 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.734303 21631 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:54.741679 21631 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.742631 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.734149 21514 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.648731 21571 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.735520 21555 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:54.731238 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:54.740797 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.748988 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:10:54.749991 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.757259 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.761224 15307 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.760942 15299 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 10: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:54.763638 15302 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:54.642868 21526 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:54.752467 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64639.8us
I20260709 13:10:54.753575 15304 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:10:54.756783 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.765803 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:54.773689 15308 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:54.731735 21300 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:54.771080 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:54.776680 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:54.759359 21625 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 13:10:54.774735 21300 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:54.790148 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.799538 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.800201 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.800643 15303 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:54.801076 15299 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:54.799538 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.795325 16008 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:54.746826 21514 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.751973 21571 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.802589 15300 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:54.744316 21631 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.811916 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.817873 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:54.818112 15303 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:54.815069 15302 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:10:54.822774 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:54.821062 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 178851us
I20260709 13:10:54.752116 21532 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.825816 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:54.801955 21563 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.829775 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.813763 21555 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:54.837991 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.840978 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:54.774102 21536 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.784278 21526 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.748605 21482 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.854061 15308 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:10:54.852784 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.854241 15301 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:54.856462 15345 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.918s (SENT)
I20260709 13:10:54.857147 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.859086 15233 raft_consensus.cc:1240] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:54.861255 15302 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:10:54.862372 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.863262 15308 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:54.863679 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.827513 21514 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:10:54.872603 15225 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:54.877000 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:54.877216 15345 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.983s (SENT)
I20260709 13:10:54.878314 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:54.881083 15226 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:54.833046 21451 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:10:54.882779 21638 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:54.884200 21526 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:54.861541 21300 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.871841 21199 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:54.875943 21555 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:54.887663 21626 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:54.888172 15345 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.000s (SENT)
I20260709 13:10:54.926923 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:54.842983 21523 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:54.896625 15243 tablet_copy_service.cc:342] P b0f9eceec749442cb9a06c87f00f3caf: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-0066b5a9791e4a30856433ed14864d2f received from {username='slave'} at 127.0.0.1:46420
W20260709 13:10:54.901196 21634 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:10:54.905025 21628 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:10:54.906118 21536 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:54.869355 21530 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:54.845449 21563 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:54.929982 21555 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:54.930696 15345 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.240s (SENT)
I20260709 13:10:54.931213 21557 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:54.874723 21250 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:54.933619 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:54.970031 15299 raft_consensus.cc:2393] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:54.970523 21563 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:54.954852 21530 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:54.973138 21530 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:54.974836 21530 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:54.960790 15243 tablet_copy_service.cc:434] P b0f9eceec749442cb9a06c87f00f3caf: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-0066b5a9791e4a30856433ed14864d2f on tablet 0066b5a9791e4a30856433ed14864d2f with peer 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:10:54.980748 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50082.2us
W20260709 13:10:54.981752 15345 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.555s (SENT)
I20260709 13:10:54.936810 21526 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:54.959913 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:54.963332 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:54.984133 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:54.984997 15306 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:54.985426 21146 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:54.985877 21146 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.986238 21146 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.986356 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:54.987749 15306 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:10:54.964465 21609 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.844s	user 0.005s	sys 0.000s
I20260709 13:10:54.988840 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:54.988883 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.990363 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.991207 15300 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:54.990945 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.992079 15303 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:54.985070 15308 raft_consensus.cc:2368] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:10:54.995973 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:54.989702 15302 raft_consensus.cc:2368] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16.
I20260709 13:10:54.981900 21532 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:54.994658 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.950906 15225 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:54.992195 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.005198 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.961166 21300 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.011478 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.013592 15302 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:55.008446 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.014672 15299 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.015231 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:54.934056 21637 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:10:54.956326 21568 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:10:55.020700 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.016891 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.023624 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 174428us
I20260709 13:10:55.025252 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:55.019479 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 170544us
I20260709 13:10:55.027928 15300 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:10:55.028410 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.029398 15299 raft_consensus.cc:2410] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:10:55.031800 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 197223us
I20260709 13:10:55.028623 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:55.030059 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.046911 15303 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.031872 15306 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:55.051715 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.052328 15303 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:55.052675 15308 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.051805 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.053133 15345 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.555s (SENT)
I20260709 13:10:55.053593 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.013439 21629 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:10:55.049973 21541 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:10:55.054507 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.055567 15300 raft_consensus.cc:2410] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:10:55.056488 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.057185 21632 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:55.060631 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.061575 15299 raft_consensus.cc:2410] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 16 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:55.062542 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.063654 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.069401 15302 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:55.072217 21571 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:55.074180 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:55.079252 21146 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:55.079838 21310 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.082414 16008 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:55.093803 15307 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:55.063165 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:55.118680 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53867.6us
W20260709 13:10:55.124922 21612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.000s	sys 0.012s
I20260709 13:10:55.126406 15305 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.127220 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:55.130302 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.133296 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80193us
W20260709 13:10:55.134146 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 71083.1us
I20260709 13:10:55.134869 16005 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 16: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:55.098176 21557 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:55.136564 15345 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.584s (SENT)
I20260709 13:10:55.141816 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:55.144058 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:55.136955 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:55.144229 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:55.136206 21612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.000s	sys 0.013s
I20260709 13:10:55.149935 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:55.153342 15233 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:55.146967 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:55.133108 21646 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:55.124038 21451 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:55.138991 21655 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:55.135710 21631 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.125735 21536 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:55.149595 21555 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:55.177140 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.157708 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:55.164781 21613 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.012s	sys 0.021s
W20260709 13:10:55.187603 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51067.1us
I20260709 13:10:55.145944 21640 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:55.191206 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 197532us
W20260709 13:10:55.192517 15345 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.589s (SENT)
I20260709 13:10:55.198714 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.200161 21653 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:55.200551 15345 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.614s (SENT)
I20260709 13:10:55.201340 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.133483 21648 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:10:55.191821 21523 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:55.204020 21523 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:55.151829 21514 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:10:55.172565 21557 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:55.166837 21646 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:55.204862 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.197082 21640 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.215356 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.220487 15306 raft_consensus.cc:2368] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:10:55.215881 21310 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:55.158403 21571 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:55.219040 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:55.184478 21655 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:55.192180 21613 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.013s	sys 0.021s
I20260709 13:10:55.189785 21555 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:55.221776 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.234614 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.176038 21451 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.238369 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:55.224177 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 87302us
I20260709 13:10:55.224737 21640 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.176558 21626 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:10:55.235456 15307 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.223548 21527 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:55.236081 21555 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:55.224939 21653 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:55.188385 21631 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:55.242071 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:55.250273 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:55.276480 15227 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:55.270946 21639 log.cc:927] Time spent T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.396s	user 0.002s	sys 0.000s
I20260709 13:10:55.233178 21557 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:55.274657 21536 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.305644 21146 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:10:55.290908 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49012.4us
I20260709 13:10:55.304543 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:55.307454 21557 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.310245 21557 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:55.305251 21536 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.314246 21536 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:55.316762 21645 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:10:55.320843 21451 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:55.230158 21523 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.246001 21569 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:55.351572 15227 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:55.361687 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:55.378791 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:55.379226 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:55.361464 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.381403 15307 raft_consensus.cc:2376] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14. Re-sending same reply.
I20260709 13:10:55.383422 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.383711 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.389317 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:55.395861 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.397702 15307 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:55.399472 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:10:55.400077 15345 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.648s (SENT)
I20260709 13:10:55.427080 15307 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.427016 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.401964 21631 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:55.402881 21588 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:55.406455 21555 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.391285 21527 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:55.436122 21527 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:55.437633 21527 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:55.362905 21569 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:55.440625 21569 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.441998 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:55.383344 21646 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.444800 21646 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.418418 15375 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:10:55.448625 15375 pending_rounds.cc:85] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 8
I20260709 13:10:55.448975 15375 pending_rounds.cc:107] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:10:55.449297 15375 raft_consensus.cc:2889] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:55.344092 21626 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.420804 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 275367us
I20260709 13:10:55.423631 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:55.452989 16004 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:55.452811 21626 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:55.434976 21557 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:55.457017 21557 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.457408 15382 raft_consensus.cc:2393] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:55.457520 21557 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.460397 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:55.463289 21557 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:55.464928 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.466205 15301 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.467373 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.468734 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.474473 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.476030 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:55.477051 16004 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:10:55.435105 15999 raft_consensus.cc:1217] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.6->[12.7-12.7]   Dedup: 12.7->[]
W20260709 13:10:55.475205 15345 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.744s (SENT)
I20260709 13:10:55.479743 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.480003 15199 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:55.478930 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:10:55.492967 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:55.495543 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.498010 15307 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.500738 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.502164 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.507480 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.512660 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59682.8us
I20260709 13:10:55.513773 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:55.518289 15307 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:55.525861 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.528409 15308 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:55.456224 21626 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:55.535584 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 55737.2us
I20260709 13:10:55.536935 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:55.570549 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.537160 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.507316 21563 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:55.531267 21300 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.509s	user 0.013s	sys 0.000s
I20260709 13:10:55.543252 15304 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:55.528827 21557 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:55.558980 15302 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:55.571697 15308 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:55.578943 15227 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:55.578715 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.574609 15301 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:10:55.563169 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.581710 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.586673 15307 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.597446 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.605348 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.573920 21664 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.575645 21563 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.610605 15301 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:55.635810 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.637171 15299 raft_consensus.cc:2410] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:55.600149 21197 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:55.638574 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.643076 15301 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:55.641918 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 117093us
W20260709 13:10:55.647454 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 172288us
I20260709 13:10:55.629307 21563 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:55.649714 15345 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.753s (SENT)
I20260709 13:10:55.653568 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.601052 21660 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:10:55.655644 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.642645 21197 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:55.651973 21662 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.374s	user 0.000s	sys 0.002s
I20260709 13:10:55.684151 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.684453 21557 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:55.685276 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.685201 15345 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 2.751s (SENT)
I20260709 13:10:55.628551 21664 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.697007 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.710157 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.711668 15307 raft_consensus.cc:2410] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:55.707070 15299 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.710572 15308 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:55.713966 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:55.708580 21679 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:55.713551 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.713587 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.717422 15302 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.719012 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.694116 15301 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:55.721869 21673 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:10:55.732810 21677 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:55.735613 21637 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:10:55.746841 21672 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:10:55.748170 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:55.755599 21530 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.780s	user 0.017s	sys 0.000s
W20260709 13:10:55.758736 21640 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.001s
I20260709 13:10:55.761729 21664 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:55.697463 21197 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.791216 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.792318 15306 raft_consensus.cc:2376] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14. Re-sending same reply.
W20260709 13:10:55.783998 21676 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:10:55.766008 21555 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:55.765640 21637 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:55.800217 15233 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:10:55.780678 21626 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:55.792680 21632 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:55.810312 15230 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:10:55.815387 15232 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:55.810137 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:55.812909 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127724us
W20260709 13:10:55.817509 15345 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.798s (SENT)
I20260709 13:10:55.818187 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:55.788707 21568 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:10:55.829749 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.830813 15303 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:55.790512 21640 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.837806 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:55.847851 15229 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:10:55.808898 21523 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:10:55.826170 21664 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.825855 21536 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:55.814273 21541 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:55.837117 21568 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:55.820060 21638 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:55.839383 21555 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:55.868250 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:55.872275 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.847133 21626 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:55.884812 21640 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:55.885710 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.887501 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:55.888330 15378 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.859040 21692 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:55.898816 21692 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:55.899418 21692 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.859325 21536 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:55.870806 21541 consensus_queue.cc:1243] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:55.863482 21568 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:55.912578 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.913789 15303 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:10:55.919766 21643 log.cc:927] Time spent T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.036s	user 0.006s	sys 0.007s
I20260709 13:10:55.922263 21655 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.923779 21655 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.928409 15999 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:55.930433 21555 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:55.930939 21568 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.932360 21568 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.935860 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:55.918468 15378 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:55.862568 21664 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:55.916790 21647 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:55.850433 21637 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:55.964466 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.905330 21536 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:55.968915 21536 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.909122 21626 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:55.955971 21526 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:55.975121 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 107011us
W20260709 13:10:55.973008 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127738us
W20260709 13:10:55.985528 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.985611 15306 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:10:55.974120 21569 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.006s
W20260709 13:10:55.986115 15345 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 3.013s (SENT)
I20260709 13:10:55.989384 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.974561 21637 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.993335 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.974505 21547 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.994738 15306 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:55.995159 15306 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:55.996913 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.997270 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:55.999816 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.000594 15303 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:56.004730 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:56.005398 15299 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.009274 21197 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.013208 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:56.013777 21197 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:56.014909 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:56.015648 16004 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:56.016281 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.016692 15308 raft_consensus.cc:2410] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:56.020154 15299 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:56.019706 15306 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.021318 15306 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:56.024475 16004 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:56.025043 21664 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:56.026013 15199 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:56.027110 21568 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:56.027707 21568 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:55.993717 21569 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.028685 21568 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.030277 15306 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:10:56.030809 21569 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:56.032109 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:56.032270 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:56.043695 21626 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:56.045262 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:56.032663 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.051375 21547 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:55.992195 21646 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.547s	user 0.017s	sys 0.000s
I20260709 13:10:55.987223 21526 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:56.072947 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2823) took 1923 ms. Trace:
I20260709 13:10:56.098858 15228 rpcz_store.cc:276] 0709 13:10:54.149534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.149748 (+   214us) service_pool.cc:224] Handling call
0709 13:10:54.162863 (+ 13115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.172843 (+  9980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.172894 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.173752 (+   858us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.341004 (+167252us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:54.341054 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.341137 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.758486 (+417349us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:54.871954 (+113468us) raft_consensus.cc:1685] finished
0709 13:10:54.871977 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.072664 (+1200687us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b54000104d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:56.072857 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3128,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":25034,"spinlock_wait_cycles":23105792,"thread_start_us":119958,"threads_started":1,"wal-append.queue_time_us":220758,"wal-append.run_cpu_time_us":7145,"wal-append.run_wall_time_us":1496457}
I20260709 13:10:56.033056 21689 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:10:56.102705 21689 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:56.103261 21689 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:56.103886 16004 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:56.102761 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:56.104499 21689 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:56.080595 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:56.106467 21689 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.109560 21197 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:56.111816 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:56.114085 21571 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:56.115000 21670 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:56.115142 21571 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:56.115741 21670 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:56.116808 21670 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:56.122820 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.122905 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.124166 15299 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:56.084626 15306 pending_rounds.cc:85] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 13
I20260709 13:10:55.986774 21647 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:56.105535 21541 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.128077 15306 pending_rounds.cc:107] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:10:56.136090 15306 raft_consensus.cc:2889] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.143013 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:56.143966 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.069828 21563 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.155920 15299 raft_consensus.cc:2368] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15.
I20260709 13:10:56.128958 21541 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:56.160503 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2543) took 1420 ms. Trace:
I20260709 13:10:56.163139 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.166419 15299 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:10:56.168892 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:56.157765 15306 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:56.152791 21706 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:10:56.201435 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:56.172400 21526 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:56.173707 21547 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:56.179226 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.204569 21555 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:56.206759 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:56.206668 21555 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.205057 15376 raft_consensus.cc:2368] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19.
I20260709 13:10:56.180596 21647 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:56.164206 15305 rpcz_store.cc:276] 0709 13:10:54.753678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.756982 (+  3304us) service_pool.cc:224] Handling call
0709 13:10:56.160198 (+1403216us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540025a8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:56.160398 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833822464}
I20260709 13:10:56.189605 15299 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:56.191123 16007 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:10:56.203301 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.219295 15306 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:56.220468 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.221479 15306 raft_consensus.cc:2410] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 16 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:56.201009 15345 leader_election.cc:336] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.801s (SENT)
I20260709 13:10:56.221951 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:56.205207 15307 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:56.208096 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:56.161778 21541 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.225231 21555 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:56.227792 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:56.158756 21646 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:56.235105 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 149959us
I20260709 13:10:56.229519 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:10:56.244750 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 43805.9us
W20260709 13:10:56.245509 15345 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.848s (SENT)
I20260709 13:10:56.245877 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:56.244254 21706 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:56.222453 21692 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.233433 21526 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:56.257429 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.260154 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 106557us
I20260709 13:10:56.241771 21626 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.244001 21646 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:56.254552 21706 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:56.258819 21555 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.267086 21526 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:56.291286 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.336900 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.339390 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.314491 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.342885 15377 raft_consensus.cc:2410] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 12 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:56.343016 15380 raft_consensus.cc:2368] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:10:56.340667 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.348312 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.349344 15308 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:56.352337 15300 pending_rounds.cc:85] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 8
I20260709 13:10:56.352753 15300 pending_rounds.cc:107] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:10:56.353012 15300 raft_consensus.cc:2889] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.353199 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:56.355733 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 86709.6us
I20260709 13:10:56.356755 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.357990 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.358583 15381 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:56.359846 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:56.363804 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:56.360252 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 102929us
I20260709 13:10:56.366405 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.379180 15373 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 8: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:56.379118 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.380224 15381 raft_consensus.cc:2368] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:56.383466 16008 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:56.291841 21685 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:10:56.386937 16005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 886) took 1368 ms. Trace:
I20260709 13:10:56.391429 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.387429 16005 rpcz_store.cc:276] 0709 13:10:55.014743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.014909 (+   166us) service_pool.cc:224] Handling call
0709 13:10:56.383026 (+1368117us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540053f2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:56.383170 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272989952}
I20260709 13:10:56.392133 15381 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:10:56.397783 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:56.399650 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:56.385794 21664 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:56.409294 21715 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:10:56.414705 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:56.417033 15380 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18.
I20260709 13:10:56.401803 21563 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:56.425789 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.432072 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.433003 15381 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:56.447572 21481 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.448280 21481 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:56.451184 21481 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:56.452528 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61133.9us
I20260709 13:10:56.458158 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:56.459030 15377 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:56.383939 21706 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:56.469901 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:56.472683 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81943.1us
W20260709 13:10:56.473847 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74294.8us
W20260709 13:10:56.476143 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 78446.8us
I20260709 13:10:56.477881 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:56.423655 21723 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.482174 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:56.478535 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:56.487861 21712 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:10:56.489328 21726 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:56.490823 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:56.491074 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3411) took 1142 ms. Trace:
I20260709 13:10:56.491503 15375 rpcz_store.cc:276] 0709 13:10:55.348911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.451644 (+102733us) service_pool.cc:224] Handling call
0709 13:10:55.452044 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:55.482970 (+ 30926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.483020 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:56.209317 (+726297us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b2c00083318. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:10:56.210167 (+   850us) log.cc:844] Serialized 52 byte log entry
0709 13:10:56.311271 (+101104us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:56.347678 (+ 36407us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.348100 (+   422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.348203 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.435706 (+ 87503us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180047f0e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:56.490859 (+ 55153us) raft_consensus.cc:1685] finished
0709 13:10:56.490882 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.491020 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37563,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":754,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":19125,"spinlock_wait_cycles":55964928,"thread_start_us":97172,"threads_started":1,"wal-append.queue_time_us":170216}
W20260709 13:10:56.502138 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.441396 21588 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:56.464130 21692 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:56.418351 21664 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:56.478231 21714 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:10:56.468845 21563 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.103s
W20260709 13:10:56.662036 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.971721 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.972414 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.776584 15300 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:56.972975 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.833000 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:56.629662 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:56.740581 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.584535 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109573us
I20260709 13:10:56.847067 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:56.981176 16007 raft_consensus.cc:2368] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
I20260709 13:10:56.985747 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:56.986152 15306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.007s
I20260709 13:10:56.986552 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:10:56.986732 15306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.007s	sys 0.007s
I20260709 13:10:56.986877 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:56.987280 16005 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:56.701102 21703 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:10:56.960199 21702 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.962s	user 0.003s	sys 0.001s
W20260709 13:10:56.631074 21732 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:10:56.918365 21555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.007s
I20260709 13:10:57.016710 15127 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 100) took 6343 ms. Trace:
W20260709 13:10:56.674621 21731 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:10:56.631415 21526 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:56.991520 21532 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:10:56.992125 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:56.993955 21747 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.995036 21742 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:56.995082 21750 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:56.995890 21596 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.997392 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 524) took 1757 ms. Trace:
W20260709 13:10:57.001199 21700 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.001s	user 0.002s	sys 0.000s
I20260709 13:10:57.027948 16008 rpcz_store.cc:276] 0709 13:10:55.239996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.243635 (+  3639us) service_pool.cc:224] Handling call
0709 13:10:56.383170 (+1139535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.383938 (+   768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.997175 (+613237us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540053f2d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:56.997300 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2619325696}
I20260709 13:10:57.004933 21743 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:57.006672 21640 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:57.007228 16005 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:10:57.011276 15198 leader_election.cc:400] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19.
W20260709 13:10:56.782347 21725 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
W20260709 13:10:56.629683 21722 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:10:56.520401 21646 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.013151 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:10:57.014101 15373 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.011s	sys 0.006s
W20260709 13:10:57.046095 15373 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.011s	sys 0.006s
W20260709 13:10:56.833602 21541 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
I20260709 13:10:56.574100 21637 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.568992 21588 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:56.677160 21721 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:10:57.049959 21748 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:56.990893 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.031512 21596 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.052506 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3537) took 1048 ms. Trace:
I20260709 13:10:57.051715 21748 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.044617 21526 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:57.016968 21555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.008s
I20260709 13:10:57.015770 21736 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:57.015437 21729 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:57.034245 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3526) took 1038 ms. Trace:
I20260709 13:10:57.032668 21640 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:57.038203 21197 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:57.041432 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3424) took 1302 ms. Trace:
I20260709 13:10:57.017143 15127 rpcz_store.cc:276] 0709 13:10:50.672063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.677168 (+  5105us) service_pool.cc:224] Handling call
0709 13:10:57.015248 (+6338080us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:52.568143 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:52.628738 (+ 60595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:52.628816 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:10:52.628860 (+    44us) tablet.cc:662] Decoding operations
0709 13:10:52.629607 (+   747us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:52.629720 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:52.629753 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:52.630229 (+   476us) tablet.cc:701] Row locks acquired
0709 13:10:52.630269 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:10:52.630494 (+   225us) write_op.cc:270] Start()
0709 13:10:52.630681 (+   187us) write_op.cc:276] Timestamp: P: 1783602652630405 usec, L: 0
0709 13:10:52.630708 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:10:52.631601 (+   893us) log.cc:844] Serialized 1302 byte log entry
0709 13:10:53.791797 (+1160196us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b1800165160. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:54.141642 (+349845us) op_driver.cc:464] REPLICATION: finished
0709 13:10:54.937259 (+795617us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f5755cef0
0709 13:10:55.413025 (+475766us) write_op.cc:301] APPLY: starting
0709 13:10:55.413177 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:55.415724 (+  2547us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:55.415744 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:55.709874 (+294130us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:55.748810 (+ 38936us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:10:55.748893 (+    83us) write_op.cc:312] APPLY: finished
0709 13:10:55.749251 (+   358us) log.cc:844] Serialized 41 byte log entry
0709 13:10:55.828467 (+ 79216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:55.835286 (+  6819us) write_op.cc:454] Released schema lock
0709 13:10:55.835351 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:55.835936 (+   585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:55.835972 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":452215,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":1218978,"apply.run_cpu_time_us":20139,"apply.run_wall_time_us":462394,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":366414,"prepare.run_cpu_time_us":62612,"prepare.run_wall_time_us":409031,"raft.queue_time_us":347433,"raft.run_cpu_time_us":34908,"raft.run_wall_time_us":1095898,"replication_time_us":1510730,"spinlock_wait_cycles":26004608,"thread_start_us":1817572,"threads_started":5,"wal-append.queue_time_us":552412,"wal-append.run_cpu_time_us":57438,"wal-append.run_wall_time_us":2187874}]]}
I20260709 13:10:57.047133 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.053064 15305 rpcz_store.cc:276] 0709 13:10:56.007117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.238750 (+231633us) service_pool.cc:224] Handling call
0709 13:10:56.250011 (+ 11261us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:56.250398 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.250425 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:56.267250 (+ 16825us) log.cc:844] Serialized 52 byte log entry
0709 13:10:56.342251 (+ 75001us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:56.356274 (+ 14023us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.359380 (+  3106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.359458 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.492925 (+133467us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b1800145e40. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1
0709 13:10:56.493620 (+   695us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800145e40. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:10:57.052245 (+558625us) raft_consensus.cc:1685] finished
0709 13:10:57.052266 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.052446 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11345,"prepare.queue_time_us":11222,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":3095,"raft.queue_time_us":4508,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":11528,"spinlock_wait_cycles":15613056,"thread_start_us":53297,"threads_started":1,"wal-append.queue_time_us":110778}
I20260709 13:10:57.049126 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:56.984112 21647 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:57.071503 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.026680 21747 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:57.109879 21755 log.cc:927] Time spent T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:57.110720 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.050117 21541 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.102039 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.104568 21197 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.112061 15375 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.113217 21541 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.113449 21197 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:57.068820 15302 rpcz_store.cc:276] 0709 13:10:55.995878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.996015 (+   137us) service_pool.cc:224] Handling call
0709 13:10:55.996448 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.997710 (+  1262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.997744 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.998250 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.139671 (+141421us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:56.139742 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.139849 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.033986 (+894137us) raft_consensus.cc:1685] finished
0709 13:10:57.034016 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.034175 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1217,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":140913,"threads_started":1,"wal-append.queue_time_us":238280}
I20260709 13:10:57.086828 21751 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.105129 21647 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.120929 21647 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:57.111073 21752 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:57.080840 15374 rpcz_store.cc:276] 0709 13:10:55.739558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.740673 (+  1115us) service_pool.cc:224] Handling call
0709 13:10:55.741104 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.741565 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.741605 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.742216 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.907412 (+165196us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:55.907452 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.907517 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.000568 (+1093051us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:57.041129 (+ 40561us) raft_consensus.cc:1685] finished
0709 13:10:57.041154 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.041353 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2527,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":5213440,"thread_start_us":164748,"threads_started":1,"wal-append.queue_time_us":232954}
I20260709 13:10:57.030829 21750 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.125053 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.125946 15374 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:10:57.111028 21747 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.126787 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.126919 21750 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.127511 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.127949 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.106735 21646 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:57.134176 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.057111 21743 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.108918 21748 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:57.115267 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3523) took 1126 ms. Trace:
I20260709 13:10:57.138707 15301 rpcz_store.cc:276] 0709 13:10:55.989306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.990667 (+  1361us) service_pool.cc:224] Handling call
0709 13:10:55.990947 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.147743 (+156796us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:56.176727 (+ 28984us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.475427 (+298700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.475498 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:56.475562 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.781623 (+306061us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:10:57.115025 (+333402us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540017a554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:57.115092 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.115213 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13740,"prepare.queue_time_us":34264,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":6954,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6341,"spinlock_wait_cycles":374779520,"thread_start_us":298126,"threads_started":2,"wal-append.queue_time_us":163809}
I20260709 13:10:57.115844 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.140580 15381 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.140990 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.141762 15380 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:10:57.142917 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.143680 15380 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:57.116649 15378 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.144687 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.146093 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.147249 15380 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:57.072084 21526 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.032819 21742 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.106101 21640 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.105574 21664 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.129514 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.151005 21640 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:57.151228 15382 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:57.152180 21742 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:57.153036 21536 consensus_queue.cc:1175] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
I20260709 13:10:57.133177 15375 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:57.108026 21596 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.150233 21526 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.155189 21646 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.175590 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.161233 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:57.176275 15374 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:57.055512 21637 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.084570 21729 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.093430 21736 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:57.191677 15381 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:57.197654 21743 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.202317 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.210867 21736 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.211690 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.212563 21751 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.213042 21751 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.215241 21751 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.215593 21637 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.182686 21596 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.216454 21596 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.216832 21596 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.220623 21749 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.221187 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.221127 21749 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.222306 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.223119 21749 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.227399 15378 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:57.229408 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.230526 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.231068 15378 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:10:57.202865 21647 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.233182 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.234061 21729 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:57.235989 21646 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:57.236626 21646 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.238077 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.239408 15273 leader_election.cc:400] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:10:57.231931 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.246785 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.248425 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.249744 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.250314 15374 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.252167 15382 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:10:57.245888 21647 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.253170 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.246007 21637 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.259068 21626 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:57.259647 21626 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.260223 15375 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:57.260970 15381 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:57.261427 15375 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:57.261919 21626 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.262655 15375 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:57.272367 21647 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:57.272558 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:57.275357 21646 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.275460 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.277379 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.278676 21637 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:57.278990 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.278003 21646 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.271742 21588 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.280365 21646 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.246834 15378 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
W20260709 13:10:57.282509 15345 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.878s (SENT)
I20260709 13:10:57.283084 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.285344 21741 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.291945 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.262027 15381 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:57.321864 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:57.322893 15307 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:10:57.335117 15307 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:57.335747 15307 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:57.341403 21648 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.341998 21648 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.296255 21637 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:57.349777 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.344367 15348 leader_election.cc:400] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
I20260709 13:10:57.350754 15348 leader_election.cc:403] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:57.347023 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:57.359269 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72574.9us
I20260709 13:10:57.345551 15307 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.363845 15307 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.370908 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:57.373139 15306 raft_consensus.cc:2410] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 22 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:10:57.374301 15374 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
W20260709 13:10:57.368809 15345 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 3.079s (SENT)
I20260709 13:10:57.375512 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.376322 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:57.377769 15345 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 3.149s (SENT)
I20260709 13:10:57.343190 21626 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:57.380695 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:57.378434 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.348714 21637 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:57.385823 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.386718 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.387553 15229 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:57.392467 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:57.399606 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78350.3us
W20260709 13:10:57.399637 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 67191.2us
I20260709 13:10:57.400518 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.400516 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.403808 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.404604 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.404680 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.405558 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.406410 15232 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:10:57.409945 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.411090 15231 raft_consensus.cc:2410] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
W20260709 13:10:57.413350 15345 leader_election.cc:336] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.980s (SENT)
I20260709 13:10:57.413925 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:57.423236 15226 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:57.424320 15230 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:57.378551 21646 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.429595 16005 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:57.428095 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.393661 21637 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.433166 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:57.433550 15307 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:10:57.436299 15307 pending_rounds.cc:85] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 11
I20260709 13:10:57.436621 15307 pending_rounds.cc:107] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:10:57.437000 15307 raft_consensus.cc:2889] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.431109 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:57.437587 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.436528 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.444469 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.425824 21748 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.431670 21750 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:57.445757 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:57.441461 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.446966 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.409509 21736 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:57.445156 15226 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:10:57.431282 21569 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:57.430251 21685 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.449527 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:57.451959 15231 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:10:57.429032 21532 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.392817 21626 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:57.465090 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.469815 15273 leader_election.cc:400] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:57.470237 15273 leader_election.cc:403] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:57.470438 21756 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:57.471402 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:57.472469 21762 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.473361 21532 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:10:57.474169 21532 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:57.477065 21648 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.464954 21204 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.477972 21204 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.478377 21204 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.441078 21588 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:57.481626 21756 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
I20260709 13:10:57.485313 21750 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:57.486511 21750 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.489392 21686 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:10:57.490811 21724 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.170s
I20260709 13:10:57.492230 21765 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:57.492827 21765 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.493527 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.494952 21765 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:57.495477 21762 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.495770 21741 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:57.497464 21626 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.510954 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.448069 21526 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:57.534690 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:57.535302 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86515.9us
I20260709 13:10:57.499013 21724 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:57.537541 21569 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:57.485327 21761 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.549921 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.535197 21751 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.557147 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.564924 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.566334 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.568059 21736 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.568549 21697 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.568895 21563 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.569038 21697 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.569564 21563 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:57.571516 21697 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.572562 21746 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:10:57.577224 21769 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:10:57.578871 21763 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:10:57.581548 21569 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.583544 15306 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:57.586534 15305 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:57.587520 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:57.588110 15300 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:10:57.589843 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:57.590396 15304 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.592691 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:57.543345 21638 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.593732 21638 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:57.556393 21761 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.596968 21761 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.541567 21724 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:57.594053 21751 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:57.548689 21742 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.548856 21756 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.555167 21748 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.605381 21638 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.697367 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3430) took 1243 ms. Trace:
I20260709 13:10:57.697810 15379 rpcz_store.cc:276] 0709 13:10:56.453924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.475065 (+ 21141us) service_pool.cc:224] Handling call
0709 13:10:56.565511 (+ 90446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.332829 (+767318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.332873 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.348139 (+ 15266us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.468892 (+120753us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:57.468942 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.470387 (+  1445us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.697137 (+226750us) raft_consensus.cc:1685] finished
0709 13:10:57.697156 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.697305 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":422176,"raft.queue_time_us":428663,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"thread_start_us":382410,"threads_started":2,"wal-append.queue_time_us":251565}
I20260709 13:10:57.698669 21724 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.699934 21724 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.606446 15382 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:57.701608 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.702193 15382 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:57.703052 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.703604 15382 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:57.609454 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 2740) took 1127 ms. Trace:
I20260709 13:10:57.704543 15377 rpcz_store.cc:276] 0709 13:10:56.482558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.976869 (+494311us) service_pool.cc:224] Handling call
0709 13:10:57.609275 (+632406us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540014c8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:57.609398 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762229504}
I20260709 13:10:57.610446 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.706084 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:57.615993 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:57.709340 15308 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.706976 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:57.710083 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.533245 21596 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.623049 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.624720 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:57.711817 15300 raft_consensus.cc:2410] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:10:57.625530 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 114653us
I20260709 13:10:57.713500 15273 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18.
I20260709 13:10:57.713876 15273 leader_election.cc:403] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:57.632619 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:57.626391 21300 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:57.673501 15299 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:57.680140 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45468.8us
I20260709 13:10:57.711000 15376 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:10:57.619815 21626 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.680745 21742 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:57.762392 21742 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:57.617247 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 50989.9us
I20260709 13:10:57.764961 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.765583 15374 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:57.766353 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.766671 21626 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.767715 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.717445 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:57.772547 15300 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
W20260709 13:10:57.724895 15380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.018s	sys 0.027s
W20260709 13:10:57.773692 15380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.018s	sys 0.027s
I20260709 13:10:57.743116 15377 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:57.744930 21596 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.749680 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.753913 21526 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18.
I20260709 13:10:57.786755 21526 raft_consensus.cc:2764] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:57.757649 21751 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:57.716181 21686 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:10:57.761080 15308 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:57.714571 15303 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
W20260709 13:10:57.769382 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62465.7us
I20260709 13:10:57.756134 15304 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:57.781356 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:10:57.782701 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 66132.2us
I20260709 13:10:57.768676 21638 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.782051 21626 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.785791 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.803023 15345 leader_election.cc:400] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15.
I20260709 13:10:57.803539 15345 leader_election.cc:403] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:57.797427 15300 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:10:57.808818 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.747943 21637 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:57.818425 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:57.821770 15377 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.820088 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.823678 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.828104 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.825208 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:57.793818 21697 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:57.832034 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.826287 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:57.807196 21638 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.808799 21736 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.855234 15308 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:57.810487 21748 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15.
I20260709 13:10:57.856716 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:57.820819 21532 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:57.862460 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76766.9us
I20260709 13:10:57.832263 21756 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:57.867713 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:57.833616 21762 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.833410 21563 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.834777 21697 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:57.879957 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47993.4us
I20260709 13:10:57.855073 21638 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:57.881582 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 450509us
I20260709 13:10:57.884649 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:57.857235 21736 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:57.886706 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:57.863013 21569 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:57.856047 21760 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.854048 21706 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:10:57.896771 15377 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:57.876991 21756 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:57.869760 21766 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:57.901850 15198 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:57.882951 21740 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:57.883424 21697 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.969722 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:57.970978 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 103329us
I20260709 13:10:57.974907 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.886679 21526 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.893180 21736 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.891817 21748 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:57.891580 21569 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:57.898303 21761 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.988485 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:57.905620 21756 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:57.904062 21766 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.903141 21750 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.007329 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:57.977250 21743 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.012621 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.905088 21778 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:10:58.015758 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:57.990097 21569 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:57.982973 21563 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:57.983808 21760 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:58.026196 21760 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.028784 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:58.030313 21532 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.031095 21532 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.032217 21563 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.034385 21563 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.903924 21204 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.037552 21204 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:57.998318 21766 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.021867 21637 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.019104 21526 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:58.043978 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.046998 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:58.047309 21631 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:58.028331 21760 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:58.047773 21631 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.049440 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:58.022276 21785 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:10:58.022512 21743 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:57.929464 21704 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
W20260709 13:10:58.023289 21791 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:10:57.928555 21633 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:10:57.992890 21740 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.037096 21569 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.053380 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.055106 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.072654 15299 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.062881 21697 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.063354 21743 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.059568 21637 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.076992 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.078483 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.086153 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.091775 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.090173 15299 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:58.080663 21532 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.086848 21637 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.093426 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:58.088193 21742 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.112016 21727 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.112587 15300 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:58.112797 21727 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:58.090766 21800 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:58.114131 21727 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.115152 21800 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:58.115605 21800 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.115746 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:58.094532 21482 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.072484 21736 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.096371 21802 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:58.102618 21770 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.672s	user 0.004s	sys 0.000s
I20260709 13:10:58.108182 21740 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.122732 21736 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:58.071841 21631 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.124830 21631 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.126663 21697 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.120615 21482 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.130106 21482 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.130586 21756 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.102135 21569 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.135259 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.137178 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.136114 21802 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.139587 21637 raft_consensus.cc:2764] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:10:58.140579 21742 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.142575 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.144853 15374 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:58.146098 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.149116 15382 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:58.150048 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.128002 21638 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:58.156714 21532 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.144515 21742 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:58.159325 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.145138 21802 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.169934 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:58.171299 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.151614 21637 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:58.177501 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.170523 21532 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:58.185964 21532 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.186858 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.187332 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.188297 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:58.188653 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:58.188695 15229 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:58.190889 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:58.192597 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.193423 15382 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.196511 21568 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:58.197839 15224 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:58.194475 21638 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.198917 21756 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:58.171788 21742 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:58.203414 15274 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.590s (SENT) [suppressed 33 similar messages]
I20260709 13:10:58.204453 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.208086 15382 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:10:58.208249 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.183465 21801 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:58.211755 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.221247 21637 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:58.233728 15382 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.203815 21742 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.175908 21766 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.223745 21802 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:58.221004 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:58.210286 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.234740 21801 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.242704 21571 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:58.241627 21815 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:58.263038 15382 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:10:58.244761 21637 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:58.247328 21811 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.247932 21801 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.268357 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:58.297137 21708 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:58.272269 21774 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.740s	user 0.001s	sys 0.001s
I20260709 13:10:58.266702 21571 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.273162 21637 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:58.278141 21800 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.279634 15224 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:58.280730 15233 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:10:58.289772 21766 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.290356 21802 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.309198 15224 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.264773 21815 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:10:58.310123 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 106732us
I20260709 13:10:58.322726 21800 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.328636 21571 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.330407 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.331207 15376 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.297721 21708 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.311472 15224 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.343271 15224 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:58.345664 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:10:58.348517 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 138325us
I20260709 13:10:58.350474 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.352830 21708 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:10:58.349398 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.317662 21815 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.360625 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:58.363832 21800 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:58.361904 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3458) took 1085 ms. Trace:
I20260709 13:10:58.367086 15375 rpcz_store.cc:276] 0709 13:10:57.276217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.412488 (+136271us) service_pool.cc:224] Handling call
0709 13:10:57.412805 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:57.413154 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.413179 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:57.425689 (+ 12510us) log.cc:844] Serialized 52 byte log entry
0709 13:10:58.248774 (+823085us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b180032e4e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:10:58.298658 (+ 49884us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:58.318417 (+ 19759us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.318704 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.318802 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.354180 (+ 35378us) raft_consensus.cc:1685] finished
0709 13:10:58.361610 (+  7430us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.361823 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8655,"prepare.queue_time_us":20780,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":12849,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":8109,"spinlock_wait_cycles":10650112,"thread_start_us":49692,"threads_started":1,"wal-append.queue_time_us":903765}
I20260709 13:10:58.378324 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.380112 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.384912 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.375034 21526 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.386981 21526 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.391431 21821 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.393096 21526 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:58.393543 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.360284 21742 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.396273 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3451) took 1238 ms. Trace:
I20260709 13:10:58.398672 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:58.402030 15303 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:58.412213 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.397147 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.414350 15232 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:10:58.410980 15381 rpcz_store.cc:276] 0709 13:10:57.157453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.300438 (+142985us) service_pool.cc:224] Handling call
0709 13:10:58.395608 (+1095170us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:10:58.395804 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.395988 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.396011 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:58.396049 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:58.396085 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.396135 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.396223 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79986432}
I20260709 13:10:58.400607 15375 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:10:58.417924 15373 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:58.372583 21800 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:58.411265 15999 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:10:58.374974 21811 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:58.420238 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.421316 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.425750 15224 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:10:58.426852 15224 pending_rounds.cc:85] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 13
I20260709 13:10:58.430202 15224 pending_rounds.cc:107] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:10:58.440977 15224 raft_consensus.cc:2889] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:58.445582 21804 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:58.445818 21689 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:58.446750 21804 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:58.446774 21689 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:58.447338 21689 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.448247 21689 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.449448 21689 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.447294 21804 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.450376 21804 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.451505 21804 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.402128 21526 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.452886 21526 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.455049 21526 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.455832 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.458444 21801 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.460403 21811 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.468804 21811 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:58.470046 15230 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:58.470595 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.470162 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:10:58.471653 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.471982 15231 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:10:58.472620 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:58.473304 15224 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:58.474231 15303 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:58.474642 21766 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.477432 21568 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:58.477320 21766 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.486730 15232 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:58.487650 15225 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:58.491612 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.497044 15308 raft_consensus.cc:2410] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:58.497787 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.498322 15308 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:58.499261 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.478018 21568 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.510890 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.513810 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.516566 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.429879 21800 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.519515 15308 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:58.523212 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:58.523949 15376 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:10:58.527316 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:58.532673 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.533907 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.535422 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.539126 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.539119 15308 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 20: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:58.513271 21801 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.551632 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:58.539767 15306 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:10:58.552582 15229 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.553210 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.553953 15306 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:58.551481 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:58.554787 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:58.540891 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.557668 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.558598 15308 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:58.559432 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:58.560545 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:58.561244 15376 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:58.560055 15232 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 21.
I20260709 13:10:58.511281 21638 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:58.567656 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.573055 15300 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.568066 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.574406 15348 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.566782 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.571458 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:58.577533 15307 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:58.582506 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.583276 15307 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:10:58.565970 21746 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:58.596289 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:58.570182 21762 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:58.592010 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.601233 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.607164 21802 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:58.579746 21805 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.579631 21801 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.610627 15229 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:10:58.611241 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.613058 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:58.569803 21756 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:10:58.623934 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.591390 21569 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:58.626181 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.626859 15300 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:10:58.599855 21762 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:58.641655 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.627874 15304 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:58.615006 21536 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:58.682152 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 69169.9us
W20260709 13:10:58.683543 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109210us
I20260709 13:10:58.625873 21746 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.627813 21526 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:58.608556 21709 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:10:58.713999 15304 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:10:58.641882 21685 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.627441 21821 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.721102 21821 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.723279 15304 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:58.663497 21816 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:10:58.728188 15304 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:58.730192 21568 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:10:58.731557 21826 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:58.735674 15299 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:58.717293 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:58.740247 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.759297 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.759435 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:10:58.643712 21742 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.661952 21805 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:58.768158 15379 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:58.664709 21762 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.684197 21588 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:58.770517 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53292.1us
W20260709 13:10:58.755343 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 70484.5us
I20260709 13:10:58.643064 21801 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.789661 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:58.793107 16008 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:58.794338 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.794319 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:58.771620 21736 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:58.807260 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:58.809614 21829 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:10:58.816587 21746 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.821509 21800 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:58.782294 21804 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:58.829279 21736 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:58.829802 21736 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:58.831071 21814 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.562s	user 0.000s	sys 0.001s
I20260709 13:10:58.833557 21626 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.844542 21781 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:58.780968 21569 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.804085 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:58.859915 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55937.5us
I20260709 13:10:58.800859 21741 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:58.877760 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:58.876246 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3464) took 1419 ms. Trace:
I20260709 13:10:58.879120 15379 rpcz_store.cc:276] 0709 13:10:57.456812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.748543 (+291731us) service_pool.cc:224] Handling call
0709 13:10:57.748855 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.773994 (+1025139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.875936 (+101942us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001ab3d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:58.876170 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320397696}
I20260709 13:10:58.885468 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3450) took 1728 ms. Trace:
I20260709 13:10:58.796768 21638 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:10:58.863075 21626 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.779582 21805 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.888757 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:58.894640 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3453) took 1684 ms. Trace:
I20260709 13:10:58.895030 15373 rpcz_store.cc:276] 0709 13:10:57.209837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.333134 (+123297us) service_pool.cc:224] Handling call
0709 13:10:58.399103 (+1065969us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:10:58.416637 (+ 17534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.418393 (+  1756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.894454 (+476061us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54003f2d50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:10:58.894586 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119806976}
I20260709 13:10:58.885947 15378 rpcz_store.cc:276] 0709 13:10:57.157213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.281653 (+124440us) service_pool.cc:224] Handling call
0709 13:10:58.358663 (+1077010us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:10:58.358848 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.359055 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:58.359265 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.885041 (+525776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:58.885107 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:58.885172 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.885265 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.885404 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1836,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":97724,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":281,"spinlock_wait_cycles":87863040,"thread_start_us":525394,"threads_started":2,"wal-append.queue_time_us":465248}
I20260709 13:10:58.877383 21741 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:58.911942 21741 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.920604 21626 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:58.922070 21626 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:58.922865 21626 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:58.925185 21815 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:10:58.925900 21571 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:58.926422 21571 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:58.927407 21571 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.929328 21761 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:58.932519 21736 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.934425 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:58.903962 21633 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.944056 21805 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:58.864452 21569 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:58.925660 21815 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.905898 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:10:58.901914 21831 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:10:58.961808 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 56019.5us
I20260709 13:10:58.953382 21802 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:58.943252 21762 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.910880 21743 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:10:58.951687 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 310092us
I20260709 13:10:58.972787 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:58.950439 21761 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:10:58.985390 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.982703 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:58.986112 16007 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:10:58.983875 15305 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.986577 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.974647 15999 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:58.987640 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:58.989768 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.963267 21766 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:58.972949 21541 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.995214 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.955850 21633 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:58.991257 21532 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:58.998355 21532 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.998718 21532 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:59.006557 21532 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.007465 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:58.972460 21831 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:59.008889 15381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.008s	sys 0.007s
W20260709 13:10:59.009285 15381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.008s	sys 0.007s
I20260709 13:10:59.008960 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:59.009822 21831 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:59.009925 21805 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.010365 21831 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:59.011158 21526 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:59.011574 21526 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:59.012046 21526 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:59.021274 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:59.015285 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:59.016125 21569 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:59.016230 21727 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.994758 21801 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.019645 21736 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:58.990312 21742 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.033632 15376 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:59.035089 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:58.990782 21802 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.027834 15374 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:59.037283 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.037931 15377 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:10:59.038218 15303 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 11: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:10:59.020174 21761 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.040019 21761 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:59.044014 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:59.058197 15306 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:10:59.058357 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 272851us
I20260709 13:10:59.062368 15306 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:59.031733 21800 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.070504 21762 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:59.029390 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:59.026005 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:10:59.082332 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53023.7us
I20260709 13:10:59.089540 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:59.086316 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 290394us
I20260709 13:10:59.090868 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:10:59.032804 21727 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:10:59.075680 21708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.005s	sys 0.025s
W20260709 13:10:59.129407 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 231060us
W20260709 13:10:59.131213 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 147431us
I20260709 13:10:59.084241 21762 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.083551 21532 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:59.148525 21631 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:59.151641 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.151510 21631 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:59.152184 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.153842 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:59.154754 15306 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 16: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:10:59.155629 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:59.157747 21536 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:59.158866 21536 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:59.161384 21739 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:59.161880 21739 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:59.162714 21739 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.164021 21739 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.165061 21800 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:59.106389 21724 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:59.167912 21727 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.174043 21571 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:59.133648 21747 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:10:59.115345 21708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.005s	sys 0.026s
I20260709 13:10:59.110363 21736 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.177366 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:59.159409 21536 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.136935 21541 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:10:59.139091 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:59.203274 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 64276.4us
I20260709 13:10:59.156239 15306 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 11.
I20260709 13:10:59.205608 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:59.178694 21802 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:59.175925 21741 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.207067 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:10:59.214067 21536 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.193780 21724 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.233690 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:59.237521 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3489) took 1033 ms. Trace:
I20260709 13:10:59.237910 15381 rpcz_store.cc:276] 0709 13:10:58.203627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.424297 (+220670us) service_pool.cc:224] Handling call
0709 13:10:58.481197 (+ 56900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.481594 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.481623 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.482060 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:10:59.015435 (+533375us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:59.015474 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.015532 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.237309 (+221777us) raft_consensus.cc:1685] finished
0709 13:10:59.237336 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.237466 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3765,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":22394,"thread_start_us":532895,"threads_started":1,"wal-append.queue_time_us":624417}
I20260709 13:10:59.241282 21835 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:10:59.245659 15382 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:59.226913 21800 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:59.196691 21746 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:59.235694 21724 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:59.263190 21569 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:59.263834 21569 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.264259 21569 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.265497 21741 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:59.282156 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:10:59.240127 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 172424us
I20260709 13:10:59.253237 21800 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:59.295475 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:10:59.294780 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 234892us
I20260709 13:10:59.378032 21815 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.379760 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:59.380954 21633 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.382797 21836 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:59.383251 21836 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:59.322485 21532 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:59.294216 21800 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.403214 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:59.408545 16004 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEARNER]: Advancing to term 13
I20260709 13:10:59.293998 21747 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:59.391145 21526 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.389597 21532 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.418913 21532 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.420635 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:59.421480 16003 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:59.320137 21741 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:10:59.425143 21741 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.425657 15300 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:59.427531 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3581) took 1022 ms. Trace:
I20260709 13:10:59.428016 15305 rpcz_store.cc:276] 0709 13:10:58.404767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.410796 (+  6029us) service_pool.cc:224] Handling call
0709 13:10:58.428054 (+ 17258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.986889 (+558835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.427269 (+440380us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540025b2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:10:59.427460 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277712128}
I20260709 13:10:59.428994 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.325560 21802 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:59.433223 15304 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:59.416658 21526 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:59.446230 15304 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:59.447309 15304 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:10:59.448561 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 242162us
I20260709 13:10:59.320012 21727 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 13:10:59.412835 21747 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:59.444816 21689 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:10:59.462144 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:10:59.471889 16000 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:59.455880 21482 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:10:59.384312 21836 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.480654 21800 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.487948 15299 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:59.486866 16003 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:10:59.489774 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:10:59.466413 21747 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.460842 15304 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:10:59.513031 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44371.4us
I20260709 13:10:59.449957 21802 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.458881 21854 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:10:59.505707 21526 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:10:59.525892 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 377154us
W20260709 13:10:59.514676 21815 consensus_queue.cc:1175] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5c70ddb5aae14b059dc90fd40125b034" responder_term: 13 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:10:59.546087 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.508176 21853 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:10:59.559355 16000 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:10:59.540293 21526 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:59.562012 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:10:59.563565 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.545230 21569 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.601321 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:59.602631 21706 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.602833 21569 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.603205 21706 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.605631 16000 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEARNER]: Advancing to term 14
I20260709 13:10:59.587981 21526 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.566653 21821 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:59.580207 21724 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.592329 15229 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:10:59.592553 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78543.4us
I20260709 13:10:59.593405 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:59.621047 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.594170 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.594354 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.595290 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.622882 15232 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:59.598554 21746 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:10:59.595293 15224 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:59.610438 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.625159 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.625345 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:59.626231 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:59.618033 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:59.610190 21756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.012s	sys 0.053s
W20260709 13:10:59.634706 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.634125 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:59.642844 15233 raft_consensus.cc:2368] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:59.650877 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:59.654217 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 283306us
I20260709 13:10:59.655507 15230 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:59.655727 15348 leader_election.cc:400] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:10:59.656363 15348 leader_election.cc:403] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:59.655606 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.660341 15229 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
W20260709 13:10:59.648881 21756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.013s	sys 0.053s
I20260709 13:10:59.664417 15300 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:10:59.666507 15300 pending_rounds.cc:85] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 10
I20260709 13:10:59.666846 15300 pending_rounds.cc:107] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:10:59.667209 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:10:59.667050 15300 raft_consensus.cc:2889] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.667804 15308 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.642665 21821 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:10:59.613188 21547 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:10:59.689608 21547 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:59.690193 21547 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:59.696856 15304 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:59.658463 21626 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.658185 21482 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.701469 16000 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:59.701841 21482 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.703259 15380 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:59.674484 21851 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:59.704691 15380 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:59.705454 21851 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:59.705821 21851 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:59.707218 15376 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:59.675789 21833 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:59.708274 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.708945 15373 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 10.
I20260709 13:10:59.710145 15377 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:59.691429 21547 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.704695 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.681257 21740 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:59.679821 21638 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:59.657536 21800 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:59.682376 21864 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:10:59.683182 21861 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:59.685730 21841 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:59.720786 21741 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:59.652976 21746 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.774435 21746 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:10:59.681494 21724 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.775949 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:10:59.676918 21857 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:59.718262 15225 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:10:59.721555 21756 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:59.718891 15232 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:10:59.656904 21811 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.721726 15378 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:10:59.721316 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 169721us
I20260709 13:10:59.662752 21762 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.793725 15379 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:59.722913 21638 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:59.802198 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:59.704124 21482 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.721627 21740 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:10:59.759274 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:59.809873 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50694.1us
I20260709 13:10:59.762691 21841 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:10:59.795214 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:59.796981 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:59.804576 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:10:59.808414 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:59.810788 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:59.706657 21851 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.818109 15381 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:59.818338 21835 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.819140 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:10:59.820861 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.755918 15308 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:10:59.743678 21747 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:10:59.822922 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 204974us
I20260709 13:10:59.741166 15974 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:10:59.827373 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 86354.4us
I20260709 13:10:59.828176 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:10:59.835892 15306 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:59.815676 21802 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:10:59.839128 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:59.814309 21766 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:59.823367 21706 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:10:59.877709 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67040.7us
I20260709 13:10:59.849654 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:10:59.851174 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:10:59.851421 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:10:59.852703 15225 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:59.886308 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.884047 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:10:59.887667 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:10:59.888309 15225 raft_consensus.cc:606] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:10:59.892131 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.893191 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:10:59.867658 15380 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:59.894444 15380 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:10:59.909511 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.838594 21529 raft_consensus.cc:2764] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:10:59.846616 21646 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.838657 21873 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:59.877759 21851 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.881311 21632 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.906245 21762 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:59.881006 21697 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.911682 21706 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.846498 21742 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:10:59.843828 21811 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
W20260709 13:10:59.953541 21870 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:10:59.823096 21821 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.958046 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:10:59.958716 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68022.9us
I20260709 13:10:59.917044 21761 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:59.971139 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:59.844046 21638 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.975342 15274 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:10:59.917407 21841 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:10:59.973040 21742 consensus_queue.cc:1243] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:59.978178 21736 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:10:59.980983 21646 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:59.980760 21526 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.961800 21697 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.019436 21637 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.025525 21637 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.030269 15380 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.031386 15380 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.034411 21747 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:10:59.985785 21532 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:00.036966 21532 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.037858 15300 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:00.040373 21876 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:00.045095 21836 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.049844 21841 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:00.051286 21872 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:11:00.052955 21740 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.054102 21740 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:00.008167 21885 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:10:59.985975 21875 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:00.066141 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:00.067262 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.970132 21761 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:10:59.986164 21802 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.071696 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:00.070843 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.075961 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:00.025596 21881 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:11:00.101024 15305 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:11:00.087208 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 152502us
I20260709 13:11:00.018316 21742 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.105892 15300 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:00.111690 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:00.071055 21875 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.068424 21736 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.072643 21646 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:00.155984 15308 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:00.119009 21847 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:00.102137 21802 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:00.152500 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 297767us
I20260709 13:11:00.116005 21742 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.168804 21762 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:00.185496 21880 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:00.186177 21761 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.189250 21736 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:00.062958 21529 consensus_queue.cc:1175] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 19 status { last_received { term: 18 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:00.192020 21802 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.193928 21742 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:00.180076 21882 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:11:00.140713 21875 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.207369 21875 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.208097 15299 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:11:00.175640 21697 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.209916 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.210726 15307 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:00.213876 21762 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.224700 21756 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:11:00.225625 21646 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:00.232121 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 290122us
I20260709 13:11:00.236703 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.236450 21689 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:00.251962 21541 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:11:00.268313 21833 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.269001 21833 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:00.271935 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 203976us
I20260709 13:11:00.238722 15304 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:11:00.274013 15304 pending_rounds.cc:85] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 10
I20260709 13:11:00.274294 15304 pending_rounds.cc:107] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:11:00.274516 15304 raft_consensus.cc:2889] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:00.241273 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 281496us
I20260709 13:11:00.241920 21766 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:00.277922 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:00.249420 15225 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:00.250164 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.280557 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.260722 15308 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:00.264849 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.264981 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:00.281275 15232 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:00.277954 21766 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.284853 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.286633 15380 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:00.286942 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.289001 15225 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:00.290019 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.291132 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.292433 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.293099 15224 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:00.293244 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.296095 15233 raft_consensus.cc:2393] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 22: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:00.296604 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:00.298381 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45109.9us
I20260709 13:11:00.300298 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.300302 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.298168 21761 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.301966 21761 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.302388 21761 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.304544 21571 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:00.305442 21844 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:00.306463 21571 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.309345 21633 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:00.298470 21847 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.313086 21847 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.253131 21885 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.272048 21833 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:00.290925 21685 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 13:11:00.317683 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.312248 21633 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:00.307770 21844 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:00.324270 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.335471 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.335569 21804 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:00.337123 21849 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:00.337918 21632 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:00.338452 21632 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:00.339361 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.282882 21766 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.340739 21536 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.388722 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55233.7us
I20260709 13:11:00.389797 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:00.320744 21836 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.394197 15230 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
W20260709 13:11:00.391971 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 73769.4us
I20260709 13:11:00.396682 15974 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:00.326650 21633 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:00.375151 21849 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:00.359938 21204 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:11:00.409176 15379 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
I20260709 13:11:00.401155 21804 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.375108 21856 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:11:00.339397 21632 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.401343 21756 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.389451 21571 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:11:00.406406 21854 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:00.323900 21885 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.406277 21869 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.400832 21836 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.407428 21647 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:00.406842 21532 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.392401 21536 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.409370 21887 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.406157 21689 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:11:00.419552 21804 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.441382 21856 consensus_queue.cc:1243] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:00.455068 21885 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.425618 21833 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.457412 21632 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.453364 21836 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.471518 21847 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.473764 21761 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.480672 21761 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.481586 21766 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.482381 21536 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.432331 21756 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:00.484225 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.484407 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.539250 15299 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:00.540902 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.484622 21833 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:00.485080 21892 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:11:00.448590 21869 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.459827 21849 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.458550 21887 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.459313 21804 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.552174 21833 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.552760 21887 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.552930 21833 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:00.553403 21887 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.553952 21887 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.553881 21833 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:00.557322 21706 raft_consensus.cc:993] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:11:00.491287 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:00.557924 21756 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:00.558427 15308 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:00.497833 21885 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.559491 21887 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.560838 21885 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.563298 21885 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.501971 21904 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:00.542797 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.564445 21904 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:00.566776 21904 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:00.568275 21877 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.595s	user 0.001s	sys 0.001s
I20260709 13:11:00.568730 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.569888 21532 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:00.570415 21532 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.570815 21532 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.574088 21547 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.575369 21863 raft_consensus.cc:1064] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
W20260709 13:11:00.576028 21863 raft_consensus.cc:1068] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Unable to promote non-voter 5c70ddb5aae14b059dc90fd40125b034: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:00.566762 21869 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.557976 21706 raft_consensus.cc:1081] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:11:00.545734 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 206425us
I20260709 13:11:00.501717 21905 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:00.550046 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:00.586280 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 196528us
I20260709 13:11:00.587996 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.588949 15308 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:00.593039 21706 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.593585 21706 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.543891 21847 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:00.594861 21847 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:00.595633 21706 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.596808 21847 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:00.605669 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:00.605854 15231 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:00.610929 15308 pending_rounds.cc:85] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 7
I20260709 13:11:00.611354 15308 pending_rounds.cc:107] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:00.606586 15378 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:00.611625 15308 raft_consensus.cc:2889] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:00.617257 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.630759 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.631719 15302 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:00.633972 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.635970 15302 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:00.638520 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.609153 21804 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.634083 21869 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.661164 21869 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.653697 21766 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.665752 21766 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:00.613940 21905 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:00.646903 21742 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.678719 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:00.679867 15375 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:00.675237 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:00.648445 21833 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:00.682245 15381 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:00.664987 15303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:11:00.689101 15303 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.689491 15303 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.662735 21804 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:00.688320 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.693758 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.694140 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:00.697702 21637 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.700093 16007 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:00.694448 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.703025 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.703707 15308 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:00.705193 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.710047 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.712224 21905 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:00.712898 21906 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:00.713416 21869 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.735538 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.713793 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:00.715510 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.740711 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:00.742870 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.745352 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.746275 21632 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.750250 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.752930 21766 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:00.757483 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.766924 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:00.767937 16007 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:00.690992 21742 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:00.763288 21637 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.738580 21906 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.770280 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.747028 21647 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:00.783902 21568 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:00.784616 21568 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.785053 21568 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.792724 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.792732 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.792270 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.800838 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.802829 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.804641 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.808959 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.819056 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:00.819731 15230 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:00.822146 15224 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:00.823269 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.763984 21632 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.738418 21571 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 13:11:00.833038 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56169.7us
I20260709 13:11:00.774307 21906 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.774107 21811 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.769186 21197 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:11:00.840830 21632 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.857798 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:00.830327 21905 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.920723 21905 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.923722 21905 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:00.932112 21847 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:00.932816 21847 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.933248 21847 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:00.940089 21638 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.850529 21532 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:00.857046 21896 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:11:00.855373 21910 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:00.900512 21916 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:11:00.891072 21811 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.818410 21637 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.840830 21736 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:00.942966 15299 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:00.943794 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:00.942245 21532 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.956525 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:00.932155 21740 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:00.960673 15303 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:00.974615 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:00.989610 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:00.990181 15308 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:00.990222 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:00.990832 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:00.940151 21742 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:00.992291 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67875.9us
I20260709 13:11:00.996150 15304 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
W20260709 13:11:00.968225 21911 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:11:00.993443 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:00.998248 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:00.999490 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:01.000126 16007 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:00.988873 21740 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:01.000792 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:01.007305 15303 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:01.005211 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:01.011113 21740 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.013070 21740 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:01.001379 21761 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.017130 21887 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:01.017443 21761 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:00.956489 21836 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.018080 21761 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.018823 21887 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:00.969575 21910 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:01.020787 15300 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:01.032519 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:01.040956 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:01.036019 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:00.999945 21904 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:00.995625 21905 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:01.000375 21903 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.060629 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:01.005988 21886 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:01.077610 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 206685us
I20260709 13:11:00.993178 21741 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.987604 21736 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.020179 21836 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:00.997067 21746 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:11:01.089095 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:01.095562 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:01.097036 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:01.063514 21887 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:01.076074 21204 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.080013 21885 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.129143 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:01.133077 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:01.130214 15378 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:01.081511 21903 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:01.132261 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:01.088840 21689 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.266853 15229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75432bd549b3481d83070979a305922b"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:01.103358 21685 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:01.100036 21904 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:01.105604 21741 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:01.083094 21905 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:01.281113 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 184141us
I20260709 13:11:01.103590 21197 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.108177 21885 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:01.321376 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:01.267499 21898 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:11:01.093715 21568 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.291899 21708 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.339075 21708 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.343755 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:01.328315 21197 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.345065 21197 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.353771 21197 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.264499 21887 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:01.091100 21633 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.261935 21903 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.344448 15374 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:01.344847 15303 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:01.250803 21204 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.329499 21885 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.384042 21736 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:01.391849 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:01.335547 21904 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:01.376921 21919 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 13:11:01.376529 21897 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:01.380503 21762 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.323256 21910 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.400509 16007 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:01.344031 21632 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.367834 21811 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:01.413360 16008 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:01.407612 21904 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.378132 21887 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.417487 21633 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.419123 21886 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.434523 21708 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:01.431630 21637 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:01.452766 21632 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:01.457600 21568 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:01.464636 21938 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:01.465163 21938 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:01.466063 21938 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.459395 21905 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:01.467087 21938 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:01.427249 21761 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.470500 21761 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:01.470916 21887 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:01.459332 21847 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.001s
W20260709 13:11:01.468137 21638 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:11:01.440802 21886 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.480005 21847 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.500934 21904 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:01.330229 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:01.543534 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 213118us
W20260709 13:11:01.546521 15199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.011s
W20260709 13:11:01.547215 15199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.011s
W20260709 13:11:01.553453 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.377707 15229 raft_consensus.cc:606] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:01.556908 15232 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:01.568877 21571 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:01.569706 21571 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.570209 21571 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:01.576896 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:01.578096 21204 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:01.578900 21886 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:01.584558 21547 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.585978 21547 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.633787 15229 raft_consensus.cc:614] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:01.651181 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:01.654279 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:01.672420 15379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3527) took 1870 ms (client timeout 2049 ms). Trace:
W20260709 13:11:01.673031 15379 rpcz_store.cc:269] 0709 13:10:59.801534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.801888 (+   354us) service_pool.cc:224] Handling call
0709 13:11:01.671897 (+1870009us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540014d2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:01.672136 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131649408}
I20260709 13:11:01.677733 21547 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:01.684607 16000 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:01.711570 15197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.006s	sys 0.033s
W20260709 13:11:01.712368 15197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.006s	sys 0.033s
I20260709 13:11:01.718405 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:01.719595 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 105671us
I20260709 13:11:01.719826 15382 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:01.720614 15303 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:01.722512 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 262767us
I20260709 13:11:01.729054 21845 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:01.729941 21845 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.730508 21845 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.732913 15231 raft_consensus.cc:2368] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
W20260709 13:11:01.734097 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 412698us
I20260709 13:11:01.738132 21940 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.705117 21886 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:01.745698 21886 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.750645 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:01.750962 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:01.739300 21940 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.731950 21847 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:01.764864 21952 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.112s	user 0.000s	sys 0.002s
I20260709 13:11:01.779184 15225 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:01.732136 21849 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.789490 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:01.790977 15225 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:01.793491 21849 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:01.810079 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57556.3us
I20260709 13:11:01.830824 21647 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.840649 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67754.8us
W20260709 13:11:01.820807 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92667.6us
I20260709 13:11:01.839109 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:01.854676 16000 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:01.846935 21886 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:01.838294 21647 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.864897 15225 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:01.869154 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:01.872921 15224 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:01.874063 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:01.876879 15301 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:01.868063 15225 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:01.885241 21906 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.996s	user 0.011s	sys 0.011s
I20260709 13:11:01.899132 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:01.900211 15380 raft_consensus.cc:2368] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23.
I20260709 13:11:01.899950 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:01.900460 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:01.901459 15381 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:01.883345 21547 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.905462 21637 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.906008 21547 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.906320 21637 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.901701 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:01.910363 21945 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 13:11:01.915656 15303 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:01.916293 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:01.921933 21875 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:01.929522 15225 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.930847 15225 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.934720 21637 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:01.934957 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2878) took 1143 ms. Trace:
I20260709 13:11:01.935581 21637 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.935523 15231 rpcz_store.cc:276] 0709 13:11:00.791528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.791766 (+   238us) service_pool.cc:224] Handling call
0709 13:11:01.934635 (+1142869us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54002d0d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:01.934863 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971537152}
W20260709 13:11:01.940994 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 105585us
I20260709 13:11:01.960990 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:01.962884 15377 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.967965 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:01.969031 15302 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:01.972486 21637 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.973268 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:01.975946 21875 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:01.976660 21547 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:01.976899 21875 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:01.979636 21875 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:01.919556 21906 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:01.991237 21746 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:01.991564 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:01.992530 21633 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.008s
I20260709 13:11:02.004535 21869 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.005635 21869 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:02.006717 21885 consensus_meta.cc:287] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.013s
I20260709 13:11:01.992161 21746 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.009171 21948 raft_consensus.cc:1064] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:11:02.000816 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:02.011821 15379 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:02.031311 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47390.5us
I20260709 13:11:02.038560 21901 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:11:02.040220 21875 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.034206 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.007496 21885 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.047031 21647 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.050194 21588 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:02.054188 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.057272 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:02.057353 15374 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.058351 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.059963 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3662) took 1380 ms. Trace:
I20260709 13:11:02.061066 15304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2676) took 1136 ms. Trace:
I20260709 13:11:02.041688 15231 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:02.071748 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2857) took 2438 ms. Trace:
I20260709 13:11:02.072862 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.074205 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3654) took 1457 ms. Trace:
I20260709 13:11:02.074952 15299 rpcz_store.cc:276] 0709 13:11:00.616820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.616954 (+   134us) service_pool.cc:224] Handling call
0709 13:11:02.073663 (+1456709us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54003e3ad4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:02.073981 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747111680}
I20260709 13:11:02.075491 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:02.076578 15305 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:02.078033 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:02.079519 21910 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.080248 21915 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.081184 21915 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.083702 21915 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.080121 21910 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.088371 21910 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.091194 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 2877) took 1300 ms. Trace:
I20260709 13:11:02.092108 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:02.103132 15303 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:11:02.097316 21875 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.105279 21849 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.097687 15376 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:11:02.096926 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:02.069495 15304 rpcz_store.cc:276] 0709 13:11:00.924609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.943526 (+ 18917us) service_pool.cc:224] Handling call
0709 13:11:02.060592 (+1117066us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54001d6854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:02.060829 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63452416}
I20260709 13:11:02.112751 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.091750 15232 rpcz_store.cc:276] 0709 13:11:00.791147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.800470 (+  9323us) service_pool.cc:224] Handling call
0709 13:11:02.090934 (+1290464us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54003c28d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:02.091104 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735171840}
I20260709 13:11:02.069103 15308 rpcz_store.cc:276] 0709 13:11:00.679265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.767402 (+ 88137us) service_pool.cc:224] Handling call
0709 13:11:00.767679 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.990676 (+222997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.059312 (+1068636us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400129b54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:02.059676 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511121664}
I20260709 13:11:02.098009 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:02.117542 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.106120 21940 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.133129 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:02.137214 15373 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:02.141158 15301 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:02.144150 21638 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.144979 21638 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.145788 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.146827 15232 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:02.148501 15382 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.149334 15381 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:02.131103 21646 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.151875 21646 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.154211 21875 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.154796 21646 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.126797 21588 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:02.072270 15226 rpcz_store.cc:276] 0709 13:10:59.614042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.616451 (+  2409us) service_pool.cc:224] Handling call
0709 13:10:59.620471 (+  4020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.780439 (+159968us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:59.780789 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.938937 (+158148us) log.cc:844] Serialized 14 byte log entry
0709 13:11:00.227847 (+288910us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18003c28c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:11:00.228094 (+   247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.228162 (+    68us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:00.228222 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.235772 (+  7550us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b18003c28c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:11:00.244764 (+  8992us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003c28c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:11:02.051785 (+1807021us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540012f7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:02.051897 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.052161 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":348284,"prepare.queue_time_us":5315,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":6029,"raft.queue_time_us":361430,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":19512,"spinlock_wait_cycles":444122880,"thread_start_us":90757,"threads_started":1,"wal-append.queue_time_us":174030,"wal-append.run_cpu_time_us":1544,"wal-append.run_wall_time_us":1029024}
I20260709 13:11:02.157003 21588 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.158847 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.160758 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:02.163096 15380 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.147912 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:02.143119 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.166182 15232 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
W20260709 13:11:02.176590 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 112497us
W20260709 13:11:02.177774 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.147816 21638 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.181779 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:02.187083 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:02.185084 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:02.188673 15308 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:02.189992 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.190387 15374 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:02.200703 15226 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:02.206998 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:02.212862 21541 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:02.213990 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.214767 15231 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:02.215739 15226 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 23.
I20260709 13:11:02.216728 15232 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 21.
I20260709 13:11:02.216014 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.227114 15382 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:02.165217 21910 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.250550 21746 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.250933 21910 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.252138 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3559) took 1124 ms. Trace:
I20260709 13:11:02.254463 21910 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.256668 21885 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:02.258327 21938 consensus_meta.cc:287] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.013s
I20260709 13:11:02.267110 15379 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
W20260709 13:11:02.230787 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 43921.9us
I20260709 13:11:02.235590 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:02.236107 21875 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:02.236876 15300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3663) took 1550 ms (client timeout 1633 ms). Trace:
I20260709 13:11:02.238794 16008 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:11:02.240995 21204 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:02.244886 21633 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:02.279842 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.252616 15373 rpcz_store.cc:276] 0709 13:11:01.127345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.131957 (+  4612us) service_pool.cc:224] Handling call
0709 13:11:02.251902 (+1119945us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400224f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:02.252059 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015897344}
W20260709 13:11:02.229353 21571 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.008s
I20260709 13:11:02.247570 21800 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:02.255772 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.267649 15305 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:02.260017 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.275756 15380 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:02.245779 15348 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:02.288199 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53466us
I20260709 13:11:02.248171 21541 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:02.290896 21802 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.291616 21802 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.291528 21541 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.295686 21875 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.296723 21482 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:02.297587 21482 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.280120 21204 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.299010 21204 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:02.300962 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.301949 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 166432us
I20260709 13:11:02.302147 21637 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.302949 21637 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.303603 21637 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.304754 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:02.271337 15300 rpcz_store.cc:269] 0709 13:11:00.686736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.693908 (+  7172us) service_pool.cc:224] Handling call
0709 13:11:02.236248 (+1542340us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540026c0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:02.236623 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733348736}
I20260709 13:11:02.305658 21646 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.306334 21646 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.212158 21845 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.309142 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:02.311167 21845 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.311311 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.312033 15233 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:02.313082 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.313866 15229 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:02.314911 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.315742 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:02.317548 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.318084 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.319662 15227 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:02.319832 21926 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:02.321749 21926 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.322232 21926 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.322650 21926 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.327193 15230 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:11:02.327857 15231 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:11:02.288446 21800 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.328735 15230 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:02.328806 21800 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:02.329761 21197 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.331326 15230 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:02.335796 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.335950 21633 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.338186 21633 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.339800 21953 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:02.340229 21953 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.340613 21953 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.352917 21906 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.353678 21886 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:02.354229 21886 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.312085 15232 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:02.358115 21886 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.355541 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:02.348838 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.352268 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:02.352236 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.322829 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.349489 21869 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.386211 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.354307 21626 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:02.390532 15379 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:02.372548 21906 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:02.348248 21948 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.369225 21571 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.410379 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:02.411252 16008 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:02.316087 15229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:02.416204 15229 raft_consensus.cc:606] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:02.416669 15229 raft_consensus.cc:614] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:02.397323 21906 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.415096 15373 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:02.391799 21885 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.396978 21482 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.420835 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:02.421573 15378 raft_consensus.cc:2376] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12. Re-sending same reply.
W20260709 13:11:02.424897 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 243459us
W20260709 13:11:02.430886 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.421557 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.434674 15377 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:02.436856 15224 raft_consensus.cc:2368] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:11:02.438623 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:02.441569 16008 raft_consensus.cc:2368] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
I20260709 13:11:02.447280 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.429677 21906 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.438647 21863 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:02.452224 21863 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:02.452775 21863 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:02.452917 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:02.453728 16007 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:02.408670 21626 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.456547 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.457518 21626 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.454244 15124 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.460220 21646 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.460904 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.460775 15124 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 12, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 12 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } }
I20260709 13:11:02.462459 21802 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.462817 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:02.459220 21875 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.461174 15273 leader_election.cc:400] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23.
I20260709 13:11:02.463809 15273 leader_election.cc:403] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:02.441092 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.469393 15348 leader_election.cc:400] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
I20260709 13:11:02.473294 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:02.480283 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 249714us
I20260709 13:11:02.483332 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:02.483907 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:02.472791 21637 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.477869 21482 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.494889 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.495998 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.473390 21626 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:02.505450 21950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.007s	sys 0.009s
I20260709 13:11:02.513811 21482 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:02.525415 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 160856us
I20260709 13:11:02.525290 21840 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:02.526322 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:02.526391 21840 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:02.527253 21840 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:02.527019 21953 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:02.525498 21903 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 1.123s	user 0.014s	sys 0.009s
I20260709 13:11:02.528949 21903 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.529438 21953 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.530949 21903 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.531690 15381 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.532716 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.533289 15374 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:02.533390 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.534157 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:02.534904 15374 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:02.535845 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.536425 15373 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 12.
W20260709 13:11:02.522156 21950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.007s	sys 0.010s
I20260709 13:11:02.537284 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.538914 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:02.525239 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:02.540656 21646 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.541016 15307 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:02.541365 21646 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:02.540912 21840 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.543026 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.543798 15378 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:02.493266 21875 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:02.534340 15380 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:02.542027 21646 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.558846 21482 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.559988 21646 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:02.545308 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52297.6us
I20260709 13:11:02.565276 21571 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.575287 21926 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:02.580596 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 137657us
I20260709 13:11:02.581609 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:02.582598 21869 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:02.583071 21869 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.583518 21869 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.583179 21800 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.589298 15348 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:02.502952 21802 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.590150 21802 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.592530 21802 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.550714 21840 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.463151 15124 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.594118 21800 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.582324 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:02.605018 15233 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:02.545498 15228 raft_consensus.cc:606] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:02.550058 21638 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:02.607254 21638 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:02.538398 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:02.595041 15124 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.608404 21638 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.610826 15124 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 13, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.557705 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:02.594671 21626 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:02.613154 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55503.6us
I20260709 13:11:02.613365 15375 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:02.615736 21626 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.616042 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:02.616770 21802 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.614785 15124 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:02.618201 15225 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.001s
I20260709 13:11:02.555858 21886 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.579614 21863 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.617170 15233 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 22.
I20260709 13:11:02.668985 15376 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:02.634225 21903 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.669173 15974 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:02.634987 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 45785.8us
I20260709 13:11:02.652396 21926 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.663385 21204 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.666155 15225 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:02.671527 15124 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 11, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 11 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:02.676100 21886 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.695124 15227 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
W20260709 13:11:02.693857 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 375854us
I20260709 13:11:02.688050 21800 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:02.659837 21906 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.704950 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:02.673463 21903 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:02.705044 15274 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.710743 15307 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 20: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:02.713313 15999 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 20: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:11:02.718286 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 102356us
I20260709 13:11:02.723929 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:02.723296 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.712831 21903 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.728466 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.733007 21529 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:02.733551 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.733789 21529 raft_consensus.cc:697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 22 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:02.733232 21482 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:02.734786 21529 consensus_queue.cc:237] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.789026 21886 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:02.789893 21626 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:02.793962 21910 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:02.735567 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:02.796203 21906 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:02.797086 15124 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 14, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:02.798106 21863 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:02.731295 21800 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:02.805006 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 73904.3us
W20260709 13:11:02.805876 21971 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:11:02.717905 21926 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:02.698545 21938 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:02.816978 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 89850.5us
I20260709 13:11:02.811465 21626 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.809974 21886 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.809412 21885 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.828194 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:11:02.831758 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 99136.9us
W20260709 13:11:02.836411 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.823027 21926 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.826489 21626 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.840306 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.846143 21204 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.848487 21802 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.849030 21802 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.849462 21802 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.843624 21885 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.855046 21885 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.855818 21885 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.857244 21869 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.862534 21800 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:02.832623 21886 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.846061 21856 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:02.862394 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:02.882803 15274 leader_election.cc:400] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:11:02.883276 15274 leader_election.cc:403] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:02.882242 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:02.884718 15227 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:02.843472 21926 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.871904 16000 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:02.893023 15304 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:02.826333 21938 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.899320 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:02.881758 21637 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:11:02.911159 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.888538 21197 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.917384 21968 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.921175 21863 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:02.921711 21863 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:02.922713 21863 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.896467 21869 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:02.894313 21875 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23.
I20260709 13:11:02.885972 21885 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:02.927019 16000 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:02.927237 21869 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:02.929253 21869 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:02.930208 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:02.934659 15304 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:02.928565 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:02.931553 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:02.945850 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49666us
I20260709 13:11:02.947750 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:02.924238 21863 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:02.951824 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72977.8us
W20260709 13:11:02.971926 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.972133 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:02.973984 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:02.980820 21631 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:02.908218 21800 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:11:02.985088 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:02.952607 21637 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:02.955437 21969 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:11:02.994835 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 259315us
W20260709 13:11:02.994815 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 100766us
I20260709 13:11:02.959005 21197 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:03.008018 21197 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:03.010161 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:03.010234 21938 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.012506 21646 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:03.013532 21646 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:02.855834 15124 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.018209 15308 raft_consensus.cc:2410] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:02.981720 21631 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:02.954311 21953 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:11:02.989952 21885 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:03.016469 21963 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.157s	user 0.000s	sys 0.002s
W20260709 13:11:03.051981 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56717.3us
I20260709 13:11:02.988617 21869 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.062234 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.026758 21910 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:03.055663 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:03.088976 21660 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.089638 21660 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:03.089785 21910 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.091825 21660 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.101348 16000 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:03.072094 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.103168 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.104010 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.104678 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.105206 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.106204 15305 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 20: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:03.108713 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:03.108933 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.109946 15233 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:03.112193 15227 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:11:03.065510 21885 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:11:03.123189 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.081614 21637 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:03.068502 21646 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:03.129730 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:03.050784 21903 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.131794 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.140651 21631 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:03.122866 21856 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:03.148376 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:03.149770 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:03.153993 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:03.154476 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.156980 15227 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:03.157239 15233 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:03.159938 15999 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:11:03.161450 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 106661us
I20260709 13:11:03.156100 15228 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:03.167205 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:03.167615 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:03.167996 21981 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:03.168630 15380 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:03.168491 21978 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:03.169044 21981 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:03.169492 21981 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:03.169322 21978 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.170677 21981 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.171918 21978 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.172698 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.173609 15377 raft_consensus.cc:2410] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:11:03.156591 21856 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.176607 21875 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:03.177217 21856 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.177253 21885 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:03.178292 21885 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.161890 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:03.180497 15973 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:03.193826 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67940us
I20260709 13:11:03.195510 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.199151 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:03.161178 21646 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:03.172161 21981 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:03.204197 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56109.1us
I20260709 13:11:03.154985 21626 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.219261 21977 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:03.196691 21889 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:03.194176 21637 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:03.222640 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:03.213804 15274 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:03.257694 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 43980us
I20260709 13:11:03.219738 21977 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:03.204056 21969 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:03.228508 21948 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.228742 21885 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.232867 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:03.265789 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:03.233899 21588 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:03.219764 21968 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19.
I20260709 13:11:03.235920 21869 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.237196 21638 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:03.238798 21903 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.201572 21875 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:03.253716 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:03.259032 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:03.268929 21953 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:03.288414 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:03.215651 21938 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:03.265779 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 291900us
I20260709 13:11:03.293330 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.218279 21646 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:03.309758 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.310170 15348 leader_election.cc:400] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
I20260709 13:11:03.310880 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:03.330713 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.312256 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.309233 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:03.310213 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 51250.4us
I20260709 13:11:03.308988 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:03.332155 15348 leader_election.cc:403] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:11:03.309154 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 223105us
I20260709 13:11:03.329783 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.335500 15227 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:03.335306 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.332267 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:03.334257 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.262306 21926 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.296523 21869 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:03.347280 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.356886 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:03.354789 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 144093us
I20260709 13:11:03.329671 21984 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:03.331069 21903 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.338742 21197 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:03.365787 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 160186us
I20260709 13:11:03.378695 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:03.377699 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 79861.9us
I20260709 13:11:03.366704 15304 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:03.351176 21906 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:03.380792 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.328856 21968 consensus_queue.cc:1059] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:11:03.351820 21869 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.334395 21938 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.355078 21885 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.346599 21985 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:03.400559 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54556.4us
I20260709 13:11:03.390307 15226 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:03.414245 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:03.401759 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54237.2us
I20260709 13:11:03.417095 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:03.382113 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.417737 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:03.381706 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 118215us
I20260709 13:11:03.419260 21983 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:03.419799 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.419996 21983 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:03.421535 21983 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.414258 15307 raft_consensus.cc:2368] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:11:03.376758 21984 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:03.403964 21869 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:03.442435 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.348845 21638 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:03.445148 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 61651.5us
I20260709 13:11:03.462386 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:03.464052 15307 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:03.468712 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44856.9us
W20260709 13:11:03.471580 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 89253.7us
I20260709 13:11:03.457620 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.286996 15124 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.473757 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.383040 21903 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.444571 21984 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.480252 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:03.459127 21985 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:03.465552 21708 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:03.488332 22000 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:03.379783 21637 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.455331 21996 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:11:03.489665 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.484582 21886 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.592s	user 0.014s	sys 0.002s
I20260709 13:11:03.380857 21977 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.491257 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.496107 21626 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.500710 21938 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.491762 21708 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:03.490419 21802 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.002s
I20260709 13:11:03.506958 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.398795 21969 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.516475 21903 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:03.517062 21646 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:03.574445 21197 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:03.575111 21197 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.575419 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.576186 15379 raft_consensus.cc:2368] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:03.577018 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.522965 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.579471 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.580605 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.580856 21697 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:03.581326 21697 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:03.581678 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.582625 21697 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:03.525728 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.580623 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.584903 15227 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:11:03.585071 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.585940 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:03.519217 15124 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 12, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 12 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:03.538832 15304 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 23.
I20260709 13:11:03.593309 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.512069 21886 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.546077 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.546698 21869 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:03.614730 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.615629 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.581378 21638 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:03.584381 15231 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:03.534622 21906 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:03.537788 15302 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:03.622287 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.589396 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:03.535158 21856 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.591986 15230 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:03.592278 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:03.601394 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 182122us
I20260709 13:11:03.608987 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:03.609622 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.536667 21708 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.591658 21903 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:03.614230 15379 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:03.610710 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 126473us
W20260709 13:11:03.616901 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 139185us
I20260709 13:11:03.618175 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.619081 15300 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:03.619616 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.623685 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:03.618541 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:03.625379 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.623602 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.623114 15380 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:03.628899 15377 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:03.638855 15273 leader_election.cc:400] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:03.610549 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.634140 15376 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:03.640071 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:03.633800 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 199627us
I20260709 13:11:03.540848 21802 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.648370 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.637346 15999 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
W20260709 13:11:03.651443 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62160.4us
I20260709 13:11:03.621827 21697 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.628607 21906 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:03.653093 15226 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:03.653683 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:03.649811 15304 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:11:03.659019 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:03.660557 22002 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:03.662504 22005 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:11:03.663602 21926 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:03.664948 21995 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:11:03.665758 21992 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:03.658061 21968 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:03.667244 21968 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.643994 21626 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:03.674863 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.684949 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44977.3us
I20260709 13:11:03.687784 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:03.693269 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:03.696516 15306 raft_consensus.cc:2368] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:11:03.702525 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:03.698196 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:03.707309 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:03.708400 15375 raft_consensus.cc:2368] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21.
I20260709 13:11:03.702608 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:03.668304 21856 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:03.710587 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57038.9us
I20260709 13:11:03.711411 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:03.714071 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:03.714797 15373 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.717087 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:03.718293 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:03.719148 15375 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:03.719923 21910 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:03.720182 21889 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:03.720604 21910 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:03.720757 21889 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:03.723080 21889 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:03.691923 21926 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:03.727557 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:03.692795 21646 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:03.650970 21903 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:11:03.696060 21978 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:11:03.816293 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 104961us
I20260709 13:11:03.828233 15345 leader_election.cc:400] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:11:03.786407 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:03.708271 21985 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:11:03.787279 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77215.9us
I20260709 13:11:03.846242 15375 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:03.807503 21541 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:03.808848 22010 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:03.856051 21863 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.004s
W20260709 13:11:03.867415 22006 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:11:03.813199 21646 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:04.079898 21197 consensus_meta.cc:287] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.000s
I20260709 13:11:03.695660 15124 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:04.048988 22008 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:11:04.062808 21541 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:04.084810 21541 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.085882 21646 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:04.086176 21984 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.004s
I20260709 13:11:04.086731 21984 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.088070 15301 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:04.088891 21802 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:03.859786 21885 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18.
I20260709 13:11:04.039331 21982 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:04.091637 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 247581us
I20260709 13:11:03.872759 21983 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.037886 22003 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:03.854887 21926 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.077629 21903 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:04.083209 15124 catalog_manager.cc:5697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 14, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:11:04.143263 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 415766us
I20260709 13:11:04.102145 15196 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:04.106788 15377 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:04.121784 21906 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:04.136361 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 308228us
I20260709 13:11:04.136157 15373 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:04.143621 22018 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:04.086758 22012 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.194s	user 0.002s	sys 0.002s
I20260709 13:11:04.080310 21197 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:04.143180 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 455418us
I20260709 13:11:04.099419 15376 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:04.118862 21541 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:04.135463 21885 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.156978 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.156978 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.151960 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:04.161682 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59621.1us
I20260709 13:11:04.165377 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:04.171197 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:04.172032 15304 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:04.158361 22015 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:11:04.183974 15229 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:04.185528 15230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:04.186460 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:04.155151 21869 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:04.155010 21886 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:04.192602 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.186112 15230 raft_consensus.cc:606] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:04.196837 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:04.187877 21708 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:11:04.181962 21863 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:04.148532 21983 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.202759 15198 leader_election.cc:400] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21.
I20260709 13:11:04.205482 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:04.208874 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51965.2us
I20260709 13:11:04.182916 21978 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.211812 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.185619 21981 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:04.212945 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56048.6us
I20260709 13:11:04.218917 22024 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.219928 22017 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:04.220396 22017 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.220744 22017 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:04.223613 22027 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:04.175836 21885 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:04.198683 21938 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:04.223104 21998 raft_consensus.cc:3055] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:04.251695 16007 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 22 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:04.224766 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.235400 22007 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:04.215086 21926 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.159173 22018 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.216238 21977 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.263226 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.264930 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.248842 21197 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.249336 21800 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.246762 21980 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.210922 21708 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:04.283538 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:04.266357 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.226897 21646 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.295435 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.257912 21998 raft_consensus.cc:740] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:04.259467 21984 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.228871 21981 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:04.225332 21978 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.250177 21802 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:11:04.278048 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 112746us
I20260709 13:11:04.353601 15225 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:04.403313 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 107952us
I20260709 13:11:04.404287 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.329958 15304 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:04.405872 15230 raft_consensus.cc:1217] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Deduplicated request from leader. Original: 20.14->[21.15-21.15]   Dedup: 21.15->[]
I20260709 13:11:04.406498 15230 raft_consensus.cc:1240] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:11:04.406780 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3599) took 1254 ms. Trace:
I20260709 13:11:04.275995 21869 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.407748 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:04.409269 15232 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.402323 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.379418 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:04.407384 15376 rpcz_store.cc:276] 0709 13:11:03.152508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.152690 (+   182us) service_pool.cc:224] Handling call
0709 13:11:04.406613 (+1253923us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400080554. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:04.406725 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072092544}
I20260709 13:11:04.250891 22027 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.274907 21626 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.314838 21980 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.296844 21800 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.417980 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:04.279304 22024 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.420722 15226 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:04.421272 15227 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:04.417615 15231 raft_consensus.cc:2368] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:04.278568 21969 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.426559 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:04.319460 21863 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:04.296064 21886 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.441252 21626 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:04.442924 22030 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:11:04.370237 21985 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.365674 22018 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.314157 21903 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:04.273041 21926 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.408190 21906 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:04.433207 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:04.435762 22032 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.436586 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:04.364526 22026 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:04.280184 21938 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:04.438491 15232 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:04.438898 21969 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:04.425949 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 146667us
I20260709 13:11:04.471715 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:04.278468 21996 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:11:04.481335 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:04.450251 21984 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.480367 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:04.446493 21869 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.482959 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:04.422689 21541 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:04.412465 21646 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.486123 16007 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:04.491173 15230 raft_consensus.cc:2368] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:11:04.494944 15198 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:04.501408 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:04.504593 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:04.505669 21980 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:04.506477 21968 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.507283 22039 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:04.507872 22039 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:04.508807 22039 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.475834 22026 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.516652 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:04.440174 21863 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:04.519901 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 117692us
I20260709 13:11:04.526798 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.492388 22018 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:04.560258 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:04.467020 21985 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.561434 16000 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:04.500391 22038 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.517351 21983 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:04.519016 21968 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.529762 21980 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:04.528589 22026 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:04.280401 15124 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 12 to 14, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.575241 21197 raft_consensus.cc:993] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:11:04.581867 21197 raft_consensus.cc:1081] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:11:04.500070 21984 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.580121 22027 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:04.578583 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 174365us
I20260709 13:11:04.559890 21885 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:04.583489 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:04.590719 15308 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:04.588116 21926 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.594112 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.565439 22018 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:04.620870 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 130574us
I20260709 13:11:04.633813 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:04.575567 21708 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:04.659475 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 65065.2us
I20260709 13:11:04.660511 15274 leader_election.cc:400] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:04.660823 15274 leader_election.cc:403] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:04.650107 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:04.649961 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:04.651229 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 136176us
W20260709 13:11:04.667847 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73835.9us
I20260709 13:11:04.668619 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.666465 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:11:04.669793 22028 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:04.670050 21646 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.670559 22040 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.671108 22040 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.671340 21983 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:04.672690 21983 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.674230 21926 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:04.678851 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:04.686559 16000 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
W20260709 13:11:04.689090 22042 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:11:04.690174 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:04.574303 22038 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.695176 22038 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.696659 15307 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:04.696854 21981 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:04.697841 22017 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.700029 22017 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:04.688987 22037 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:04.589887 21968 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.701998 21978 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:04.704107 21800 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.704478 21541 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:04.704702 22043 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:04.687500 21906 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:04.663661 22041 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.705268 21637 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:04.658802 22027 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:04.519547 21998 consensus_queue.cc:260] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:04.709288 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:04.706634 21985 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.718031 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:04.719813 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 59422.3us
I20260709 13:11:04.680367 21885 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:04.731513 22043 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:04.750702 15308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:11:04.751516 15308 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.751675 22043 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:04.752000 15308 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.745999 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:04.724228 21984 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.767362 21984 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:04.767926 21984 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:04.726286 21968 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.768833 21984 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:04.776189 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58251.8us
I20260709 13:11:04.776446 22044 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.777635 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.778880 22017 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:04.781694 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:04.780524 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.802059 21885 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:04.811365 15345 leader_election.cc:400] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17.
I20260709 13:11:04.720661 22037 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:04.821422 22037 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.725361 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:04.722661 21983 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:04.727082 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:04.733678 22041 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.734242 21998 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:04.831508 22041 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:04.734445 22046 consensus_queue.cc:1175] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5c70ddb5aae14b059dc90fd40125b034" responder_term: 22 status { last_received { term: 22 index: 16 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:04.735378 21856 raft_consensus.cc:993] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:11:04.832446 21856 raft_consensus.cc:1081] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:11:04.832581 22045 consensus_queue.cc:1175] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0f9eceec749442cb9a06c87f00f3caf" responder_term: 22 status { last_received { term: 22 index: 16 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: [21.15-21.15]" } } last_received_current_leader { term: 22 index: 16 } }
I20260709 13:11:04.736011 22027 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.835116 22027 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.737594 21906 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:04.836404 21906 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.738983 21541 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:04.730486 21708 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:11:04.867589 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3610) took 1143 ms. Trace:
I20260709 13:11:04.698943 15124 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 8 to 10, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.841650 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.868140 15377 rpcz_store.cc:276] 0709 13:11:03.700109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.811527 (+111418us) service_pool.cc:224] Handling call
0709 13:11:03.853272 (+ 41745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.146496 (+293224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.843041 (+696545us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400224f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:04.843302 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581801856}
I20260709 13:11:04.872997 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.874209 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.875185 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.876286 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.876653 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.877528 15307 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 12.
I20260709 13:11:04.878628 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.880801 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.880095 21885 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.882926 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.885386 21885 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.885850 16008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 928) took 1685 ms. Trace:
I20260709 13:11:04.887189 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:04.887080 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:04.896811 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:04.897842 15306 raft_consensus.cc:2368] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:11:04.899127 15379 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:04.907114 15375 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:04.886245 16008 rpcz_store.cc:276] 0709 13:11:03.200684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.201145 (+   461us) service_pool.cc:224] Handling call
0709 13:11:03.212748 (+ 11603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.336803 (+124055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.336851 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.347637 (+ 10786us) log.cc:844] Serialized 26 byte log entry
0709 13:11:03.614809 (+267172us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:03.614846 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.614906 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.866520 (+251614us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:04.881987 (+1015467us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b24002eb1b8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a77fb0 00007f2f536ee488 00007f2f536eebe8 00007f2f536c6398 00007f2f536c176a 00007f2f536c0bb6
0709 13:11:04.885631 (+  3644us) raft_consensus.cc:1685] finished
0709 13:11:04.885650 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.885777 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103764,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":17625,"spinlock_wait_cycles":22884480,"thread_start_us":286027,"threads_started":2,"wal-append.queue_time_us":259136}
W20260709 13:11:04.916814 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.918061 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:04.921741 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:04.922014 22026 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.922369 15303 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:04.929144 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.930378 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.931063 15382 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:04.931689 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.876303 21983 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.933046 21983 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.935111 21983 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:04.880568 22043 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:04.886656 21977 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.000s
I20260709 13:11:04.944999 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.947816 15375 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:04.945715 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.945127 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.953459 22043 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.952562 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:04.955919 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:04.956698 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.957237 15345 leader_election.cc:400] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:11:04.929294 15303 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:04.957708 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.957971 15345 leader_election.cc:403] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:04.959545 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.959699 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.961052 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.951133 15308 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.962095 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.954838 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:04.963307 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.966074 15379 raft_consensus.cc:2368] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:04.966624 15380 raft_consensus.cc:2368] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:11:04.969064 16008 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:11:04.924283 22026 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.971483 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.974625 15379 raft_consensus.cc:2410] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:04.974963 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:04.976955 15308 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.971129 22027 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:11:04.984238 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:04.986590 22025 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.988937 22018 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:04.990270 22018 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.968694 22017 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:11:04.993602 21969 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:04.954885 21977 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.989341 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:04.995843 21938 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:04.995663 21708 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.997360 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:05.000562 21708 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:04.968936 22043 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.967257 21983 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:05.001561 21983 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:05.002020 21983 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:05.004801 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:05.004381 15124 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 11, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.006137 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2843) took 1422 ms. Trace:
I20260709 13:11:05.006582 15229 rpcz_store.cc:276] 0709 13:11:03.583769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.583896 (+   127us) service_pool.cc:224] Handling call
0709 13:11:03.584166 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.191139 (+606973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.005875 (+814736us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540043ba54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:05.006054 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373960960}
I20260709 13:11:05.007491 15230 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:05.008037 15233 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:05.007535 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.009133 15227 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:05.009087 15124 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 5 to 10, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.010605 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.011436 21910 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.011168 15124 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 6 to 8, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 8 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.012530 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.012694 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.013774 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.015027 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:05.015455 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.016677 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.016852 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1142) took 1527 ms. Trace:
I20260709 13:11:05.017578 21885 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.018129 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.018409 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:05.019410 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.019972 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.020639 15228 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:05.021230 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.021893 15230 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:05.022212 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.022831 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.018169 21885 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:05.023496 22040 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:05.023970 21977 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:05.026651 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:05.027196 15226 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.027460 15226 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:05.028910 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.017278 15225 rpcz_store.cc:276] 0709 13:11:03.489027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.489233 (+   206us) service_pool.cc:224] Handling call
0709 13:11:03.497799 (+  8566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.402174 (+904375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.016637 (+614463us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54002d0854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:05.016798 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967750400}
I20260709 13:11:05.028242 15226 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.033409 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.033636 15226 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.043074 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.043957 15229 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:05.044499 15273 leader_election.cc:400] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:05.054348 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.061196 15348 leader_election.cc:400] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 13. Current term is 14.
I20260709 13:11:05.061934 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:05.055516 15273 leader_election.cc:400] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:11:05.063046 15273 leader_election.cc:403] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:05.060513 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:05.029735 21885 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:05.036531 21903 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.105079 15301 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:05.079839 21969 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:05.082767 22028 log.cc:927] Time spent T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:11:05.109375 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:05.113715 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.065459 22026 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:05.045238 22040 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:11:05.117532 15304 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:05.174584 15305 raft_consensus.cc:1275] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:05.177802 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.178812 21885 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:05.218360 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51517.4us
I20260709 13:11:05.044984 21571 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:11:05.101217 21993 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
W20260709 13:11:05.224208 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 113897us
I20260709 13:11:05.226573 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:05.225807 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 146773us
I20260709 13:11:05.075675 22043 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:11:05.100864 22027 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 13:11:05.307909 15226 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:05.238546 15381 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:05.351971 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.236941 15306 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:05.285149 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:05.372596 15376 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:05.412768 15379 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:05.359720 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 123512us
I20260709 13:11:05.331240 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:05.169099 22045 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:05.426374 15382 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:05.316891 22058 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:11:05.354971 22036 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:05.431309 21863 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:11:05.397082 21938 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:05.180089 21903 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.438815 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.382133 22007 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.226791 21910 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:05.449177 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.279227 22025 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.452649 15377 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:11:05.456314 15377 pending_rounds.cc:85] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 9
I20260709 13:11:05.456578 15377 pending_rounds.cc:107] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:11:05.456841 15377 raft_consensus.cc:2889] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.454082 21903 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.337175 22044 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:11:05.458030 22044 consensus_queue.cc:1243] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:05.458735 22044 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.459039 22044 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:05.459849 22026 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.459846 22044 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.461971 22044 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.443748 22027 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:11:05.431236 21977 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:05.466336 15226 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:05.470880 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:05.471798 15226 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:05.335770 21983 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:05.258168 22047 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.227s
I20260709 13:11:05.336115 21982 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
I20260709 13:11:05.475136 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.473426 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.464232 22043 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.481794 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.482620 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.354971 22011 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.478163 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.432060 22045 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.487870 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.490402 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.477202 21910 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:05.492132 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.489478 15306 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:05.494434 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.495106 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.495896 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:05.498042 15227 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.474036 21631 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:11:05.495707 22043 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.500993 21631 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:05.501374 21631 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:05.502205 21631 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:05.503324 21631 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.504717 22040 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:05.506028 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.506361 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:05.495023 15230 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
W20260709 13:11:05.510978 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.466709 22007 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:05.511130 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.479579 21903 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:05.467386 22025 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.326574 15124 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.522733 21903 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.516708 22040 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:05.536700 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.484634 21977 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.539630 21903 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.505297 21910 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:05.549688 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54667.2us
I20260709 13:11:05.554169 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:05.553860 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 489545us
I20260709 13:11:05.559056 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.559911 15378 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:05.560952 21885 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:05.561578 21885 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.562017 21885 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.562299 15382 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:05.569754 21885 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.547382 22017 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:05.577661 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:05.585357 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:05.590934 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.549196 22018 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:05.599319 15307 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:05.600138 15305 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:11:05.600912 15305 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.601365 15305 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.609712 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.613996 15274 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.578547 22040 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:05.586009 22047 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.547842 22011 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.617244 15299 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:11:05.616210 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 128120us
I20260709 13:11:05.586294 21697 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:11:05.610263 21637 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.598575 22018 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:05.621372 21969 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.591564 22027 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.614193 21926 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:05.618883 15274 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:05.616501 21984 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:05.674058 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 167437us
I20260709 13:11:05.589011 22017 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.670529 15308 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:11:05.694882 15305 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.697027 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:05.717568 15300 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:05.696457 22040 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:05.688486 22027 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:05.719667 22040 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:05.719899 22027 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.720185 22040 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.723438 21990 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:05.723979 21990 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:05.725951 22011 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:05.676841 21637 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:05.726643 21637 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.727321 15305 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:05.728238 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:05.728071 22040 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.730065 22040 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:05.730453 22077 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.731045 22077 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.739112 21938 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:05.684056 15124 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 12, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 12 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:05.743863 15124 catalog_manager.cc:5697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.745409 15124 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.679149 21983 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:05.746856 15124 catalog_manager.cc:5697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.748176 21983 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.748556 21885 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.748600 21983 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:05.750376 21983 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:05.751133 22045 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:05.752158 21977 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:05.757031 22072 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:05.757099 15227 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:05.757869 15381 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
W20260709 13:11:05.695559 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 76560.4us
I20260709 13:11:05.763729 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:05.764122 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 67196.9us
I20260709 13:11:05.718264 22075 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:05.780326 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.781239 15232 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 23: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:05.783354 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:05.784258 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:05.770033 22026 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:05.770781 22040 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:05.765682 21969 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:05.790993 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.812589 15227 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:11:05.792371 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.771787 22007 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.794729 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:05.819100 15228 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:05.795368 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:05.770208 22043 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:05.772389 21926 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.801041 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:05.800093 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.806813 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:05.807900 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.819416 15228 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:05.819404 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:05.828617 15301 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.825357 15380 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.796330 22026 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:05.835821 21926 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:05.836539 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.787927 22025 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:05.838145 21926 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:05.838618 22017 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.840704 22070 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:05.778857 22075 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.849629 22075 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.852876 22077 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:05.822356 22023 consensus_queue.cc:1048] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:11:05.861209 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:05.864311 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.864686 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.862011 15375 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:05.866710 15378 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:11:05.867251 15378 pending_rounds.cc:85] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 11
I20260709 13:11:05.867527 15378 pending_rounds.cc:107] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:11:05.867802 15378 raft_consensus.cc:2889] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.868155 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:05.870412 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:05.875397 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.865324 15299 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:05.873637 15228 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.896699 15228 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.902359 22086 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:05.935340 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:05.935628 22040 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:05.936045 15302 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:11:05.936866 22040 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.938920 21990 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:05.943518 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 47614.5us
W20260709 13:11:05.946223 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 265869us
I20260709 13:11:05.890596 22007 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:05.834097 21999 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:11:05.823801 21969 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:05.947376 15274 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.814460 22018 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:05.910588 22046 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:05.981817 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.981753 22011 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:11:05.896453 21482 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 13:11:06.005697 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55540.6us
W20260709 13:11:06.006600 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57153.8us
I20260709 13:11:06.013741 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.015420 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.018615 15302 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:05.954869 22007 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:06.021844 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 124653us
I20260709 13:11:06.023533 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:05.945291 21529 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:11:05.985167 22046 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:06.039754 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.040962 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:06.041530 15229 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:05.901067 22026 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:06.014772 22047 consensus_queue.cc:1175] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 17 status { last_received { term: 17 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 17 index: 10 } }
I20260709 13:11:06.026705 21977 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:06.052440 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.026923 22007 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.025134 22017 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.037851 22079 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.042831 22078 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.037106 21984 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:06.058130 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.043985 22046 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:06.054214 21631 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.550s	user 0.003s	sys 0.012s
W20260709 13:11:06.073356 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65251.5us
I20260709 13:11:06.079874 21984 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.095530 21969 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:06.096952 21984 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:06.048244 21885 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.097782 21885 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.079612 22077 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.092281 21977 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.099213 15379 raft_consensus.cc:1240] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:06.099550 21977 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.084017 22089 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.057806 22102 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:06.093286 21903 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.002s
I20260709 13:11:06.048507 21863 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:06.094985 15380 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
W20260709 13:11:06.126395 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 99161us
I20260709 13:11:06.099645 21637 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.159317 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:06.163774 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 216461us
I20260709 13:11:06.160262 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:06.158914 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:06.164664 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.047343 22027 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.058089 22075 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:06.167263 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64674.5us
W20260709 13:11:06.172672 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 311817us
I20260709 13:11:06.163683 22077 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.185438 15307 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:06.186352 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:06.169133 21984 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:06.188624 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:06.192458 22075 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.193030 22075 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.195053 22075 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.195526 22075 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.196149 15379 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:06.101179 21910 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:11:06.171021 22089 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:06.202477 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:06.155220 22100 consensus_queue.cc:1059] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:06.155550 21903 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.178508 21969 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:11:06.220695 15228 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:06.074085 22079 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.195966 22075 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.229089 15301 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:06.229784 15305 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:11:06.231086 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 178752us
I20260709 13:11:06.232543 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:06.234822 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:06.236030 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:06.236791 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.238201 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:06.239048 15231 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:06.167208 21863 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.189693 21984 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:06.241490 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:06.242439 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:06.244693 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:06.244132 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:06.227988 22079 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:06.248937 15227 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:11:06.253865 15227 pending_rounds.cc:85] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 14
I20260709 13:11:06.254241 15227 pending_rounds.cc:107] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:11:06.254558 15227 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.254971 15232 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:06.204535 22105 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:06.173852 22102 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:06.266063 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.201314 22077 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.251160 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:06.277221 21637 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.278142 21984 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.283757 22027 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.286664 15306 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:06.271948 22105 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.296029 21638 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:06.296597 21638 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:06.296784 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:06.297632 15375 raft_consensus.cc:2393] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:06.299564 21977 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.247094 22113 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:06.303193 22027 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.297667 21638 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:06.305899 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.303740 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52711us
I20260709 13:11:06.320209 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:06.328917 15348 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.324119 22113 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:06.332207 22046 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.332840 22113 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.334749 22046 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.330945 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:06.337821 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:06.338456 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:06.338590 15379 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.330309 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:06.339383 15306 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:11:06.341816 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.368070 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.443720 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:06.319883 16005 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:06.445043 15380 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:06.447603 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.452070 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84155.3us
I20260709 13:11:06.453485 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:06.331727 21638 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.457615 15301 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:06.459141 15999 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:06.460418 15233 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:06.491173 22122 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:06.491876 22122 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.492667 22122 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.305514 22109 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.324193 22022 raft_consensus.cc:3055] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:06.321360 22003 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.314684 21983 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.513005 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:06.311331 21863 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:06.313297 22102 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.313619 22105 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.396834 22084 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:06.527947 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.308249 21977 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 13:11:06.312798 22027 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.520291 22022 raft_consensus.cc:740] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:06.518767 22109 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.496275 22079 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:06.519965 22003 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:06.557898 15379 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:06.536645 22125 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.544355 22077 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.577312 22027 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.553802 22109 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.584088 21910 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.584859 21910 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.588393 21910 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.585780 22084 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.588027 22022 consensus_queue.cc:260] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.589607 22105 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:06.546773 22000 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:11:06.597577 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 144187us
I20260709 13:11:06.556589 22079 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:06.603612 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52492.5us
I20260709 13:11:06.609618 15378 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:06.556860 22044 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.597828 22027 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.636994 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:06.644572 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:06.647146 15378 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:06.637171 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:06.629271 22079 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:06.647823 22101 consensus_queue.cc:1175] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260709 13:11:06.641000 22044 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.643762 22125 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.643512 22113 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:06.689196 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:06.691052 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:06.650715 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:06.684729 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48372.6us
I20260709 13:11:06.685262 22040 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:06.651588 22007 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.002s
I20260709 13:11:06.648916 22022 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.692276 15301 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
W20260709 13:11:06.692862 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.693075 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:06.646279 22077 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.694591 22113 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.696099 22110 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.696625 22125 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.618526 22084 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.701256 22026 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:06.688633 22128 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:11:06.708091 22123 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:11:06.710006 15308 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:06.713038 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:06.714241 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:06.643162 22027 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.721386 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:06.725931 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:06.719415 22007 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:06.749267 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.732089 22110 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:06.732097 22086 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.732291 22040 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:06.793624 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.744927 21948 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.750643 21999 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.817837 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 478135us
I20260709 13:11:06.818892 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.732959 22077 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:06.827683 22135 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:11:06.812237 21948 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.831787 21948 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:06.834640 22075 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:06.807543 21982 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.808271 22105 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.857420 22105 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.859835 22105 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.862752 22027 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:06.775013 21926 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:06.850943 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2933) took 1372 ms. Trace:
I20260709 13:11:06.851774 22040 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.852409 22003 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.852931 22110 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.856621 22075 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.864627 21938 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.865741 22018 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.868741 22125 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.870204 22084 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.872423 22113 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.807183 22086 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.896006 15225 rpcz_store.cc:276] 0709 13:11:05.478903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.479012 (+   109us) service_pool.cc:224] Handling call
0709 13:11:05.479274 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.551097 (+ 71823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.551140 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.553627 (+  2487us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.772849 (+219222us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:05.772895 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.846553 (+1073658us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b54000e79d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:06.846608 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.846652 (+    44us) raft_consensus.cc:1685] finished
0709 13:11:06.846667 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.850873 (+  4206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":27560,"spinlock_wait_cycles":129355136,"thread_start_us":159158,"threads_started":1,"wal-append.queue_time_us":225701,"wal-append.run_cpu_time_us":2176,"wal-append.run_wall_time_us":1003260}
I20260709 13:11:06.897262 15348 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:06.849128 21982 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.912750 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:06.923877 15375 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:06.825086 21999 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.900954 22128 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.898954 22078 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.954878 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:06.956112 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 58931.4us
W20260709 13:11:06.959729 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.965458 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.967974 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:06.972370 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:06.898303 21926 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:06.923485 21982 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.918794 22086 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.982224 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.967672 22125 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:06.986488 22125 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.989015 22125 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.926467 21903 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:06.991254 15373 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:11:06.974996 22116 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.968879 22075 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:07.013458 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.017069 15305 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:06.967064 22084 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:07.007061 22092 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.983300 22047 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:07.052268 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 204056us
I20260709 13:11:07.019402 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:06.920451 21938 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:06.967875 22128 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.099396 15379 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:11:07.108868 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 126883us
I20260709 13:11:07.128540 21885 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.140594 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:07.152959 15381 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:07.154493 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:07.155870 15378 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:07.138500 15373 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 7 to 9, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:07.164113 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:06.975648 22078 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.177690 15374 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:07.187496 21983 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:07.176635 22075 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:07.189373 22075 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.146121 22125 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.159107 22076 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.009536 22116 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.148242 22044 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.212986 22077 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.085886 22092 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:07.218851 22075 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.021430 22139 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.176s
I20260709 13:11:07.059806 22084 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.022687 22109 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.200253 21996 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.261432 21697 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.262485 22007 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.267422 22078 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:07.236264 22079 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.001s
I20260709 13:11:07.272302 22044 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:07.232327 22111 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:07.238308 22027 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:07.299058 22044 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:07.272857 22077 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:07.300266 21885 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:11:07.296638 21697 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:07.327229 22044 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:07.327519 21697 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:07.233897 22076 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.298394 22079 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.370113 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.658888 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.659576 22092 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:07.660027 22044 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.660765 21938 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.675174 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.682793 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.290953 21996 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.687299 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:07.702577 15299 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:07.688679 22086 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.006s
I20260709 13:11:07.688905 22116 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:07.693037 22076 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:07.695044 22084 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.700253 15308 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:07.337849 22128 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.708171 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.316545 22111 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.713627 15377 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:07.715024 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.718034 15308 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:11:07.730023 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.054s	sys 0.141s
W20260709 13:11:07.734019 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.055s	sys 0.141s
W20260709 13:11:07.734565 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 726848us
I20260709 13:11:07.736001 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:07.320820 22022 consensus_meta.cc:287] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.009s
I20260709 13:11:07.702128 22092 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:07.770164 15197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.080s	sys 0.151s
I20260709 13:11:07.339941 22027 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.705325 21999 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:07.794140 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:07.770952 15197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.080s	sys 0.151s
I20260709 13:11:07.802361 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.802788 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.804071 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.804819 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:07.805505 15228 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.808636 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.711558 22047 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:07.785986 22092 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.808887 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.808887 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:07.780522 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44692.4us
I20260709 13:11:07.819306 15228 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:07.800411 15381 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:07.813012 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.050s	sys 0.095s
I20260709 13:11:07.811510 15299 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
W20260709 13:11:07.820941 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.050s	sys 0.095s
I20260709 13:11:07.733641 22116 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:07.703061 22044 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:07.758523 22084 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:07.831732 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.832638 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.833547 15226 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
W20260709 13:11:07.821514 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 654100us
W20260709 13:11:07.809890 22122 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.317s	user 0.014s	sys 0.001s
I20260709 13:11:07.750731 22128 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:07.841092 15229 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:07.822350 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:07.710333 22086 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.333740 22077 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:07.826332 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:07.771572 21938 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:11:07.856174 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.885546 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.838924 22084 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:07.834785 22047 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.887848 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.889894 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.834444 22116 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:07.886356 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.869845 15306 raft_consensus.cc:2368] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:07.884032 15379 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:11:07.838343 22040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.066s	sys 0.086s
I20260709 13:11:08.004105 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:07.889758 21996 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:07.860956 22077 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:07.849426 22102 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.011351 22113 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.875654 22111 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:07.876582 22079 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.013147 22113 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:07.847554 22027 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.014473 22084 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.014657 22047 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:07.869438 22086 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:08.000159 15373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.012s	sys 0.014s
W20260709 13:11:08.015990 15373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.012s	sys 0.014s
I20260709 13:11:08.016005 22113 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.971997 22092 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:08.012130 22040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.067s	sys 0.087s
I20260709 13:11:07.987464 22043 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:07.908787 15305 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
W20260709 13:11:07.958608 15348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.041s	sys 0.030s
W20260709 13:11:08.023258 15348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.043s	sys 0.030s
W20260709 13:11:08.023692 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 846097us
I20260709 13:11:08.024296 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.016271 15303 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 8.
I20260709 13:11:07.887362 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:08.011106 22116 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:08.026849 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 139600us
I20260709 13:11:07.872933 22109 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:07.847985 22122 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:07.943365 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:07.975901 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:07.886103 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:08.001897 22026 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.244s	user 0.018s	sys 0.001s
W20260709 13:11:07.935031 21982 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.930s	user 0.007s	sys 0.006s
I20260709 13:11:07.875278 22076 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:08.039915 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.041464 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.036286 15228 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:07.866346 22044 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:07.861920 21938 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:07.867298 21697 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.171s
I20260709 13:11:07.854871 22128 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.102386 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:08.054736 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:08.045104 15300 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 23.
I20260709 13:11:08.096423 15301 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:08.047123 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.124260 15308 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.124917 15299 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:08.108594 22079 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.118091 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3670) took 1221 ms. Trace:
I20260709 13:11:08.127282 22077 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.127620 22079 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.128146 22077 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.131796 22017 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.031790 22047 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:08.134860 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3664) took 1447 ms. Trace:
I20260709 13:11:08.135628 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.101917 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.137681 15232 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:08.135667 15377 rpcz_store.cc:276] 0709 13:11:06.687320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.687489 (+   169us) service_pool.cc:224] Handling call
0709 13:11:06.687834 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.714245 (+1026411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.132035 (+417790us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540023ebd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:08.134780 (+  2745us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351262464}
I20260709 13:11:08.142618 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.142618 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.126921 15382 rpcz_store.cc:276] 0709 13:11:06.896545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.897183 (+   638us) service_pool.cc:224] Handling call
0709 13:11:06.897742 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.181779 (+284037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.181832 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.181896 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:07.182239 (+   343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.117725 (+935486us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540023f0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:08.117794 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.117998 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652523776}
I20260709 13:11:08.152149 15228 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:08.152434 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.151618 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.150866 15232 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:08.161125 15225 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:08.029836 22102 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.178752 22102 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.168315 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.149286 22079 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.180946 22079 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:08.181196 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.149647 21938 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:08.182613 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.182699 21938 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.184732 22044 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:08.185300 22027 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.186133 22027 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.100536 22109 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.187384 22109 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.029755 22043 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.191769 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.192101 22122 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:08.105947 21926 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.184286 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.193245 15308 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:08.134694 21982 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.185523 22044 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:08.132799 22143 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.193593 22043 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.042850 22111 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.129s
I20260709 13:11:08.195762 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.169670 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.148792 22017 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.196321 22079 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:08.196620 22109 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.206908 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:08.165611 22040 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.214391 15225 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:08.219997 15274 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.029s
W20260709 13:11:08.222479 15274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.009s	sys 0.029s
I20260709 13:11:08.222735 15375 raft_consensus.cc:2368] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:08.225890 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.054005 22116 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
I20260709 13:11:08.147445 22047 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.209914 21708 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.229841 22040 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.230686 22109 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.231400 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:08.221221 22077 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.235191 22047 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.240326 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:08.217846 22143 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:08.248561 15274 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.65:44011 timed out after 1.516s (SENT) [suppressed 3 similar messages]
I20260709 13:11:08.347465 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.355913 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.296283 22128 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.357367 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.313886 22044 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.358202 15227 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:08.358536 22044 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.359346 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.245302 22079 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:08.313449 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3676) took 1294 ms. Trace:
I20260709 13:11:08.360909 22079 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.361624 22079 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:08.361346 15375 rpcz_store.cc:276] 0709 13:11:07.018850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.019125 (+   275us) service_pool.cc:224] Handling call
0709 13:11:08.313137 (+1294012us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540012b1d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:08.313359 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2584069376}
I20260709 13:11:08.238569 21983 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:08.363258 22003 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:08.313014 22076 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.363582 21983 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.363993 21885 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.364662 21983 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:08.308801 15300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49780 (request call id 951) took 2120 ms (client timeout 1507 ms). Trace:
W20260709 13:11:08.365531 15300 rpcz_store.cc:269] 0709 13:11:06.188218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.188369 (+   151us) service_pool.cc:224] Handling call
0709 13:11:08.308375 (+2120006us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54002c3154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:08.308599 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4265707392}
I20260709 13:11:08.366065 15226 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:08.292440 22084 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:08.255410 22018 consensus_meta.cc:287] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.339s	user 0.016s	sys 0.001s
I20260709 13:11:08.367353 15307 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:08.250169 22086 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.366549 15226 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:08.369295 22144 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.238049 22149 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:08.244985 21984 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.373297 22086 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.373605 21984 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:08.374095 15306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 3793) took 1654 ms (client timeout 2083 ms). Trace:
W20260709 13:11:08.374559 15306 rpcz_store.cc:269] 0709 13:11:06.719931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.725746 (+  5815us) service_pool.cc:224] Handling call
0709 13:11:08.373842 (+1648096us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540025a8d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:08.374023 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537391360}
W20260709 13:11:08.285669 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 438959us
I20260709 13:11:08.325383 15233 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:08.357414 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.368813 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.372449 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3797) took 1599 ms. Trace:
I20260709 13:11:08.394232 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:08.309267 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.371646 15226 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.397029 15226 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.336194 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:08.275154 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 420742us
I20260709 13:11:08.392735 15231 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:08.326488 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1272) took 1152 ms. Trace:
W20260709 13:11:08.411365 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 171134us
I20260709 13:11:08.411262 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.394121 15301 rpcz_store.cc:276] 0709 13:11:06.772745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.772915 (+   170us) service_pool.cc:224] Handling call
0709 13:11:06.808099 (+ 35184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.124431 (+1316332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.372042 (+247611us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003e17d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:08.372328 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2962129792}
I20260709 13:11:08.412385 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:08.411242 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.410753 15376 rpcz_store.cc:276] 0709 13:11:07.174212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.315452 (+141240us) service_pool.cc:224] Handling call
0709 13:11:07.339733 (+ 24281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.869216 (+529483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.869253 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.869299 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:07.869359 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.326126 (+456767us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54000028d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:08.326222 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.326403 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217132928}
I20260709 13:11:08.413756 15231 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.412163 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.323453 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.242488 21926 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.413583 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:08.416049 15225 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:08.351850 22154 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.420145 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.420704 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:08.317143 22140 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.005s	user 0.004s	sys 0.010s
I20260709 13:11:08.371627 22144 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.519133 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.506764 22084 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.424106 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:08.521287 22084 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.427232 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.522100 15382 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:08.522151 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:08.522958 15374 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:08.523379 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.525343 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1274) took 1350 ms. Trace:
I20260709 13:11:08.512904 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.526722 15379 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:08.529368 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:08.521481 15378 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:11:08.532809 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.533582 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:08.535310 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.537230 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:08.538055 15308 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.524788 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.543622 15380 raft_consensus.cc:2393] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 13: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:08.543474 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2736) took 1908 ms. Trace:
I20260709 13:11:08.505945 22128 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:08.417325 21910 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:08.238385 21708 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.428002 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:08.250638 21982 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.271819 22027 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.271139 22017 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.417654 21953 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:08.506891 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.508710 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.509518 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:08.513022 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.544230 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:08.524809 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 88285.1us
W20260709 13:11:08.551723 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.552903 15306 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:08.536417 15300 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:08.525729 15381 rpcz_store.cc:276] 0709 13:11:07.174761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.845187 (+670426us) service_pool.cc:224] Handling call
0709 13:11:07.845674 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.171713 (+326039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.171756 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:08.171810 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:08.171846 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.525081 (+353235us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54003c4454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:08.525139 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.525283 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749035264}
I20260709 13:11:08.570696 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:08.572486 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.364828 21885 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.590646 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.544221 15302 rpcz_store.cc:276] 0709 13:11:06.635248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.637650 (+  2402us) service_pool.cc:224] Handling call
0709 13:11:06.638136 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.639637 (+  1501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.639675 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.683042 (+ 43367us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.899125 (+216083us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:06.899169 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.899232 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.316100 (+1416868us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:08.525456 (+209356us) raft_consensus.cc:1685] finished
0709 13:11:08.525490 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.543358 (+ 17868us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2352,"raft.queue_time_us":4299,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":36120,"spinlock_wait_cycles":14608640,"thread_start_us":190445,"threads_started":1,"wal-append.queue_time_us":502067}
W20260709 13:11:08.592073 15307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2740) took 1221 ms (client timeout 1599 ms). Trace:
I20260709 13:11:08.334237 22059 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.253134 22040 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.595325 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:08.430445 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 181919us
I20260709 13:11:08.590235 22128 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:08.506968 21984 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.545554 21910 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.690805 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:08.608219 22044 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:08.765375 15307 rpcz_store.cc:269] 0709 13:11:07.370273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.682428 (+312155us) service_pool.cc:224] Handling call
0709 13:11:08.591719 (+909291us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540017aa54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:08.591861 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533789440}
I20260709 13:11:08.439143 21926 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.819377 22040 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.712606 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.819844 22027 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.691258 22079 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.649724 22154 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:08.768999 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 198435us
I20260709 13:11:08.853191 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.854660 15348 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.833772 21910 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.657198 15230 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:08.364574 22076 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.836032 21984 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.811597 15374 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:08.808707 15382 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:08.313416 22083 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.601972 16008 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:08.437009 22067 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:08.675918 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:08.866108 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 190324us
I20260709 13:11:08.867202 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:08.438700 22000 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:08.868680 22000 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.420912 21993 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.872673 21993 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.610802 15377 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:08.589845 22149 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:08.876145 22149 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.876677 22149 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.877399 21993 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.813324 15233 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.608106 22105 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:08.604638 22077 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:08.757906 15303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.034s	sys 0.050s
I20260709 13:11:08.814213 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:08.883862 15303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.036s	sys 0.051s
I20260709 13:11:08.815313 15308 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:08.818583 15225 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 21.
W20260709 13:11:08.809312 15971 connection.cc:256] RPC call timeout handler was delayed by -1.1256600489999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
I20260709 13:11:08.812508 22101 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.810354 15224 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:08.891718 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.690714 22102 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:08.896970 22163 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:08.896867 22102 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.860081 21903 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:08.899605 22102 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.809855 21529 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:08.607048 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 186428us
I20260709 13:11:08.808449 22046 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:08.827422 22059 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.821817 22018 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.837110 22128 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.838064 21926 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.823025 22047 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.842178 22002 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:08.844990 21983 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.673022 15226 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:11:08.922245 15226 pending_rounds.cc:85] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 9
I20260709 13:11:08.922559 15226 pending_rounds.cc:107] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:11:08.922857 15226 raft_consensus.cc:2889] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.923136 16005 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:08.924664 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:08.925290 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.926775 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.930476 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:08.850543 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 174064us
I20260709 13:11:08.851745 15227 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:08.766211 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.856032 15348 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.862273 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.881178 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.933243 15382 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
W20260709 13:11:08.933375 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 77443.6us
W20260709 13:11:08.415336 22145 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.025s	sys 0.036s
W20260709 13:11:08.885562 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.885984 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.838097 21885 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:08.894845 15272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.002s	user 0.028s	sys 0.021s
I20260709 13:11:08.895646 15231 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:08.853770 22027 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.858372 22044 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.852262 22040 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.906716 15301 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:08.949007 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.910388 15373 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:08.878909 21984 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.937948 22162 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:08.910784 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 76052.2us
I20260709 13:11:08.878929 22022 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.953902 22022 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.954358 21984 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.955129 21984 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:08.958272 22040 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.960526 22027 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.902669 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:08.961078 22002 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:08.961508 22002 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:08.961654 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59094.7us
I20260709 13:11:08.961855 22155 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:08.962375 22002 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.934742 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.964660 22154 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:08.965024 22158 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:11:08.943924 15272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.028s	sys 0.021s
I20260709 13:11:08.966388 21708 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.966845 22001 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:08.914825 22018 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.967448 22001 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.933876 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.969202 22018 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.969849 22001 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.900303 22102 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:08.966490 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2754) took 1079 ms. Trace:
I20260709 13:11:08.950192 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:08.978979 15233 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:08.908885 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:08.892086 22083 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.900972 21529 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.981600 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:08.963917 15196 leader_election.cc:400] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:08.948597 15226 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:11:08.971917 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 104859us
W20260709 13:11:08.937778 22145 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.027s	sys 0.046s
I20260709 13:11:08.984650 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:08.973269 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:08.973335 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:08.937736 21982 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:08.992523 21708 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:08.993419 22076 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.993194 21708 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.995455 22079 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:08.995564 21708 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.997704 22047 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.998457 22047 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:08.950949 22092 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:11:08.977553 15303 rpcz_store.cc:276] 0709 13:11:07.887019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.026423 (+139404us) service_pool.cc:224] Handling call
0709 13:11:08.026990 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.027709 (+   719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.027753 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.028740 (+   987us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.884446 (+855706us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:08.884499 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.884585 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.966239 (+ 81654us) raft_consensus.cc:1685] finished
0709 13:11:08.966263 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.966415 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3728,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":11409,"thread_start_us":750581,"threads_started":1,"wal-append.queue_time_us":731053}
I20260709 13:11:08.912317 22046 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.000674 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:09.001333 21983 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:09.001706 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:08.977468 22102 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.002538 22046 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.002681 22102 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:09.003180 22046 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:09.003770 22046 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:09.006541 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.007166 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.007865 16001 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:08.974232 21885 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.008898 21885 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.010928 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.011325 21885 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:08.981447 22086 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:08.946609 22096 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:09.012751 22086 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:09.012880 22096 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:09.013255 22086 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.013756 22086 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.014050 22096 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.008147 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:09.016796 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 43592.4us
I20260709 13:11:08.982939 15196 leader_election.cc:403] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:08.962688 22155 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.970965 22018 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:08.924045 21926 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:09.027272 21926 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.027748 21926 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.029074 22047 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:09.029680 22047 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.984581 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:08.963781 22002 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:08.981599 22162 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:08.987495 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.037111 21926 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:08.989319 21953 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:08.991122 22059 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.023175 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.019964 15348 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:09.025933 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 211757us
I20260709 13:11:09.032051 22047 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.037366 16000 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:08.908003 22101 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:08.983276 22027 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.043529 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:09.041706 22079 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:11:09.077363 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 113596us
I20260709 13:11:09.072556 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.075264 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:09.076165 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:09.086691 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 49239.5us
W20260709 13:11:09.081346 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.984690 21984 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.088980 15225 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:08.983105 22040 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.025583 22155 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.038645 21983 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:09.110478 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67068.2us
I20260709 13:11:09.094262 15973 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:09.115051 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:09.116673 15198 leader_election.cc:400] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:09.087996 22162 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:09.124823 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.125990 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.127029 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.129138 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.128023 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.114650 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:09.111925 21977 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.136121 15374 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:09.068832 21999 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:11:09.143256 15382 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:09.092043 22113 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.046418 21885 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:11:09.041395 21953 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.146513 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.112327 22169 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.093066 22067 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:09.147801 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.091917 22165 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:09.153789 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 127581us
I20260709 13:11:09.157249 15379 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:09.157995 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:09.150732 22171 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:09.091339 22027 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.161408 15225 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:09.162564 22027 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.042402 22018 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.181025 22077 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:09.182296 21529 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.111707 22040 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.184856 22040 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.109359 21984 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.148964 22162 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:09.149582 21986 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:11:09.186082 22083 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.186203 22162 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.187093 21984 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.188546 22175 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:09.189721 21953 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.190104 22175 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:09.190414 22171 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:09.191642 22175 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:09.191540 22171 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.168409 22101 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.142498 22046 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:09.146234 21977 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.145251 22166 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:11:09.175485 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 60479.1us
I20260709 13:11:09.147748 21983 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:09.195420 22176 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:09.200903 21482 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:09.201076 22176 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.201380 21482 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:09.201542 22176 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.201885 21926 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.202479 21482 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.203504 22110 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.180083 22018 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.205272 22165 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.206944 22168 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:09.207770 22165 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.207597 22168 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:09.208132 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 50213.6us
I20260709 13:11:09.156818 22113 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.208856 21948 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:09.224172 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.221853 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:09.204226 21482 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.227097 21948 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:09.232582 21948 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:09.232225 22102 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.232980 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.164738 22169 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.234587 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.234823 22102 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.235343 22169 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.255265 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.230204 22175 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:09.257877 22175 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.261531 22113 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:09.262086 22168 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.265223 22149 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.268715 15378 raft_consensus.cc:2368] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18.
I20260709 13:11:09.265264 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.275679 15303 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:09.280167 15308 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:09.270639 22086 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.294976 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:09.253679 21885 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.200279 21983 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.305181 15303 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:09.307670 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.309258 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.310667 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.329905 15307 raft_consensus.cc:2393] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:09.331875 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.331845 15308 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:09.198544 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:09.378738 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2973) took 1036 ms. Trace:
I20260709 13:11:09.380102 15231 rpcz_store.cc:276] 0709 13:11:08.342000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.974873 (+632873us) service_pool.cc:224] Handling call
0709 13:11:08.975442 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.976097 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:09.085101 (+109004us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.378200 (+293099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.378278 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:09.378355 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.378455 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.378650 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49916,"prepare.queue_time_us":137718,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":5376,"thread_start_us":307937,"threads_started":2}
I20260709 13:11:09.491449 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.304898 22105 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:09.514807 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 316321us
I20260709 13:11:09.516010 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:09.519062 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.494192 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.344750 21983 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.517975 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.542153 15303 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:09.542755 15307 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:09.490397 22079 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:09.561647 22180 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.561532 22186 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:09.572458 15303 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:09.575016 22154 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:09.578037 15407 heartbeater.cc:646] Failed to heartbeat to 127.13.196.126:35597 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.196.126:35597 timed out after 15.000s (SENT)
I20260709 13:11:09.579276 22149 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.582705 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.584478 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.385409 22104 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:09.636070 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 414339us
I20260709 13:11:09.383579 22175 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.644698 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.632591 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.652249 15308 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:09.514635 22105 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.328465 21885 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.561427 22047 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:09.542963 22171 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.640887 22186 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.562628 21977 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:09.654536 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.668983 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.672895 15300 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:09.645397 22104 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.628060 22169 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:09.703610 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:09.626046 21638 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:11:09.728937 15306 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:09.667070 22105 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:09.734716 15373 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:11:09.569641 22079 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:09.737854 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.570248 22180 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.689487 22047 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:09.747972 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 370559us
I20260709 13:11:09.755540 15303 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:11:09.754518 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 122998us
I20260709 13:11:09.735273 22104 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:09.740234 21910 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.875s	user 0.012s	sys 0.002s
W20260709 13:11:09.753706 22176 consensus_meta.cc:287] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.552s	user 0.020s	sys 0.000s
I20260709 13:11:09.760464 22047 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:09.752312 22002 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:09.733704 22171 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.789235 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.786695 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:09.790706 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:09.733382 22186 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.740038 22169 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:09.782313 22155 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.002s
I20260709 13:11:09.794103 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:09.794817 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.799413 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.804605 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.777752 22176 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.777391 21910 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.806001 16008 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.806010 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.783891 22002 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:09.807534 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:09.818315 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:09.818989 15231 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.819525 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:09.820267 15226 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:09.798884 22077 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.797127 22144 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.821877 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.824939 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.827591 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.829275 15232 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:11:09.829713 15232 pending_rounds.cc:85] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 9
I20260709 13:11:09.829932 15232 pending_rounds.cc:107] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:11:09.830178 15232 raft_consensus.cc:2889] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.828451 15226 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:09.835415 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.835791 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.836077 15231 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:09.841892 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.804059 22155 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.838611 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:09.845870 22198 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:09.846626 21885 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.848237 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.850287 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:09.853235 22183 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:09.852746 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.856328 22180 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.857707 22143 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.862128 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.866992 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:09.872241 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:09.867889 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:09.860168 21948 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.002s
I20260709 13:11:09.873764 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:09.875141 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.878240 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.879046 15231 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
W20260709 13:11:09.871891 22182 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:11:09.885592 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.006s	sys 0.020s
W20260709 13:11:09.886161 22195 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:11:09.886225 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.006s	sys 0.020s
W20260709 13:11:09.886981 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 553053us
W20260709 13:11:09.896083 22193 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:11:09.897053 22188 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:09.898638 22169 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.899991 21910 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:09.878383 22002 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.902225 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:09.907852 15300 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:09.880728 21885 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:09.917773 15307 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:09.923271 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.880918 21948 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.934121 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.927618 22149 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.937078 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.936933 22149 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.937858 15373 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:09.939414 22149 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:09.941895 21948 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.941738 21983 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:09.942584 15224 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:09.927304 21885 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:09.945182 15379 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:09.945487 21885 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.948729 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:09.949880 21993 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:09.950099 15973 leader_election.cc:400] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18.
I20260709 13:11:09.950387 21993 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:09.950507 15973 leader_election.cc:403] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.950960 21993 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:09.928223 21910 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:09.952554 22177 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18.
I20260709 13:11:09.952947 21910 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:09.954344 22176 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.955207 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:09.955611 21910 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:09.963078 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:09.963891 15378 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.939122 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:09.965371 15373 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:11:09.965173 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:09.927124 22110 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.723s	user 0.000s	sys 0.015s
I20260709 13:11:09.971804 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.926779 22186 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.000880 15382 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:10.014452 22000 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:09.998335 21983 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:10.002771 22139 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:11:10.002470 22109 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.026228 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.027123 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.028052 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:09.997639 22171 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.080586 15229 raft_consensus.cc:2368] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18.
I20260709 13:11:09.996692 21910 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:11:10.086174 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:10.086005 22211 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:11:10.083649 22109 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.118229 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 954) took 1174 ms. Trace:
I20260709 13:11:10.149118 15999 rpcz_store.cc:276] 0709 13:11:08.944161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.944373 (+   212us) service_pool.cc:224] Handling call
0709 13:11:08.955439 (+ 11066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.042233 (+ 86794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.042271 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.042317 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:09.042354 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.117670 (+1075316us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54004010d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:10.117736 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.118132 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199022464}
I20260709 13:11:10.178633 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.179690 15307 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:10.181489 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:10.182760 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.184403 15308 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:10.185639 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.186415 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.187551 15308 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:10.187624 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.186473 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.191071 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:10.192164 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:10.193370 15308 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:10.188257 15304 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 10.
I20260709 13:11:10.153394 15380 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:10.124652 22077 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:10.099472 21983 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.136885 22155 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.102088 22171 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.202596 21983 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.206845 22079 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:10.208446 21983 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:10.205252 22171 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.209461 15303 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:10.219723 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3698) took 1071 ms. Trace:
I20260709 13:11:10.221012 22217 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.223203 22217 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.224047 22077 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:10.224236 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:10.224694 22077 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.225709 22217 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.225952 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:10.226090 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.226915 22077 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:10.227193 22217 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.227485 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.221747 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.123335 21999 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:10.122771 22105 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:10.222195 22202 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
I20260709 13:11:10.121620 21910 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:10.204113 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:10.233714 15379 rpcz_store.cc:276] 0709 13:11:09.148254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.946531 (+798277us) service_pool.cc:224] Handling call
0709 13:11:10.218757 (+272226us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:11:10.219052 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.219297 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.219328 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.219385 (+    57us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:10.219426 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.219490 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.219643 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26244480}
I20260709 13:11:10.230820 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1177) took 1900 ms. Trace:
I20260709 13:11:10.232250 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3692) took 1088 ms. Trace:
I20260709 13:11:10.228765 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:10.235857 15228 rpcz_store.cc:276] 0709 13:11:08.330443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.330640 (+   197us) service_pool.cc:224] Handling call
0709 13:11:08.331116 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.046271 (+715155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.046318 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.046368 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:09.046400 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.230497 (+1184097us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540007a654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:10.230573 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.230752 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644082560}
I20260709 13:11:10.237299 15374 rpcz_store.cc:276] 0709 13:11:09.144017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.144118 (+   101us) service_pool.cc:224] Handling call
0709 13:11:09.147187 (+  3069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.196073 (+ 48886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.196126 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.196205 (+    79us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:09.196263 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.231999 (+1035736us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54001a95d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:10.232053 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.232183 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111749504}
I20260709 13:11:10.242602 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.235399 22104 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.245220 15376 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:10.246083 22047 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.246917 22104 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.249074 22109 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:10.250469 21993 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.252550 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.252784 22186 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:10.255353 22105 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.228751 15381 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:10.261057 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.262168 15374 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:10.258419 21982 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:10.240697 21999 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:10.227857 22217 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.298285 15303 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 9.
I20260709 13:11:10.262619 15274 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:10.112660 22086 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.240166 21910 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:10.272020 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:10.279109 15378 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:11:10.262266 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.304716 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.289413 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:10.204512 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.305934 15380 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
W20260709 13:11:10.243672 21482 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.012s	user 0.004s	sys 0.018s
I20260709 13:11:10.302533 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:11:10.268541 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 362127us
I20260709 13:11:10.311882 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:10.307169 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.308409 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:10.286828 21982 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.315582 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.328298 15376 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:10.380883 15376 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:11:10.338547 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 306116us
I20260709 13:11:10.389708 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.267210 22180 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:10.338697 22169 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:10.403353 15228 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:10.308128 22047 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.308437 22143 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:10.314591 22109 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:10.426018 15376 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:10.438576 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.439749 15376 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:11:10.336838 22086 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:10.376855 22022 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:10.444294 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 172344us
I20260709 13:11:10.451014 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.297732 22186 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.452818 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.467865 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.466037 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3700) took 1314 ms. Trace:
I20260709 13:11:10.469065 15228 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:10.454114 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.455297 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:10.471511 15231 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:11:10.448673 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 137527us
I20260709 13:11:10.456270 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:10.458400 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.464010 15230 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:10.469204 15375 rpcz_store.cc:276] 0709 13:11:09.151495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.947855 (+796360us) service_pool.cc:224] Handling call
0709 13:11:09.948219 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.961397 (+ 13178us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:09.970710 (+  9313us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.210357 (+239647us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b1800352c60. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a39522 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:11:10.465500 (+255143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.465605 (+   105us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:10.465683 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.465802 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.465973 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81829,"prepare.queue_time_us":9081,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":7904,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3269,"spinlock_wait_cycles":41641216,"thread_start_us":492090,"threads_started":2,"wal-append.queue_time_us":38461}
I20260709 13:11:10.408751 22169 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.475742 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.488332 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.489861 15376 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:10.481235 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.492255 15226 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 16: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:10.484009 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.485438 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:10.486301 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.445053 22047 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.493569 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.498667 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.494841 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.487628 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:10.452291 22194 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.501704 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:10.494875 22207 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.504446 22076 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:10.506803 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.508189 22196 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:10.500630 15376 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:11:10.509658 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:10.510613 22104 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:10.518508 16000 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.527412 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.528155 22079 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:10.537978 22218 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:10.443998 21910 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.495882 22169 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:10.541188 22213 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:11:10.544446 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.574193 15378 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:10.449205 21999 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:10.545742 16003 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:10.547915 22217 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.472539 22210 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:10.554549 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 239038us
I20260709 13:11:10.556979 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.584081 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:10.585188 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.397254 22177 consensus_queue.cc:1059] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:10.494422 21948 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.494083 22109 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.463631 22105 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
W20260709 13:11:10.567641 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58094.7us
I20260709 13:11:10.616626 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.617735 15307 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
W20260709 13:11:10.568296 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61598.1us
I20260709 13:11:10.516176 22171 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.575439 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.579968 21910 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:10.569440 22110 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.640161 22110 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.640605 22110 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.567868 22104 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.591892 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:10.642925 15306 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:10.644143 22104 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.608083 22076 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:11:10.604991 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.572868 21708 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:10.650229 15382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3706) took 1322 ms (client timeout 1726 ms). Trace:
W20260709 13:11:10.650996 15382 rpcz_store.cc:269] 0709 13:11:09.327861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.933649 (+605788us) service_pool.cc:224] Handling call
0709 13:11:10.649914 (+716265us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b54003f2354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:10.650128 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150996224}
I20260709 13:11:10.654050 22201 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:10.654887 22201 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:10.658687 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:10.660173 21697 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:10.662810 22105 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:10.663331 22105 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:10.664157 22076 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:10.659884 21999 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:10.664304 22105 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.674008 22105 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:10.674928 22092 consensus_queue.cc:1175] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 17 status { last_received { term: 14 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: [16.9-16.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:10.620946 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.679035 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.679639 15378 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:10.545032 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 162033us
I20260709 13:11:10.621042 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.622871 15301 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:10.681412 15973 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:10.624781 22186 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.627055 22177 raft_consensus.cc:3055] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:10.607707 21948 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:10.628575 22109 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:10.579046 21977 consensus_queue.cc:1175] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0f9eceec749442cb9a06c87f00f3caf" responder_term: 22 status { last_received { term: 21 index: 15 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:10.632038 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 644) took 1625 ms. Trace:
I20260709 13:11:10.552871 22207 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.632578 15226 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:10.583987 22210 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.637828 15230 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:10.639420 21993 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.573580 22218 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.660251 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:10.681686 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.682202 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:10.612227 16000 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:10.724414 15382 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:11:10.603449 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.685500 15306 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 21.
I20260709 13:11:10.689599 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.691257 15229 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:10.726208 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.697808 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.698048 15378 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:10.703265 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3702) took 1406 ms. Trace:
I20260709 13:11:10.727924 15373 rpcz_store.cc:276] 0709 13:11:09.296533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.997566 (+701033us) service_pool.cc:224] Handling call
0709 13:11:10.010470 (+ 12904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.086671 (+ 76201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.086711 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.107755 (+ 21044us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.450750 (+342995us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:10.702474 (+251724us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.702873 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.702965 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.703008 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:10.703020 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.703196 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":756,"prepare.queue_time_us":112727,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":87617,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":1569,"thread_start_us":529811,"threads_started":3,"wal-append.queue_time_us":374180}
I20260709 13:11:10.730456 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.731254 15378 raft_consensus.cc:2393] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:10.727743 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.733057 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.733506 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.733942 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.734967 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.664661 22076 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:10.699158 22176 raft_consensus.cc:2804] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:10.700968 21948 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:10.742511 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 82337.4us
W20260709 13:11:10.742132 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60001.5us
I20260709 13:11:10.660434 22204 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:11:10.692813 22177 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:10.716522 16001 rpcz_store.cc:276] 0709 13:11:09.006930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.008526 (+  1596us) service_pool.cc:224] Handling call
0709 13:11:09.015819 (+  7293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.133438 (+117619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.133567 (+   129us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.151528 (+ 17961us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.127860 (+976332us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18003f7540. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:11:10.442948 (+315088us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:10.442999 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.443074 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.630356 (+187282us) raft_consensus.cc:1685] finished
0709 13:11:10.630385 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.631782 (+  1397us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b54006b03d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:10.631964 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10387,"raft.queue_time_us":124825,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":4346,"spinlock_wait_cycles":23232000,"thread_start_us":406607,"threads_started":2,"wal-append.queue_time_us":1421089}
I20260709 13:11:10.746078 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.756093 15376 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.750713 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:10.665773 21982 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.740837 22079 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:10.737602 21986 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:10.736824 22194 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:10.656172 22201 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:10.775564 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 172254us
I20260709 13:11:10.736629 22154 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:10.731954 22139 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:11:10.767549 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:10.769007 15373 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:10.747258 22206 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:10.752301 21993 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:10.752202 21863 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:10.821098 21863 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.670651 22169 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.821623 21863 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:10.823735 22207 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.823870 22169 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:10.773990 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57886.4us
I20260709 13:11:10.762882 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.770738 21708 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:10.781642 15376 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:10.776355 22079 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:10.843333 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.811887 22218 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:10.819900 22177 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.744191 22230 raft_consensus.cc:2764] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:10.776242 22076 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.771780 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:10.856094 15381 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:10.781457 22092 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
W20260709 13:11:10.861248 22234 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:11:10.844187 22206 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:10.863904 15381 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:10.863791 22206 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.770043 21986 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:10.747747 22223 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:11:10.868244 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.869323 22109 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:10.831614 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68882.2us
I20260709 13:11:10.868197 21986 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:10.870553 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.870874 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.871491 15233 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:10.777098 15974 leader_election.cc:400] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18.
I20260709 13:11:10.827980 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:10.872830 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 95887.5us
I20260709 13:11:10.838116 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:10.873047 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.825516 22210 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.841789 22225 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.837306 21953 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.852356 15380 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:10.854566 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1293) took 1190 ms. Trace:
I20260709 13:11:10.888813 15374 rpcz_store.cc:276] 0709 13:11:09.663842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.288416 (+624574us) service_pool.cc:224] Handling call
0709 13:11:10.299450 (+ 11034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.341729 (+ 42279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.341782 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.341848 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:10.341898 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.854235 (+512337us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54001ac7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:10.854299 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.854480 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96445824}
I20260709 13:11:10.776602 22110 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.857693 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:10.860188 22076 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.867585 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:10.894222 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 122531us
I20260709 13:11:10.868330 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:10.827845 15302 raft_consensus.cc:2468] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:11:10.869532 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.895841 15225 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 23.
W20260709 13:11:10.842522 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.898382 15230 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:10.844252 15382 raft_consensus.cc:2393] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 9: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:10.810196 15306 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 23.
I20260709 13:11:10.874243 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.859690 22079 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.886862 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.889807 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:10.893198 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3707) took 1004 ms. Trace:
I20260709 13:11:10.920883 15228 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:10.921041 15232 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:10.922124 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.923017 15226 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:11:10.924785 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.927264 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:10.897106 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.920258 15380 rpcz_store.cc:276] 0709 13:11:09.888588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.851820 (+963232us) service_pool.cc:224] Handling call
0709 13:11:10.852155 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.892941 (+ 40786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.893141 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:10.905951 22110 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:10.907246 22189 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.170s	user 0.003s	sys 0.005s
I20260709 13:11:10.932793 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.882161 22223 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:10.910769 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.832268 22154 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.912452 21708 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:10.912832 22228 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:10.907879 22139 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:10.914510 22186 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:10.874899 22176 raft_consensus.cc:697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:10.888048 22225 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:10.935446 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.935616 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.934659 22169 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.937551 22171 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:11:10.949575 22194 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:10.952739 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57234.1us
I20260709 13:11:10.960678 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 2987) took 1747 ms. Trace:
I20260709 13:11:10.933849 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.908143 22002 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.966102 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.966476 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:10.972786 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:10.969347 15227 rpcz_store.cc:276] 0709 13:11:09.213284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.213425 (+   141us) service_pool.cc:224] Handling call
0709 13:11:09.213830 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.214260 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.214297 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.214822 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.382551 (+167729us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:09.382616 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.382718 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.904171 (+1521453us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b240011e6b8. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a7809d 00007f2f536aa10e 00007f2f536c188c 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221
0709 13:11:10.955559 (+ 51388us) raft_consensus.cc:1685] finished
0709 13:11:10.955580 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.960575 (+  4995us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37133,"raft.queue_time_us":342,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10848,"spinlock_wait_cycles":13127552,"thread_start_us":164146,"threads_started":1,"wal-append.queue_time_us":440090}
I20260709 13:11:10.974184 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:10.937188 21708 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.977913 21708 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:10.978089 22047 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:10.978874 22219 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.979321 22219 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:10.979681 22219 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.981105 22217 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:10.971390 22194 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.985831 15308 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:10.961545 22139 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:10.988974 22139 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:10.989924 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:10.991580 22176 consensus_queue.cc:237] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.992156 22077 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.992717 22077 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:10.993142 22077 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.899755 21953 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.994187 15233 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:10.994526 22067 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:10.994959 22067 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:10.995760 22067 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.970535 22186 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.997413 22067 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.998095 22110 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:10.998620 22110 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:10.999039 22110 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:10.999692 22186 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:10.961627 21983 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.001866 22154 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:10.972936 22241 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:10.988577 21708 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:10.976048 15274 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:11.006635 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.008273 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.010927 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:11.011729 16001 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:11.011866 21708 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:11.008029 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:10.961665 22223 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:10.961267 22175 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:11.020565 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51088.5us
W20260709 13:11:11.022938 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.027374 22223 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:10.968743 22225 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.036038 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:11.045395 22155 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:11.016680 22171 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:11.016098 22217 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.067303 22217 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:11.068055 22217 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:11.068655 22217 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:11.070627 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52726.5us
I20260709 13:11:11.053086 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:11.072374 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:11.079243 22252 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:11.079734 22252 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.055198 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.057327 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.058228 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:11.083510 15307 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.087090 22155 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:11.087715 22155 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:11.088721 22155 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.090220 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.090214 22155 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:11.095105 15307 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:11.096750 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:11.098152 21638 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:11.098809 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:11.100059 21638 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.029047 22175 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:11.102998 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 95064.6us
I20260709 13:11:10.955055 21863 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:11.016011 21977 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:11.029043 22169 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:11.062628 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:11.090987 15303 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:11:11.057189 15375 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:11.105296 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:11.109819 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:11.104692 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.108224 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.111475 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:11.105940 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58631.9us
I20260709 13:11:11.050478 21953 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.016022 21986 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.066434 22171 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.105836 22175 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:11.192914 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 84330.6us
I20260709 13:11:11.080176 22252 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:11.196774 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:11.203186 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91791.3us
I20260709 13:11:11.204608 15345 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.207182 15224 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.106331 21977 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:11.126086 22104 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:11.065868 21948 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.223614 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.217585 21986 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.219713 21982 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.101261 22210 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:11:11.123910 22076 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:11.192323 22171 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:11.244555 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 128184us
I20260709 13:11:11.263790 15224 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:11.281658 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:11.223419 21977 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.242442 22169 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:11.235142 22104 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.189381 22186 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:11:11.234472 22249 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.311693 22255 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:11.318250 22169 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:11.325675 22104 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:11.347226 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.380383 22139 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.350102 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:11.326045 22076 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:11.381954 22177 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:11.357499 22219 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.339129 21983 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.368722 21863 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:11.370018 22256 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.373909 21948 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.309839 22217 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:11.383739 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:11.385136 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:11.385378 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.385769 22169 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:11.412784 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 189312us
I20260709 13:11:11.446535 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:11.425482 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.450394 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.451781 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.452689 15307 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:11.455936 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.455237 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.382820 22076 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.457866 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:11.459815 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.446866 22139 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.471728 15230 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:11.453651 22258 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:11.386557 22175 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:11.495533 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.476696 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.402220 22194 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.502210 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.468837 21910 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:11.507228 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:11.456840 21977 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.485327 22253 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.514370 15307 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:11.474498 22261 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:11.501111 22139 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:11.509272 22047 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:11.531535 21910 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:11.532869 21910 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:11.486258 22186 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:11:11.478312 22252 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:11.484019 22169 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:11.554513 22077 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.001s
I20260709 13:11:11.555217 22169 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.555019 22077 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.557071 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:11.557265 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.557924 15377 raft_consensus.cc:2368] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:11:11.558269 22223 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.558874 22223 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.476751 22110 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:11.560564 22175 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.518764 22264 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:11.545298 22238 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:11.518865 22253 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.562356 22223 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.562549 22077 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.563733 22253 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.564529 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.566746 15373 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:11.569927 22225 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.541885 22047 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:11.549806 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.585027 15225 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:11.551311 21977 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.561376 22110 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:11.590875 22225 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.572083 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.591523 15382 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:11.542335 22139 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.592584 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.593256 15382 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:11.594063 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:11.594583 22139 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.595110 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.572643 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.572829 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:11.573378 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.547694 22252 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:11.579716 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.585351 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.587168 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.588568 22194 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.588024 22217 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:11.587399 22169 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:11:11.589242 22002 consensus_meta.cc:287] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:11:11.570501 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.646530 15230 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:11.636401 15376 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:11.596252 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.648054 15382 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:11.648142 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1294) took 1883 ms. Trace:
I20260709 13:11:11.650674 15379 rpcz_store.cc:276] 0709 13:11:09.764862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.647224 (+1882362us) service_pool.cc:224] Handling call
0709 13:11:11.647582 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.647799 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.647829 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:11.647874 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:11.647905 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.647961 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.648083 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:11.639021 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:11.653137 15381 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:11.587625 22264 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.654982 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 67944.4us
I20260709 13:11:11.656131 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:11.655149 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 148044us
I20260709 13:11:11.658986 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.662820 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.679669 15373 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:11.665518 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.586622 22047 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.694267 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.695755 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.698341 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.588788 22219 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.703579 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.705317 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.698287 15225 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 24.
I20260709 13:11:11.640672 22169 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:11.706024 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.711787 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:11.686976 21977 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.685861 22261 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:11.601812 22171 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.693110 22265 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.715693 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:11.730801 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 85316.5us
I20260709 13:11:11.720898 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:11.754129 15307 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:11.713444 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.743805 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.754396 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:11.716223 22169 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:11.715194 22253 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:11.739949 22251 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.721571 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:11.715469 22252 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.678027 21953 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.761096 15301 raft_consensus.cc:2368] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16.
I20260709 13:11:11.686362 22264 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.761082 15232 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:11.765259 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:11.766669 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45250.5us
I20260709 13:11:11.769431 22194 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.770531 21977 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:11.797106 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:11.759524 22277 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.764225 22186 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:11.834019 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:11.834847 15378 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.835853 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.836643 21910 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.837293 21910 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:11:11.841675 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.842280 15971 connection.cc:256] RPC call timeout handler was delayed by -1.0239797820000831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:11:11.817684 21977 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:11.795706 22261 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.843444 21977 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.845844 22176 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.846438 22176 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:11.847440 15973 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.848623 15348 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:11.841675 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.841861 22169 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:11.852165 15308 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:11.829211 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:11.793213 22272 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.763046 21953 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.857865 15305 raft_consensus.cc:3060] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:11.860827 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 98396us
W20260709 13:11:11.861235 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 89164.6us
I20260709 13:11:11.864490 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.869171 15378 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:11.859951 22241 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:11.876982 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3720) took 1398 ms. Trace:
I20260709 13:11:11.786213 22264 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.878854 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:11.881282 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.877822 15378 rpcz_store.cc:276] 0709 13:11:10.478773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.745726 (+266953us) service_pool.cc:224] Handling call
0709 13:11:11.833806 (+1088080us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01e9c 00007f2f50a01a5b 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58aec0a0 00007f2f58aeb984 00007f2f520666d4 00007f2f52066662
0709 13:11:11.876890 (+ 43084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16276608}
I20260709 13:11:11.886773 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:11.888857 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:11.855310 21910 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:11.887126 15377 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:11.858888 22139 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:11.868054 22225 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:11.935454 22225 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.938225 22225 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:11.888806 15373 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:11.908993 22279 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:11.903892 22277 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:11:11.922688 22067 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:11.961054 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:11.885847 22186 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 24 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:11.925896 22248 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:11.967285 15378 raft_consensus.cc:2368] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16.
I20260709 13:11:11.848734 22104 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.868606 22219 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:11.943821 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3009) took 1100 ms. Trace:
I20260709 13:11:11.978159 15229 rpcz_store.cc:276] 0709 13:11:10.843336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.843568 (+   232us) service_pool.cc:224] Handling call
0709 13:11:10.843941 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.969516 (+125575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.969556 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.969611 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:10.969658 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.943399 (+973741us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400312754. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:11.943485 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.943707 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288252800}
I20260709 13:11:11.789019 22171 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:11.952900 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:11.982589 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 93809.9us
I20260709 13:11:11.954751 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:11.961473 22067 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:11.966449 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:11.878489 22002 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:11:11.962265 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:11.970993 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:11.943920 22047 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:11.992700 15231 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:11.995365 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 147994us
W20260709 13:11:11.996935 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 142169us
I20260709 13:11:11.958884 22225 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:11.981570 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:11.985042 15273 leader_election.cc:400] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:11:12.016458 15273 leader_election.cc:403] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:11:11.931977 22217 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:11.985984 15305 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:11.972460 15379 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:12.018827 15227 raft_consensus.cc:2368] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:11:11.931027 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:12.024181 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 62030.5us
W20260709 13:11:12.025281 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 150689us
I20260709 13:11:11.957170 22139 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:12.029832 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.986153 22149 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:12.049341 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 64521.1us
I20260709 13:11:12.015347 22044 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:12.059482 15971 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.026707 22092 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:12.058311 22248 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14.
I20260709 13:11:12.061544 22149 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.028512 22217 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.048789 22257 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:12.061971 22171 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.071571 22171 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.072887 22149 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:12.066427 22186 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.065070 22092 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.073515 22139 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:12.067848 22104 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.068485 22169 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:12.070016 22176 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.077531 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:12.047194 22047 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.025027 21977 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:11:12.022810 22225 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.070420 22257 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:12.060863 22253 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:12.078202 22044 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:12.082461 22281 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:12.065611 22279 consensus_queue.cc:1059] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:11:12.069933 22217 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:12.077198 22288 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:11:12.090324 22257 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.098893 22044 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.095706 22279 raft_consensus.cc:3055] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:12.094777 22281 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.107999 22281 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.090526 22282 consensus_queue.cc:1059] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:11:12.100075 22253 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.107100 22279 raft_consensus.cc:740] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:12.133442 22225 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:12.134562 22279 consensus_queue.cc:260] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.135901 22279 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.144295 22257 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.146596 22275 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:12.147318 22275 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:12.151806 22257 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:12.148332 22275 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.159323 22275 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:12.213827 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.215837 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 190320us
I20260709 13:11:12.070842 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:12.223640 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 152700us
I20260709 13:11:12.218513 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:12.242616 22206 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:12.149557 22241 raft_consensus.cc:3055] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:12.245236 22241 raft_consensus.cc:740] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:12.246349 22092 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:12.235791 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.259080 22186 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:12.260515 22186 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.266306 22265 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.270254 22171 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.273361 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.277659 22253 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:12.278322 22253 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.278779 21953 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.278831 22253 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:12.273074 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.285511 22162 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.286760 22162 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.247735 22241 consensus_queue.cc:260] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.291853 22241 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.242748 22067 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.267777 22265 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.302039 22175 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:12.305543 22265 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:12.308991 22043 raft_consensus.cc:2764] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:11:12.309731 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 74284.9us
I20260709 13:11:12.316032 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:12.316097 15375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3716) took 1838 ms (client timeout 1544 ms). Trace:
I20260709 13:11:12.303462 22281 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.334407 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.334444 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.336961 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.320519 22175 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:12.323333 15375 rpcz_store.cc:269] 0709 13:11:10.477533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.483665 (+  6132us) service_pool.cc:224] Handling call
0709 13:11:12.315536 (+1831871us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540027b0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:12.315800 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965816064}
I20260709 13:11:12.354346 22281 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.320788 22162 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:12.361181 22043 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.362337 22043 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.366307 21948 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:12.367394 21948 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.370579 21948 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.374552 15226 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:12.376752 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.378093 15232 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:12.379935 22186 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:12.389635 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 73936us
I20260709 13:11:12.390713 22166 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:12.391713 22002 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:11:12.393641 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 56925.2us
I20260709 13:11:12.402316 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:12.406517 22139 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:12.408363 22225 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:12.433532 22176 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:12.434198 22176 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:12.436105 22175 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.438437 22175 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.439497 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:12.440508 15302 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.444852 15301 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:12.445200 15307 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:12.446900 22177 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.448118 22177 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.455561 22110 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.457216 15375 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:12.456835 22110 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.408723 22201 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:12.435643 22176 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.407122 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:12.463231 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.477063 15227 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:12.480923 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.465844 15380 raft_consensus.cc:1275] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:12.523808 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:12.469326 15229 raft_consensus.cc:1240] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:12.461244 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:12.479291 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.517750 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:12.487746 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 333739us
I20260709 13:11:12.470685 22171 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.410143 22253 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.542601 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:12.544184 15307 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:12.550945 15374 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:11:12.484669 22177 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.525897 22067 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:12.429082 22139 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:12.559686 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:12.561048 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 154243us
I20260709 13:11:12.448120 22166 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.570024 15226 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:12.569690 22186 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:12.588141 22257 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:12.588766 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:12.589123 22257 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.589664 16000 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.573406 22079 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.598547 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:12.603588 15305 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:12.600274 16003 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:10.608795 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.603428 15999 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:12.603459 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:12.616524 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.580310 22177 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.618824 15227 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:12.625294 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52102us
W20260709 13:11:12.627625 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 148835us
I20260709 13:11:12.628932 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:12.631300 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.623929 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:12.581236 22110 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:12.613801 22079 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.653533 22079 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.658740 15307 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:12.626456 22177 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.659061 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.638919 22187 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:12.678118 22288 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:12.673379 22204 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.669378 22275 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:12.679838 22204 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:12.686299 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 146764us
I20260709 13:11:12.702831 15196 leader_election.cc:400] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16.
I20260709 13:11:12.706158 15196 leader_election.cc:403] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.702359 22291 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 13:11:12.719431 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51229.4us
I20260709 13:11:12.710320 22257 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:12.725236 15274 leader_election.cc:400] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:11:12.725574 15274 leader_election.cc:403] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.724874 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.723104 22253 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:12.737973 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 158512us
W20260709 13:11:12.740031 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 109046us
W20260709 13:11:12.744807 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.748895 16001 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:12.747108 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:12.752471 22176 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:12.759665 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 2933) took 1412 ms. Trace:
W20260709 13:11:12.759858 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 113742us
W20260709 13:11:12.760537 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 79331.8us
I20260709 13:11:12.721164 22139 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.753964 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:12.752766 22257 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16.
I20260709 13:11:12.769104 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:12.769434 22166 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:12.770000 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.769234 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 74984.9us
I20260709 13:11:12.768996 15308 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:12.764654 22241 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.760406 15228 rpcz_store.cc:276] 0709 13:11:11.347388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.347508 (+   120us) service_pool.cc:224] Handling call
0709 13:11:11.347895 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.348315 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.348388 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.348959 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.318105 (+969146us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b18003e2cc0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:11:12.567949 (+249844us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:12.568006 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.573833 (+  5827us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.759034 (+185201us) raft_consensus.cc:1685] finished
0709 13:11:12.759057 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.759409 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7768,"spinlock_wait_cycles":12392192,"thread_start_us":205347,"threads_started":1,"wal-append.queue_time_us":1285257}
I20260709 13:11:12.780128 22043 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:12.768594 22304 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:12.763684 22175 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:12.789790 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:12.764680 22291 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.784435 22204 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.791867 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.785563 22241 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.784291 22177 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.796934 22139 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.816573 15974 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:12.809824 22299 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 13:11:12.808842 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.795138 22281 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:11:12.830544 15307 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:12.812067 22241 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.835042 22253 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:12.850256 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.844524 22291 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:12.830528 22175 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.841838 22257 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:11:12.867772 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 121667us
I20260709 13:11:12.852834 22253 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.874737 22175 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:12.876294 21982 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.877174 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.880625 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:12.881301 15225 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:12.882421 21863 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:12.874516 22288 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:12.883350 22197 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:12.884321 22206 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:12.890034 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:12.882809 22205 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:12.899276 22288 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:12.899706 21982 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.908013 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:12.909364 21863 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.914050 22206 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:12.914650 21863 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:12.915382 21863 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:12.915757 22288 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.916751 15228 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:11:12.914695 22206 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:12.910277 22175 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.918030 22228 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:12.918218 22175 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.918740 22228 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:12.919545 22228 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:12.918857 22175 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.918627 22206 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:12.931295 22206 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:12.896656 22253 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.932196 21982 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:12.915778 21863 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:12.939226 22288 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:12.940495 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 166275us
W20260709 13:11:12.953863 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63948.3us
W20260709 13:11:12.960489 15302 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.519s	user 0.016s	sys 0.000s
I20260709 13:11:12.961067 15302 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:12.955765 22204 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:12.962715 22275 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15.
I20260709 13:11:12.973140 22204 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.973795 22204 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:12.979193 22306 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.123s	user 0.000s	sys 0.006s
W20260709 13:11:12.979660 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.981474 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:12.983395 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:12.985422 21708 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:12.985884 21708 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:12.986244 21708 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.988611 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.989701 22186 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:12.990165 22186 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:12.990571 22186 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:12.992738 22067 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:12.994158 21697 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:12.994421 22067 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:12.994728 21697 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:12.995051 22067 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:12.995335 21697 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.996551 22225 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.989897 22241 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.997256 22225 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:12.997644 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:12.999550 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:12.999852 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:13.006444 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:13.007700 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 206641us
I20260709 13:11:12.973280 15233 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:13.005996 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:13.017112 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:12.938992 21863 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.016839 21999 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:13.029800 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45510.3us
I20260709 13:11:13.019914 16000 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:13.021301 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.032694 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:13.033473 15374 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.010460 22187 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:13.043937 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:13.054464 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.034207 22166 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:13.035099 22241 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.059870 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:13.015012 22225 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.069928 15302 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:13.080119 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:13.081681 21948 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:13.082314 21948 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:13.084530 21982 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:13.085345 16003 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:11:13.085193 21982 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.088722 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.089062 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.089363 22281 consensus_queue.cc:1048] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:13.089885 16008 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 9.
I20260709 13:11:13.088892 22110 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.095399 15232 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:13.001549 22067 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.024199 21999 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.098765 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.099925 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.100616 22154 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:13.100805 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.100975 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.083515 21948 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.094594 21982 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.101532 22311 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:11:13.142872 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.101558 22110 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:13.112093 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 114577us
I20260709 13:11:13.112241 15999 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:13.065474 22257 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:13.068768 22166 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:13.115873 22177 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:13.121033 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 2942) took 1548 ms. Trace:
W20260709 13:11:13.131114 22310 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.122s	user 0.003s	sys 0.000s
W20260709 13:11:13.131995 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.139271 22079 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.094025 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:13.173944 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80020.9us
W20260709 13:11:13.142681 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49388us
I20260709 13:11:13.140287 22187 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.153164 16005 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:13.088109 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.119927 21708 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.161765 15233 rpcz_store.cc:276] 0709 13:11:11.572163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.572586 (+   423us) service_pool.cc:224] Handling call
0709 13:11:13.120695 (+1548109us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001c6e54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:13.120918 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3045444352}
W20260709 13:11:13.169278 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65829.2us
W20260709 13:11:13.178726 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 268015us
I20260709 13:11:13.179435 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:13.181277 22110 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.196947 15374 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:11:13.161473 22166 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.205933 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.182145 15224 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:13.161563 22177 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:13.214747 15230 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:11:13.186937 22197 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:13.177758 22154 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:13.220582 22187 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.222549 22067 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:13.223340 22275 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:13.165603 22043 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:11:13.177526 22257 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:13.178581 22175 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.229512 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:13.229923 22228 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.236402 15973 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:11:13.257437 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58990.3us
I20260709 13:11:13.243711 16001 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:13.231599 22204 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:13.251796 15345 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.631s (SENT) [suppressed 25 similar messages]
I20260709 13:11:13.258797 22002 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:13.260802 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83254.2us
I20260709 13:11:13.261307 22177 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.261888 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:13.262238 22204 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.262737 22228 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.263576 16002 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:13.262945 22177 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:13.264195 22186 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.266667 22186 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.270696 22175 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.270517 22139 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:11:13.237520 22197 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:13.237300 22154 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:13.276144 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:13.279345 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.279659 16005 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:13.274940 22225 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:13.243091 22110 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:13.285164 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.284175 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:13.291976 15305 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:13.278545 22186 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:13.297444 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:13.298560 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:13.299230 21708 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.284080 22225 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:13.304976 22257 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.306825 22187 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.298614 15227 raft_consensus.cc:2368] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 23. Current term is 24.
I20260709 13:11:13.310119 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:13.311029 15308 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:13.311578 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82196.5us
I20260709 13:11:13.314015 22079 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.246692 21697 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.322134 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.322431 16004 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:13.322943 21697 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.324368 16003 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:13.324793 16007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.324887 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.325577 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.326395 16003 raft_consensus.cc:2393] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:13.327246 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:13.327915 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45560.2us
I20260709 13:11:13.329044 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:13.329743 15302 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:13.327963 15999 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:13.326403 16004 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:13.324430 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.334232 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.330411 15199 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:13.336825 22110 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.339613 22110 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.280162 22154 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.340581 21948 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:13.341377 21948 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:13.342113 21948 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:13.276508 22311 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:13.344812 22311 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:13.345968 22311 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.352840 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.353076 22197 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.354565 22197 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.358045 21863 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:13.360605 21697 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:13.361366 21697 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:13.362707 21999 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:13.366286 22313 log.cc:927] Time spent T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:11:13.366470 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.366488 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:13.367556 15301 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:13.370786 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.370985 15233 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:13.371580 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.371637 15232 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:13.375530 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:13.376938 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.376957 22149 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:13.374300 15230 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:13.381820 15198 leader_election.cc:400] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16.
I20260709 13:11:13.383534 22043 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:13.305073 22225 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:13.406592 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.385253 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52481.1us
I20260709 13:11:13.385782 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:13.359648 22253 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.392228 15231 raft_consensus.cc:2393] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:13.413031 15974 leader_election.cc:400] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 23. Current term is 24.
I20260709 13:11:13.413090 15308 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:13.400993 22149 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.388546 22166 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.399811 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.397979 15302 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:13.404759 21697 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.413610 15974 leader_election.cc:403] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.417158 15228 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:13.418231 16006 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:11:13.370990 22110 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:13.422248 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:13.422876 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.418793 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3030) took 1439 ms. Trace:
I20260709 13:11:13.422350 22043 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:13.415419 22139 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:13.428093 22139 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.429477 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:13.431317 22253 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.431604 22139 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.424969 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:13.434136 22166 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.435529 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.427479 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:13.426965 22043 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.437670 22043 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:13.438884 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57306.2us
I20260709 13:11:13.439993 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:13.441617 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:13.425446 22044 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:13.441715 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:13.427547 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.411008 16008 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:13.446693 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.447916 16006 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:13.417677 16002 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 24.
I20260709 13:11:13.443506 15230 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:13.455003 15301 raft_consensus.cc:2393] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:13.425053 15224 rpcz_store.cc:276] 0709 13:11:11.980063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.980265 (+   202us) service_pool.cc:224] Handling call
0709 13:11:13.121532 (+1141267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.206757 (+ 85225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.319492 (+112735us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54001c6e54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:13.409862 (+ 90370us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001c6e50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:13.418717 (+  8855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2715475072}
I20260709 13:11:13.455534 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:13.467129 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:13.442456 22318 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:13.428052 22225 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:13.454774 21697 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:13.483771 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:13.438922 22149 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.457679 22288 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 23. Current term is 24.
I20260709 13:11:13.485066 15305 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:13.442598 22044 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.494442 15230 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:13.495234 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.484000 22067 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:13.483879 22318 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.501353 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:13.454699 22110 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.504527 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:13.510735 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69136.4us
I20260709 13:11:13.513880 21999 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.514046 22067 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:13.535643 22067 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.538863 22044 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.540617 22253 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:13.541234 22083 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:13.542133 22083 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:13.541831 22253 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.543174 22083 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.556488 22253 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.562809 15233 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:13.573096 22043 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.573971 22110 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.575049 22265 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:13.567469 22149 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:13.577369 22149 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.581941 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.582715 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.583076 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.505949 22318 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.588857 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.584007 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.590564 16003 raft_consensus.cc:2393] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:13.585364 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.582232 22204 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.514307 21948 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.594482 22204 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.596974 21948 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.511267 22275 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:13.583424 16005 raft_consensus.cc:2376] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17. Re-sending same reply.
I20260709 13:11:13.598898 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.597486 22204 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.602320 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:13.604462 22265 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.605080 22265 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.607744 22265 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:13.511374 22257 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:13.610682 15233 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:13.611598 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:13.612516 16004 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:13.612454 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.613056 22149 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:13.613767 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 351948us
I20260709 13:11:13.614795 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:13.616591 22275 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.594264 22043 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.514643 22206 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:13.603976 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.617775 22206 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:13.618384 16006 raft_consensus.cc:2376] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14. Re-sending same reply.
I20260709 13:11:13.618871 22206 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.619789 15999 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
W20260709 13:11:13.620581 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.621878 22311 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:13.622460 22311 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.623238 22043 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.635074 22288 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:13.642426 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 51967us
W20260709 13:11:13.643953 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.645797 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:13.641824 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:13.657925 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 88414.7us
I20260709 13:11:13.659090 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:13.659307 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:13.661209 16000 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:11:13.661278 22257 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:13.662142 22311 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.662575 22257 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:11:13.667953 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.673059 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:13.665640 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.684903 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:13.624022 22043 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.687314 15380 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 22: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:13.676442 22275 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.693200 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:13.681218 22149 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:13.711941 22149 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:13.713384 22149 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.686560 22257 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:13.722348 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:13.686774 22321 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:13.676753 22044 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:13.692021 22154 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:13.752803 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:13.730355 22139 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:13.755970 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.757727 15380 raft_consensus.cc:2393] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:13.757893 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:13.760839 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:13.792729 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 121224us
W20260709 13:11:13.810962 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 135981us
I20260709 13:11:13.815953 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:13.779091 22139 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:13.828398 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:13.836798 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:13.839006 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:13.840817 22206 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:13.868211 22043 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:13.815140 22257 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.871810 22043 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:13.872573 22043 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.874256 22225 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:13.874760 22225 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.875164 22225 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:13.875487 22043 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:13.881680 22309 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:13.882308 22309 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:13.869570 22139 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:13.894888 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 44055.4us
I20260709 13:11:13.898139 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:13.883554 22309 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.906764 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:13.923416 15379 raft_consensus.cc:2410] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:11:13.936034 15305 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:11:13.936517 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 124626us
I20260709 13:11:13.938185 15274 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:13.939235 22043 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:13.939838 22043 raft_consensus.cc:697] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:13.941246 22043 consensus_queue.cc:237] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.941992 22083 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.908808 22044 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.969911 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:13.970829 15305 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:13.942618 22083 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:13.974073 15380 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:13.977054 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:13.979537 15228 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:11:13.979966 15228 pending_rounds.cc:85] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 11
I20260709 13:11:13.980156 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:13.980940 15374 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:13.979110 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:14.009507 15307 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 9.
I20260709 13:11:14.014016 16003 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:11:14.022049 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.980232 15228 pending_rounds.cc:107] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:11:14.024956 15228 raft_consensus.cc:2889] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:13.962577 22320 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:13.942643 21948 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:11:14.044893 22154 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.080737 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:14.047211 15381 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:13.967470 22044 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:14.048157 22333 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:11:14.049409 15300 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:14.053792 22275 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:13.973435 22265 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:14.059417 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.061779 15299 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:14.068320 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:14.068804 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:14.069156 15230 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:13.950485 22321 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.069s
I20260709 13:11:14.081714 22110 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:14.073714 22225 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.103024 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.076567 22083 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:14.079756 22149 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:14.103828 15227 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
W20260709 13:11:14.096824 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71140.2us
W20260709 13:11:14.100792 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 69375.2us
I20260709 13:11:14.118934 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:14.119488 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.116153 16001 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:13.963223 22206 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.102069 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:14.119737 15227 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:14.126953 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:14.134495 15999 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:14.138463 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:14.142560 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.143461 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.146560 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.135666 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:14.148504 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46576.1us
I20260709 13:11:14.102931 22281 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.104861 22110 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.159492 15379 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:14.159757 15227 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:14.162181 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.166754 15305 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:11:14.162094 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.170975 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.171890 15379 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:14.172056 15373 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:14.166409 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.167527 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.148810 22083 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.096325 22265 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.086961 22320 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.197767 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.162813 22110 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:14.166713 22177 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:14.128019 22275 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.138746 22149 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.223556 15301 raft_consensus.cc:1240] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:14.224458 15381 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:14.229717 15374 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:14.229776 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:14.224453 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109707us
W20260709 13:11:14.240475 15124 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 204) took 41521 ms (client timeout 15000 ms). Trace:
I20260709 13:11:14.244467 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.245491 15379 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:14.246335 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.247138 15382 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:14.188791 22228 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:11:14.246484 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.224453 22321 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:14.169281 22281 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:14.278501 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 142958us
I20260709 13:11:14.258383 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.264880 15374 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:14.266454 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.281052 15274 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:14.281172 15376 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:14.281491 15274 leader_election.cc:403] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:14.266570 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.268738 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.268888 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:14.281951 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.270175 15307 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:14.282266 15373 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:14.273950 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:14.288759 22043 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:14.228960 22291 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:11:14.298378 22149 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:14.300701 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.302412 22206 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.304267 22044 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:14.304569 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.304267 22320 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:14.241174 15124 rpcz_store.cc:269] 0709 13:10:32.583336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.583640 (+   304us) service_pool.cc:224] Handling call
0709 13:11:14.090026 (+41506386us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:06.225871 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:06.226752 (+   881us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:06.226814 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:11:06.226843 (+    29us) tablet.cc:662] Decoding operations
0709 13:11:06.288689 (+ 61846us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:06.288781 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:06.288818 (+    37us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:11:06.306776 (+ 17958us) tablet.cc:701] Row locks acquired
0709 13:11:06.324242 (+ 17466us) write_op.cc:260] PREPARE: finished
0709 13:11:06.324429 (+   187us) write_op.cc:270] Start()
0709 13:11:06.324583 (+   154us) write_op.cc:276] Timestamp: P: 1783602666324363 usec, L: 0
0709 13:11:06.324622 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:11:06.458311 (+133689us) log.cc:844] Serialized 9065 byte log entry
0709 13:11:07.824193 (+1365882us) op_driver.cc:464] REPLICATION: finished
0709 13:11:08.300711 (+476518us) write_op.cc:301] APPLY: starting
0709 13:11:08.300838 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:08.773451 (+472613us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:08.811187 (+ 37736us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:09.932029 (+1120842us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2332a 00007f2f53aa8f14 00007f2f53aa8ec3 00007f2f53aa8e38 00007f2f53aa8df3 00007f2f53aa80dc 00007f2f53ad1e16 00007f2f53ab9cbb 00007f2f53aa439d 00007f2f53aa7d75
0709 13:11:09.933203 (+  1174us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:09.934133 (+   930us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:11:09.934217 (+    84us) write_op.cc:312] APPLY: finished
0709 13:11:09.934854 (+   637us) log.cc:844] Serialized 204 byte log entry
0709 13:11:10.148704 (+213850us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:10.173757 (+ 25053us) write_op.cc:454] Released schema lock
0709 13:11:10.173874 (+   117us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:10.174622 (+   748us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:10.174661 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66534,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":460298,"apply.run_cpu_time_us":79392,"apply.run_wall_time_us":1874824,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100175,"num_ops":23,"prepare.queue_time_us":157690,"prepare.run_cpu_time_us":14451,"prepare.run_wall_time_us":388919,"raft.queue_time_us":821269,"raft.run_cpu_time_us":80218,"raft.run_wall_time_us":2243914,"replication_time_us":1433782,"spinlock_wait_cycles":103875200,"thread_start_us":1964124,"threads_started":5,"wal-append.queue_time_us":509479,"wal-append.run_cpu_time_us":113158,"wal-append.run_wall_time_us":2972612}]]}
W20260709 13:11:14.307827 22318 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.005s
I20260709 13:11:14.234625 22347 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:11:14.313746 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.226044 22083 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.315937 15300 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:14.316018 22318 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.323974 15375 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:14.292053 22275 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:14.309533 22321 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:14.329496 15376 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:14.330476 15971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.372500 22265 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:14.376847 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.380311 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.381496 15376 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:14.343264 15299 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:14.329357 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.383232 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:14.344982 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.357650 22291 consensus_queue.cc:1243] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:11:14.327244 22348 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:14.361815 22281 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.364552 22318 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.368103 22043 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.370709 22309 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.371501 22343 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:14.372113 22253 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:14.378610 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:14.384704 15374 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:14.361454 15375 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:14.385581 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.397606 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.337592 22292 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 13:11:14.412576 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64870.1us
I20260709 13:11:14.388264 22348 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:14.387612 22339 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:11:14.401623 15226 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:14.385079 22275 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:14.411937 15308 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.412813 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:14.403152 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 124899us
I20260709 13:11:14.415822 15229 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:14.424995 15305 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:14.425675 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.426465 15230 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:14.426878 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.427971 15300 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.428109 22225 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:14.428877 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:14.440831 15307 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:11:14.443084 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 169204us
I20260709 13:11:14.401268 22291 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:11:14.418454 22348 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.446301 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.448088 22225 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:14.449225 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:14.449734 22083 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.429179 22275 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.414561 22043 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.407126 22281 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:11:14.417805 22335 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:14.428372 22343 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.483845 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.413045 22253 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.506309 15307 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:14.508469 22335 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:14.512661 15306 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:14.513203 15308 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:14.514804 22253 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.515493 22275 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.516930 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.517639 15308 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:14.517989 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.524134 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:14.525007 16000 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:14.524091 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:14.526177 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.483343 22349 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:14.528025 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.529786 15230 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.546957 15300 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:14.549206 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:14.549453 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:14.576270 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.550998 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:14.569993 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.550530 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.573604 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.580690 15307 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:14.579782 15226 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:14.483470 22110 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.579972 15225 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
W20260709 13:11:14.590724 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66740.6us
I20260709 13:11:14.483876 22265 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:11:14.598088 15308 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
W20260709 13:11:14.603964 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 451747us
W20260709 13:11:14.604585 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.574818 21697 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.481439 22321 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.533036 22166 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 13:11:14.575349 22349 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:14.637633 22349 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.626255 16000 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 23.
W20260709 13:11:14.626682 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 198889us
I20260709 13:11:14.543061 22257 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:11:14.646413 22110 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:14.608289 22358 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.632634 21697 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.635385 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.641906 22177 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:14.598387 22281 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:14.657428 22281 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.657872 22281 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:14.664729 16003 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:14.665481 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.667253 15302 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:14.631786 16001 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:14.598023 22354 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.656927 21697 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:14.668287 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.677977 15304 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.679924 15307 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:11:14.652258 22265 consensus_queue.cc:1243] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:11:14.682871 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 145433us
I20260709 13:11:14.651707 22335 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.681809 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.686612 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.677377 22291 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:14.689996 22291 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:14.689682 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.670830 22177 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.694800 15307 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:14.701615 22358 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:14.689631 22043 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.691192 22291 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.712776 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.714442 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.714861 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.715790 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.716650 15374 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:14.717567 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.717662 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.718935 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.719022 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.720544 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.721200 15376 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:14.716153 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.728010 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.728945 15374 raft_consensus.cc:2368] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:14.727852 16001 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:14.739423 15376 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:14.712023 22291 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:14.751942 15376 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:14.774416 22281 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.782169 15382 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:14.734305 22343 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.790912 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:14.790755 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.802757 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.803778 15305 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.808267 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.822396 16001 raft_consensus.cc:1275] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:14.825414 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.829375 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.830349 15299 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:14.831630 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.839663 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.827812 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.841501 15304 raft_consensus.cc:2376] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17. Re-sending same reply.
I20260709 13:11:14.843007 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.839351 22348 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.851392 22348 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:14.840590 15302 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.827773 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.852949 15299 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:14.856988 15301 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.857445 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.854272 15304 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:14.854174 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.859270 15305 raft_consensus.cc:2376] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15. Re-sending same reply.
I20260709 13:11:14.860847 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.862178 15299 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.867758 15228 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:14.865447 22288 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.868703 22288 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.872323 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.873104 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.864544 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.874752 15304 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:14.876157 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.878921 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:14.880116 15228 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:11:14.878742 22353 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:14.881404 15306 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.875684 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.884287 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.875245 15301 raft_consensus.cc:2376] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11. Re-sending same reply.
I20260709 13:11:14.886283 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.885193 15305 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:14.890807 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.892771 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.893877 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.890956 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.895344 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.896085 15305 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
W20260709 13:11:14.897275 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.897606 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.898500 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:14.897809 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.899401 15226 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:14.900674 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.896445 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.902561 15299 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.902519 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.888882 22139 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.919090 22139 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.921751 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.922968 15302 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.889451 22206 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:14.924537 15302 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:14.924806 22206 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:14.926115 15302 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:14.927311 22206 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.927507 15302 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:14.898438 22288 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.929517 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.932755 22139 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:14.935037 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.904119 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:14.939358 15302 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:14.905139 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:14.941049 15306 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:14.923921 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.907172 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.907388 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46420 (request call id 1209) took 1242 ms. Trace:
I20260709 13:11:14.895967 22353 consensus_queue.cc:1243] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:11:14.884490 22177 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:14.933655 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:14.971421 15232 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:14.943959 15224 rpcz_store.cc:276] 0709 13:11:13.665168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.665357 (+   189us) service_pool.cc:224] Handling call
0709 13:11:14.907170 (+1241813us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54003ce454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:14.907325 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041108864}
I20260709 13:11:14.944888 15305 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:14.906906 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.949697 15300 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:14.950837 22149 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:14.938062 15377 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:11:14.953003 15303 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:14.954813 22083 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:14.955315 22336 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:14.955368 22166 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:14.956634 22281 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:14.958546 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:14.959498 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:14.963389 15999 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:14.964401 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:14.976769 15301 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:14.977519 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:14.980748 16003 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:14.985540 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:15.012095 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:15.000927 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:15.015954 15306 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.000998 15973 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.017963 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:15.019044 15301 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
W20260709 13:11:15.021157 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 43708.3us
I20260709 13:11:15.027673 15226 raft_consensus.cc:2468] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:11:15.029539 16000 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:15.030136 16000 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:15.033840 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:15.033883 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:15.034735 15375 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:15.035051 15377 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:15.037348 15307 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:15.039448 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.974920 22149 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:15.046275 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:15.044904 15345 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.588s (SENT)
I20260709 13:11:15.047078 15304 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 15.
I20260709 13:11:15.001554 22204 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:15.054850 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:15.038935 22369 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:11:15.019199 22110 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:15.060469 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:15.056535 16000 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.060817 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:15.061789 15377 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:14.990620 22043 consensus_queue.cc:1048] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:11:15.064899 21948 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:15.065405 21948 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.065809 21948 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.077057 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.039876 22353 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:15.084408 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.086112 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.039237 22253 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:15.093480 16000 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:15.096426 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 136997us
I20260709 13:11:15.098238 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:15.100708 15974 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:15.106592 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.091055 15231 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:15.114118 15378 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:15.130263 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.137837 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:15.028771 22166 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.035506 22225 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:11:15.011577 22083 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.157761 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.027416 22354 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:11:15.147145 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.090013 22353 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:15.118463 22372 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:11:15.169966 15227 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:11:15.054025 22265 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:11:15.044704 22336 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:15.166136 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 61669.2us
I20260709 13:11:15.110240 22253 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:15.116854 22291 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:15.220103 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:15.242319 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.218777 22350 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.225986 15233 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:11:15.226136 22320 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:15.226883 22357 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.129200 22347 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:15.237506 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 192617us
W20260709 13:11:15.274770 15345 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.631s (SENT)
I20260709 13:11:15.275518 15345 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:15.172040 22288 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.242198 15228 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:15.245777 22339 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:15.278258 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.302341 15227 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:15.246493 22253 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.107180 22204 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.279670 22357 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.306905 22204 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.216228 22353 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.282197 15233 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:15.233994 22358 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:15.282888 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 100298us
I20260709 13:11:15.263695 16000 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:11:15.149668 22311 raft_consensus.cc:2804] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:15.276891 22288 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.277907 22385 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:11:15.292626 22083 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:15.258319 22350 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.294253 22394 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:15.257198 22320 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.271739 22110 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:15.291862 22206 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.330080 15228 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:15.331281 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:15.334192 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 187174us
W20260709 13:11:15.283694 22376 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:11:15.230643 22149 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.340868 22177 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.330948 22139 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:15.342492 22336 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.342993 22166 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:15.379518 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 302541us
I20260709 13:11:15.354017 22225 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:15.349255 15306 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:15.360231 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.336655 22358 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.357695 22320 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:15.344668 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70114.4us
W20260709 13:11:15.413391 15345 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Timed out: RequestConsensusVote RPC to 127.13.196.66:37121 timed out after 1.645s (SENT)
I20260709 13:11:15.397197 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:15.367162 21697 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:11:15.404723 22378 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:11:15.405718 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:15.421295 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:15.406011 22379 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:11:15.368283 22206 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.387955 22139 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.432689 22139 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:15.412496 22347 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 13:11:15.424268 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 112573us
I20260709 13:11:15.398123 22343 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.403187 22043 raft_consensus.cc:2764] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:11:15.413589 22149 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:15.423316 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.447985 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.421849 21697 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:15.459970 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46635.1us
I20260709 13:11:15.461254 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.462049 15228 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:11:15.457386 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.468485 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:15.474169 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 70235.7us
I20260709 13:11:15.474501 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.436307 22253 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.452864 22357 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.481370 21697 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.482847 21697 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:15.477632 22347 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:15.485366 22347 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:15.485599 22358 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.486310 22347 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.487749 22347 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.466272 22225 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:15.489115 22043 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:15.489217 22350 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.481976 22206 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.494028 22253 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:15.470247 22110 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.498570 22336 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:15.498695 22383 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:15.500663 22383 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:15.501102 22383 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:15.502177 22383 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.503715 22383 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:15.479972 22352 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:15.505044 22352 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.505468 22352 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:15.507956 22288 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.509368 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:15.509869 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52618.2us
I20260709 13:11:15.510298 22204 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:15.511675 22392 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:15.475812 22166 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:11:15.500067 22336 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:15.514992 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:15.527361 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:15.530092 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.536440 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:15.536773 22396 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:11:15.512074 22204 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:15.538954 22204 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:15.539546 22204 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.544642 22394 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:15.545288 22394 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.545707 22394 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.530723 21863 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:15.521911 22336 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:15.473670 22311 raft_consensus.cc:697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:15.512302 22392 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.556048 16002 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:15.558405 22253 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.561578 22253 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.564009 22253 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.571502 22225 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:15.572897 22225 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:15.573963 15380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3750) took 1340 ms. Trace:
I20260709 13:11:15.532776 22149 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:11:15.574510 15380 rpcz_store.cc:276] 0709 13:11:14.233780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.249369 (+ 15589us) service_pool.cc:224] Handling call
0709 13:11:15.572981 (+1323612us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:11:15.573247 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.573507 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.573539 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.573593 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:15.573628 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.573702 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.573860 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557312}
W20260709 13:11:15.577342 21948 consensus_meta.cc:287] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.004s
I20260709 13:11:15.584748 21948 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.590812 22154 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:15.597975 22394 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.599239 22154 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:15.599660 22154 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:15.600680 22154 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.601377 15301 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:15.602053 22154 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:15.602957 22394 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:15.592693 22390 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:15.559357 22392 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.549782 22336 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.605862 22336 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:15.606383 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 48481us
W20260709 13:11:15.596872 22312 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:11:15.603080 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:15.596414 15302 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:15.606873 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:15.579259 22353 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.608309 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:15.621726 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:15.624567 15301 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:15.624713 15305 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.628058 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:15.630079 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:15.629189 15304 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
W20260709 13:11:15.715458 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 247001us
I20260709 13:11:15.717553 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:15.681278 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60028.1us
W20260709 13:11:15.738581 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.746646 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:15.738086 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:15.746075 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62337.9us
I20260709 13:11:15.818730 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75432bd549b3481d83070979a305922b"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:15.819939 15225 raft_consensus.cc:606] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:15.820395 15225 raft_consensus.cc:614] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:15.618409 22318 consensus_queue.cc:1175] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 17 status { last_received { term: 16 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:15.828188 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:15.829228 16006 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:15.574021 22225 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:15.840952 22343 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:15.841655 22343 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:15.842077 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 124665us
I20260709 13:11:15.844482 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:15.748314 22385 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:11:15.845571 22358 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:15.855820 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.865567 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57017us
I20260709 13:11:15.844106 22343 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:15.893250 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48905.2us
I20260709 13:11:15.893520 22343 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.894666 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:15.904402 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 374344us
I20260709 13:11:15.905550 15273 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:15.906865 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:15.907334 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 405892us
I20260709 13:11:15.909694 15305 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:11:15.857267 22206 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.913056 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:15.912225 16006 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:15.914803 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:15.858697 22394 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:15.864481 21948 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:15.917502 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.928427 21863 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:15.909148 22343 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:15.870838 22204 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:15.944010 21863 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:15.990056 21863 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:15.997411 22405 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:16.009616 22398 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:16.016254 22407 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:11:16.028649 22410 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:16.030440 22406 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:16.030892 22350 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:15.868624 22311 consensus_queue.cc:237] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:15.919741 22206 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.035742 22395 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:15.926744 22394 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:16.039182 22347 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
W20260709 13:11:16.049335 22320 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
W20260709 13:11:16.053331 22139 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 13:11:16.059021 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:16.124534 15225 raft_consensus.cc:606] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:16.062023 15233 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:16.069777 15224 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:16.071452 15232 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:16.072018 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.971926 22368 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:16.073753 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:16.132586 15228 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:16.075067 22204 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:16.075431 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:16.077484 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 999) took 1055 ms. Trace:
I20260709 13:11:16.077801 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:16.078706 22352 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 13:11:16.079883 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:15.971032 22315 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.134023 15307 rpcz_store.cc:276] 0709 13:11:15.022375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.026235 (+  3860us) service_pool.cc:224] Handling call
0709 13:11:15.037037 (+ 10802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.037962 (+   925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.077235 (+1039273us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540017a050. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:16.077381 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23680384}
I20260709 13:11:16.111820 22318 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:16.098172 22177 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.173857 15226 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:16.176069 22353 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.176257 22315 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.173636 22352 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:16.181246 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 268256us
I20260709 13:11:16.182555 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.132352 22368 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:16.117799 21697 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.007s
W20260709 13:11:16.215229 15974 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.237597 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55158.2us
I20260709 13:11:16.264557 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:16.260762 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 361983us
W20260709 13:11:16.243701 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60125.4us
I20260709 13:11:16.283512 15273 leader_election.cc:400] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:16.285048 15273 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.287391 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:16.132763 22320 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.105379 22410 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.103133 22398 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.242532 22368 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:16.303525 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 388780us
W20260709 13:11:16.288920 15971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.020s	sys 0.052s
I20260709 13:11:16.243292 22343 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:16.309979 15971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.020s	sys 0.052s
I20260709 13:11:16.135957 22139 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:16.314685 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 576655us
I20260709 13:11:16.412322 16003 raft_consensus.cc:1240] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:16.412766 15971 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:16.308748 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:16.413993 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 106816us
I20260709 13:11:16.414742 22390 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:16.415375 22390 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:16.415808 22390 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:16.181439 22318 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:16.294657 22392 consensus_meta.cc:287] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.689s	user 0.013s	sys 0.002s
W20260709 13:11:16.380180 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 95234.3us
W20260709 13:11:16.308305 22154 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.006s
I20260709 13:11:16.305513 22347 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:16.418015 22392 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.185247 22177 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.421902 22414 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:16.422608 22414 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.424475 22312 raft_consensus.cc:2804] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:16.425168 22312 raft_consensus.cc:697] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:16.426126 22312 consensus_queue.cc:237] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.384603 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:16.429113 15232 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:16.429796 22398 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:16.381667 22043 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.432786 22043 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.434502 22352 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.438942 22392 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:16.441437 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:16.384531 22253 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:16.442207 15307 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:16.442611 22253 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:16.445425 22417 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:16.450383 15303 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:16.449391 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:16.458220 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 73432.3us
I20260709 13:11:16.286669 22350 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:16.414094 16006 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:11:16.417582 22067 raft_consensus.cc:993] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:11:16.463842 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:16.466378 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:16.472532 15380 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:16.443789 22253 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.310340 21697 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:11:16.474960 15374 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:16.393061 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.477885 15379 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:16.476447 15307 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:16.478441 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.489691 15374 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:16.490983 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.491161 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.491567 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.519327 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:16.519280 15379 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
W20260709 13:11:16.521865 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.521307 15382 raft_consensus.cc:2410] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:16.524632 15378 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:16.525775 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48326.5us
I20260709 13:11:16.528930 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:16.529222 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.529538 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.529695 15304 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:16.531095 15377 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:16.531589 15374 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:16.531998 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:16.532719 15304 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:16.532850 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.533133 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:16.533713 16006 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:16.539557 15232 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:11:16.541343 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.520684 22206 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:16.573752 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 180827us
I20260709 13:11:16.580506 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.591526 15375 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:16.580757 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.598654 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.470696 22275 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:11:16.526471 15381 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:16.530983 22358 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:16.602382 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:16.590310 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:16.526779 22349 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.816s	user 0.025s	sys 0.023s
W20260709 13:11:16.602555 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65651.5us
I20260709 13:11:16.601591 22177 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.572985 22318 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:16.607722 22349 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.895s	user 0.025s	sys 0.023s
I20260709 13:11:16.640058 22423 raft_consensus.cc:1081] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
W20260709 13:11:16.640980 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49596.4us
W20260709 13:11:16.641975 22424 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:16.642164 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.639855 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:16.644593 15382 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.638801 22315 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.580526 22410 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:16.590926 22394 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.477849 22343 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:11:16.700678 22197 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:11:16.730737 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88701.2us
I20260709 13:11:16.709183 22043 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.710168 22414 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.740469 22419 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:16.740976 22411 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:16.732932 22399 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.773502 22411 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:16.765847 15304 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:11:16.741766 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:16.775949 15304 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.776132 15301 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:11:16.776429 15304 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:16.745939 22413 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:16.777263 22413 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:16.771018 22383 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.267s	user 0.010s	sys 0.007s
I20260709 13:11:16.752192 15382 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:16.755702 22390 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.711491 22349 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:16.722020 22351 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:16.768177 22336 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.140s	user 0.015s	sys 0.000s
I20260709 13:11:16.787220 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:16.789831 15381 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:16.797919 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:16.803035 15308 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:16.805053 15375 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:16.806428 22350 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:16.807139 22350 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.808446 22139 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:16.810192 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44152.3us
I20260709 13:11:16.772450 22419 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.814603 22419 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:16.812114 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.774019 22399 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.824913 22336 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:16.825819 22336 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.830054 15304 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.831924 22390 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.832571 22351 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:16.835790 15304 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:16.837953 22351 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.840209 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:16.841405 15381 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:16.775278 22411 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.846117 22197 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:16.778563 22413 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.854480 22197 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:16.863011 22351 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:16.864991 22197 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:16.839452 22139 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:16.874928 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:16.875957 15225 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:16.867740 16000 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:16.868431 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:16.877548 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:16.877708 16003 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 11.
I20260709 13:11:16.870564 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:16.879081 15304 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:16.871798 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:16.896986 15232 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:16.893421 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.877154 22349 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:16.883435 22427 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:11:16.873797 22377 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:11:16.905807 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 65726.3us
I20260709 13:11:16.921849 15345 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:16.932644 15304 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
W20260709 13:11:16.883618 22421 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:11:16.944320 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:16.897495 22350 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:16.887389 22392 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.915194 21863 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.915623 22197 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.896092 22347 consensus_queue.cc:1059] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 13:11:16.968001 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 67863.5us
I20260709 13:11:16.971859 22197 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.972726 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:16.973402 15233 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:16.975521 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:16.911203 22398 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:11:16.976274 15303 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:16.883731 22422 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:11:16.963091 22349 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.997161 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 49947.6us
I20260709 13:11:16.982692 22434 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:16.995743 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:16.987501 22410 raft_consensus.cc:3055] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:17.005332 22399 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:16.946575 22377 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.010627 15233 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:16.980672 21863 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.997702 22265 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:16.991500 22349 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:16.971285 22392 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.014577 22410 raft_consensus.cc:740] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:17.024713 22416 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:17.064671 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:17.070149 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:17.034386 22265 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:17.070712 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 76233.1us
I20260709 13:11:17.071767 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:17.073210 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65842us
I20260709 13:11:17.093197 15302 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:17.070971 22166 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:11:17.103840 15225 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:17.065402 22399 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
W20260709 13:11:17.108148 22430 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:11:17.076179 22416 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.068130 22320 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.113703 15198 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.121050 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.089749 22197 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.124492 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.112273 22416 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:17.108201 22385 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:17.069273 22390 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:17.126538 22166 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:17.174811 22385 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:17.174402 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.169284 22392 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:17.177956 22385 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.173175 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:17.179158 15302 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
I20260709 13:11:17.152194 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.181432 22350 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:17.126775 22410 consensus_queue.cc:260] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.159134 22377 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.125988 22383 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:17.138240 22253 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:17.182054 22350 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.165221 22368 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.844s	user 0.015s	sys 0.000s
I20260709 13:11:17.201923 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:17.200951 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.213199 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:17.187832 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63479.1us
I20260709 13:11:17.204589 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:17.206833 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:17.216071 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:17.215624 15233 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.156733 22257 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:17.190935 22396 raft_consensus.cc:3055] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:17.165789 22349 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:17.127921 22265 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.205817 22154 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.263263 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.209709 22419 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:17.220785 22410 raft_consensus.cc:3060] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:17.221457 22336 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.222868 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:17.223652 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:17.225538 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:17.215703 22351 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:17.188206 22166 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.234464 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:17.210608 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.237718 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:17.278579 15225 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:17.238860 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:17.278954 15225 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:17.279426 15307 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.279747 15233 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:17.188441 22139 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:17.324028 22434 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:17.248256 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.248692 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:17.249653 16002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 993) took 1603 ms. Trace:
I20260709 13:11:17.210685 22350 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.146725 22320 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:11:17.355991 22320 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:17.357144 22320 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:17.357630 22320 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:17.358839 22320 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.265974 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:17.189376 22275 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:11:17.249007 22377 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:17.267292 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.361809 15380 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 13.
I20260709 13:11:17.210212 22253 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.273792 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.274859 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:17.366269 15224 raft_consensus.cc:606] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.360862 15303 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:11:17.366868 15224 raft_consensus.cc:614] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:17.273851 15230 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:17.250325 22396 raft_consensus.cc:740] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:17.285333 22265 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:17.292975 15225 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.294039 22149 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:17.294816 22413 consensus_queue.cc:1059] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:17.296746 22351 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:17.297277 22347 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.297013 22349 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.300489 21863 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.217842 22368 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.365303 22383 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.308948 22401 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:17.312801 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:17.372627 22320 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.318259 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.235821 22257 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:17.323267 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.254446 22321 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:17.280828 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.327886 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:17.398839 15375 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 10.
I20260709 13:11:17.330621 15307 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:11:17.244699 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:17.421149 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 176582us
I20260709 13:11:17.329413 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:17.425612 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 96313.8us
I20260709 13:11:17.346213 15378 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.291836 22385 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.353312 15301 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:17.268002 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:17.364032 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 115463us
I20260709 13:11:17.342343 16002 rpcz_store.cc:276] 0709 13:11:15.630586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.746697 (+116111us) service_pool.cc:224] Handling call
0709 13:11:15.747145 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.754581 (+  7436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.754633 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.755289 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.319861 (+564572us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:16.479893 (+160032us) log.cc:844] Serialized 14 byte log entry
0709 13:11:16.520569 (+ 40676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.520669 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.004205 (+483536us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b18004bd3c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1
0709 13:11:17.006271 (+  2066us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b18004bd3c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:11:17.228045 (+221774us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b18004bd3c0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:11:17.233332 (+  5287us) raft_consensus.cc:1685] finished
0709 13:11:17.233372 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.233591 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13520,"prepare.queue_time_us":203598,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":54243,"raft.run_cpu_time_us":561,"raft.run_wall_time_us":39970,"spinlock_wait_cycles":33572864,"thread_start_us":444850,"threads_started":1,"wal-append.queue_time_us":672259}
I20260709 13:11:17.368846 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:17.433472 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:17.433874 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 65183.1us
I20260709 13:11:17.435072 15274 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.370879 15225 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:17.437130 22253 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.437815 22253 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:17.438553 22253 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:17.439051 22253 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:17.276556 22154 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.393385 15308 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:17.313663 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:17.441310 15305 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:17.279946 22419 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.400326 22351 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.374099 22149 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:17.447932 15232 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:17.449720 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:17.383677 22377 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.411777 22166 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:17.392325 22349 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.414192 22368 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.414419 16001 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:11:17.382408 22413 consensus_queue.cc:1243] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer 5c70ddb5aae14b059dc90fd40125b034 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:17.473806 15227 raft_consensus.cc:1240] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:17.461742 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.480202 15226 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:11:17.441155 22375 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:17.480997 15226 pending_rounds.cc:85] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 15
I20260709 13:11:17.485867 15226 pending_rounds.cc:107] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:11:17.486467 15226 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:17.417363 22321 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:17.390384 22347 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.440868 22383 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:17.492951 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.496995 15229 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:17.457082 22149 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.455706 22336 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:17.417382 22401 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.519999 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 674) took 1107 ms. Trace:
I20260709 13:11:17.480129 22197 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.508798 22383 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.522732 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 349566us
I20260709 13:11:17.521741 16001 rpcz_store.cc:276] 0709 13:11:16.412094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.412547 (+   453us) service_pool.cc:224] Handling call
0709 13:11:16.412865 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.460841 (+1047976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.519671 (+ 58830us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540068d654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:17.519918 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302526208}
W20260709 13:11:17.530052 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 459975us
I20260709 13:11:17.532133 15225 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:17.505249 22204 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:17.522683 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.530392 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:17.439965 22253 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.479771 22083 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:11:17.569386 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:17.573570 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50995.6us
W20260709 13:11:17.582803 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 221194us
I20260709 13:11:17.519043 22166 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:17.581462 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 270425us
I20260709 13:11:17.541891 22204 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.519819 22375 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:11:17.533099 22383 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.619697 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.605926 22411 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:17.621639 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.625691 22204 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.642556 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.538867 22197 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.609417 22336 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:11:17.637315 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 210337us
I20260709 13:11:17.639246 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:17.644114 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 209149us
I20260709 13:11:17.658162 15348 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.662029 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:17.654989 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 167668us
I20260709 13:11:17.621013 22166 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:17.679067 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 142813us
I20260709 13:11:17.680503 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:17.637526 22422 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:17.644157 22411 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:17.658923 22388 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:17.656028 21863 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:17.697158 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.666858 22398 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:17.700320 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:17.669215 22385 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:17.678479 22336 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:17.686173 22166 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.695431 22411 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.710034 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:17.677227 22390 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.697238 22154 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:17.627345 22321 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:17.721288 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59346.7us
I20260709 13:11:17.693770 22435 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:17.701361 21863 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:17.704334 22392 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:17.681835 22448 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:11:17.749604 22336 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.742843 22139 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:17.753800 22451 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:11:17.754997 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.757143 22197 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:17.758074 22445 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:17.759708 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:17.762431 15378 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:11:17.737432 22388 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:17.769490 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:17.746695 22422 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:17.714310 22452 consensus_queue.cc:1059] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 13:11:17.757187 22444 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:17.776604 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.777062 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:17.765293 22437 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:11:17.737950 22275 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:11:17.781608 22443 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:11:17.747042 21863 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:17.780640 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.788043 16001 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
W20260709 13:11:17.797747 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 123151us
I20260709 13:11:17.769667 22321 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:17.800906 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:17.805402 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.800050 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 123068us
I20260709 13:11:17.771526 22435 raft_consensus.cc:697] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:17.769996 22459 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.773818 22449 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:17.773967 22349 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:17.816970 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.827324 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:17.833384 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 73775us
I20260709 13:11:17.814252 22401 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:17.836328 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.817830 22455 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:17.837942 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.825444 22377 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:17.821930 22398 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:17.820693 22390 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:17.874652 22390 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.875385 22390 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:17.814007 22453 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:17.844287 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.845081 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.880614 22453 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:17.845953 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.881778 22453 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:17.883507 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.898869 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.820767 22420 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:11:17.901451 22388 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:17.825798 22449 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:17.858588 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:17.848640 22419 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:17.862939 22450 log.cc:927] Time spent T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:11:17.872627 22435 consensus_queue.cc:237] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.837039 22458 raft_consensus.cc:3055] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:17.847505 22455 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.918123 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:17.923069 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 195755us
W20260709 13:11:17.925622 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 87780.4us
W20260709 13:11:17.923372 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 262247us
W20260709 13:11:17.943864 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 243663us
I20260709 13:11:17.940426 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:17.950642 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:17.950519 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.954880 16001 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:17.942991 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3785) took 1399 ms. Trace:
I20260709 13:11:17.814558 22257 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:17.936064 22458 raft_consensus.cc:740] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:17.958750 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.906499 22468 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:17.959762 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:17.968232 15228 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:17.942919 22455 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:17.943274 22375 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:17.985965 22396 consensus_queue.cc:260] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.989449 22396 raft_consensus.cc:3060] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:17.989620 22458 consensus_queue.cc:260] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:17.991281 22458 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.965003 22419 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:17.957322 15379 rpcz_store.cc:276] 0709 13:11:16.543307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.543459 (+   152us) service_pool.cc:224] Handling call
0709 13:11:16.576816 (+ 33357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.582645 (+  5829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.582694 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.604590 (+ 21896us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.220449 (+615859us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b18003e2a20. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:11:17.505264 (+284815us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:17.515091 (+  9827us) log.cc:844] Serialized 14 byte log entry
0709 13:11:17.515331 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.515465 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.925052 (+409587us) raft_consensus.cc:1685] finished
0709 13:11:17.942735 (+ 17683us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.942921 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64969,"prepare.queue_time_us":9485,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":7586,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":13914,"spinlock_wait_cycles":40487040,"thread_start_us":284562,"threads_started":1,"wal-append.queue_time_us":997621}
I20260709 13:11:17.984858 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.000293 15227 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:17.962136 22420 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:17.996055 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:17.977185 22410 consensus_meta.cc:287] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.010s
I20260709 13:11:18.002467 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52412 (request call id 1336) took 1002 ms. Trace:
I20260709 13:11:18.003368 15971 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:17.993541 22476 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:18.004822 22476 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:17.993758 22257 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.004570 22459 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:18.008751 22459 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:18.009406 22459 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:11:18.010430 22320 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.001s
I20260709 13:11:18.011785 15380 raft_consensus.cc:1275] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:18.002902 15378 rpcz_store.cc:276] 0709 13:11:16.995270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.995440 (+   170us) service_pool.cc:224] Handling call
0709 13:11:17.996916 (+1001476us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540012a7d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:17.997131 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776267520}
I20260709 13:11:18.010645 22459 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.017293 22467 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:18.018378 21863 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.002228 22139 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:17.979753 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:18.001133 22375 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:18.024477 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 64804.5us
I20260709 13:11:17.981997 22347 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:17.981745 22413 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:17.971923 22468 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.005350 22476 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:18.042588 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63474.3us
I20260709 13:11:18.054704 16002 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:18.055365 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:18.030285 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:18.043385 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:18.050379 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:17.973809 22166 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:18.058965 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 147485us
I20260709 13:11:18.059000 15302 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:18.067481 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:18.038887 22466 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.029120 22478 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:18.042182 22419 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:18.115563 15227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
W20260709 13:11:18.148476 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 98934.4us
I20260709 13:11:18.032550 22465 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:18.095175 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:18.029090 22467 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.046030 22197 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:18.119215 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60435.6us
I20260709 13:11:18.057868 22468 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:18.066690 22154 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:18.049928 22390 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.066779 22349 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:18.164834 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.052704 22477 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:18.046497 22434 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:11:18.172971 22420 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:11:18.167513 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72445.7us
I20260709 13:11:18.070741 22482 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:17.998688 22398 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:18.149170 22383 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.003s
I20260709 13:11:18.146817 22460 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:18.192674 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.050372 22464 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.122s
W20260709 13:11:18.175155 22204 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.007s
I20260709 13:11:18.148227 22478 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:18.180044 22197 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.218582 22420 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:11:18.233451 22149 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.001s
W20260709 13:11:18.223585 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 156172us
W20260709 13:11:18.290058 22350 consensus_meta.cc:287] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.934s	user 0.013s	sys 0.003s
I20260709 13:11:18.169235 15302 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
W20260709 13:11:18.247877 22472 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:18.312690 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:18.176702 22467 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.250684 22419 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.252900 22349 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:18.326689 22349 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:18.327674 22349 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.328424 22149 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.329229 22349 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:18.330874 22149 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:18.332046 15378 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:18.332289 15230 raft_consensus.cc:1240] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:18.254370 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:18.263512 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:18.168761 22139 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:17.993734 22449 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.152590 22466 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.347957 22453 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.349959 22466 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.350916 22466 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:18.351428 22466 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:18.351949 22466 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.320539 22410 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.314383 22420 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:18.323542 22484 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:18.289579 22383 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.325110 22464 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:18.325971 22462 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.313637 22043 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.298007 22460 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:18.335762 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72362.6us
W20260709 13:11:18.335310 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81046.4us
I20260709 13:11:18.417806 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:18.345132 22477 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:11:18.345913 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.421597 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.347048 16001 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:18.333585 22350 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.303241 22478 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.305531 22469 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:11:18.318220 22390 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.362123 22197 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:18.363224 22411 consensus_meta.cc:287] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:11:18.362479 15126 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 15 to 18, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 18 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.297091 22482 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.365831 22166 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:18.366362 22321 consensus_meta.cc:287] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.005s
I20260709 13:11:18.366859 22149 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:18.435328 22494 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:18.458487 22149 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.458714 22494 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.459213 22149 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:18.370873 21863 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.464265 15377 raft_consensus.cc:1275] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:11:18.464802 15377 pending_rounds.cc:85] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 14
I20260709 13:11:18.465270 15377 pending_rounds.cc:107] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:11:18.465562 15377 raft_consensus.cc:2889] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.374387 22467 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:18.466131 22482 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.305045 22204 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.422649 22043 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.468737 22467 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.469318 22467 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.454257 22411 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.470510 22468 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.471769 22467 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:18.402783 22275 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:18.403124 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:18.472576 22275 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:18.473680 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70687.6us
I20260709 13:11:18.475157 22275 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.442306 22320 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:18.476586 22377 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.476779 22320 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.477223 22377 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.478540 16002 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:18.479329 22320 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.480221 22458 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:18.480967 22458 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:18.482023 22458 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.485061 22468 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:18.485447 22350 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.485850 22468 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:18.486428 22468 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.488163 15227 raft_consensus.cc:606] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:18.397629 22465 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:18.405597 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:18.488749 15227 raft_consensus.cc:614] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:18.403394 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.576s (SENT) [suppressed 31 similar messages]
I20260709 13:11:18.408458 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.489615 15229 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
W20260709 13:11:18.489651 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 86309.8us
I20260709 13:11:18.490717 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.434612 22434 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:18.413600 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.493738 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.494479 15307 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:18.495692 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:18.421065 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.497134 15307 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:18.498765 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:18.499723 15300 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:18.501174 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 185855us
W20260709 13:11:18.501914 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.502131 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:18.446410 22351 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.420984 22139 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.444706 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.422322 22460 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:18.457500 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.459396 22494 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:18.538777 15129 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 195) took 85077 ms (client timeout 15000 ms). Trace:
I20260709 13:11:18.373620 15381 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:18.377624 15231 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:11:18.385071 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 209992us
I20260709 13:11:18.469694 15233 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:11:18.406378 22385 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:18.411760 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.574889 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:18.576200 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.576882 15302 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:18.577754 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.504381 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.527356 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:18.543206 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.564289 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.421890 22462 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:18.424072 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.567618 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:18.539578 15129 rpcz_store.cc:269] 0709 13:09:53.379446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.416130 (+ 36684us) service_pool.cc:224] Handling call
0709 13:11:18.449738 (+85033608us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":962342,"reported_tablets":53}
I20260709 13:11:18.581607 15229 raft_consensus.cc:2393] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:18.583534 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:18.411052 22484 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.503743 22350 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:18.480229 22377 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:18.517266 22411 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:18.515887 22204 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.601058 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.536772 22139 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.517300 22467 consensus_queue.cc:1048] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:11:18.526852 22351 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.517115 22434 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.642573 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:18.707834 15307 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:18.673197 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:18.673609 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:18.610666 15300 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
W20260709 13:11:18.649737 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.685520 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1340) took 1368 ms. Trace:
I20260709 13:11:18.673316 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.659822 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:18.792549 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.828312 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:18.589188 22385 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.756420 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.825625 15126 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 10 to 13, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 13 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.849819 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:18.746088 15377 rpcz_store.cc:276] 0709 13:11:17.317167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.317315 (+   148us) service_pool.cc:224] Handling call
0709 13:11:17.317692 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.466073 (+1148381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.685095 (+219022us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400224f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:18.685423 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635749632}
I20260709 13:11:18.824030 15302 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
W20260709 13:11:18.842746 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 169692us
I20260709 13:11:18.857643 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:18.841771 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 182053us
W20260709 13:11:18.861158 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.611486 22336 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:18.850049 15307 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
W20260709 13:11:18.681321 22455 consensus_meta.cc:287] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.005s
I20260709 13:11:18.890944 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:18.890574 15126 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 7 to 10, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 10 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.642881 22469 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.897578 15232 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:18.899772 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:18.874311 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.906330 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 404046us
I20260709 13:11:18.907295 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:18.850201 22275 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:18.860883 22204 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:18.861310 22468 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:18.675057 22411 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:18.918776 15232 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:18.920022 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62477.1us
I20260709 13:11:18.921808 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:18.891160 22492 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:18.890776 22253 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:18.890683 22483 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:18.611759 22350 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.927824 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:18.770242 22321 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.143s
I20260709 13:11:18.932389 15376 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:18.941587 15126 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 9 to 12, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 12 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.946807 15232 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:18.947381 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:18.948272 15380 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.911167 22383 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:18.745474 22320 consensus_queue.cc:1059] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.172s
I20260709 13:11:18.950647 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:18.910624 22479 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:18.962845 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:18.976498 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:18.947865 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:18.916182 22204 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.983340 15376 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:18.980508 15382 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:18.975903 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 66587.2us
I20260709 13:11:18.935808 22468 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:18.935555 22459 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:18.935142 22347 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:19.010263 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:18.935567 22498 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.011847 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:18.901244 22455 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:18.939690 22435 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:18.993881 22204 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:19.020364 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98649.8us
I20260709 13:11:18.756604 22465 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:18.910944 22469 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:19.024024 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:19.017062 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:19.021397 15273 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.842s (SENT)
I20260709 13:11:19.045480 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:19.000933 22467 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:19.036139 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 104124us
I20260709 13:11:18.920689 22275 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.001066 22398 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:19.047302 15377 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:19.048115 22499 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:11:19.049424 22500 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:11:19.052516 22509 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:11:19.056905 22484 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:19.057897 22398 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.058570 22398 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.938689 22492 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.012526 22479 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.063012 22479 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.035599 22435 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.065294 15126 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:19.067086 22435 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:19.072986 15376 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:19.074546 22469 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:18.952252 22253 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.032969 22383 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:11:19.100459 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.101246 22385 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.102943 22350 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:18.946091 15363 tablet_service.cc:1558] Processing DeleteTablet for tablet 362d7a17088a4e86a51428b5ee97346e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:43900
I20260709 13:11:19.022536 22493 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:19.036983 22498 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:19.034934 15196 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:19.007108 22468 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:18.939531 22483 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.019889 15373 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:19.110960 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 3008) took 1771 ms. Trace:
I20260709 13:11:19.038888 15382 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
W20260709 13:11:19.113235 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 91861.7us
I20260709 13:11:19.114193 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:19.034969 22166 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.150588 15225 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:19.154951 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:11:19.170568 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 135732us
W20260709 13:11:19.174041 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59925.5us
I20260709 13:11:19.150810 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:19.131323 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.151818 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 1005) took 1052 ms. Trace:
I20260709 13:11:19.175762 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:19.176451 15375 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:19.170706 15380 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:19.165897 15231 rpcz_store.cc:276] 0709 13:11:17.339492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.339754 (+   262us) service_pool.cc:224] Handling call
0709 13:11:17.354112 (+ 14358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.565978 (+1211866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.110646 (+544668us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001c7354. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:19.110882 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352688896}
I20260709 13:11:19.176367 16001 rpcz_store.cc:276] 0709 13:11:18.099967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.128019 (+ 28052us) service_pool.cc:224] Handling call
0709 13:11:18.148210 (+ 20191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.436269 (+288059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.151519 (+715250us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540064e954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:19.151743 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455988096}
I20260709 13:11:19.110234 15230 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:19.146250 15126 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 10 to 11, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 11 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:19.182178 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.147001 22498 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:19.123246 22471 consensus_queue.cc:1048] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 13:11:19.188711 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:19.201181 22385 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:19.219122 22206 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:19.221446 22385 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:19.222685 22385 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.183183 22469 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:19.175952 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:19.192322 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:19.232789 16002 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:11:19.108253 22476 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.014s	user 0.008s	sys 0.002s
W20260709 13:11:19.130683 22420 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.000s
W20260709 13:11:19.126179 22466 consensus_meta.cc:287] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.732s	user 0.004s	sys 0.008s
W20260709 13:11:19.197438 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.145537 22453 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.797s	user 0.006s	sys 0.006s
W20260709 13:11:19.165025 22349 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.003s
I20260709 13:11:19.201494 15382 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:19.165704 22468 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:19.183600 22410 consensus_meta.cc:287] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.004s
I20260709 13:11:19.173957 22493 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.108530 22351 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.133412 22434 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:19.126772 22455 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.210155 15230 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:19.117440 22139 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:19.122471 22459 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:19.136435 22350 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:19.199577 22149 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.004s
I20260709 13:11:19.191782 22388 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:19.240538 22511 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:19.289116 22351 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.240839 22375 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:19.242660 22474 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.065s	user 0.000s	sys 0.007s
I20260709 13:11:19.280750 22483 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:19.251770 15273 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.880s (SENT)
W20260709 13:11:19.253315 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77468.9us
W20260709 13:11:19.254360 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 354749us
W20260709 13:11:19.331267 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 79565.9us
I20260709 13:11:19.331389 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:19.332590 15273 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.968s (SENT)
I20260709 13:11:19.187899 22166 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.279232 15126 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:19.232933 22083 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:11:19.240115 22398 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:19.311522 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 93204.8us
I20260709 13:11:19.340063 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:19.279254 22410 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:19.324828 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.348062 22139 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.348815 22139 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.349812 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3802) took 1506 ms. Trace:
I20260709 13:11:19.350994 22455 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:19.351541 15379 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:19.326210 15229 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:19.243763 22496 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.837s	user 0.000s	sys 0.017s
I20260709 13:11:19.329800 15231 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:11:19.333570 15273 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.000s (SENT)
I20260709 13:11:19.400875 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:19.322903 22351 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:19.337572 15377 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:19.256629 22476 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:19.266445 22466 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.350355 15374 rpcz_store.cc:276] 0709 13:11:17.843468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.844783 (+  1315us) service_pool.cc:224] Handling call
0709 13:11:17.845187 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.845572 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.845620 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.846164 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.020649 (+174485us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:18.053617 (+ 32968us) log.cc:844] Serialized 14 byte log entry
0709 13:11:18.053879 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.053962 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.466674 (+412712us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b18003728e0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a393f3 00007f2f50a3b7c1 00007f2f50a3b779 00007f2f50a3b709 00007f2f50a3b6d1 00007f2f50a3a9cd 000000000038f354 000000000038f199 00007f2f50a1c83a
0709 13:11:19.241803 (+775129us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:19.349454 (+107651us) raft_consensus.cc:1685] finished
0709 13:11:19.349493 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.349713 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33896,"prepare.run_cpu_time_us":7247,"prepare.run_wall_time_us":22855,"raft.queue_time_us":2931,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":217,"spinlock_wait_cycles":22060544,"thread_start_us":174068,"threads_started":1,"wal-append.queue_time_us":215738}
I20260709 13:11:19.402626 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:19.404412 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.405449 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 71907.4us
W20260709 13:11:19.411227 15273 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.059s (SENT)
I20260709 13:11:19.260879 22420 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:19.399430 22494 consensus_meta.cc:287] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.004s
W20260709 13:11:19.340417 22478 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.888s	user 0.015s	sys 0.000s
I20260709 13:11:19.323174 22149 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.321470 22459 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:19.398972 22475 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:19.426330 15299 raft_consensus.cc:1240] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:19.427109 15230 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:19.411698 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:19.409039 22410 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:19.420830 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80871.3us
I20260709 13:11:19.280462 22493 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:19.421742 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 90462us
I20260709 13:11:19.422065 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:19.402155 22388 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:19.420666 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:19.425328 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:19.408238 22511 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.428501 15226 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:19.560667 16004 raft_consensus.cc:2368] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:11:19.561816 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:59848 (request call id 59) took 1490 ms. Trace:
I20260709 13:11:19.422757 22494 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.452034 22467 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:19.460067 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:19.427738 22478 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.424100 22515 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:11:19.443084 22521 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:19.417821 22321 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:19.415833 22320 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:11:19.415583 22453 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:11:19.444108 22516 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.427578 22377 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:19.546425 22419 raft_consensus.cc:3055] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:11:19.569494 22204 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.003s
I20260709 13:11:19.558636 15999 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:19.566097 16006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 684) took 1090 ms. Trace:
I20260709 13:11:19.562440 15227 rpcz_store.cc:276] 0709 13:11:18.058483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.059118 (+   635us) service_pool.cc:224] Handling call
0709 13:11:19.459427 (+1400309us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54003ce954. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b20853 00007f2f58aee60a 00007f2f520747d4 00007f2f52074762 00007f2f52074691 00007f2f5207460c 00007f2f520738c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:19.548848 (+ 89421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780584832}
W20260709 13:11:19.560246 22460 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.972s	user 0.009s	sys 0.006s
I20260709 13:11:19.626256 15228 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:19.559525 22401 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:19.570009 22520 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.162s	user 0.001s	sys 0.004s
I20260709 13:11:19.551533 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:19.581563 22511 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:19.638005 22375 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.646062 22449 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.646651 22493 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.648741 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3809) took 1798 ms. Trace:
I20260709 13:11:19.649693 22494 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.650380 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3986) took 1126 ms. Trace:
I20260709 13:11:19.434741 22484 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.202s
I20260709 13:11:19.619011 22377 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.629063 22419 raft_consensus.cc:740] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:19.660148 15302 rpcz_store.cc:276] 0709 13:11:18.524242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.094183 (+569941us) service_pool.cc:224] Handling call
0709 13:11:19.094597 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.198540 (+103943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.198584 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.198644 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:19.198679 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.650122 (+451443us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400430654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:19.650176 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.650317 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238470912}
I20260709 13:11:19.658957 15381 rpcz_store.cc:276] 0709 13:11:17.850731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.882291 (+ 31560us) service_pool.cc:224] Handling call
0709 13:11:18.204028 (+321737us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b58000d1798. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a01a22 00007f2f5991ac09 00007f2f58a74ee0 00007f2f58b3e0ab 00007f2f58b3e131 00007f2f58afffc0 00007f2f58aea929 00007f2f58aea3d2 00007f2f52061bd4
0709 13:11:18.204307 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.565950 (+361643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.648464 (+1082514us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54001b9ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:19.648667 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393403008}
I20260709 13:11:19.656149 22388 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.656170 22460 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.670558 22511 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.671866 22460 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.672727 15224 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:19.674125 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3110) took 1266 ms. Trace:
I20260709 13:11:19.674503 15224 rpcz_store.cc:276] 0709 13:11:18.407199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.407330 (+   131us) service_pool.cc:224] Handling call
0709 13:11:18.407609 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.673168 (+1265559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.673837 (+   669us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540043b054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:19.674049 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908958464}
W20260709 13:11:19.676787 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 265586us
W20260709 13:11:19.680428 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98042.1us
I20260709 13:11:19.638803 16006 rpcz_store.cc:276] 0709 13:11:18.476153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.476372 (+   219us) service_pool.cc:224] Handling call
0709 13:11:18.476887 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.477317 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:18.691364 (+214047us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.234943 (+543579us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.258923 (+ 23980us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.259149 (+   226us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:19.259196 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.259313 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.565828 (+306515us) raft_consensus.cc:1685] finished
0709 13:11:19.565855 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.566006 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21651,"prepare.queue_time_us":444578,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":54099,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":13308,"spinlock_wait_cycles":21248,"thread_start_us":589549,"threads_started":2,"wal-append.queue_time_us":443355}
I20260709 13:11:19.687670 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.688882 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.689256 15373 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:19.690322 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.690821 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.691711 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.692858 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.696774 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.700492 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.700984 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.701599 15374 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:19.705192 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:19.704164 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 147362us
I20260709 13:11:19.708199 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:19.709164 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.675515 22468 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.709854 15379 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:19.710139 15302 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:19.711513 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:19.679474 22350 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.686008 22377 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:19.629331 22516 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.714295 15304 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:19.743973 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:19.744918 15382 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:19.745326 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.739336 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:19.749522 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.749405 15306 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:19.751077 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.751745 15306 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:19.696589 22410 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:19.753047 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.662521 22375 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:19.757555 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.758018 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.694037 22475 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:19.781836 15301 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:19.698740 22521 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:19.735103 22489 log.cc:927] Time spent T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.320s	user 0.000s	sys 0.004s
I20260709 13:11:19.759274 15306 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:19.711867 22149 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:19.707305 22476 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:19.694883 22204 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:19.752137 22452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.350s	user 0.000s	sys 0.023s
I20260709 13:11:19.837903 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:19.834712 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81421.4us
I20260709 13:11:19.837356 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.734625 22466 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.866175 15377 raft_consensus.cc:2468] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:11:19.866240 15307 raft_consensus.cc:2376] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17. Re-sending same reply.
I20260709 13:11:19.712522 22459 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:19.758224 22434 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:19.900050 15302 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:11:19.895783 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:19.903945 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.905876 15302 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:19.904918 15225 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:19.905709 15381 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:19.873627 22452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.471s	user 0.001s	sys 0.024s
I20260709 13:11:19.901110 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3815) took 1844 ms. Trace:
I20260709 13:11:19.911109 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.977175 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.802242 22410 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:19.978554 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.746244 22350 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:19.981000 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.981633 15307 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:19.982188 15232 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:11:19.982133 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.908273 15382 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:19.976125 15302 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:19.814153 22521 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:19.985554 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:19.803814 22455 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.153s
I20260709 13:11:19.970582 15378 rpcz_store.cc:276] 0709 13:11:18.056420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.056677 (+   257us) service_pool.cc:224] Handling call
0709 13:11:18.057228 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.332470 (+275242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.900737 (+1568267us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400224a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:19.901012 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631560448}
I20260709 13:11:19.987545 15381 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:11:19.985793 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 82112.3us
I20260709 13:11:19.994397 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:19.995262 15382 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.989014 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:19.996711 15302 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.988131 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:19.980114 22410 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:19.911458 22532 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.967285 22476 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.016543 22526 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.833187 22475 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.023703 15302 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:20.024796 15306 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:20.029706 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:19.985203 22511 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:11:20.024763 22529 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:11:20.027439 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:20.052136 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:20.053151 15302 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.033574 22516 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.021737 22535 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:11:20.036224 22492 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:19.851421 22419 consensus_queue.cc:260] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.038025 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.065204 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.063776 22204 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.046592 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:20.068662 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:20.069403 15377 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:20.048861 15382 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:20.071154 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.077883 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.078662 15307 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:20.078348 15302 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:20.051522 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:20.059062 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:19.969491 22434 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.083098 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.083901 22351 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:20.086107 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.065174 22493 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:20.101233 22493 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:20.101524 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 3013) took 1686 ms. Trace:
I20260709 13:11:20.101922 15233 rpcz_store.cc:276] 0709 13:11:18.416150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.843413 (+427263us) service_pool.cc:224] Handling call
0709 13:11:18.844091 (+   678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.905201 (+ 61110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.905239 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.905287 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:18.905319 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.101236 (+1195917us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b54000dded4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:20.101293 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.101452 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139959168}
I20260709 13:11:20.102367 22493 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.103637 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.020553 22466 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.075534 22419 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:20.106037 22466 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.063490 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.108829 15380 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:11:20.026633 22476 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.086892 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:20.113752 22476 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.073333 22521 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.115770 22521 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.115895 22257 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:20.116556 22257 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:20.117578 22257 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.119598 15308 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.123358 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.124779 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.085608 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 362d7a17088a4e86a51428b5ee97346e (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
W20260709 13:11:20.129760 15117 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 71504.3us
I20260709 13:11:20.061085 22519 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:11:20.136840 22204 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:20.138058 22204 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:20.141037 15233 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:11:20.143326 15233 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:20.144481 22321 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:20.144997 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.145146 22321 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:20.146005 15380 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:20.141119 22468 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.140673 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.141454 22466 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.153775 15373 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:11:20.156540 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.158737 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:20.161038 22043 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:20.161976 15233 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:11:20.167451 22350 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.168534 22437 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:20.169713 22437 consensus_queue.cc:1243] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:20.170403 22437 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:20.171810 22253 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.175184 22505 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:20.175767 22505 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:20.044727 22526 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.018973 22478 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.045049 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:20.201823 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 156861us
I20260709 13:11:20.082106 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.209389 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:20.204859 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:20.230628 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.231623 15380 raft_consensus.cc:2368] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:20.168187 22377 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.237251 15307 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:20.250708 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:20.249157 15196 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:20.258164 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:20.089586 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.060719 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.267796 15306 raft_consensus.cc:2410] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:20.058950 22511 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:20.097034 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.098359 22434 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:20.099843 22475 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:20.292054 15225 raft_consensus.cc:2393] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:20.026721 22532 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.105162 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.185405 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3834) took 1090 ms. Trace:
I20260709 13:11:20.186249 15308 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:20.186915 15376 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:11:20.164206 15232 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:20.296325 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.154887 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.212409 22449 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.212937 22535 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:20.265908 15377 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 12.
I20260709 13:11:20.269857 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:20.219230 22368 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:20.278647 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.300230 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.254518 22478 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:20.288859 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.306991 15306 raft_consensus.cc:2410] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:11:20.290964 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.146438 22321 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.238544 22275 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.321940 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.322860 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.287495 22537 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:20.301496 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 231837us
I20260709 13:11:20.296691 15382 raft_consensus.cc:2376] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19. Re-sending same reply.
I20260709 13:11:20.296906 15375 rpcz_store.cc:276] 0709 13:11:19.095330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.187345 (+ 92015us) service_pool.cc:224] Handling call
0709 13:11:19.212181 (+ 24836us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:19.257574 (+ 45393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.257618 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:19.277868 (+ 20250us) log.cc:844] Serialized 52 byte log entry
0709 13:11:19.417141 (+139273us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:19.417194 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.417276 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.184986 (+767710us) raft_consensus.cc:1685] finished
0709 13:11:20.185023 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.185303 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34500,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12206,"thread_start_us":90294,"threads_started":1,"wal-append.queue_time_us":339529}
I20260709 13:11:20.250723 22483 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:20.089362 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:20.348254 15302 raft_consensus.cc:2393] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:20.309629 15198 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:20.311203 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.313150 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:20.355108 15306 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:20.355609 15304 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:11:20.314471 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:20.259986 22468 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:11:20.312472 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 250837us
I20260709 13:11:20.292609 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:20.139789 22204 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.322971 15377 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:20.326969 15300 raft_consensus.cc:2368] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:11:20.330353 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1022) took 1912 ms. Trace:
I20260709 13:11:20.340200 15226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3112) took 1931 ms. Trace:
I20260709 13:11:20.305354 22368 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.369464 15307 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.369880 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.373445 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:20.345187 16000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46140 (request call id 1011) took 1191 ms. Trace:
I20260709 13:11:20.381254 16000 rpcz_store.cc:276] 0709 13:11:19.154289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.155036 (+   747us) service_pool.cc:224] Handling call
0709 13:11:19.155424 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.548242 (+392818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.548282 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.548357 (+    75us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:19.548398 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.344781 (+796383us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540064f5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:20.344947 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.345125 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685573376}
I20260709 13:11:20.382325 22351 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:20.363896 15302 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:20.377775 15226 rpcz_store.cc:276] 0709 13:11:18.408323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.408466 (+   143us) service_pool.cc:224] Handling call
0709 13:11:18.408790 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.560609 (+1151819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.339761 (+779152us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000e79d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:20.340074 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344526592}
I20260709 13:11:20.376731 15299 rpcz_store.cc:276] 0709 13:11:18.418210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.418396 (+   186us) service_pool.cc:224] Handling call
0709 13:11:18.418801 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.426780 (+1007979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.329962 (+903182us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400250154. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:20.330253 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311742336}
I20260709 13:11:20.318156 22463 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:20.306205 22478 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:20.236900 22505 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.399431 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.344193 22537 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:20.408227 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.407538 15302 raft_consensus.cc:1275] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:11:20.407938 15304 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:20.376621 22494 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:20.368856 22526 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.365667 22483 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.383000 22275 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:11:20.384055 22458 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:20.319808 22449 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.425518 15380 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:20.412766 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:20.394316 22368 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.391322 22413 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:20.360172 22401 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:11:20.397882 22398 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:20.410305 15302 pending_rounds.cc:85] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 10
I20260709 13:11:20.442582 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:20.407506 22478 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:20.390805 22434 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:11:20.417495 22537 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:20.472837 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60229.7us
I20260709 13:11:20.445827 15348 leader_election.cc:400] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:11:20.474669 15348 leader_election.cc:403] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.450354 15302 pending_rounds.cc:107] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:11:20.475291 15302 raft_consensus.cc:2889] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.452527 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.476300 15380 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:20.477734 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.453826 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.454083 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.399327 22410 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:11:20.402549 22464 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:11:20.436590 22468 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:20.432660 22336 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:20.467973 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:20.493353 15302 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:20.469074 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.473194 15375 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:20.495906 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.443554 15307 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:20.403213 22540 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:11:20.450646 22505 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:20.449810 22494 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:20.443063 22466 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:20.487474 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45094.2us
I20260709 13:11:20.441789 22413 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.497826 15299 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:20.449770 22546 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:20.500450 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 110803us
I20260709 13:11:20.438889 22388 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:11:20.439256 22475 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:11:20.505049 15302 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:20.505982 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:20.557091 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.523108 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:20.557993 15377 raft_consensus.cc:2376] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15. Re-sending same reply.
I20260709 13:11:20.480641 22493 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:20.557451 15380 raft_consensus.cc:2376] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19. Re-sending same reply.
I20260709 13:11:20.534005 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:20.486171 22457 consensus_queue.cc:1059] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:11:20.531773 22413 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:20.521826 22398 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:20.522109 22545 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 12.
I20260709 13:11:20.541123 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.580994 15373 raft_consensus.cc:2410] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:11:20.582468 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.562711 22463 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:20.559885 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.541182 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:20.578259 15307 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:20.589411 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.565543 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.549860 22377 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.585651 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.587361 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:20.594383 15230 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.590443 15380 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:20.533187 22466 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.565965 22434 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:20.598075 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.579861 22398 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:20.566226 22458 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:20.539917 22546 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:20.603229 22149 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:20.574568 22540 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:11:20.556306 22468 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.629422 22149 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:20.630774 22149 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.632388 22149 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.638087 22511 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.607812 22556 raft_consensus.cc:3055] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:20.605844 22434 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:20.622135 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:20.624564 22544 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 13:11:20.654295 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.658676 15373 pending_rounds.cc:85] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 10
I20260709 13:11:20.662792 15373 pending_rounds.cc:107] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:11:20.663257 15373 raft_consensus.cc:2889] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:20.672302 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:20.684320 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.709549 22552 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:11:20.718354 22466 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.721076 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1242) took 1316 ms. Trace:
I20260709 13:11:20.721747 15233 rpcz_store.cc:276] 0709 13:11:19.405031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.162883 (+757852us) service_pool.cc:224] Handling call
0709 13:11:20.163217 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:20.163958 (+   741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:20.163999 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:20.164615 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.425862 (+261247us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:20.425962 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.426089 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.720574 (+294485us) raft_consensus.cc:1685] finished
0709 13:11:20.720629 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.720980 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":238721,"threads_started":1,"wal-append.queue_time_us":327704}
I20260709 13:11:20.724478 22398 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.725374 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.620601 22463 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:20.728557 22549 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:11:20.730260 22551 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:11:20.732061 22434 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.734239 22434 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.653278 22556 raft_consensus.cc:740] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:20.738445 22556 consensus_queue.cc:260] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.595649 22494 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.741232 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.745365 22532 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:20.747212 22457 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:20.746912 22458 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.765240 22457 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.748622 22462 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:20.736887 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.753557 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:20.754503 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.723948 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:20.779433 15233 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.652797 22449 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:20.760123 16005 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:20.780620 15229 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 16: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:11:20.785280 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.760028 22556 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.784796 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:20.793694 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.794950 15229 raft_consensus.cc:2393] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:20.768160 22546 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:11:20.780902 22419 consensus_meta.cc:287] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.004s
I20260709 13:11:20.799608 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.779628 22561 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:20.787153 22462 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:20.823599 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:20.790021 22449 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:20.840298 15233 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
W20260709 13:11:20.821115 22553 log.cc:927] Time spent T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:11:20.844928 22571 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:20.846374 15226 raft_consensus.cc:1240] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:11:20.877461 22449 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.879182 22410 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:20.879707 22410 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:20.880754 22410 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.882416 22410 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:20.847641 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 122380us
I20260709 13:11:20.855521 22491 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:20.862025 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50774 (request call id 2866) took 1131 ms. Trace:
I20260709 13:11:20.864441 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3109) took 2457 ms. Trace:
W20260709 13:11:20.865023 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.865478 22563 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:20.821017 22546 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.866482 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 3976) took 2343 ms. Trace:
W20260709 13:11:20.868330 15225 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47392 (request call id 3024) took 1439 ms (client timeout 1839 ms). Trace:
I20260709 13:11:20.894891 15228 rpcz_store.cc:276] 0709 13:11:18.406898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.407988 (+  1090us) service_pool.cc:224] Handling call
0709 13:11:18.408284 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.655430 (+1247146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.864083 (+1208653us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400384d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:20.864302 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795605248}
I20260709 13:11:20.893966 15300 rpcz_store.cc:276] 0709 13:11:19.731002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.900602 (+169600us) service_pool.cc:224] Handling call
0709 13:11:20.861706 (+961104us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54002300d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:20.861933 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802394880}
W20260709 13:11:20.902659 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.904572 15228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:20.905558 15228 raft_consensus.cc:606] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:20.900002 15303 rpcz_store.cc:276] 0709 13:11:18.493962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.494130 (+   168us) service_pool.cc:224] Handling call
0709 13:11:18.494641 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.494995 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.495041 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.998601 (+1503560us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b2c00080928. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:11:20.022098 (+ 23497us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.241270 (+219172us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:20.241315 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.241397 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.829943 (+588546us) raft_consensus.cc:1685] finished
0709 13:11:20.829982 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.837033 (+  7051us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21969792,"thread_start_us":206170,"threads_started":1,"wal-append.queue_time_us":342441}
I20260709 13:11:20.909243 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:11:20.900169 15225 rpcz_store.cc:269] 0709 13:11:19.429081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.907329 (+478248us) service_pool.cc:224] Handling call
0709 13:11:20.868088 (+960759us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54002e2a54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:20.868256 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645244800}
I20260709 13:11:20.918712 22554 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:20.912382 22563 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.911688 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:20.911793 22478 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:20.926805 22574 log.cc:927] Time spent T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:11:20.899315 22573 log.cc:927] Time spent T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:11:20.912922 22546 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:20.903419 15273 connection.cc:256] RPC call timeout handler was delayed by -1.0479520350000939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2465s for a response
I20260709 13:11:20.950366 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.948801 15230 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:20.893632 22491 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:20.963192 22558 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:20.963639 22491 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.964540 22558 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:20.965441 22491 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:20.967728 15273 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.530s (SENT)
I20260709 13:11:20.968228 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.971385 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.973651 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.979444 22336 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:20.980216 22336 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:20.984033 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:20.985122 15378 raft_consensus.cc:2368] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18.
I20260709 13:11:20.989181 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:20.992880 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:20.838457 22561 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:20.988219 22419 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:20.990873 22540 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:20.998456 22540 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:20.998934 22540 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:20.996018 22434 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:21.000765 22570 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:21.000895 22575 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:20.960111 22457 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.003039 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:21.030063 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:21.031324 15302 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.001572 22570 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:21.004865 22563 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:21.005424 22197 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:21.013778 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2861) took 1287 ms. Trace:
I20260709 13:11:21.039085 15299 rpcz_store.cc:276] 0709 13:11:19.726166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.397936 (+671770us) service_pool.cc:224] Handling call
0709 13:11:20.497619 (+ 99683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.530384 (+ 32765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.013528 (+483144us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b540006f250. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:21.013700 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228148992}
I20260709 13:11:20.919521 22554 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:21.021104 22572 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:11:21.021327 15973 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.033707 22368 consensus_meta.cc:287] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.578s	user 0.014s	sys 0.001s
I20260709 13:11:21.020107 22413 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:21.025111 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.031731 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:21.033458 22434 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:21.039368 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:21.018250 22527 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.449s	user 0.006s	sys 0.009s
I20260709 13:11:21.023625 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.036466 22575 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:21.037269 15273 leader_election.cc:400] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:21.049852 22482 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:21.054036 22166 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:21.055917 22550 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.594s	user 0.000s	sys 0.003s
I20260709 13:11:21.038817 22197 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:21.057098 22554 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.057502 22449 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.033349 22468 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:11:21.058296 22197 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.059891 22197 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.036213 22204 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:11:21.060567 22204 consensus_queue.cc:1243] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:21.038949 22401 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.037994 22570 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.063854 22482 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:21.064630 15273 leader_election.cc:403] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:21.061854 22561 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.069525 15302 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:21.073580 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2956) took 1378 ms. Trace:
I20260709 13:11:21.078125 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:21.076059 15376 rpcz_store.cc:276] 0709 13:11:19.695687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.695825 (+   138us) service_pool.cc:224] Handling call
0709 13:11:20.186456 (+490631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:20.297369 (+110913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.073354 (+775985us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54001ac2d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:21.073522 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127317888}
I20260709 13:11:21.072540 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.064921 22434 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:21.073726 22449 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:21.071061 22401 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.087464 22275 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:21.093756 22275 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:21.094399 22537 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.003s
I20260709 13:11:21.094794 22401 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.094944 22537 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.096385 15229 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:21.069988 22458 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:21.102437 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63170.8us
I20260709 13:11:21.108805 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.123900 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.072873 22343 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:21.123775 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.048107 22368 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:21.132440 22478 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:21.128823 22575 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:21.133627 22482 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.135015 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:21.138533 22083 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:21.139222 22083 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:21.148741 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65466.3us
W20260709 13:11:21.131259 22505 consensus_meta.cc:287] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.608s	user 0.014s	sys 0.000s
I20260709 13:11:21.151652 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.154812 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:21.152452 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53194us
I20260709 13:11:21.087836 22525 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:11:21.125859 22449 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:21.156876 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.158433 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.158756 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.159509 15999 raft_consensus.cc:2368] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19.
I20260709 13:11:21.162464 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.169386 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.169588 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:21.170078 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.171021 15378 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:21.092172 22434 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.168228 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.174815 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.176957 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.178117 15377 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:21.174795 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.159207 22343 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.177927 15380 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:21.132539 22563 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:21.150403 22567 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:11:21.185303 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.189491 15304 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:21.191322 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:21.192392 15303 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:21.197295 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.201701 15303 pending_rounds.cc:85] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 8
I20260709 13:11:21.202535 15303 pending_rounds.cc:107] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:11:21.203258 15303 raft_consensus.cc:2889] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.155640 22571 consensus_queue.cc:1048] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:21.218268 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:21.211668 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:21.190128 22546 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.216161 22540 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.204873 22139 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.198518 22343 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:21.207122 22563 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.208703 22449 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:21.212966 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:21.240533 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.228153 22526 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:21.325578 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:21.216956 22463 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:11:21.327566 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.239828 22343 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:21.251024 22449 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:21.187330 22083 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:21.356060 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 193678us
I20260709 13:11:21.267719 22413 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:21.359771 15273 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.350859 22343 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.331158 22585 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:21.355683 22582 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:11:21.335144 22526 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:11:21.388434 22586 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:11:21.388577 22526 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:21.389878 22149 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:21.390358 22149 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:21.329511 22563 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.391350 22149 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.396732 22350 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.397415 22350 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.394399 22563 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.405216 22368 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.360404 22537 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.428423 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:21.426301 15301 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:21.422470 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:21.438350 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.448056 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:21.449368 16000 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:21.454452 22336 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:21.431165 22410 consensus_meta.cc:287] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.003s
I20260709 13:11:21.382983 22483 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:21.479106 22540 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.446655 22585 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.495105 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 135486us
I20260709 13:11:21.498365 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.399730 22570 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:21.530121 22543 log.cc:927] Time spent T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 1.103s	user 0.004s	sys 0.002s
I20260709 13:11:21.491422 22561 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:21.547502 15376 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:21.510772 22275 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:21.549728 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1017) took 3502 ms. Trace:
I20260709 13:11:21.550251 15305 rpcz_store.cc:276] 0709 13:11:18.046995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.047141 (+   146us) service_pool.cc:224] Handling call
0709 13:11:18.047601 (+   460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:18.053646 (+  6045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.053682 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:18.480957 (+427275us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b48000b0058. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:11:19.107320 (+626363us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b1800359b00. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a072a6 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a
0709 13:11:20.014540 (+907220us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b2c00080928. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f5241fa11 00007f2f5242f372 00007f2f53b61a01 00007f2f53b2643a 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2
0709 13:11:20.015152 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 13:11:20.250466 (+235314us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:20.250526 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.250669 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.529083 (+1278414us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:21.549460 (+ 20377us) raft_consensus.cc:1685] finished
0709 13:11:21.549485 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.549650 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":198,"raft.run_cpu_time_us":3724,"raft.run_wall_time_us":430540,"spinlock_wait_cycles":57217536,"thread_start_us":217489,"threads_started":1,"wal-append.queue_time_us":315242}
W20260709 13:11:21.553731 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76886.8us
I20260709 13:11:21.461207 22449 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.560300 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.561128 15373 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:11:21.563037 15233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3133) took 1075 ms. Trace:
I20260709 13:11:21.563601 15233 rpcz_store.cc:276] 0709 13:11:20.486819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.843754 (+356935us) service_pool.cc:224] Handling call
0709 13:11:20.844068 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.037000 (+192932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.037038 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:21.037082 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:21.037113 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.561781 (+524668us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000e7ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:21.561827 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.561950 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443229568}
I20260709 13:11:21.542116 22598 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.584285 22598 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:21.514816 22585 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.602900 22410 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:21.602084 22434 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.607610 22434 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.607707 22410 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.644984 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:21.646250 16002 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.646689 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:21.631515 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.631893 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:21.651661 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 153377us
I20260709 13:11:21.628479 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:21.628710 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.628111 15224 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:21.658319 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.661203 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.551541 22561 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:21.652161 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.665863 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:21.614921 22590 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:21.594543 22596 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:21.619050 22548 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 1.091s	user 0.001s	sys 0.007s
I20260709 13:11:21.669787 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.605214 22449 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.694250 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:21.610644 22434 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.637459 22350 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.673117 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:21.699021 15232 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.673983 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.676400 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.691354 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:21.619629 22336 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:21.626752 22570 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.615372 22410 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.695601 15273 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:21.695686 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 126449us
I20260709 13:11:21.630558 22321 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:21.639843 22420 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.668330 22483 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:21.694860 22491 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.007s
I20260709 13:11:21.693964 22545 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:21.706842 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:21.730846 16002 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:21.731259 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.706280 22350 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:21.693122 22598 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:21.672071 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.715034 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.717701 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.722656 15232 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:21.710839 22596 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:21.759351 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:21.724917 22413 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:21.761129 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.766099 15232 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:21.766065 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.770084 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:21.744961 22592 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:21.753777 22410 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.755086 22598 raft_consensus.cc:2764] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:21.770171 22571 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:21.757236 22491 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:21.773545 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:21.783738 15306 raft_consensus.cc:1240] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:21.763794 22570 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:21.770412 22434 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:21.789760 15308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 4001) took 2061 ms (client timeout 2060 ms). Trace:
W20260709 13:11:21.782488 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50194.1us
W20260709 13:11:21.791059 15302 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.011s	sys 0.014s
W20260709 13:11:21.810206 15302 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.011s	sys 0.014s
I20260709 13:11:21.810338 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.752610 22545 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.811136 15224 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 24.
I20260709 13:11:21.777860 22563 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:21.808784 15308 rpcz_store.cc:269] 0709 13:11:19.722255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.980037 (+257782us) service_pool.cc:224] Handling call
0709 13:11:21.783116 (+1803079us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54003e44d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:21.783316 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313603840}
I20260709 13:11:21.780701 22596 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:21.815934 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.816888 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:21.819658 15224 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.770454 22413 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.846112 22413 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:21.853322 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:21.866207 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.829514 22558 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.832927 22539 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:21.874125 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 119165us
W20260709 13:11:21.875399 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58811.6us
I20260709 13:11:21.883212 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.885397 15374 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:11:21.883364 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109910us
I20260709 13:11:21.887090 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:21.889735 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:21.889896 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 158749us
I20260709 13:11:21.834877 15224 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:21.843386 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 691) took 1302 ms. Trace:
I20260709 13:11:21.843654 22585 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:21.784850 22410 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.853626 22563 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:21.819453 22610 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:21.858758 22545 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:21.769076 22526 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.813445 22570 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.863750 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2863) took 2136 ms. Trace:
W20260709 13:11:21.867205 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45556.9us
I20260709 13:11:21.855959 22434 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:21.878629 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.903936 15306 rpcz_store.cc:276] 0709 13:11:19.726801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.396978 (+670177us) service_pool.cc:224] Handling call
0709 13:11:21.783459 (+1386481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.787701 (+  4242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.863256 (+ 75555us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003e44d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:21.863614 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3139711232}
I20260709 13:11:21.917155 15376 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:11:21.893550 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:21.894119 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.891348 15999 rpcz_store.cc:276] 0709 13:11:20.540589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.540922 (+   333us) service_pool.cc:224] Handling call
0709 13:11:21.843110 (+1302188us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54004f3654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:21.843267 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300158208}
I20260709 13:11:21.896185 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:21.898661 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.902424 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.902801 15381 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:21.919806 15225 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:21.870931 22454 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:21.882570 22520 log.cc:927] Time spent T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:11:21.911484 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.919781 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.883044 22567 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:21.938072 15381 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:21.898309 22413 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.950543 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:21.964550 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.965168 15300 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:21.970853 15374 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:21.923453 22615 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:21.924538 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.931881 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:21.935588 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:21.947124 22434 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:22.002025 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 70230.6us
I20260709 13:11:22.003530 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:21.936617 22454 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:22.010883 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 86862.6us
W20260709 13:11:22.020980 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 96737.6us
I20260709 13:11:22.021404 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:22.022262 15373 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:22.024444 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:22.018265 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:22.025565 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:22.026011 15374 raft_consensus.cc:2410] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:11:21.957274 22413 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:21.994022 22571 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:22.026255 15380 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:22.029208 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:22.029353 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:21.951442 22567 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:22.018039 22343 consensus_meta.cc:287] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.591s	user 0.013s	sys 0.003s
I20260709 13:11:22.034291 15229 raft_consensus.cc:2393] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 24: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:22.009100 22607 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:22.034962 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.050028 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.036307 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:22.034574 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:22.036940 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:22.028554 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 126992us
I20260709 13:11:22.063980 15376 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:22.064495 15348 leader_election.cc:400] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19.
I20260709 13:11:22.064911 15348 leader_election.cc:403] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:22.065915 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:22.074534 15974 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:22.030385 22585 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:22.077527 22434 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.093586 22526 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:22.034294 22616 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:22.093900 22454 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:22.087885 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:22.095785 15373 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.087612 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:22.097568 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:22.092913 22621 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:22.098629 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.020807 22608 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:11:22.053153 22253 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:22.073460 22615 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:22.117048 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:22.102564 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46450.3us
I20260709 13:11:22.031119 22618 consensus_queue.cc:1059] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 13:11:22.108095 22565 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:11:22.134436 16003 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:11:22.137794 16005 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 1010) took 2980 ms (client timeout 2325 ms). Trace:
I20260709 13:11:22.027313 22563 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.062695 22343 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:22.108605 22613 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:11:22.101841 22558 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:22.149669 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:22.096661 22619 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:22.150429 16000 raft_consensus.cc:2376] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18. Re-sending same reply.
I20260709 13:11:22.101202 22607 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:22.141160 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43656.9us
W20260709 13:11:22.138351 16005 rpcz_store.cc:269] 0709 13:11:19.153647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.154573 (+   926us) service_pool.cc:224] Handling call
0709 13:11:22.133909 (+2979336us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400850f54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:22.134087 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3540404608}
I20260709 13:11:22.144222 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:22.100796 22458 raft_consensus.cc:2804] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:22.113399 22253 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:22.113194 22621 raft_consensus.cc:3060] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.148097 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:22.157047 15374 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:22.156138 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.164611 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.166282 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.167768 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.168831 15300 raft_consensus.cc:2410] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:11:22.142244 22454 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.153292 15377 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.132202 22585 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:22.146502 22615 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.170855 15304 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:11:22.165594 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 2974) took 1769 ms. Trace:
I20260709 13:11:22.175832 15375 rpcz_store.cc:276] 0709 13:11:20.395938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.396462 (+   524us) service_pool.cc:224] Handling call
0709 13:11:20.427247 (+ 30785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.495190 (+ 67943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.165220 (+1670030us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b54001b9ed4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:22.165510 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99836800}
I20260709 13:11:22.173076 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.189978 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.172008 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.150085 22558 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:22.166195 22253 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.103781 22571 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.161105 22618 raft_consensus.cc:3055] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:22.152285 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:22.141160 22455 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:11:22.216229 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.224771 15300 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:22.225808 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.226714 15300 raft_consensus.cc:2410] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:11:22.227756 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.216454 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:22.229795 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 77615.4us
I20260709 13:11:22.174978 22585 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.215397 22558 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:22.172242 22410 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:22.237622 15377 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.158628 22619 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.248978 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:22.251551 22622 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:11:22.236989 22526 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:11:22.254922 22627 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:11:22.254832 22526 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:22.249300 22488 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:22.265597 15373 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:22.219869 22618 raft_consensus.cc:740] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:22.279902 15228 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:22.236537 22585 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:22.191912 22454 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:22.254017 22623 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:22.282024 22526 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.277773 22633 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:22.345323 22633 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.270506 22608 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.284277 22635 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:22.349205 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.349371 22608 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.350194 15231 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:22.350265 15225 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:22.350656 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:22.351922 22608 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:22.275643 22449 consensus_meta.cc:287] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.004s
I20260709 13:11:22.293321 22618 consensus_queue.cc:260] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.302605 22592 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:22.306070 22612 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.273s	user 0.000s	sys 0.007s
W20260709 13:11:22.313428 22581 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 1.159s	user 0.005s	sys 0.002s
I20260709 13:11:22.321857 22413 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:22.322723 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.375216 15228 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 22: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:22.323737 22567 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:22.324186 22343 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:22.278512 22488 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:22.329589 22321 consensus_meta.cc:287] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.003s
I20260709 13:11:22.336068 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:22.336838 15302 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:22.338384 22607 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.339949 15300 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:11:22.287091 22619 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:22.356447 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:22.348240 22633 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:22.380060 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:22.384871 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:22.395141 15299 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.358769 22420 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:22.364887 22556 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:22.410593 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54268.8us
I20260709 13:11:22.413329 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.397850 22618 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:22.408128 22556 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:22.378890 22592 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.421602 22525 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:22.430965 22556 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:22.456075 15381 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:22.414041 22420 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.460609 15300 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.399878 22607 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.439878 22525 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:22.480306 22525 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.482453 22616 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:22.521780 22621 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19.
I20260709 13:11:22.534459 22615 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:22.583364 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.590708 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4028) took 1396 ms. Trace:
I20260709 13:11:22.591609 15303 rpcz_store.cc:276] 0709 13:11:21.194517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.200426 (+  5909us) service_pool.cc:224] Handling call
0709 13:11:21.201364 (+   938us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:21.354558 (+153194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.355292 (+   734us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:21.358940 (+  3648us) log.cc:844] Serialized 52 byte log entry
0709 13:11:21.547792 (+188852us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:21.584451 (+ 36659us) log.cc:844] Serialized 14 byte log entry
0709 13:11:21.594083 (+  9632us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.309904 (+715821us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b1800081400. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:11:22.589384 (+279480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.589674 (+   290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.589998 (+   324us) raft_consensus.cc:1685] finished
0709 13:11:22.590029 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.590412 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23250,"prepare.queue_time_us":48454,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":138516,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":226,"spinlock_wait_cycles":3094912,"thread_start_us":488061,"threads_started":3,"wal-append.queue_time_us":330655}
W20260709 13:11:22.603008 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 189573us
I20260709 13:11:22.606074 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.629352 15227 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 21.
I20260709 13:11:22.614157 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:22.614378 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.590400 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.632995 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.633801 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:22.634810 15377 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:22.620188 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.637199 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:22.639029 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.643570 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.645270 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.646088 15299 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:22.646813 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.647814 15303 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:22.648559 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.651358 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:22.654129 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.659548 16003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 592) took 3252 ms. Trace:
I20260709 13:11:22.660701 15304 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:22.663329 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.664969 15304 raft_consensus.cc:2393] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 22: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:22.627595 15224 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:22.667495 15974 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:22.648963 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.691039 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:22.691617 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.668450 16003 rpcz_store.cc:276] 0709 13:11:19.407003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.407224 (+   221us) service_pool.cc:224] Handling call
0709 13:11:22.134148 (+2726924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.139263 (+  5115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.658609 (+519346us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b5400850f50. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:22.659074 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6270427008}
I20260709 13:11:22.694190 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.694535 15373 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:22.677402 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:22.678140 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.687192 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:22.639879 15308 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:22.674816 15375 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:22.695346 15303 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:22.689426 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:22.696688 21863 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:22.697854 22350 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.703446 22410 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:22.622838 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:22.710567 15304 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:22.730098 15375 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:22.732194 22413 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:22.710518 22350 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.736795 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:22.737722 21863 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.737457 22526 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.747826 22535 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:22.757196 15379 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:22.758540 22592 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:22.748973 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98354.9us
I20260709 13:11:22.759249 16005 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:22.746055 15299 raft_consensus.cc:2376] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16. Re-sending same reply.
W20260709 13:11:22.762863 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 110587us
I20260709 13:11:22.733841 22413 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.735948 22607 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:22.764605 15302 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.764991 15376 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:22.768428 22526 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.769296 22454 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:22.770247 22488 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:22.771543 22539 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:22.771807 22526 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:22.482208 22458 raft_consensus.cc:697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:22.778241 22375 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:22.779489 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:22.781103 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:22.784541 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:22.784811 22636 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.785454 22615 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:22.745687 22625 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:22.771855 15300 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:22.791666 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:22.792986 22635 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.778357 22420 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:22.796001 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:22.805946 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:22.828511 15375 raft_consensus.cc:2468] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 10.
I20260709 13:11:22.816134 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:22.829581 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.832543 22437 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:22.833869 22437 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:22.834255 22437 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:22.834537 22526 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.817188 22149 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.835456 22437 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.837580 22437 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:22.839452 21863 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:22.819777 22413 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:22.820684 22625 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.822153 15380 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:22.822290 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:22.822726 22635 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.816282 22458 consensus_queue.cc:237] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.850360 15306 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:22.835283 22526 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.844580 22625 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:22.845371 22615 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:22.861014 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:22.871696 15374 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:22.874539 22608 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:22.874441 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.884807 15228 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:22.889550 15225 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:22.891846 15227 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:11:22.893240 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.894271 22204 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:22.895219 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.879810 22608 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.898785 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:22.909162 15196 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:22.848135 22410 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.907610 22596 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:22.927383 15377 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
W20260709 13:11:22.902307 22253 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.671s	user 0.015s	sys 0.007s
I20260709 13:11:22.903424 22608 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.923475 15301 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:22.932755 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:22.934844 15374 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:22.896325 22635 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:22.940723 15380 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:22.925359 22615 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.946892 22253 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:11:22.948139 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 125966us
W20260709 13:11:22.957154 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48177.1us
I20260709 13:11:22.959414 15226 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:22.928573 22596 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:22.965481 22596 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:22.966923 22596 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:22.967965 15999 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:22.925823 22375 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:22.987131 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:22.987340 22532 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:22.988099 15229 raft_consensus.cc:2376] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16. Re-sending same reply.
I20260709 13:11:22.988284 22532 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.991963 22532 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:22.992718 22459 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:22.993290 22459 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:22.998189 22375 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:22.981127 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:23.004523 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 115020us
W20260709 13:11:23.006356 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47262us
I20260709 13:11:22.976845 22615 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:23.024712 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.035295 22607 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:23.046443 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.050736 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:23.050923 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:23.049782 22652 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:23.056208 22652 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:23.056473 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.038137 22561 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.058403 15302 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
I20260709 13:11:23.062956 22652 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.041401 21863 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.068756 22563 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:11:23.047711 22607 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:23.077594 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.091893 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.079813 21863 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.094190 21863 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.081526 15301 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:23.094980 22505 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:23.096769 15301 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.097118 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:23.098263 15301 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:23.029783 22413 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:11:23.068850 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:23.102020 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:23.103245 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:23.104676 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.078269 15299 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.096808 22630 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.112535 22630 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.095805 22505 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.115284 22505 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:23.117103 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57587.5us
I20260709 13:11:23.125478 15300 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:11:23.127539 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:23.083827 22655 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:11:23.129155 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:23.130185 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:23.132797 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66368.9us
I20260709 13:11:23.125962 15300 pending_rounds.cc:85] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 12
I20260709 13:11:23.135251 22505 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.143119 22636 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:23.147289 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 128529us
I20260709 13:11:23.090677 22607 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.134564 15300 pending_rounds.cc:107] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:11:23.161177 15300 raft_consensus.cc:2889] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.165928 16003 raft_consensus.cc:2410] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:23.164391 15373 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:23.136008 22505 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.170684 15302 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:23.171741 15304 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:23.162791 22526 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.154767 22547 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.108289 22459 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.194360 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:23.192291 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:23.205915 15301 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:11:23.206790 22656 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:11:23.206852 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46789.5us
I20260709 13:11:23.208930 22654 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:23.209515 22410 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.209869 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:23.210697 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:23.211273 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 82579.9us
I20260709 13:11:23.211704 15379 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:23.214505 22585 consensus_meta.cc:287] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.011s
I20260709 13:11:23.214936 22368 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:23.215369 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:23.215098 22585 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.216832 15305 raft_consensus.cc:2368] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 13.
I20260709 13:11:23.218313 22398 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.190377 22253 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:23.238914 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:23.242026 15374 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:23.243345 15304 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:11:23.247319 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 136687us
W20260709 13:11:23.242889 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 188323us
I20260709 13:11:23.197758 22630 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:23.239336 15376 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
W20260709 13:11:23.256480 22556 consensus_meta.cc:287] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.712s	user 0.018s	sys 0.000s
I20260709 13:11:23.257920 22654 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:11:23.261206 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 92279.7us
I20260709 13:11:23.264458 15302 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:23.265618 22556 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.194710 22618 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.205s
I20260709 13:11:23.260684 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:23.259353 22653 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.375s	user 0.004s	sys 0.001s
I20260709 13:11:23.283280 22570 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:23.288110 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52309.7us
I20260709 13:11:23.290552 16002 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:23.256541 22257 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:23.209564 22494 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:11:23.267249 22654 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.303552 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.274562 22375 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:23.283864 22561 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:11:23.314311 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 66641.7us
W20260709 13:11:23.314131 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.314188 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.315254 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.316730 15302 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
W20260709 13:11:23.317068 22558 consensus_meta.cc:287] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 1.075s	user 0.007s	sys 0.019s
W20260709 13:11:23.321519 22659 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:11:23.322149 22482 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:11:23.321524 16006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:23.292841 22540 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.324059 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.337767 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:23.330719 22253 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:23.321651 22505 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.339596 15375 raft_consensus.cc:2468] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:23.311431 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:23.342705 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:23.357611 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:23.358747 15305 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:23.323037 22556 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.374323 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:23.407407 22401 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:23.377102 22149 consensus_meta.cc:287] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.014s
W20260709 13:11:23.378262 22525 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.617s	user 0.015s	sys 0.002s
I20260709 13:11:23.378067 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.414139 15302 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
W20260709 13:11:23.379011 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 79734.1us
I20260709 13:11:23.378538 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:23.380478 22660 log.cc:927] Time spent T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:23.349117 22253 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:23.386950 15303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4036) took 1054 ms. Trace:
I20260709 13:11:23.393326 15378 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.393989 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.312145 22410 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:11:23.376266 22663 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:23.406651 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:23.365409 22375 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.404405 15379 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.407572 22654 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.413005 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.378629 22561 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 24 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:23.422317 15303 rpcz_store.cc:276] 0709 13:11:22.332226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.966567 (+634341us) service_pool.cc:224] Handling call
0709 13:11:22.967132 (+   565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.967737 (+   605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.967777 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.978000 (+ 10223us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.181950 (+203950us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:23.182013 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.182119 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.386621 (+204502us) raft_consensus.cc:1685] finished
0709 13:11:23.386651 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.386865 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10020,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":36904,"thread_start_us":147148,"threads_started":1,"wal-append.queue_time_us":365579}
I20260709 13:11:23.433007 15233 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 24.
I20260709 13:11:23.353516 22558 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.438333 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.442931 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:23.445376 22505 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:23.428051 22253 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:23.432245 22607 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.458236 22607 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.459568 22585 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.465425 22505 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:23.468461 22457 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:23.470191 22558 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:23.463996 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:23.453516 22665 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:11:23.454388 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.425491 22525 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:23.452966 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 150000us
W20260709 13:11:23.481029 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.474531 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 142256us
I20260709 13:11:23.483258 16008 raft_consensus.cc:1240] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 24. Current term is 25. Ops: []
W20260709 13:11:23.450647 22625 consensus_meta.cc:287] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.007s
I20260709 13:11:23.487973 15381 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
I20260709 13:11:23.448649 22401 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.495936 22401 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.446532 22350 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:23.509295 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.511948 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:23.514046 15230 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.525087 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:23.528816 15305 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 22.
I20260709 13:11:23.541208 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.443051 22561 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.508773 22625 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:23.559402 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 165699us
I20260709 13:11:23.530354 22505 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:23.560289 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:23.549153 22607 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.568646 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2883) took 1269 ms. Trace:
I20260709 13:11:23.551860 22204 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:11:23.596014 16005 raft_consensus.cc:2368] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23.
I20260709 13:11:23.586812 15307 rpcz_store.cc:276] 0709 13:11:22.223922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.229078 (+  5156us) service_pool.cc:224] Handling call
0709 13:11:22.229459 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.229869 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.229903 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.238163 (+  8260us) log.cc:844] Serialized 26 byte log entry
0709 13:11:22.681003 (+442840us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b180027f580. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:11:22.808494 (+127491us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:22.840963 (+ 32469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.846884 (+  5921us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.142059 (+295175us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:23.258657 (+116598us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b24001c8668. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a7809d 00007f2f536aa10e 00007f2f536c188c 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221
0709 13:11:23.493398 (+234741us) raft_consensus.cc:1685] finished
0709 13:11:23.493426 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.493576 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3932,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":7708,"spinlock_wait_cycles":118471168,"thread_start_us":40068,"threads_started":1,"wal-append.queue_time_us":612727}
W20260709 13:11:23.600294 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 132627us
I20260709 13:11:23.604200 15379 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:23.609834 15374 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:23.610277 22204 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:23.610819 22204 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:23.613796 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.619184 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:23.624755 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:23.625589 15228 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:23.611737 22204 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:23.619781 22608 consensus_meta.cc:287] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.006s
I20260709 13:11:23.598037 22505 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:23.644140 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 97214.1us
I20260709 13:11:23.641129 15379 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:23.646486 22563 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:23.647408 15382 raft_consensus.cc:2410] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:11:23.647199 22563 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.648077 22620 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.648638 22620 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.649804 22563 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:23.659277 22525 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.660311 22658 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:11:23.663527 22625 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:23.628994 22375 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:11:23.643347 22596 consensus_meta.cc:287] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.673s	user 0.016s	sys 0.006s
I20260709 13:11:23.639376 22410 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:23.687724 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:23.690395 22525 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:23.692718 22204 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.693347 15299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4034) took 1361 ms. Trace:
I20260709 13:11:23.693816 15299 rpcz_store.cc:276] 0709 13:11:22.331603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.778981 (+447378us) service_pool.cc:224] Handling call
0709 13:11:23.077960 (+298979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.108749 (+ 30789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.693124 (+584375us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54001d5950. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:23.693256 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686027520}
I20260709 13:11:23.697327 22482 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:23.698473 22505 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.741791 22606 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:23.640601 22608 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.749688 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:23.751320 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:23.750739 22606 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:23.755545 22671 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:23.756579 22615 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.758347 15379 raft_consensus.cc:2468] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 21.
I20260709 13:11:23.758005 22615 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.761209 22535 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:23.751138 22596 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:23.761900 22535 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:23.762779 22535 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.762696 22596 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.767071 22596 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:23.767784 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 94495.9us
I20260709 13:11:23.768925 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:23.770493 22671 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:23.770949 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:23.750655 22654 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:11:23.773710 22615 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.770975 22671 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:23.776996 22608 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:23.777218 15308 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:23.757763 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 161172us
I20260709 13:11:23.776993 22671 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.782398 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:23.791622 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:23.792671 22654 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:23.793125 22654 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.793095 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.793743 22654 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:23.793993 22651 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.953s	user 0.000s	sys 0.004s
I20260709 13:11:23.794266 22410 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.795101 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.796066 22410 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:23.807530 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:23.807929 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:23.808655 15300 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:23.813853 22468 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:23.815613 22494 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:23.820317 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.845928 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:23.851001 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.857581 15306 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:23.816167 22494 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:23.860041 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:23.861500 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48550.2us
I20260709 13:11:23.862468 22607 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:23.866364 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:23.866765 15382 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3843) took 1970 ms (client timeout 1613 ms). Trace:
I20260709 13:11:23.867125 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:23.867298 15382 rpcz_store.cc:269] 0709 13:11:21.889242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.889377 (+   135us) service_pool.cc:224] Handling call
0709 13:11:23.850009 (+1960632us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001a95d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:23.859082 (+  9073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4039103360}
I20260709 13:11:23.867733 22545 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:23.861766 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:23.863325 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:23.827978 22608 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:23.838464 22615 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.884758 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:23.868018 22458 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:23.897559 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 99557.6us
I20260709 13:11:23.878363 22410 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:23.884325 22606 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:23.890434 22563 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:23.944914 22505 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:23.945376 22437 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:23.947203 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81070.6us
I20260709 13:11:23.948534 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.951165 15345 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:23.945045 22494 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:23.953037 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.897553 22398 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:23.929831 22410 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.959239 22610 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:23.958105 15300 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 23.
I20260709 13:11:23.981236 15227 raft_consensus.cc:1275] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:23.948550 22663 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:23.892132 22615 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.022657 22615 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:23.940472 22563 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:23.897367 22545 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.023339 22375 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:24.024479 22630 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:24.024986 22630 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:24.025336 22545 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:23.992611 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.025962 22625 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:24.026417 22625 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:24.027469 22625 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:23.993678 22687 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:24.028523 22687 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:24.029615 22687 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:23.901221 22608 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.031301 22687 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.023386 22563 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:24.032848 22608 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.033469 15307 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.983729 22410 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:23.899384 22253 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.036594 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:24.037401 16008 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:24.038390 22253 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:24.038861 22625 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:24.041621 22535 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:23.993307 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 140536us
I20260709 13:11:24.000278 22083 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:11:24.007541 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.716s (SENT) [suppressed 14 similar messages]
I20260709 13:11:24.008536 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:24.009289 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:24.010105 22672 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.412s	user 0.000s	sys 0.002s
I20260709 13:11:24.013154 22494 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.017684 22398 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:24.019631 22525 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:24.025388 22630 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.047644 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:24.069509 15381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3872) took 1383 ms (client timeout 1779 ms). Trace:
I20260709 13:11:24.048830 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:24.067920 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:24.099220 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 170004us
W20260709 13:11:24.073781 16003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46140 (request call id 1023) took 1297 ms (client timeout 1627 ms). Trace:
W20260709 13:11:24.101706 16003 rpcz_store.cc:269] 0709 13:11:22.776365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.779074 (+  2709us) service_pool.cc:224] Handling call
0709 13:11:24.073457 (+1294383us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54006b03d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:24.073683 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820109696}
I20260709 13:11:24.072830 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:24.050926 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:24.007331 22674 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.379s	user 0.002s	sys 0.002s
I20260709 13:11:24.040156 15973 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:24.106660 16008 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:24.083017 15301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1047) took 1434 ms. Trace:
W20260709 13:11:24.096971 15381 rpcz_store.cc:269] 0709 13:11:22.686435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.686628 (+   193us) service_pool.cc:224] Handling call
0709 13:11:24.069301 (+1382673us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b540027b5d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:24.069433 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638950144}
I20260709 13:11:24.119735 15230 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:24.051523 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:24.112414 15307 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:24.117250 15301 rpcz_store.cc:276] 0709 13:11:22.648649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.207084 (+558435us) service_pool.cc:224] Handling call
0709 13:11:23.207522 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:23.207937 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:23.671417 (+463480us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b1800228ee0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f536ce4bc 00007f2f50a1c48b 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf
0709 13:11:23.671581 (+   164us) log.cc:844] Serialized 14 byte log entry
0709 13:11:23.885196 (+213615us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.082375 (+197179us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b1800228ee0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f53b1e060 00007f2f53b30716 00007f2f53b41287 00007f2f53b41208
0709 13:11:24.082584 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:24.082643 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:24.082697 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.082788 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.082944 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7155,"prepare.queue_time_us":121984,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":112,"raft.queue_time_us":206040,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":7996,"spinlock_wait_cycles":78005376,"thread_start_us":298331,"threads_started":2,"wal-append.queue_time_us":181419}
W20260709 13:11:24.131687 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 91609.5us
I20260709 13:11:24.135704 16000 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:24.043965 22535 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.097374 22398 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:24.044869 22663 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:24.139420 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:24.180680 22687 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.181669 22687 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.096309 22083 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:24.143348 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:24.074899 22458 consensus_queue.cc:1048] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:11:24.066624 22671 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.158296 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:24.159288 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:24.115432 15129 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 16 to 21, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 21 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:24.191155 15224 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:24.163427 15199 leader_election.cc:400] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23.
I20260709 13:11:24.163757 21863 consensus_queue.cc:1059] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:24.164536 22204 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:24.166988 22563 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.191884 15199 leader_election.cc:403] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:24.216792 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 209442us
I20260709 13:11:24.139930 22636 raft_consensus.cc:2804] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:24.180760 22663 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:24.185622 22398 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:24.217530 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75719.3us
I20260709 13:11:24.214151 22204 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:24.249383 22204 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:24.239619 22083 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.253201 22083 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:24.254612 22204 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.143266 22654 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:24.257129 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 372403us
W20260709 13:11:24.246205 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 295219us
I20260709 13:11:24.266000 15224 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 23.
I20260709 13:11:24.267278 22482 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23.
I20260709 13:11:24.280803 22563 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.282882 22654 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.284883 22616 raft_consensus.cc:2764] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:11:24.284967 22608 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:24.285885 22608 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:24.286643 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 123481us
I20260709 13:11:24.296777 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.298766 15971 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:24.300228 22688 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:24.301131 22688 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.302034 22690 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.298947 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:24.302697 22690 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.299688 22505 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:24.303690 22688 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.304553 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:24.305648 22687 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.246186 22671 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.299482 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.317344 22686 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:24.318353 22686 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:24.318773 22608 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.319710 15274 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:24.320487 22525 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:24.320376 22401 consensus_queue.cc:1059] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:11:24.321866 22615 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:24.322495 22615 raft_consensus.cc:697] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:24.322926 22525 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:24.324553 22606 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:24.325655 22401 raft_consensus.cc:3055] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:24.326072 22401 raft_consensus.cc:740] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:24.326277 22606 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:24.327025 22401 consensus_queue.cc:260] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.323580 22615 consensus_queue.cc:237] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.330627 22410 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.315019 22398 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.333176 22410 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:24.334767 22398 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.336527 15198 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:24.338009 22525 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:24.338155 15198 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:24.316560 22694 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:24.342834 22401 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:24.340456 22635 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:11:24.347177 22688 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:24.356731 22694 raft_consensus.cc:697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:24.352862 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:24.356837 22688 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:24.339500 22663 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.357466 22420 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:24.360620 16008 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:24.367581 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:24.378681 15307 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:24.374761 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:24.343703 22686 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:11:24.388530 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 89151.6us
I20260709 13:11:24.373766 22688 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:24.400290 15302 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:24.346030 22398 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:24.405607 15305 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:24.407322 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:24.403362 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65353us
I20260709 13:11:24.404727 15226 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:24.316843 22630 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.390169 22636 raft_consensus.cc:697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:24.419718 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.425719 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.359252 22694 consensus_queue.cc:237] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.435822 15307 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:24.404965 22420 consensus_queue.cc:1243] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:11:24.470438 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.470360 16008 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 25.
I20260709 13:11:24.427071 22686 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:24.501802 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 94053.3us
I20260709 13:11:24.509696 15299 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:24.514151 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:24.515237 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:24.524044 22673 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:24.500646 22410 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:24.525868 22410 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.526353 22410 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.529256 22686 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.533401 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.515089 15307 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.424082 22398 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:24.534353 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 111920us
I20260709 13:11:24.569602 15301 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:24.553395 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:24.569024 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 160553us
W20260709 13:11:24.578801 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 320015us
I20260709 13:11:24.584677 15231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3168) took 1298 ms. Trace:
W20260709 13:11:24.586246 22697 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:11:24.585224 15231 rpcz_store.cc:276] 0709 13:11:23.285766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.285891 (+   125us) service_pool.cc:224] Handling call
0709 13:11:23.297182 (+ 11291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.344157 (+ 46975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:23.344192 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:23.376000 (+ 31808us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.507774 (+131774us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:23.507844 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.507955 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.009171 (+501216us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:24.583744 (+574573us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b240011e868. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f508bf9c4 00007f2f508bdacb 00007f2f50a78dc9 00007f2f50a78a55 00007f2f50a77fb0 00007f2f536ee488 00007f2f536eebe8 00007f2f536c6398 00007f2f536c176a 00007f2f536c0bb6
0709 13:11:24.584371 (+   627us) raft_consensus.cc:1685] finished
0709 13:11:24.584394 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.584553 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24203,"raft.queue_time_us":53507,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":13764,"spinlock_wait_cycles":122055168,"thread_start_us":131223,"threads_started":1,"wal-append.queue_time_us":177193}
I20260709 13:11:24.575830 22350 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.588889 22350 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.591483 22459 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.592847 22505 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:24.594527 22620 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.594864 22690 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.596575 22630 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.545442 22673 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:24.598173 22673 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.599689 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:24.541087 22636 consensus_queue.cc:237] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.626883 22535 raft_consensus.cc:3055] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:24.627435 22535 raft_consensus.cc:740] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:24.604216 22687 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:24.613099 22410 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.615387 22698 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:24.616786 22705 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:24.617332 22625 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:24.625033 22398 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:24.631842 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98592.3us
I20260709 13:11:24.653775 22625 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.654750 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.658733 22625 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.658905 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.659786 22398 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:24.660313 22398 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.660804 22398 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:24.643020 15307 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:24.629621 22535 consensus_queue.cc:260] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.533329 22663 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.669255 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:24.673398 22535 raft_consensus.cc:3060] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:24.675956 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:24.676813 15376 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:24.678212 22687 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 25 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:24.680477 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.669478 22630 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:24.676731 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:24.719662 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:24.722558 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:24.725410 15375 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:11:24.725936 15375 pending_rounds.cc:85] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 9
I20260709 13:11:24.726215 15375 pending_rounds.cc:107] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:24.726509 15375 raft_consensus.cc:2889] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.683476 22700 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.694918 22630 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.679693 22687 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.730506 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:24.735919 15379 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:11:24.737766 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78944.9us
I20260709 13:11:24.753846 15376 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:24.730393 22585 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:24.748216 22630 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.769917 15379 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
W20260709 13:11:24.768651 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 343010us
I20260709 13:11:24.772327 15379 pending_rounds.cc:85] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 10
I20260709 13:11:24.776918 15379 pending_rounds.cc:107] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:11:24.777209 15379 raft_consensus.cc:2889] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.777666 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:24.785902 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.768220 22710 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:24.798651 15376 raft_consensus.cc:1240] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:24.801558 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:24.804145 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 262414us
I20260709 13:11:24.747987 22700 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.801071 15382 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:24.772716 22585 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:24.811931 15972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.813046 22410 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.813787 22585 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:24.814010 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:24.814687 15376 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:24.823565 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.809391 22437 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:24.840986 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:24.803843 22710 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:24.819278 22585 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:24.887027 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:24.845217 22437 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:24.888622 22585 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:24.889439 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 71333us
I20260709 13:11:24.891340 22585 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.891587 15345 leader_election.cc:400] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 11. Current term is 13.
I20260709 13:11:24.905179 15229 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:24.834403 22401 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.886158 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45629.8us
I20260709 13:11:24.841955 22690 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:24.917399 15382 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:11:24.924733 22719 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 13:11:24.926237 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4074) took 1077 ms. Trace:
I20260709 13:11:24.927439 22710 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:24.889323 22437 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.928318 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:24.929458 22401 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.930774 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:24.892235 22350 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.931774 22401 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:24.913048 22585 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.933734 22526 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:24.935091 22707 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:11:24.939071 22688 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.001s
I20260709 13:11:24.873194 22482 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 13:11:24.944828 22482 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:24.945350 22482 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:24.945721 22482 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:24.947800 22204 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:24.926818 15306 rpcz_store.cc:276] 0709 13:11:23.857182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.897853 (+ 40671us) service_pool.cc:224] Handling call
0709 13:11:23.930101 (+ 32248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.270474 (+340373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.270532 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.272509 (+  1977us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.713627 (+441118us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:24.713716 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.713837 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.925881 (+212044us) raft_consensus.cc:1685] finished
0709 13:11:24.925914 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.926150 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":331406,"raft.queue_time_us":328496,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":5028,"thread_start_us":371009,"threads_started":1,"wal-append.queue_time_us":477587}
I20260709 13:11:24.949595 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:24.950289 15382 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:24.951166 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:24.933714 22585 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.899607 22563 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:11:24.954181 22606 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:24.954777 22606 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:24.939944 22688 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.960474 15198 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:24.962178 15378 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:24.963524 15376 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:24.971496 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:24.990509 22401 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:25.001098 15382 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:25.003331 15376 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:11:24.955188 22585 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:25.052686 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.967290 22616 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.002696 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:25.061574 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 57168.3us
I20260709 13:11:25.001675 22410 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:25.072937 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70317.9us
W20260709 13:11:25.061540 22707 log.cc:927] Time spent T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:11:24.984776 22671 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:11:25.092922 22336 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:25.082649 22526 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:25.095176 22526 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:25.095759 22465 consensus_queue.cc:1059] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:25.096100 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:25.097256 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 175940us
I20260709 13:11:25.097373 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:24.983574 22398 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:24.955745 22606 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.002086 22204 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:11:25.119313 15379 raft_consensus.cc:1240] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:25.105131 22535 raft_consensus.cc:3055] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:25.060968 22686 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:11:25.064067 22616 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.116279 22585 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.177816 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.192330 22166 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:25.193176 22718 log.cc:927] Time spent T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:11:25.182197 22488 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:11:25.211711 22732 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:25.212633 22732 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:25.214692 22688 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:25.215340 22732 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:25.216735 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:25.217454 16008 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:25.218488 16000 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:25.233769 15376 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:25.216322 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.247556 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:25.107208 22410 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.224747 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.257376 15301 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 22: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:11:25.289855 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58812.6us
I20260709 13:11:25.291826 22698 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:11:25.297423 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72789.7us
I20260709 13:11:25.146908 22535 raft_consensus.cc:740] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:25.138564 22350 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:25.096268 22526 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.134647 22690 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:25.181859 22685 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:25.308019 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91790.8us
I20260709 13:11:25.321298 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:25.322228 15378 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:25.322849 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.323551 15376 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:25.324666 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.325634 15376 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:25.280306 22166 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:25.311832 22687 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:25.321817 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.342042 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.347065 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:25.349004 15376 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:25.279204 22468 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:11:25.317423 22636 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.254029 22585 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.445150 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.286253 22630 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.383695 22375 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:25.478595 15378 raft_consensus.cc:2410] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:11:25.371918 22685 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:25.473310 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 353396us
W20260709 13:11:25.480585 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 343001us
W20260709 13:11:25.463230 22672 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:11:25.489068 15374 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:25.491607 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.498124 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:25.500078 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.370875 22350 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.443531 22482 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:25.515825 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.521057 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.534099 15373 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:25.533238 15376 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:25.448448 22535 consensus_queue.cc:260] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:25.547264 22730 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:25.536597 22690 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.551401 22738 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:25.553272 22685 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:25.589286 22725 log.cc:927] Time spent T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:11:25.591995 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:25.610335 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 246086us
I20260709 13:11:25.660235 22561 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:25.661067 15225 raft_consensus.cc:1275] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:25.661252 21863 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.661787 21863 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.661070 22561 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:25.668834 21863 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:25.671528 22561 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:25.669101 15225 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:25.677871 15304 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:11:25.610976 22731 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:11:25.686671 15302 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:11:25.692600 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.611585 22535 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:25.702137 16008 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:25.702968 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.643604 22525 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:25.715137 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 185390us
I20260709 13:11:25.716017 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:25.724711 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:25.725574 16000 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:11:25.725838 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.733633 22751 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.740154 22751 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.742481 22751 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:25.728864 22688 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.737576 16003 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:11:25.744025 22688 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:25.747746 22728 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:11:25.753491 22350 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:25.754477 22350 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:25.755205 22350 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:25.706911 22743 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.710383 22410 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:25.722008 22525 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.561544 22166 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.764984 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.766132 22585 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:25.768477 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.701350 22636 consensus_queue.cc:1048] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 13:11:25.769366 15375 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:25.770345 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.771116 15375 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:25.766040 15380 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:25.775529 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.779928 15375 raft_consensus.cc:2410] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:11:25.763989 22525 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:25.809378 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83674.9us
I20260709 13:11:25.810371 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.759765 22482 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:25.779764 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60389.4us
I20260709 13:11:25.807740 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.822849 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.728395 22616 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:25.814744 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 80897.3us
I20260709 13:11:25.756843 22743 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.829547 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:25.832830 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:25.804745 22630 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:25.824748 22585 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:25.845814 22616 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.874596 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 62427.7us
I20260709 13:11:25.866775 22687 raft_consensus.cc:2764] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:25.874516 22671 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.871295 22488 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:25.883227 22585 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:25.919692 22745 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:25.914242 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.924962 15273 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.920760 22745 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.865259 22748 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:11:25.933281 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:25.886263 22350 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.922506 22757 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:25.892645 22616 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:25.930930 22488 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:25.963094 22746 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:11:25.926409 22688 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:25.890277 22750 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 13:11:25.915424 22671 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.967424 21863 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.978991 22685 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:25.981806 22767 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:25.996380 15224 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:25.996213 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:25.998402 22740 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:26.000080 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3905) took 1041 ms. Trace:
I20260709 13:11:26.000464 15382 rpcz_store.cc:276] 0709 13:11:24.958827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.017353 (+ 58526us) service_pool.cc:224] Handling call
0709 13:11:25.075847 (+ 58494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.076316 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.076443 (+   127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.084171 (+  7728us) log.cc:844] Serialized 26 byte log entry
0709 13:11:25.476291 (+392120us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:25.495062 (+ 18771us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.495282 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.495375 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.999815 (+504440us) raft_consensus.cc:1685] finished
0709 13:11:25.999885 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.000021 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26555,"prepare.queue_time_us":18619,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":75,"raft.queue_time_us":131151,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":18974,"thread_start_us":340032,"threads_started":1,"wal-append.queue_time_us":754793}
I20260709 13:11:25.996004 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.003221 15233 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:26.002920 22767 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.005239 22767 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.005744 22767 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:25.996452 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.006466 22616 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:25.988456 22525 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:11:26.008930 22700 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.009102 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.009783 15226 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:11:26.013124 22398 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:26.019171 21863 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:25.982568 22585 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:26.021281 22585 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:26.021665 21863 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.021760 22585 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.022789 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3898) took 1130 ms. Trace:
I20260709 13:11:26.023201 15379 rpcz_store.cc:276] 0709 13:11:24.892451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.896832 (+  4381us) service_pool.cc:224] Handling call
0709 13:11:24.897213 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.120026 (+222813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.022452 (+902426us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540014d2d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:26.022697 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509929728}
I20260709 13:11:26.024411 22745 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:26.026438 15381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 3878) took 1363 ms (client timeout 1627 ms). Trace:
W20260709 13:11:26.026909 15381 rpcz_store.cc:269] 0709 13:11:24.662592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.663012 (+   420us) service_pool.cc:224] Handling call
0709 13:11:26.026200 (+1363188us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540027b0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:26.026370 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044547328}
I20260709 13:11:26.027314 22437 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.027918 22743 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.027891 22437 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.030105 22437 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:25.989295 22757 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:26.032191 22757 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:25.982815 22738 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.040800 22671 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:26.045552 22723 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.906s	user 0.000s	sys 0.005s
I20260709 13:11:25.996138 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.101704 22769 consensus_queue.cc:1059] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:11:26.111272 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.112360 15229 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
W20260709 13:11:26.083739 22375 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.007s
I20260709 13:11:26.119623 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.122162 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.117060 22375 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:26.128175 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:26.189465 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.192071 22398 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:26.208772 22398 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:26.210140 22754 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:26.191498 22738 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:26.212841 22738 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.225112 22738 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.226464 22585 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.267426 16005 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:26.265964 22336 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.275722 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 342485us
I20260709 13:11:26.252068 22398 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:26.292080 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.274684 22778 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:26.320652 22778 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.323683 22778 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.274968 22336 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:26.305411 22535 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 13:11:26.307045 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:26.337033 22784 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:26.339243 22375 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.339916 22375 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.342259 22375 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.343571 15307 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:26.344215 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.344554 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.344856 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.345444 15306 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:26.345683 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.347193 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.350376 15304 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:26.351444 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:26.359434 22777 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:26.359632 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:26.370296 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.370992 15302 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:11:26.332050 22336 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:26.397722 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.370790 22654 raft_consensus.cc:3055] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:26.397008 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.398689 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.400564 15225 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:26.403693 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:26.404326 15302 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.399415 22654 raft_consensus.cc:740] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:26.409358 22585 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.425947 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.411366 22654 consensus_queue.cc:260] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.435307 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.435860 15302 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:26.442238 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.443513 15300 raft_consensus.cc:2410] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:11:26.444643 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.448583 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:26.456881 22717 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:26.457456 22717 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:26.458454 22717 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.462848 22717 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:26.467743 22785 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:26.468549 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3880) took 1794 ms. Trace:
I20260709 13:11:26.468372 22785 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.469005 15374 rpcz_store.cc:276] 0709 13:11:24.673872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.675019 (+  1147us) service_pool.cc:224] Handling call
0709 13:11:24.675392 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.491620 (+816228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.468248 (+976628us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54001aa9d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:26.468480 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870541056}
I20260709 13:11:26.470641 22785 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.473533 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:26.474221 16008 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 25.
W20260709 13:11:26.477862 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.486743 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.487401 15225 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:26.486129 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 70629.5us
I20260709 13:11:26.479455 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:26.493008 15302 raft_consensus.cc:1275] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:26.496999 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.499645 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.500173 15304 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:11:26.502760 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.502763 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:26.503973 15304 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.479061 22785 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:11:26.496609 22784 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:26.509560 15300 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:11:26.517386 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.510946 22784 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.524042 15302 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:26.524106 15971 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:26.519979 22694 consensus_queue.cc:1048] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:11:26.521072 22784 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:26.535423 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.540514 22654 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.540863 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.544628 15302 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:26.543557 22457 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:26.555569 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:26.556219 15307 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:26.557539 15229 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:11:26.561378 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.556438 22457 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.565547 22457 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.582322 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.583217 15299 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:26.589042 15304 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:11:26.591187 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.594257 15307 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:26.599385 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.600071 15376 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 24.
I20260709 13:11:26.601097 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.602728 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.603008 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.603860 15374 raft_consensus.cc:2410] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:11:26.604849 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.605458 15376 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:26.608551 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.609288 15374 raft_consensus.cc:2393] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:26.610262 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.610502 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.611446 15382 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:26.613451 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.614657 15233 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:26.614883 22457 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.620882 15377 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:26.622409 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.623014 15379 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:26.625417 15307 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:26.627051 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.628619 15301 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:26.629348 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.634594 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.636912 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.637810 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:26.638592 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.634054 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.638687 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:26.639812 15381 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.643106 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.643980 15305 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:26.637616 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:26.649595 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.651278 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:26.652837 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.653438 15301 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:26.661137 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:26.661978 15304 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:26.663241 15304 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:26.664014 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.664783 15377 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:26.629256 22785 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.668895 15345 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:26.667595 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.670806 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.671516 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.671690 15224 raft_consensus.cc:2410] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:26.673170 15304 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:26.670490 22505 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.688062 15303 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:26.673807 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.675040 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:26.675599 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.676759 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.679584 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:26.682127 22620 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:26.665444 22760 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.686779 22785 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.641093 22751 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.636122 15273 connection.cc:256] RPC call timeout handler was delayed by -1.066388978999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:11:26.710366 15225 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 25.
I20260709 13:11:26.715728 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.716988 15224 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:26.718179 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.720618 15303 raft_consensus.cc:1240] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:26.719645 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:26.729677 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.715966 22741 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:26.732914 15308 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:26.733260 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.728102 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:26.740743 15345 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:26.735921 15381 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:26.711002 22620 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:26.716833 22350 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.712932 22687 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:26.723223 22751 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.723701 22737 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:26.745025 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.748996 15233 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.720527 22585 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:26.741568 22505 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:26.757894 22457 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.754351 22585 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.762203 22585 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:26.768127 15273 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.682s (SENT)
I20260709 13:11:26.768749 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:26.778573 22488 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:26.779798 22401 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:26.745678 22620 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:26.746649 22760 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:11:26.786784 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 161832us
W20260709 13:11:26.784289 15273 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.817s (SENT)
I20260709 13:11:26.788262 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:26.793248 15233 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:11:26.793321 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:26.783561 22505 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:26.747093 22563 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:11:26.808128 15273 leader_election.cc:336] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.056s (SENT)
I20260709 13:11:26.791818 22585 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:26.758845 22747 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:11:26.748049 22741 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.805008 22494 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:26.827529 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.823843 22505 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:26.101537 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:26.814523 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:26.841252 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:26.840376 22401 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:11:26.846436 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:26.809711 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.851490 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.833662 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:26.799479 22734 consensus_queue.cc:1059] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:11:26.794101 22204 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:11:26.853753 15228 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 25.
I20260709 13:11:26.808096 22398 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:26.822402 22687 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.859874 15129 catalog_manager.cc:5697] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 14 to 17, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 17 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:26.867460 16005 raft_consensus.cc:2393] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 25: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:26.805419 22719 consensus_queue.cc:1059] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:26.852365 22494 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.853629 22760 raft_consensus.cc:697] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:26.823210 22735 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:11:26.891954 22760 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.868328 22732 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:26.897620 22732 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:26.898641 22732 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.900014 22732 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:26.884610 22398 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.884749 22687 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:11:26.901044 22794 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:11:26.890239 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 89940us
I20260709 13:11:26.903741 22719 raft_consensus.cc:3055] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:26.888036 22494 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:26.907132 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 104021us
I20260709 13:11:26.885035 22734 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:26.909006 22784 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:26.910303 22735 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:26.982199 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.886346 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:26.983191 15228 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
W20260709 13:11:26.983323 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 97084.8us
I20260709 13:11:26.911691 22757 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:26.912175 22799 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:26.901124 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.984321 15228 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:11:26.911680 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 97325.7us
I20260709 13:11:26.913029 22751 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:26.883242 22585 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:11:26.879487 22563 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:11:26.915397 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.918201 22741 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:26.918807 22785 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:26.947605 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:26.947700 22505 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:26.979940 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:26.996563 16005 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:26.980784 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:26.982178 15227 raft_consensus.cc:1275] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:26.988392 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:26.989166 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 144315us
I20260709 13:11:26.992198 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:26.954509 22719 raft_consensus.cc:740] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.003090 15307 raft_consensus.cc:2368] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 25. Current term is 26.
I20260709 13:11:27.001619 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:27.006453 15233 raft_consensus.cc:1240] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:27.007472 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:27.008074 15375 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.008286 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.012260 15381 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 13:11:26.980198 22734 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:26.982831 22735 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.012949 22778 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.016579 22800 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.008642 22751 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:26.997803 22401 consensus_queue.cc:1243] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:11:27.016913 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.013201 22760 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:27.013258 22737 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.056324 15303 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.056782 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.058048 15381 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:11:27.058533 15381 pending_rounds.cc:85] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 9
I20260709 13:11:27.018641 22620 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.019637 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.059403 15233 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:27.010285 22741 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.023556 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.064697 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.023882 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
W20260709 13:11:27.024729 15273 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 2.390s (SENT)
I20260709 13:11:27.011788 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:27.066608 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:27.067052 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55357.3us
I20260709 13:11:27.053049 15379 raft_consensus.cc:1240] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:11:27.068682 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.058813 15381 pending_rounds.cc:107] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:11:27.022418 15380 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
W20260709 13:11:27.086995 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 62311.6us
I20260709 13:11:27.071056 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:27.089323 15377 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.045061 22778 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.086510 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.093787 15374 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:27.069401 15379 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:27.096700 15375 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:11:27.101539 15376 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:27.107612 15374 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:27.108474 15375 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:27.029721 22654 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:11:27.085629 22401 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.114120 22784 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:27.117946 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.119336 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.085630 22457 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:27.121167 15376 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:27.063675 22741 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.123620 15379 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:11:27.101030 22778 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.129415 15374 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:27.070124 15381 raft_consensus.cc:2889] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.059612 22800 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.132261 22800 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:27.063019 22751 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.107403 22735 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.139640 22620 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:27.139933 22735 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.129612 22741 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.145475 22751 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:27.149298 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.152199 15381 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:27.092530 22760 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.147927 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:27.155884 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.156066 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.156747 15375 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:27.063309 22737 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.167517 15381 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:11:27.216576 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 127882us
I20260709 13:11:27.217512 15376 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:27.219331 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 428575us
I20260709 13:11:27.220974 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:27.173696 22336 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.117740 22734 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.184430 22401 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.162642 22606 consensus_queue.cc:1059] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:11:27.215683 22585 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.218932 22398 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:27.222694 22687 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:27.183054 22488 consensus_queue.cc:1059] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 13:11:27.247958 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 104455us
W20260709 13:11:27.249854 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78289.8us
I20260709 13:11:27.136071 22719 consensus_queue.cc:260] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.228976 22350 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.224836 22654 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:11:27.233526 22505 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:27.268622 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.266201 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.246824 15377 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:27.275409 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.280372 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.281247 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.248642 22784 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.283650 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.258911 22734 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.289392 15973 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:27.234131 22401 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.257720 22751 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:27.275743 22488 consensus_queue.cc:1243] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:27.240671 22585 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:27.318671 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 99213.2us
I20260709 13:11:27.280813 22757 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:27.322273 15303 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
I20260709 13:11:27.321017 22719 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.272898 22350 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.334105 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.323300 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:27.331598 15374 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:27.332126 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.332223 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.338104 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.339020 15374 raft_consensus.cc:2368] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18.
I20260709 13:11:27.321453 22751 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:27.344379 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.347913 15376 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:27.346922 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.345543 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.352056 15377 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:27.355916 15196 leader_election.cc:400] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 25. Current term is 26.
I20260709 13:11:27.356396 15196 leader_election.cc:403] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:27.356725 15308 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.314543 22784 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.379520 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.379499 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:27.380244 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:27.360543 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.337170 22401 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:27.358793 22809 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:27.344902 22810 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.358456 22760 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:27.405638 15231 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:11:27.358633 22811 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:11:27.413684 22654 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:27.415149 15303 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:27.378388 22821 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:27.406455 15305 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:27.432674 15306 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:27.444020 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 180933us
I20260709 13:11:27.452805 15305 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:27.354001 22686 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:11:27.407589 22635 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:27.441983 22820 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:27.344872 22827 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
I20260709 13:11:27.451967 22821 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:27.487396 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 203831us
I20260709 13:11:27.490458 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.491068 15374 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:27.420288 22741 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.495913 15273 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.496776 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.489586 22821 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.473219 22654 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.503918 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.500351 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.506937 15376 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:27.510619 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.510942 15299 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:27.498983 22834 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:11:27.512529 22810 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:27.512806 22822 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:11:27.513028 22810 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.499444 22585 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.507542 22757 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:27.514058 22757 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.514496 22757 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:27.515017 22810 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:27.516809 22813 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:11:27.517768 22814 log.cc:927] Time spent T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:27.522550 22757 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.523053 22810 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.524222 22585 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.525691 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.526722 22585 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.527209 22778 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.527866 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:27.528041 22817 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:11:27.529749 22741 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.530510 22810 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.487288 22535 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:11:27.531275 22737 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:27.507925 22758 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:11:27.531695 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.484689 22635 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.494961 22820 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:27.488988 22336 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:11:27.542311 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.543963 15299 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:27.541874 15273 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.493947 22751 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.545652 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.546736 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.534063 22350 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:27.549873 22791 log.cc:927] Time spent T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.720s	user 0.000s	sys 0.003s
W20260709 13:11:27.552856 22732 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.003s
I20260709 13:11:27.553048 22735 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:27.553602 22735 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.554689 22735 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.547348 15299 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:27.558591 15381 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:11:27.559166 15381 pending_rounds.cc:85] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 10
I20260709 13:11:27.559454 15381 pending_rounds.cc:107] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:11:27.559762 15381 raft_consensus.cc:2889] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.563346 15308 raft_consensus.cc:2410] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:27.564864 22350 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.566820 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.568073 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1082) took 1019 ms. Trace:
I20260709 13:11:27.568558 15302 rpcz_store.cc:276] 0709 13:11:26.548289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.548574 (+   285us) service_pool.cc:224] Handling call
0709 13:11:26.548877 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.549222 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.549248 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.553022 (+  3774us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.785219 (+232197us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:26.785265 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.785350 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.549294 (+763944us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:27.557926 (+  8632us) raft_consensus.cc:1685] finished
0709 13:11:27.557948 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.567996 (+ 10048us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":521,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":4156288,"thread_start_us":218971,"threads_started":1,"wal-append.queue_time_us":269168}
I20260709 13:11:27.573640 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.557344 22757 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.578052 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.556313 22735 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.581355 22778 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.565140 22585 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:27.592984 22654 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:27.582708 22829 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:11:27.599517 22494 consensus_meta.cc:287] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.611s	user 0.003s	sys 0.005s
I20260709 13:11:27.571980 22204 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:27.582751 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.591163 22635 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.591740 22784 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.557101 22820 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.582970 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.544575 22810 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:27.609539 15226 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:27.611212 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.615393 15302 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:27.600018 22494 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.615006 22810 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.620916 22810 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.621913 22839 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:27.622478 22839 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.625536 22457 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:27.626097 22457 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:27.627161 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:27.627777 16003 raft_consensus.cc:3060] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:27.629539 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:27.632537 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69719.4us
I20260709 13:11:27.637120 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.638628 15273 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.640323 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.642513 15273 leader_election.cc:400] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18.
I20260709 13:11:27.642915 15273 leader_election.cc:403] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:27.611359 22822 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 25. Current term is 26.
I20260709 13:11:27.650946 16003 raft_consensus.cc:2468] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 26.
I20260709 13:11:27.644174 22350 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.645771 22829 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:27.662276 22839 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:27.667975 22845 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18.
I20260709 13:11:27.613575 22821 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.664614 22488 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:27.667536 22829 raft_consensus.cc:697] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:27.696127 15301 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:27.700598 15301 raft_consensus.cc:1240] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:27.701901 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.702602 15301 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.704867 15227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47392 (request call id 3095) took 1045 ms. Trace:
I20260709 13:11:27.705261 15227 rpcz_store.cc:276] 0709 13:11:26.659935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.660059 (+   124us) service_pool.cc:224] Handling call
0709 13:11:26.660492 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.997533 (+337041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.698199 (+700666us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400359dd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:27.704801 (+  6602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739030784}
W20260709 13:11:27.714051 22841 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:27.715734 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.716395 15307 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.721166 22465 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:27.723802 15307 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:27.724040 22735 consensus_queue.cc:1059] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:27.724920 22735 raft_consensus.cc:3055] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:27.725225 22735 raft_consensus.cc:740] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.725939 22829 consensus_queue.cc:237] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.728487 22719 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:27.697328 22457 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.726034 22735 consensus_queue.cc:260] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.685321 22488 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.735900 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:27.736491 15307 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.734642 22457 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.734894 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:27.735021 22494 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.689705 22784 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.744843 22488 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.746060 22488 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.746300 15308 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:27.747310 22785 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:27.747678 22785 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:27.685078 22844 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:11:27.751236 15307 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:27.751438 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.752197 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:27.752638 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:27.754175 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:11:27.757329 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 57541.1us
I20260709 13:11:27.759012 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.759928 15231 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:27.760917 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.761233 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.761544 15224 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
W20260709 13:11:27.763286 22840 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:11:27.763715 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.763890 22350 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.764053 22734 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.764775 22620 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.764667 22734 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.765239 22620 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.766896 22734 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:27.767091 22620 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:27.749495 22719 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:27.774731 22719 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.775586 22719 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.780651 22824 raft_consensus.cc:3055] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:27.781073 22824 raft_consensus.cc:740] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.781881 22824 consensus_queue.cc:260] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.783083 22824 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.783357 22821 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.786540 22204 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:27.787045 22204 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.793121 22827 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.793424 22830 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:27.793962 22830 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.793653 22827 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.768155 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.769146 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.757970 22735 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:27.769896 22350 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:27.767825 22844 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:27.773075 22808 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.534s	user 0.005s	sys 0.000s
W20260709 13:11:27.795392 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 153048us
I20260709 13:11:27.797549 15301 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:27.798890 15302 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:27.796306 22845 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.805169 15274 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.811640 15299 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:27.810838 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.814463 22810 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.815002 22827 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:27.815590 22350 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:27.796656 22494 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.816679 22494 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.798491 22830 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.818722 22494 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.819531 22830 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:27.821003 22785 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.810215 22734 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.822230 22785 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.798542 22844 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.824304 22844 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.826589 15305 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:27.827704 15305 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.829078 15348 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.830235 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.831740 22585 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:27.832440 22585 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:27.835985 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:27.836522 22732 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:27.837179 22732 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.837915 22563 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.839855 15232 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:27.841096 22635 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.841868 15381 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.841614 22635 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:27.837126 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:27.844549 22166 raft_consensus.cc:3055] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:27.848145 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:27.849975 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44871.9us
I20260709 13:11:27.878158 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:27.850971 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:27.852246 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:27.853572 15226 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 25.
I20260709 13:11:27.856809 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.864708 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.881299 15373 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.882545 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:27.883154 15375 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.883733 15306 raft_consensus.cc:1240] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:27.885723 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:27.887677 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:27.889370 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46829.6us
I20260709 13:11:27.891105 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.894814 15380 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:11:27.893368 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.900506 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:27.905516 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 100263us
I20260709 13:11:27.915769 15375 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:27.916882 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:27.917536 15375 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:27.875384 22166 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:27.921231 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.806453 22851 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:11:27.923571 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.921425 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:27.922420 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.906494 15379 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:27.902143 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:27.901707 22799 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:11:27.955552 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:28.094483 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:27.977713 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:28.095711 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 168011us
I20260709 13:11:27.983832 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:28.089093 15373 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:27.952054 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.955123 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:27.950606 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:28.067965 15305 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:27.968072 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:28.157945 15224 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:28.136053 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:28.076555 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.155548 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 253432us
I20260709 13:11:27.912819 15129 catalog_manager.cc:5697] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 9 to 14, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 14 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.910763 22737 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:28.041260 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:27.911084 22760 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.931404 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:27.970083 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:28.172848 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 131696us
I20260709 13:11:28.174918 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:28.178449 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 223374us
W20260709 13:11:28.181196 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 256911us
I20260709 13:11:28.181758 15303 raft_consensus.cc:1240] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:28.181663 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.182157 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:28.182828 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:28.180625 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 228658us
I20260709 13:11:28.170640 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:28.188287 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:28.189342 15305 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:28.190757 15380 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:28.184705 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:28.190752 15305 raft_consensus.cc:1240] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:27.899621 22563 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:28.208010 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:27.985059 22854 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:11:27.921676 22810 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:27.903791 22401 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:27.916622 22488 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.283s
I20260709 13:11:28.234784 15378 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:28.188671 22535 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:27.983156 22855 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.971639 22350 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:28.188027 22852 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:27.925201 22732 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.965214 22398 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.973662 22635 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.215396 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.215969 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:28.216876 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:28.218861 22821 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:28.221150 22858 log.cc:927] Time spent T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:28.144888 22844 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.111711 22694 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:28.204226 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:28.297780 15379 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:27.925487 22829 raft_consensus.cc:2764] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:11:28.189831 22757 raft_consensus.cc:2764] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:11:28.180379 22831 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:28.189137 22739 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:11:27.919476 22805 consensus_queue.cc:1048] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.300s
I20260709 13:11:28.197846 22804 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:28.239756 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:27.950954 22845 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.279s
I20260709 13:11:27.976714 22751 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.255s
I20260709 13:11:28.202912 22719 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:28.073644 22741 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:11:27.991927 22204 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.258638 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:28.109717 22585 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.264600 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.256817 22747 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:11:28.237948 22620 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:28.269670 22350 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.274643 15303 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:11:28.293872 15224 raft_consensus.cc:2468] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 26.
I20260709 13:11:28.245297 22810 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:28.245090 22401 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:27.988777 22166 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:28.309302 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 115335us
I20260709 13:11:28.273111 22535 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:28.271394 22855 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.323064 15304 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:11:28.325147 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 140519us
W20260709 13:11:28.336756 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 155162us
W20260709 13:11:28.337000 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72548.8us
I20260709 13:11:28.309368 22831 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.328732 15380 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:11:28.308890 22694 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.322330 22804 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:28.386042 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.377346 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.320245 22805 consensus_queue.cc:1243] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:28.390273 15224 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:28.390937 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.377903 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.382251 22822 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:11:28.381978 22401 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.382949 15345 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.339530 22620 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.375303 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.403595 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.331096 22757 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:28.372085 15307 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:28.388676 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.360832 22827 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:28.339988 22869 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:28.387358 22785 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.005s
I20260709 13:11:28.432919 15301 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:28.397341 22784 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:28.386961 22831 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.435765 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.361104 22719 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:28.448614 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:28.400465 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:28.389169 22804 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.440487 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:28.360811 22810 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:28.397926 22829 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:28.441084 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 163781us
I20260709 13:11:28.431116 22620 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:28.448050 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:28.453352 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.468932 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:28.470297 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.472404 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:28.473146 15233 raft_consensus.cc:2368] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 25. Current term is 26.
I20260709 13:11:28.441893 22166 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.446786 22784 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:28.490645 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:28.462343 22810 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:28.497483 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 282187us
I20260709 13:11:28.502118 15274 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.505264 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:28.544787 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:28.496217 22784 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:28.555712 15274 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:28.559999 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 61666.2us
I20260709 13:11:28.484588 22824 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:11:28.498560 22457 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:28.540012 22757 raft_consensus.cc:2804] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:28.550930 22844 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.554849 22336 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:28.567349 22867 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:11:28.582032 15306 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:28.581859 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.561196 22719 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.576556 22526 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 13:11:28.586382 22859 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:11:28.587296 22866 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:11:28.558197 22823 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.499091 22535 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.578078 22350 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.578353 22204 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.578737 22855 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.578472 22457 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.625101 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:28.629251 22860 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:11:28.629848 22868 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:11:28.637416 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.645395 15227 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:28.618628 22878 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:28.677589 22878 raft_consensus.cc:697] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 25 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:28.677692 22824 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:28.678722 22878 consensus_queue.cc:237] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.678953 22824 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.679728 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:28.681412 22824 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:28.682395 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.683480 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.666653 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.675987 15303 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:28.696162 15274 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:28.696493 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:28.670652 22784 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.697708 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:28.698393 15224 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:28.698858 22784 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:28.700438 22867 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:28.701095 22880 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:28.701655 22880 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.702328 22457 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.703663 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:28.704669 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
W20260709 13:11:28.706702 22859 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:28.713775 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:28.622466 22585 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.622433 22694 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:28.725899 15225 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:28.729995 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 173437us
I20260709 13:11:28.734556 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.730159 22717 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.743848 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:28.732162 22784 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.739077 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:28.708250 22804 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.740258 22870 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:28.743678 22717 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:28.749044 22757 raft_consensus.cc:697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:28.750020 22784 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:28.776446 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.769794 22717 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.785009 15224 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:28.787217 15224 pending_rounds.cc:85] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Aborting all ops after (but not including) 11
I20260709 13:11:28.787508 15224 pending_rounds.cc:107] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:11:28.787750 15224 raft_consensus.cc:2889] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:28.789248 22757 consensus_queue.cc:237] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.791390 22810 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.793640 22804 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.762578 22887 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:28.794477 22887 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.794854 22887 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.796711 22717 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.763428 22880 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:28.802857 22829 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:28.750753 15231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:28.804301 15231 raft_consensus.cc:606] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:28.804703 15231 raft_consensus.cc:614] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:28.806033 15231 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:11:28.797989 22831 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:28.808622 22831 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:28.808787 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:28.809458 16005 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.808166 15230 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:28.775612 22870 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:11:28.775946 22784 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.844867 16005 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:28.846922 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:28.852756 15229 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:28.855027 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:28.846552 22620 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:28.875145 22620 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:28.889601 22810 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:28.891196 22890 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:11:28.892897 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.850085 22831 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:28.895228 22831 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:28.896546 22831 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.902804 22887 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:28.917502 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:28.918686 15225 raft_consensus.cc:606] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:28.919042 15225 raft_consensus.cc:614] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:28.926935 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:28.916862 22880 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.862731 22717 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:28.934962 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3953) took 1035 ms. Trace:
I20260709 13:11:28.938863 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3944) took 1087 ms. Trace:
I20260709 13:11:28.935653 15375 rpcz_store.cc:276] 0709 13:11:27.901290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.918920 (+ 17630us) service_pool.cc:224] Handling call
0709 13:11:27.919200 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.919545 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.919572 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.924555 (+  4983us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.236837 (+312282us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:28.306280 (+ 69443us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.934429 (+628149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.934544 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.934623 (+    79us) raft_consensus.cc:1685] finished
0709 13:11:28.934647 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.934869 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":661552,"prepare.queue_time_us":91084,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":2458,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":48109,"thread_start_us":129606,"threads_started":1,"wal-append.queue_time_us":213705}
I20260709 13:11:28.942607 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:28.943643 15377 raft_consensus.cc:2376] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21. Re-sending same reply.
I20260709 13:11:28.939327 15376 rpcz_store.cc:276] 0709 13:11:27.851579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.851729 (+   150us) service_pool.cc:224] Handling call
0709 13:11:27.894966 (+ 43237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.895278 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.895305 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.905506 (+ 10201us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.246955 (+341449us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:28.325790 (+ 78835us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.938430 (+612640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.938569 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.938622 (+    53us) raft_consensus.cc:1685] finished
0709 13:11:28.938638 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.938798 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":671172,"prepare.queue_time_us":134850,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":4022,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9663,"thread_start_us":280171,"threads_started":1,"wal-append.queue_time_us":444721}
I20260709 13:11:28.948215 15377 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:11:28.919876 22878 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:28.930295 22836 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:28.956163 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 573241us
I20260709 13:11:28.957521 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.949048 22687 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:28.971237 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:28.972788 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:28.976315 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3939) took 1128 ms. Trace:
I20260709 13:11:28.976999 15381 rpcz_store.cc:276] 0709 13:11:27.847524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.849830 (+  2306us) service_pool.cc:224] Handling call
0709 13:11:27.850064 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.850235 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:11:28.099345 (+249110us) log.cc:844] Serialized 14 byte log entry
0709 13:11:28.975901 (+876556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.975968 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:28.976020 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.976100 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.976250 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699291,"prepare.queue_time_us":417389,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":425531,"threads_started":2,"wal-append.queue_time_us":368154}
I20260709 13:11:28.953847 22836 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.982062 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75432bd549b3481d83070979a305922b"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:28.986491 15225 raft_consensus.cc:606] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:28.987075 15225 raft_consensus.cc:614] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:28.967000 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 208956us
I20260709 13:11:28.963217 22873 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.962292 22751 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:28.959935 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:28.997968 15376 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:28.935151 22880 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:29.003082 15377 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:28.981020 22620 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:29.007262 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47399.9us
I20260709 13:11:29.007863 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.016408 15225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:29.026845 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:28.960927 22878 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.021323 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3946) took 1169 ms. Trace:
I20260709 13:11:28.991612 22836 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.020965 22887 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.005927 22734 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.041543 15225 raft_consensus.cc:606] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Received request to transfer leadership to TS 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:29.008543 22874 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:11:29.014822 22620 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:29.008867 22732 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:29.007417 22873 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.023373 22880 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:29.070487 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3942) took 1220 ms. Trace:
I20260709 13:11:29.076910 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.020900 22735 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.074573 15382 rpcz_store.cc:276] 0709 13:11:27.849720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.850384 (+   664us) service_pool.cc:224] Handling call
0709 13:11:27.894120 (+ 43736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.894458 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.894485 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.894919 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.095444 (+200525us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:28.122929 (+ 27485us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b480012d158. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f58a4faa1 00007f2f58a46b37 00007f2f58a469ca 00007f2f58b3e26f 00007f2f58b3df37 00007f2f58b5255c 00007f2f58b52508 00007f2f58b52488 00007f2f58b52443 00007f2f58b516ec 00007f2f57a7ba96
0709 13:11:28.494720 (+371791us) log.cc:844] Serialized 14 byte log entry
0709 13:11:29.065477 (+570757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.065553 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.065593 (+    40us) raft_consensus.cc:1685] finished
0709 13:11:29.070304 (+  4711us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.070436 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":640573,"prepare.queue_time_us":172678,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":57,"raft.queue_time_us":501705,"raft.run_cpu_time_us":3447,"raft.run_wall_time_us":234884,"spinlock_wait_cycles":35088256,"thread_start_us":460642,"threads_started":3,"wal-append.queue_time_us":218119}
I20260709 13:11:29.053059 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:29.055359 22760 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:11:29.070587 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.068976 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.087530 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.044327 15374 rpcz_store.cc:276] 0709 13:11:27.852139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.852244 (+   105us) service_pool.cc:224] Handling call
0709 13:11:27.852747 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.879967 (+ 27220us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:28.151621 (+271654us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b180042ae40. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f509b3c0a 00007f2f5a0f3219 00007f2f50a3ba40 00007f2f50a364e4 00007f2f50a36455 00007f2f5751e3c7 00007f2f53b309a7 00007f2f53b400bf 00007f2f53b40038
0709 13:11:28.494481 (+342860us) log.cc:844] Serialized 14 byte log entry
0709 13:11:29.000549 (+506068us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.002706 (+  2157us) log.cc:844] Serialized 26 byte log entry
0709 13:11:29.002861 (+   155us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:29.002893 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.002976 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.005994 (+  3018us) raft_consensus.cc:1685] finished
0709 13:11:29.021103 (+ 15109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.021246 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":431131,"prepare.queue_time_us":387896,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":433910,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":42485,"spinlock_wait_cycles":20160384,"thread_start_us":364004,"threads_started":3,"wal-append.queue_time_us":197771}
I20260709 13:11:29.101851 15381 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:29.102515 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:29.047571 22861 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:29.049271 22620 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.101970 15380 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.102942 15379 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:29.008924 22751 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.057353 22488 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:29.107506 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.095818 22810 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.068629 22737 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.056536 22732 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.095564 22760 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:29.068807 22784 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.117133 15382 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:29.096832 22398 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:11:29.110685 22488 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.119112 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.119729 15382 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:29.120193 22488 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.120636 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.121259 22488 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.121443 15382 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:29.122395 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.124742 22829 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.125273 22829 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.127416 22829 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.137753 22751 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:29.138615 22907 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:29.139180 22907 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:29.140260 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.141781 22907 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:29.143189 15300 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:29.144411 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:29.145016 15301 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:29.145381 22757 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:29.145810 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:29.146533 15305 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:29.147922 22873 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:29.148662 22732 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:29.148859 15308 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:29.149853 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:29.150774 22878 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.097505 22735 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.149900 22784 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.155607 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4160) took 1427 ms. Trace:
I20260709 13:11:29.156029 15307 rpcz_store.cc:276] 0709 13:11:27.727786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.846893 (+119107us) service_pool.cc:224] Handling call
0709 13:11:27.847123 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.439075 (+591952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.155383 (+716308us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54001856d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:29.155550 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206866816}
I20260709 13:11:29.115770 22810 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:29.171957 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 53365.4us
I20260709 13:11:29.173864 22735 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.175040 22810 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.176112 15348 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:29.177016 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:29.177120 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 124178us
I20260709 13:11:29.177630 15303 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:29.179952 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.181128 22881 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:29.181731 22881 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.182004 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:29.176203 22494 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:29.186738 15303 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
W20260709 13:11:29.187704 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.182706 22881 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.193442 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.193809 15378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3948) took 1337 ms. Trace:
I20260709 13:11:29.194262 15382 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:29.194197 15378 rpcz_store.cc:276] 0709 13:11:27.856794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.904614 (+ 47820us) service_pool.cc:224] Handling call
0709 13:11:27.905003 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.235439 (+330436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.193593 (+958154us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54002896d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:29.193754 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757837696}
I20260709 13:11:29.117961 22760 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:29.199985 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:29.214548 15381 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:29.216578 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.217233 15227 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:11:29.202562 15231 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:11:29.220160 15378 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: [16.11-17.12]
I20260709 13:11:29.220597 15224 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:29.159994 22836 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.204689 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.200531 22905 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.224501 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.224501 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:29.227011 16002 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:29.224133 15378 raft_consensus.cc:1275] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:11:29.226138 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:29.198101 22535 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.238111 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.238251 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.239331 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:29.241007 15227 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:29.235405 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.244544 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:29.232054 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.232218 15974 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:29.233858 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.247391 15382 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:29.235908 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.190735 22494 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.225250 22839 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:29.248749 22535 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.257748 22535 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.257987 22836 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.258505 22911 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:29.259982 22760 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.241811 22734 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:29.259086 22620 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.249243 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.239049 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:29.251046 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.270830 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.252126 15378 raft_consensus.cc:2393] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:29.267642 22741 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:29.249112 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.268822 15232 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 25. Current term is 26. Ops: [23.16-25.17]
I20260709 13:11:29.223312 22166 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.273057 15381 raft_consensus.cc:3060] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.270761 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.273401 15380 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 14.
I20260709 13:11:29.274065 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.293105 15232 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:29.294081 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.295157 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.295454 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.269918 15228 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:29.275424 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.223026 22861 consensus_queue.cc:1059] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:11:29.297142 22861 raft_consensus.cc:3055] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:29.242239 22882 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:11:29.297544 22861 raft_consensus.cc:740] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:29.297916 22620 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:29.276099 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:29.278738 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46599.1us
I20260709 13:11:29.298393 22861 consensus_queue.cc:260] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:29.277901 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45778.7us
I20260709 13:11:29.299082 22494 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.287956 22829 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:29.299957 22910 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.281479 22821 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:29.282151 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:29.282907 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:29.311923 15308 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:29.313099 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.313560 15129 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:29.317687 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:29.320315 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.283054 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:29.326701 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 43711us
I20260709 13:11:29.283746 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:29.284639 15301 raft_consensus.cc:1240] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:11:29.285169 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:29.287784 15307 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:29.285805 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:29.295964 15373 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:29.297330 22535 raft_consensus.cc:993] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:11:29.332435 15299 raft_consensus.cc:2393] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:29.299338 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:29.279260 22815 raft_consensus.cc:2804] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:29.299572 22861 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.280604 22894 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:29.300388 22494 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.268520 22735 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:29.275424 22839 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:29.299567 15377 raft_consensus.cc:1240] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:29.249805 22526 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.303741 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.268659 22336 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:29.256225 22870 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.306970 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.309302 15381 raft_consensus.cc:2468] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:29.333806 15348 leader_election.cc:400] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for earlier term 25. Current term is 26.
I20260709 13:11:29.371335 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.373153 15232 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:11:29.343309 22620 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.251350 22880 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:11:29.387313 22880 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:29.387708 22880 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.388492 22880 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.389669 22880 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:29.390425 22719 consensus_queue.cc:1175] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "841138f50ace4746978e72d7f13878de" responder_term: 16 status { last_received { term: 16 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 16 index: 12 } }
I20260709 13:11:29.370260 22336 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.393385 22336 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.393959 15228 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:29.398327 22751 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:29.352524 22815 raft_consensus.cc:697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 26 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:29.398933 22751 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.399878 22815 consensus_queue.cc:237] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:29.300419 22829 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:29.403180 22751 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:29.297209 22908 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:29.404270 22829 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:29.370810 22784 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:29.406463 22784 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.364629 22894 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.412423 22894 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.368412 22882 raft_consensus.cc:1081] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Signalling peer 0ec140f610ed4500ba58208c0e5519bb to start an election
I20260709 13:11:29.341555 15224 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:29.315393 15129 catalog_manager.cc:5697] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 15 to 20, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 20 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:29.348791 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49529.4us
I20260709 13:11:29.289036 22869 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:11:29.417964 15129 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.354585 15226 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:29.335305 22914 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:29.311009 22821 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.333860 22734 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:29.364778 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.333593 22871 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:29.336961 22687 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:29.337067 22204 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:29.369393 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.375630 22910 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:29.304623 22166 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:29.376605 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.378283 22747 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:29.358316 22694 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:29.385186 22839 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:29.311518 22831 consensus_queue.cc:1059] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:11:29.371534 22845 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
W20260709 13:11:29.380183 15126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 196) took 54779 ms (client timeout 15000 ms). Trace:
I20260709 13:11:29.420040 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.347009 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.430150 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.439173 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:29.431128 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:29.419692 15129 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 18 to 24, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 24 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:11:29.436367 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 59816.6us
I20260709 13:11:29.436439 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.439067 22784 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.374087 22870 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:29.565421 22821 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.420603 22898 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:11:29.587843 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 305746us
I20260709 13:11:29.436863 22747 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.437026 22694 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:29.438630 22687 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:29.611696 15229 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 13:11:29.619514 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 178956us
I20260709 13:11:29.615417 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:29.616000 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.616786 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 269860us
I20260709 13:11:29.617049 15224 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:29.620664 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:29.631280 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.442703 22887 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.662565 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.663579 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:29.666208 15379 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:29.619099 22810 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:29.620314 22881 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.690096 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74781.2us
I20260709 13:11:29.620538 22747 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:29.628520 22805 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.693300 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:29.692893 15129 catalog_manager.cc:5697] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.693944 15381 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:29.671509 15373 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:29.672936 15224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a"
dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
mode: GRACEFUL
new_leader_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:59848
I20260709 13:11:29.695736 15224 raft_consensus.cc:606] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Received request to transfer leadership to TS 841138f50ace4746978e72d7f13878de
I20260709 13:11:29.438616 22871 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.212s
I20260709 13:11:29.681136 15226 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:29.658705 22831 consensus_queue.cc:1059] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:29.686457 15379 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06"
dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
 from {username='slave'} at 127.0.0.1:54656
I20260709 13:11:29.624864 22694 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:29.659668 22882 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:29.501873 22829 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.216s
I20260709 13:11:29.705873 15379 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:29.621699 22734 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:11:29.718385 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:29.720122 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:29.717494 15129 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index -1 to 9, term changed from 10 to 16, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to <none>, VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 16 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:29.714808 15379 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.738019 22204 raft_consensus.cc:3055] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:29.738499 22204 raft_consensus.cc:740] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.739276 22204 consensus_queue.cc:260] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.741477 22829 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:29.742014 22829 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.743873 22829 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:29.744447 22882 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.745376 22882 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:29.753428 22204 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.755537 22823 raft_consensus.cc:3055] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:29.712451 15198 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:29.756019 22823 raft_consensus.cc:740] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:29.757021 22823 consensus_queue.cc:260] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.757885 22488 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:29.758262 22823 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:29.758349 22488 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.758884 22488 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:29.760195 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.738065 15129 catalog_manager.cc:5697] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.765288 22871 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:29.765703 22871 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:29.766474 22871 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:29.767573 22871 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:29.764250 15129 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 12 to 18, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 18 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:29.716327 22845 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:29.769001 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.701077 22872 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:29.694567 22878 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.703081 22881 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.723604 22166 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:29.725381 22821 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:29.726578 22870 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:29.700994 22810 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:29.660455 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 341007us
I20260709 13:11:29.620777 22910 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:11:29.707211 22911 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 13:11:29.439070 15126 rpcz_store.cc:269] 0709 13:10:34.600964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.617550 (+ 16586us) service_pool.cc:224] Handling call
0709 13:11:29.379929 (+54762379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:20.459084 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:20.459908 (+   824us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:20.459990 (+    82us) write_op.cc:435] Acquired schema lock
0709 13:11:20.460039 (+    49us) tablet.cc:662] Decoding operations
0709 13:11:20.461366 (+  1327us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:20.461519 (+   153us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:20.461562 (+    43us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:11:20.462562 (+  1000us) tablet.cc:701] Row locks acquired
0709 13:11:20.462627 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:11:20.492792 (+ 30165us) write_op.cc:270] Start()
0709 13:11:20.532622 (+ 39830us) write_op.cc:276] Timestamp: P: 1783602680480949 usec, L: 0
0709 13:11:20.548523 (+ 15901us) op_driver.cc:348] REPLICATION: starting
0709 13:11:20.652440 (+103917us) log.cc:844] Serialized 2865 byte log entry
0709 13:11:21.231527 (+579087us) op_driver.cc:464] REPLICATION: finished
0709 13:11:21.541464 (+309937us) write_op.cc:301] APPLY: starting
0709 13:11:21.552044 (+ 10580us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:21.807670 (+255626us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:21.824121 (+ 16451us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:22.160794 (+336673us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:22.252796 (+ 92002us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:11:22.252896 (+   100us) write_op.cc:312] APPLY: finished
0709 13:11:22.253319 (+   423us) log.cc:844] Serialized 73 byte log entry
0709 13:11:22.377323 (+124004us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:22.394949 (+ 17626us) write_op.cc:454] Released schema lock
0709 13:11:22.411715 (+ 16766us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:22.447327 (+ 35612us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:22.459018 (+ 11691us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1012314,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":301096,"apply.run_cpu_time_us":40425,"apply.run_wall_time_us":895618,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":442806,"prepare.run_cpu_time_us":13617,"prepare.run_wall_time_us":390373,"raft.queue_time_us":247500,"raft.run_cpu_time_us":31866,"raft.run_wall_time_us":126118,"replication_time_us":677504,"thread_start_us":708978,"threads_started":5,"wal-append.queue_time_us":327806,"wal-append.run_cpu_time_us":31256,"wal-append.run_wall_time_us":2384089}]]}
W20260709 13:11:29.770711 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 58431.6us
I20260709 13:11:29.791167 15373 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:29.791651 15373 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:29.784770 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:29.784389 15129 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.775715 15379 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.797809 15379 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:29.773321 22829 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:29.769035 22845 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.812392 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:29.813198 16003 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:29.829958 15378 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:11:29.808014 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 116665us
I20260709 13:11:29.833897 15129 catalog_manager.cc:5697] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.805423 15373 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:29.854373 15129 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 17 to 20, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:11:29.876386 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 91690.8us
I20260709 13:11:29.889921 15373 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.891974 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.894654 15224 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 22.
I20260709 13:11:29.810175 22829 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.783300 22878 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.901957 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:11:29.908381 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 75805us
I20260709 13:11:29.915329 22488 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:29.907889 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:29.900104 22910 consensus_queue.cc:1243] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Peer b0f9eceec749442cb9a06c87f00f3caf log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:29.901327 22829 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.930387 15348 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:29.930899 22687 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:29.907326 22336 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:29.938488 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.932039 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:29.907495 22535 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.931216 15274 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:29.938910 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.941784 15227 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:29.980532 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49401.5us
I20260709 13:11:29.942252 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:29.981626 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:29.941866 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:29.979650 16003 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.992693 15229 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:30.014361 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:29.928741 22737 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.979863 22910 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:29.926828 22757 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:29.934255 22805 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.927935 22836 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:11:29.980011 22563 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:11:30.017675 22734 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.986531 22735 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.036192 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:29.926502 22694 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:30.032418 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 127683us
I20260709 13:11:29.927712 22810 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.042582 15373 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:29.989885 22887 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.067595 16002 raft_consensus.cc:1240] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:30.021227 22822 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:30.033463 22910 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:30.041033 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 409858us
I20260709 13:11:29.986498 22535 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.034539 22741 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:30.074069 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:30.086715 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 184814us
I20260709 13:11:30.087560 15196 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:30.054771 22936 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:30.068281 22563 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:30.030931 22737 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.034068 22757 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:30.109934 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.072410 22822 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:30.060626 22751 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:30.071362 22933 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.037385 22747 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.083528 22910 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:30.055989 22861 consensus_queue.cc:1059] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:11:30.084995 22741 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:30.158587 22935 log.cc:927] Time spent T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:30.160055 15232 raft_consensus.cc:3055] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:30.160916 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78208.3us
I20260709 13:11:30.203004 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.082396 22887 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:30.062476 22734 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.085501 22928 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:30.064713 22735 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.088825 22881 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.087761 22920 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 13:11:30.170697 22751 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:30.051352 22805 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.193926 15232 raft_consensus.cc:740] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:30.156258 22894 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:30.172015 22822 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:30.191604 22932 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.228847 22932 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.231000 22932 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.231493 22932 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.196364 22741 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:30.212661 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 304815us
W20260709 13:11:30.198487 22924 log.cc:927] Time spent T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:11:30.213788 22926 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:11:30.225559 22894 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:30.212026 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 138017us
I20260709 13:11:30.147753 22931 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.115s
I20260709 13:11:30.240124 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:30.213644 22928 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.232081 22932 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.197463 22535 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:30.245255 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 263706us
I20260709 13:11:30.222419 15232 consensus_queue.cc:260] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.193126 22845 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.184464 22922 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:11:30.152859 22936 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.267844 15379 raft_consensus.cc:3055] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:11:30.272042 22687 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.275223 15232 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:30.276741 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:30.277793 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 190334us
I20260709 13:11:30.244177 22488 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:30.274097 22204 consensus_meta.cc:287] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
I20260709 13:11:30.255065 22878 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.260679 22894 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:30.289839 15379 raft_consensus.cc:740] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:30.312755 15348 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.312234 15379 consensus_queue.cc:260] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:30.313810 15379 raft_consensus.cc:3060] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:30.274500 22928 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:30.188644 22933 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.358032 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 2950) took 1075 ms. Trace:
W20260709 13:11:30.331611 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60629.4us
I20260709 13:11:30.296132 22881 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:30.340448 22805 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.341921 22735 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:30.346971 22938 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:11:30.378201 15307 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:11:30.348215 22937 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:30.349301 22734 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:30.349509 22948 consensus_queue.cc:1048] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:30.350278 22737 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:30.351972 22747 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.290033 22694 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.294549 22687 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.288851 22929 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:30.294232 22940 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.358536 15306 rpcz_store.cc:276] 0709 13:11:29.282499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.286038 (+  3539us) service_pool.cc:224] Handling call
0709 13:11:29.286228 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.302493 (+ 16265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.302524 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.343135 (+ 40611us) log.cc:844] Serialized 26 byte log entry
0709 13:11:29.705972 (+362837us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:29.713241 (+  7269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:29.713333 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.357782 (+644449us) raft_consensus.cc:1685] finished
0709 13:11:30.357817 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:30.357967 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15960,"raft.queue_time_us":16430,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":13500,"thread_start_us":329585,"threads_started":1,"wal-append.queue_time_us":544678}
I20260709 13:11:30.365538 22881 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:30.364192 22942 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.371007 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:30.371914 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:30.411792 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 152889us
I20260709 13:11:30.412891 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:30.331818 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 60852.1us
I20260709 13:11:30.375252 15379 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:11:30.290791 22943 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:30.382932 15232 raft_consensus.cc:2468] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:30.320703 22751 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.383934 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:30.384143 22944 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:11:30.319664 22845 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.321274 22947 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.403213 22717 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.441241 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:30.368161 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.368459 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.364782 22488 consensus_queue.cc:1059] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:11:30.399701 22929 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.398726 22922 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.443519 15300 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:30.409103 16003 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:11:30.386982 22871 consensus_meta.cc:287] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.000s
I20260709 13:11:30.448758 22717 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:30.450940 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.416661 15273 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.435869 15305 raft_consensus.cc:2393] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:30.416636 15380 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:30.410378 22881 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.449666 22535 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:30.458436 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:30.464326 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.464582 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.474920 15305 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:30.446868 22931 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.477989 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.452090 22929 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:30.483167 15305 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:30.461794 22751 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.495925 22933 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.499951 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.463234 22757 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.451293 22845 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.508539 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:30.409916 22940 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:30.480993 22871 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:30.463830 22957 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:30.519696 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.436625 22942 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.520829 22694 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.532946 22694 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:30.511713 22952 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:30.534289 22942 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.465488 22955 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
W20260709 13:11:30.523073 22953 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:11:30.532086 22717 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.535022 22694 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:30.531647 22821 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.746s	user 0.004s	sys 0.004s
I20260709 13:11:30.497532 22887 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:30.539516 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.505450 22734 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.540016 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.522418 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.541641 15232 raft_consensus.cc:1275] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:11:30.460486 22922 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.542296 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.451133 22947 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.542936 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:30.551707 15308 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:30.527145 22823 consensus_meta.cc:287] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.004s
W20260709 13:11:30.540743 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 80686.4us
I20260709 13:11:30.545548 15273 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.563905 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.565115 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.546453 15306 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:30.518999 22933 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.568442 15224 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:30.569752 15303 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:30.571655 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.574788 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.577533 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.578423 15303 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 16.
I20260709 13:11:30.583063 22871 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.583683 22871 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.585654 22871 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.583133 22874 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.588064 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.588460 22861 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:30.590745 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:30.593422 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.595223 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.595822 15300 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:30.596889 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:30.601115 15308 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:30.538022 22910 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.601867 15303 raft_consensus.cc:2393] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:30.555426 22957 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:30.602771 15304 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:11:30.580837 22620 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:30.580009 22757 raft_consensus.cc:2804] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:30.580942 22563 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.623447 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.550187 22741 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:30.622956 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.552249 22734 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.624241 15373 raft_consensus.cc:2393] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:30.601908 22687 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:30.625952 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.628456 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.634487 15375 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:30.630324 15379 raft_consensus.cc:2393] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:30.612497 22620 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.608481 22957 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.633821 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:30.622030 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.638116 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.643792 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.644729 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.645588 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.639073 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.653097 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.656715 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.658267 15348 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:30.665009 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.665762 15230 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:30.633487 22757 raft_consensus.cc:697] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:30.656272 15228 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 13:11:30.640638 22620 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:30.619972 22894 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.650105 22957 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:30.695058 22757 consensus_queue.cc:237] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.705540 22874 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:30.706668 22874 raft_consensus.cc:2804] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:30.707261 22874 raft_consensus.cc:697] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:30.716007 22928 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.682345 15375 raft_consensus.cc:1275] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:30.743136 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.745698 15375 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:30.711706 22687 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.749976 15299 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:30.763175 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.708282 22874 consensus_queue.cc:237] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.751477 22845 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.771930 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:30.774006 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.775022 15375 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:30.777112 22922 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.781284 22894 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.782234 22760 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:30.784616 22910 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:30.790180 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.791143 22965 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:30.793248 15376 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:11:30.793200 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.793877 15376 pending_rounds.cc:85] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 10
I20260709 13:11:30.794174 15376 pending_rounds.cc:107] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:11:30.794438 15376 raft_consensus.cc:2889] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.795861 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 3978) took 1609 ms. Trace:
I20260709 13:11:30.797935 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.799165 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.799743 15378 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:30.803164 22734 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:30.796207 15376 rpcz_store.cc:276] 0709 13:11:29.186399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.188068 (+  1669us) service_pool.cc:224] Handling call
0709 13:11:29.200940 (+ 12872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.794875 (+1593935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.795629 (+   754us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003f2d54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:30.795801 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3661074688}
I20260709 13:11:30.809402 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.755121 22687 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.815021 22687 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:30.819312 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:30.768105 22947 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:30.823463 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 165267us
I20260709 13:11:30.825315 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:30.828034 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.831410 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.804152 22741 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:30.833122 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.833784 15233 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:30.833878 15382 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
W20260709 13:11:30.821894 22829 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.839s	user 0.003s	sys 0.010s
I20260709 13:11:30.834968 22829 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.836133 15301 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:30.817873 22910 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.832012 22932 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.839126 22829 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.839257 22620 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.840608 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.841470 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:30.842209 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.844420 16008 raft_consensus.cc:1275] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:11:30.845003 22920 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.845538 22920 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.846850 22956 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:30.847592 22956 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:30.848802 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.851238 22887 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:30.851670 22887 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.852063 22887 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:30.842245 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.855247 15376 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:30.855945 22737 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:30.856382 22737 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.856748 22737 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:30.861316 22822 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.000s
I20260709 13:11:30.863106 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.865142 22955 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:30.866587 22955 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:30.870060 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:30.870244 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.866776 22936 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.847806 22920 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.877030 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.861809 22822 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:30.872400 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.877144 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.871014 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.879932 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.883179 15233 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:30.885890 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.888952 15230 raft_consensus.cc:2393] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:30.882447 15382 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:30.891333 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:30.892086 15382 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:30.816486 22928 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.894510 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.895995 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.904356 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.905162 15376 raft_consensus.cc:2468] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 25.
I20260709 13:11:30.906322 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:30.908367 15229 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:30.912459 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.914266 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:30.888361 22784 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:30.881562 22947 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:30.918666 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:30.922891 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:30.915840 22928 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:30.927706 15378 raft_consensus.cc:2393] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:30.929817 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:30.904156 22931 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:30.930387 15378 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:30.932519 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:30.930795 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:30.887957 22831 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:11:30.893923 22734 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:30.915618 22943 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:30.936357 15382 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:30.934934 22974 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:30.941901 22974 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.942303 22974 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:30.893783 22936 consensus_queue.cc:1048] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
I20260709 13:11:30.898967 22871 consensus_queue.cc:1059] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 13:11:30.947083 22822 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:30.924640 22829 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:30.947592 22871 raft_consensus.cc:3055] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:30.903759 22810 consensus_queue.cc:1048] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
I20260709 13:11:30.951639 15224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47396 (request call id 3232) took 1011 ms. Trace:
I20260709 13:11:30.961195 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:30.940097 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.964514 15382 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:30.968881 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.935221 22910 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:30.898648 22760 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:30.933126 22931 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.961230 15224 rpcz_store.cc:276] 0709 13:11:29.940249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.941600 (+  1351us) service_pool.cc:224] Handling call
0709 13:11:30.951487 (+1009887us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54000e74d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:30.951588 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325770112}
I20260709 13:11:30.952996 22829 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:30.950558 22871 raft_consensus.cc:740] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:31.027032 15378 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:31.033185 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:30.979310 22910 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.973155 22563 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.044790 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.052997 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
W20260709 13:11:31.053337 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 139175us
I20260709 13:11:31.053733 15224 raft_consensus.cc:2368] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:31.054641 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.025156 22829 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.023452 22931 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:31.058496 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.044090 22910 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.022246 22881 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.066998 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.066556 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:31.054819 22563 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.072068 22887 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.074644 22887 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.027784 22760 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:31.091449 22929 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 13:11:31.094270 22940 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:31.094635 22881 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:31.095307 15226 raft_consensus.cc:1240] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:31.097036 22620 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.100248 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:31.101559 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:31.102604 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:31.103180 15381 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:31.107357 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:31.111635 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.112278 15301 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:31.116205 15381 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:31.098089 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.062064 22757 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:31.128595 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.129312 15305 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:31.130155 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.131075 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.133190 15224 raft_consensus.cc:1275] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:31.137087 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.065809 22942 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:31.140153 22942 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.140571 22942 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.141490 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.142087 15306 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.143919 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:31.064764 22687 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.153378 15376 raft_consensus.cc:1240] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:31.115299 22894 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:31.157532 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:31.158000 15301 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
W20260709 13:11:31.148689 22934 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.940s	user 0.002s	sys 0.019s
I20260709 13:11:31.165349 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.121774 22757 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:31.092155 22929 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.164821 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.167462 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:31.147447 22925 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 1.164s	user 0.006s	sys 0.011s
I20260709 13:11:31.183358 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.160234 22982 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:31.173936 16002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46148 (request call id 723) took 1189 ms. Trace:
I20260709 13:11:31.174966 22922 raft_consensus.cc:993] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: : Instructing follower 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:11:31.186288 16002 rpcz_store.cc:276] 0709 13:11:29.979632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.979800 (+   168us) service_pool.cc:224] Handling call
0709 13:11:29.995121 (+ 15321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.068051 (+ 72930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.168861 (+1100810us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54006301d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:31.169012 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166224256}
I20260709 13:11:31.177004 22737 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.181318 22931 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.181502 22942 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.201152 16005 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 23: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:31.144507 22810 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:31.173511 15306 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:31.187034 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:31.216768 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.217327 15306 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:31.219250 22941 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:31.185384 22734 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:31.191192 22972 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:11:31.183425 22967 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:31.107906 22871 consensus_queue.cc:260] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.183149 22757 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.156041 22687 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.243073 15376 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:31.169325 22921 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:31.158100 22894 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.206854 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.204008 15231 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:31.226257 15377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1432) took 1799 ms. Trace:
I20260709 13:11:31.227291 22810 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.203981 22741 raft_consensus.cc:1081] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Signalling peer 841138f50ace4746978e72d7f13878de to start an election
I20260709 13:11:31.160878 22923 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:11:31.230037 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.158819 22974 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.196663 22735 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.233350 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.234254 15373 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:11:31.237627 15380 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:31.254746 15227 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:31.238636 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:31.195566 22957 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.000s
I20260709 13:11:31.228577 22535 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:31.247253 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:31.249977 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.229569 22948 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.247025 15377 rpcz_store.cc:276] 0709 13:11:29.426561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.428990 (+  2429us) service_pool.cc:224] Handling call
0709 13:11:29.429350 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.433530 (+  4180us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:29.441327 (+  7797us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.024294 (+582967us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.025361 (+  1067us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.025525 (+   164us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:30.025570 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.025653 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.093232 (+1067579us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:31.225923 (+132691us) raft_consensus.cc:1685] finished
0709 13:11:31.226025 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.226188 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30409,"prepare.queue_time_us":7232,"prepare.run_cpu_time_us":12685,"prepare.run_wall_time_us":137882,"raft.queue_time_us":44293,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":6320,"spinlock_wait_cycles":6340480,"thread_start_us":290489,"threads_started":1,"wal-append.queue_time_us":434771}
I20260709 13:11:31.256138 15306 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:31.256412 15302 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:31.248699 22894 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:31.259203 15301 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:31.266916 15378 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:31.269732 22929 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.269505 22948 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:31.258745 22535 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:31.272279 22535 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:31.273980 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.261736 22881 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:31.254037 22871 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:31.280169 15307 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:11:31.283725 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.283864 15307 pending_rounds.cc:85] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 11
I20260709 13:11:31.284214 15307 pending_rounds.cc:107] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:11:31.284559 15307 raft_consensus.cc:2889] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:31.240815 22734 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.261016 22620 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:31.242134 22967 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.250725 22940 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:11:31.314411 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.318178 15376 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:31.283033 22488 consensus_queue.cc:1059] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:11:31.332131 22488 raft_consensus.cc:3055] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:31.328168 22974 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.336477 22982 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.336679 22810 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.337054 22982 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.337819 22967 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.339290 22982 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.339702 22931 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.261572 22957 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.342460 22957 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.344405 22734 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.344537 22737 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.346359 22910 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.347877 15380 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:31.332540 22488 raft_consensus.cc:740] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.351917 22488 consensus_queue.cc:260] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.355583 15230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.353169 22488 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.360975 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.354625 15971 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:31.362757 15299 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:31.364672 15299 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:11:31.364461 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:31.372675 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.373483 15231 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:31.374948 15308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a"
dest_uuid: "841138f50ace4746978e72d7f13878de"
 from {username='slave'} at 127.0.0.1:50788
I20260709 13:11:31.373762 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:31.279083 22829 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.401158 15348 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:31.402333 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.402639 22829 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.403174 15308 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:31.403575 15308 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:31.405057 22734 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.405566 22734 raft_consensus.cc:697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:31.406430 22734 consensus_queue.cc:237] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.385516 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.388803 15231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.389726 22563 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.316610 22881 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.391422 22535 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.394374 22923 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.397327 15300 raft_consensus.cc:2410] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260709 13:11:31.398389 22942 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.400784 22204 raft_consensus.cc:3055] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:31.430220 22204 raft_consensus.cc:740] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.431160 22204 consensus_queue.cc:260] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.432551 22932 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:11:31.433828 22932 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:31.434193 22932 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:31.435077 22932 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.442006 22687 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.442188 22881 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.372818 22874 consensus_queue.cc:1059] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:11:31.447613 22874 raft_consensus.cc:3055] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:11:31.449633 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 95097.9us
I20260709 13:11:31.378496 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:31.414673 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.417933 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:31.464627 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 86241us
W20260709 13:11:31.465204 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 47375.2us
I20260709 13:11:31.465893 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.423135 22923 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.414696 15308 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.468667 15274 leader_election.cc:400] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:31.469101 15274 leader_election.cc:403] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:31.376802 22910 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.452215 15302 raft_consensus.cc:1240] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:31.408330 22967 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.484853 15227 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:31.448014 22874 raft_consensus.cc:740] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:31.451339 22932 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:31.432219 22204 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:31.481791 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:31.511183 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.505448 15226 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:31.483407 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.519359 15299 raft_consensus.cc:2393] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:31.520143 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.479305 22717 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:31.492616 22922 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:31.482882 22635 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:31.486366 22942 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:31.488056 22952 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.543578 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:31.522243 22931 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.530359 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.547916 15302 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:31.524482 15299 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 23: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:31.531867 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.551213 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.552143 15299 raft_consensus.cc:2393] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 22: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:31.557051 15301 raft_consensus.cc:1240] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:31.450821 22871 consensus_queue.cc:1059] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:11:31.534878 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1315) took 1111 ms. Trace:
I20260709 13:11:31.482571 22921 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:31.538452 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:31.539146 15225 raft_consensus.cc:1240] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 25. Current term is 26. Ops: [23.16-25.17]
I20260709 13:11:31.487942 22747 consensus_queue.cc:1059] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:11:31.540421 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:31.451480 22757 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.477839 22957 raft_consensus.cc:3060] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:31.546217 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:31.546442 15229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.653383 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.654407 15299 raft_consensus.cc:1240] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:11:31.666653 15299 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:31.491987 22760 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:31.653359 15232 rpcz_store.cc:276] 0709 13:11:30.423315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.423453 (+   138us) service_pool.cc:224] Handling call
0709 13:11:30.423815 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.545176 (+121361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.534575 (+989399us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003ce454. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:31.534811 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270236416}
I20260709 13:11:31.540727 22717 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.659850 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.662753 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.522424 22488 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 13:11:31.675570 15233 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 23: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:31.676812 15199 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:31.546945 22945 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.529263 22929 consensus_queue.cc:1059] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.133s
W20260709 13:11:31.710139 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 171745us
I20260709 13:11:31.662003 22687 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.711436 15274 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:31.723327 15274 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:31.684716 22923 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.729732 22831 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.746785 22982 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:31.747434 22982 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.747871 22982 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:31.750114 22757 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.675056 22635 raft_consensus.cc:697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:31.751802 22635 consensus_queue.cc:237] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.677968 22717 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:31.704847 22872 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 13:11:31.677024 22874 consensus_queue.cc:260] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.758036 22874 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:31.681517 22845 raft_consensus.cc:3055] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:31.760159 22845 raft_consensus.cc:740] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:31.718901 22747 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:31.770897 22965 log.cc:927] Time spent T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:31.770982 22488 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:31.771574 22488 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.732015 22942 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:31.773926 22942 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:31.774333 22942 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:31.776010 22535 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.776221 15225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47396 (request call id 3242) took 1125 ms. Trace:
I20260709 13:11:31.787111 15225 rpcz_store.cc:276] 0709 13:11:30.651010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.654086 (+  3076us) service_pool.cc:224] Handling call
0709 13:11:31.534777 (+880691us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:31.655921 (+121144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.776019 (+120098us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54003ce450. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:31.776154 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024479488}
I20260709 13:11:31.776449 22760 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:31.788854 22760 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.684072 22933 consensus_queue.cc:1048] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:11:31.777866 22687 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.778828 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.725437 22931 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.792076 22931 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:31.793282 22931 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.706619 22945 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.662803 22921 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.714340 22829 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:31.798660 22829 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.800910 22922 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.801365 22922 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:31.810153 22969 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.810343 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:31.810853 22969 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.813524 22948 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:31.816160 22974 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:31.816936 22974 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:31.818068 22974 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.824218 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:31.828552 22955 raft_consensus.cc:3055] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:31.829250 22955 raft_consensus.cc:740] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:31.830554 22955 consensus_queue.cc:260] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.842811 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:31.843986 22861 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:31.848567 22997 log.cc:927] Time spent T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
W20260709 13:11:31.828701 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 288377us
I20260709 13:11:31.850962 22822 raft_consensus.cc:3055] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:31.868597 22822 raft_consensus.cc:740] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.869553 22822 consensus_queue.cc:260] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:31.870431 22998 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:11:31.871106 22822 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:31.865454 15346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.873425 23000 log.cc:927] Time spent T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.103s	user 0.000s	sys 0.002s
W20260709 13:11:31.876561 22999 log.cc:927] Time spent T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 13:11:31.863787 22845 consensus_queue.cc:260] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.878086 22845 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.882411 15308 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.884142 22488 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.886525 22921 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:31.887842 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:31.888775 22488 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:31.890619 22969 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.884771 22955 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:31.893036 15197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.893450 16001 raft_consensus.cc:1240] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:31.894757 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.895367 15226 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:31.895885 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46152 (request call id 626) took 1054 ms. Trace:
I20260709 13:11:31.896699 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.897035 22945 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.898123 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.889918 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:31.914634 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:31.915105 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:31.915882 15303 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:31.921423 22945 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:31.922171 22945 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.924940 22945 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.926076 15198 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:31.927053 22921 raft_consensus.cc:2804] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:31.926867 22734 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:31.927511 22921 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:31.927977 22921 raft_consensus.cc:3060] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:31.930536 22945 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:31.931270 22945 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.932096 22945 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:31.937112 23001 log.cc:927] Time spent T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.219s	user 0.000s	sys 0.003s
I20260709 13:11:31.938277 15375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52412 (request call id 1444) took 1066 ms. Trace:
I20260709 13:11:31.938676 15375 rpcz_store.cc:276] 0709 13:11:30.871598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.877039 (+  5441us) service_pool.cc:224] Handling call
0709 13:11:30.901122 (+ 24083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.901608 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.901648 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.902193 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.538909 (+636716us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b1800046240. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c60d1 00007f2f53ae1a0f
0709 13:11:31.678566 (+139657us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:31.678615 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.678696 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.936632 (+257936us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:31.937979 (+  1347us) raft_consensus.cc:1685] finished
0709 13:11:31.937998 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.938209 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6957,"spinlock_wait_cycles":29101312,"thread_start_us":139452,"threads_started":1,"wal-append.queue_time_us":815728}
I20260709 13:11:31.900766 22687 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.902377 22760 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.941605 22734 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:31.903043 22861 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.942278 22734 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:31.942600 22861 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.943320 22734 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.944739 16008 raft_consensus.cc:1240] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:31.944885 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:31.903781 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88233.1us
I20260709 13:11:31.903967 15305 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 17. Ops: []
I20260709 13:11:31.945711 22821 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:31.896358 16001 rpcz_store.cc:276] 0709 13:11:30.841017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.853463 (+ 12446us) service_pool.cc:224] Handling call
0709 13:11:31.800639 (+947176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.893946 (+ 93307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.895693 (+  1747us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b540064f5d0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b258ad 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:31.895829 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177665920}
I20260709 13:11:31.908413 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:31.946267 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.946677 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:31.947068 15224 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:31.947422 23004 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:31.947650 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.948873 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:31.942845 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.950130 15228 raft_consensus.cc:3060] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:31.951161 15196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.946115 22821 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.952656 22821 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:31.908757 22829 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:31.903401 22894 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.000s
I20260709 13:11:31.958228 22894 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.962078 15304 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:31.963845 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.965687 15224 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:31.967001 22894 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.968592 22734 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:31.969539 23002 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.970088 23002 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.972625 23002 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.973832 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.975308 22940 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:31.975991 22940 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:31.949415 22760 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:31.977363 22760 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:31.977756 22760 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.977990 15224 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:31.978524 22940 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:31.944689 22861 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:31.902513 22952 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011) with higher term. Message: Invalid argument: T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16.
I20260709 13:11:31.979094 22940 consensus_queue.cc:1059] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:31.980633 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:31.982336 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:31.941663 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:31.981534 22535 raft_consensus.cc:3055] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:31.985548 22535 raft_consensus.cc:740] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:31.986465 22535 consensus_queue.cc:260] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.987641 22535 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:31.988162 22887 consensus_queue.cc:1048] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:31.988587 22717 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:31.991300 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.992607 15228 raft_consensus.cc:2468] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:31.992833 15225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:31.994055 15225 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:31.993345 22861 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:31.995111 22861 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.995530 22861 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:31.996433 22940 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:31.996537 22921 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:31.998836 22921 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 26 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.001168 22717 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:31.993088 22821 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.004558 22922 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.004901 22872 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:32.005214 15348 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.005393 22821 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.006039 22910 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:32.006443 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.007076 22910 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:32.007755 22687 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:31.936244 22942 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:32.008145 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 284981us
I20260709 13:11:32.009527 22687 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:32.009965 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.010739 22839 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:32.010362 22687 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.011736 22687 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:32.012497 22910 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:32.014025 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.017262 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:32.017824 15379 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:32.018062 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.018657 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.019398 15373 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 23: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:32.019151 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.020054 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.021730 15379 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:32.021922 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.022434 15382 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:32.023043 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.026772 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:32.027618 22872 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:32.030965 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:32.031596 15375 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:32.032956 22952 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:32.035843 15382 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:32.038035 15381 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:32.045624 15196 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:32.046833 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:31.996464 22957 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:32.049463 15299 raft_consensus.cc:1275] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:32.050640 15224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:32.051203 15226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:32.051970 15226 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:32.052378 15226 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:32.053439 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:32.053268 15226 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.054910 15226 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:32.057076 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf" is_pre_election: true
I20260709 13:11:32.061177 15233 raft_consensus.cc:1240] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:32.051476 15224 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:32.067195 15233 raft_consensus.cc:1275] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:32.033990 22922 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.062888 22760 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.070935 22760 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:32.071537 23004 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:32.072520 22494 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:32.078423 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:32.083647 22821 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:32.063066 22717 consensus_queue.cc:1059] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:11:32.086638 22717 raft_consensus.cc:3055] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:32.086967 22717 raft_consensus.cc:740] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:32.092005 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.092996 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:32.094040 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.094522 15373 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:32.096683 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:32.096909 15226 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:32.097544 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:32.098757 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.087752 22717 consensus_queue.cc:260] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.099840 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.100242 22717 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:32.100646 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:32.101267 15379 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
W20260709 13:11:32.104041 22940 consensus_queue.cc:1175] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 23 status { last_received { term: 20 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: [22.15-22.15]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:32.084087 22821 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.111608 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.106786 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.108825 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:32.109597 15378 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:32.110769 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:32.115326 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.116272 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:32.123525 15232 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:32.117128 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:32.118193 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:32.124544 15300 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:32.124979 15301 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:32.119297 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.126780 15380 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:32.124069 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:32.128422 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.131785 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:32.132525 15303 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:32.134280 15273 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.135721 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:32.128069 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 120499us
I20260709 13:11:32.137480 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:32.142623 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.144528 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.145360 15307 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:32.150939 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.128252 22821 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:32.173281 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:32.175040 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:32.156142 15373 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:32.144119 22829 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:32.197710 15198 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:32.141410 22922 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:32.171219 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:32.179796 22942 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.143946 22936 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:32.143519 22952 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:32.186563 15303 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:32.128135 22921 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:32.135351 22760 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:11:32.224606 23006 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:32.217352 22922 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.162567 22734 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:32.141570 22982 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.225665 22922 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:32.227764 22982 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.225863 22734 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.228734 22734 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:32.064851 22861 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.237349 15374 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 22: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:32.236737 22922 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.238852 22861 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:32.239573 22922 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:32.241554 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68375.8us
I20260709 13:11:32.250538 15229 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:32.241410 22969 consensus_queue.cc:1048] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:32.250743 15233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:32.250684 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:32.243605 22923 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:11:32.252151 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:32.243753 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68837us
I20260709 13:11:32.253027 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:32.253515 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.144536 22932 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:11:32.254932 22932 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:32.255383 22932 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:32.244278 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 46658.3us
I20260709 13:11:32.253263 22887 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:32.252228 23006 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:32.258376 23006 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:32.259230 23006 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.259622 22921 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.260174 22932 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.255327 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:32.264410 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:32.265666 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.266280 15232 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:32.266690 15381 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:32.281275 22494 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:32.289157 15233 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:32.260286 22921 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.297282 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.318248 15378 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 14: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:32.297588 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.297999 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:32.319881 15373 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:32.298642 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.322779 15304 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:32.298905 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:32.300951 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.301482 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.302452 15196 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:11:32.303536 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 138351us
I20260709 13:11:32.307582 15300 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:32.326287 15348 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:32.311654 15380 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:32.329967 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.333650 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.334388 15232 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:32.329042 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:32.244477 22747 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:32.355846 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:32.356804 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 54462us
I20260709 13:11:32.356825 22204 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:32.358091 15304 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:32.358333 15375 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:32.358743 15373 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:32.363830 15381 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:32.366376 15198 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:32.371101 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44957.7us
I20260709 13:11:32.381975 22204 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:32.382215 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48661.9us
W20260709 13:11:32.382373 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52496.3us
I20260709 13:11:32.383460 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:32.383184 22204 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.352470 22982 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:32.388775 22687 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:32.391950 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.393240 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:32.393836 15302 raft_consensus.cc:3060] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:32.198414 22974 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:32.296661 22494 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:32.408721 15273 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:32.409283 22747 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:32.353055 22936 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:32.409006 15274 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:32.382892 22922 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:32.413883 15227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:32.429581 15233 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:32.401573 22894 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:32.369249 22861 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:32.409224 22822 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:32.426054 15232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:32.388459 22872 raft_consensus.cc:2804] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:32.402518 22535 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:11:32.432647 22942 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:32.431722 22982 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:32.409472 22948 consensus_queue.cc:1048] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:11:32.495895 15302 raft_consensus.cc:2468] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:32.511480 22821 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.442951 22922 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:32.424818 22494 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:32.474037 22894 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:32.542688 15227 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 22: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:32.474035 22872 raft_consensus.cc:697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:32.472299 22822 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:32.475419 22829 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.463861 22760 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:11:32.512531 22942 raft_consensus.cc:697] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:32.526074 23008 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.473289 22734 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.538679 22881 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:32.534206 22874 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:32.474426 22747 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.574476 22894 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:32.649928 15374 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:32.580819 22829 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.674518 22942 consensus_queue.cc:237] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.704895 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:32.711167 15348 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:32.714234 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 305270us
I20260709 13:11:32.725175 15198 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:32.730103 15308 raft_consensus.cc:2468] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 16.
I20260709 13:11:32.737828 15307 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:32.625595 22874 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:32.662817 22945 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:11:32.608386 23008 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:32.707162 22921 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.618445 22982 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:32.750697 15305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.012s	sys 0.024s
I20260709 13:11:32.717463 22974 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:32.639506 22922 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.742744 23002 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:32.765573 15305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.012s	sys 0.024s
I20260709 13:11:32.760972 22734 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:32.763432 22995 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:11:32.720912 22822 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.761322 22969 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:32.763584 22861 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.815874 22760 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:32.818384 22874 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:32.809862 22821 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.718502 22872 consensus_queue.cc:237] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.810600 22845 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:32.811713 22974 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:32.811271 23002 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:32.824047 23008 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:11:32.812971 22967 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:32.876684 22967 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.879298 22967 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:32.825268 15307 raft_consensus.cc:1275] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:32.812772 22494 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:32.827919 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:32.773808 23006 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.855362 22760 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:32.863068 22829 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:32.857628 22874 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:32.833281 22861 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:32.833154 22995 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.855816 22910 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:32.867781 23019 log.cc:927] Time spent T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:32.832746 22734 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:32.868701 22974 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.871248 23002 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.885591 16001 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:32.893899 22760 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:32.813231 22894 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:32.833024 22969 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:32.901167 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78709.9us
W20260709 13:11:32.901841 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 69949.7us
W20260709 13:11:32.912107 15376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.026s	sys 0.041s
W20260709 13:11:32.940990 15376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.026s	sys 0.041s
W20260709 13:11:32.927809 15273 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.025s	sys 0.056s
W20260709 13:11:32.941915 15273 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.025s	sys 0.056s
W20260709 13:11:32.942625 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 533939us
I20260709 13:11:32.946205 15375 raft_consensus.cc:1240] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:32.948267 15345 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:33.001686 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.009909 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.014369 15303 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:32.899017 22874 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:32.889979 23006 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.040942 15228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1330) took 1003 ms. Trace:
I20260709 13:11:33.026137 22969 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.002651 22760 raft_consensus.cc:2804] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:32.933691 22734 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.029237 22874 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:33.058580 15229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.006s	sys 0.039s
I20260709 13:11:32.926213 22910 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.041600 15228 rpcz_store.cc:276] 0709 13:11:32.038029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.038218 (+   189us) service_pool.cc:224] Handling call
0709 13:11:32.038658 (+   440us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:32.070221 (+ 31563us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:32.289686 (+219465us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.747149 (+457463us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:32.755378 (+  8229us) log.cc:844] Serialized 78 byte log entry
0709 13:11:32.755571 (+   193us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:32.755611 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.755687 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.040582 (+284895us) raft_consensus.cc:1685] finished
0709 13:11:33.040616 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.040856 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44472,"prepare.queue_time_us":150644,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":52190,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":5541,"thread_start_us":567584,"threads_started":2,"wal-append.queue_time_us":628245}
I20260709 13:11:33.020030 22952 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.054482 15307 raft_consensus.cc:1275] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:33.030566 22974 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:33.060412 15229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.006s	sys 0.039s
I20260709 13:11:33.019541 22931 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:33.064246 15299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.011s	sys 0.034s
I20260709 13:11:33.029268 22995 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:33.068562 15299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.012s	sys 0.034s
W20260709 13:11:33.066012 15272 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.027s	sys 0.018s
W20260709 13:11:33.079023 15272 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.027s	sys 0.018s
I20260709 13:11:33.053615 22760 raft_consensus.cc:697] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 22 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:33.055740 23006 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.100521 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:33.102463 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.104395 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.105813 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.114434 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.064033 22635 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:33.069597 22952 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.081077 22931 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.142829 22687 consensus_queue.cc:1059] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:11:33.304705 22734 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.305521 22952 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.306818 22952 consensus_queue.cc:1059] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:33.276057 15229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46420 (request call id 1332) took 1017 ms. Trace:
W20260709 13:11:33.281721 15196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.006s
W20260709 13:11:33.308182 15196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.006s
I20260709 13:11:33.307931 15229 rpcz_store.cc:276] 0709 13:11:32.258320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.262179 (+  3859us) service_pool.cc:224] Handling call
0709 13:11:32.262560 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.287101 (+ 24541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.287146 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.287725 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.065653 (+777928us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:33.065704 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.065883 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.274881 (+208998us) raft_consensus.cc:1685] finished
0709 13:11:33.274978 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.275638 (+   660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23751,"raft.queue_time_us":23981,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":777475,"threads_started":1,"wal-append.queue_time_us":906323}
W20260709 13:11:33.282624 15197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.005s
I20260709 13:11:33.312331 22942 raft_consensus.cc:3055] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:11:33.312638 15197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.006s
I20260709 13:11:33.313066 22942 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:33.283370 15199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.003s
I20260709 13:11:33.152626 22969 consensus_queue.cc:1048] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:11:33.286345 15300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.003s
I20260709 13:11:33.287691 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.290810 15379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 4048) took 1031 ms. Trace:
I20260709 13:11:33.186110 22760 consensus_queue.cc:237] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.291214 22747 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.294063 22910 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:33.295430 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 358185us
I20260709 13:11:33.297324 22931 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.160084 22635 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.307209 22734 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.382463 22734 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:33.285212 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 167342us
W20260709 13:11:33.209775 23021 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.388s	user 0.003s	sys 0.003s
I20260709 13:11:33.155529 23030 consensus_queue.cc:1048] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:11:33.273608 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
W20260709 13:11:33.359258 15199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.010s	sys 0.004s
I20260709 13:11:33.401278 22635 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.372219 22747 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.408969 22734 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.410210 22734 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.441915 22747 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:33.445778 15300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.012s	sys 0.004s
I20260709 13:11:33.365509 15379 rpcz_store.cc:276] 0709 13:11:32.258705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.269027 (+ 10322us) service_pool.cc:224] Handling call
0709 13:11:32.269545 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.269841 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.269881 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.284160 (+ 14279us) log.cc:844] Serialized 26 byte log entry
0709 13:11:32.748559 (+464399us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:32.748594 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.749999 (+  1405us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.290005 (+540006us) raft_consensus.cc:1685] finished
0709 13:11:33.290059 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.290443 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":463990,"threads_started":1,"wal-append.queue_time_us":911707}
I20260709 13:11:33.458585 15228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0f9eceec749442cb9a06c87f00f3caf"
I20260709 13:11:33.459926 15228 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:33.460642 23031 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:33.450349 22872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.000s	sys 0.019s
W20260709 13:11:33.510008 15974 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 22 similar messages]
I20260709 13:11:33.476747 15307 raft_consensus.cc:2393] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 23: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:33.487275 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.491386 23050 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:33.496873 23002 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:33.499665 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.499933 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:33.500470 22931 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:33.481402 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.495855 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:33.517639 15381 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 17.
I20260709 13:11:33.535002 15306 raft_consensus.cc:2393] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 22: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:33.450572 22942 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.532823 23016 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:33.528388 23031 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.540779 23050 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.550787 22741 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:33.530308 22931 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.544049 23031 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:33.557780 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 521416us
I20260709 13:11:33.557950 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 3114) took 1192 ms. Trace:
I20260709 13:11:33.546849 23050 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.533239 22734 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.562355 23002 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:33.568743 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 73264.1us
I20260709 13:11:33.569538 15377 raft_consensus.cc:1240] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:33.579454 22741 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.566166 22974 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:33.597707 23058 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.599349 23058 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.599974 22845 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:33.601357 22845 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:33.603427 23054 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:33.609089 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.605717 23058 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.608891 23054 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.610283 16001 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 17: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:33.612110 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.613024 23037 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:33.613191 23054 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.614096 23037 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.604691 22974 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.558844 15382 rpcz_store.cc:276] 0709 13:11:32.318628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.318776 (+   148us) service_pool.cc:224] Handling call
0709 13:11:32.319113 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:32.370954 (+ 51841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.371008 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:32.371898 (+   890us) log.cc:844] Serialized 52 byte log entry
0709 13:11:32.911812 (+539914us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.453263 (+541451us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.510883 (+ 57620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.511074 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.511157 (+    83us) raft_consensus.cc:1685] finished
0709 13:11:33.511172 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.511411 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25801,"prepare.queue_time_us":540707,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":96159,"raft.run_cpu_time_us":636,"raft.run_wall_time_us":15605,"thread_start_us":909961,"threads_started":2,"wal-append.queue_time_us":768762}
I20260709 13:11:33.619675 22872 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.619954 23037 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.620677 22872 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.623291 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.626513 23040 raft_consensus.cc:2804] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:33.627260 23040 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.627729 23040 raft_consensus.cc:3060] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:33.627884 22872 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.626581 22933 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:33.629326 22933 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.593971 23002 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.633497 22910 raft_consensus.cc:3055] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:33.634007 22910 raft_consensus.cc:740] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:33.635309 22910 consensus_queue.cc:260] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.636157 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.636665 22932 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.637167 16002 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 23.
I20260709 13:11:33.637488 22931 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.625840 15379 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:33.638160 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:33.640813 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44643.2us
I20260709 13:11:33.650812 22717 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.650749 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.652302 22717 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.653445 22931 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.650744 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.654508 22931 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.658977 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.659334 22931 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.618254 22760 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.660996 22760 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.655597 22717 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.653401 15228 raft_consensus.cc:2468] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:33.638792 22933 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.664940 22910 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:33.665161 22734 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.636608 22741 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.635344 23002 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.681243 22734 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.687934 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.687904 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.637566 22932 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.692539 15305 raft_consensus.cc:1240] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:11:33.688182 22734 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.697978 22734 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.703572 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.704733 15307 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:33.708527 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 4036) took 1552 ms. Trace:
I20260709 13:11:33.710350 22974 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.709239 15376 rpcz_store.cc:276] 0709 13:11:32.090296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.104458 (+ 14162us) service_pool.cc:224] Handling call
0709 13:11:32.104890 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:32.105301 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.105339 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:32.106015 (+   676us) log.cc:844] Serialized 52 byte log entry
0709 13:11:32.941565 (+835550us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.533856 (+592291us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.591357 (+ 57501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.595194 (+  3837us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.622727 (+ 27533us) raft_consensus.cc:1685] finished
0709 13:11:33.622746 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.642693 (+ 19947us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52403,"prepare.queue_time_us":532178,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":93,"raft.queue_time_us":24946,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":16280,"thread_start_us":1316863,"threads_started":2,"wal-append.queue_time_us":971391}
W20260709 13:11:33.712450 23060 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:11:33.714254 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.715361 15380 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:33.721266 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.716368 16008 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:33.724363 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:33.748889 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 64503.7us
I20260709 13:11:33.756491 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.757346 15303 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:33.758561 15303 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:33.765372 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.766646 23002 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.767345 23002 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.768625 23006 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.769510 23006 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.770377 23032 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.771155 23032 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.771795 22741 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:33.772688 22741 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.773667 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.774853 22933 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.775228 22741 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:33.775624 22861 consensus_meta.cc:287] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.879s	user 0.000s	sys 0.025s
I20260709 13:11:33.775864 22741 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:33.776491 22974 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.776198 22861 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:33.776135 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 50191.9us
I20260709 13:11:33.780751 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.782158 15302 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:33.780783 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:33.750150 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 240393us
W20260709 13:11:33.765280 23061 log.cc:927] Time spent T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:11:33.788233 23002 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.772256 23006 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.808049 22957 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:33.809195 15307 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:33.811425 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.775629 22933 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.813490 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.815131 22932 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.805651 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.802035 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:33.818308 15307 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:33.833882 22957 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.837096 15301 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:33.836560 22741 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.842542 22734 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:33.843380 22922 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.843348 22734 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.844287 22922 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.846446 22861 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.831876 15306 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
I20260709 13:11:33.840256 22741 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.859061 22933 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.840297 15307 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.809238 22760 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.803704 22931 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:33.883890 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 114561us
W20260709 13:11:33.884552 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 84987.6us
W20260709 13:11:33.886003 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 64889.1us
I20260709 13:11:33.803768 22974 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.853858 23032 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.844566 23037 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.846436 22822 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.896668 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.896562 23006 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.905203 23006 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:33.907509 23006 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.908090 23038 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.908815 15307 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:33.909013 23038 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.889760 22741 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:33.927315 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.927591 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.920915 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.934346 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.954854 15379 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:33.920746 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.921756 15380 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:33.924655 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.886761 23002 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.925139 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:33.885463 22922 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.881752 22717 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.958968 15374 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:33.960274 15377 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:33.927714 22933 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.963454 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:33.964193 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.927616 22822 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.965685 22948 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.966280 15378 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:11:33.921708 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.927832 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:33.929340 22974 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.918211 22734 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:33.975494 15373 raft_consensus.cc:2393] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:33.970563 15378 pending_rounds.cc:85] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 11
I20260709 13:11:33.955577 22741 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:33.922420 22957 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.988508 22741 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:33.989813 22822 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.991413 22933 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.993701 22933 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:33.993721 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:33.912245 23038 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:33.980635 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 140099us
I20260709 13:11:33.975190 22922 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.010840 22922 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.014518 22922 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:33.916654 23037 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.998212 15303 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:33.931562 23067 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.979549 15378 pending_rounds.cc:107] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:11:34.016615 16008 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:33.996311 15307 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:11:34.019569 15378 raft_consensus.cc:2889] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:34.022950 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59600.1us
I20260709 13:11:33.917057 22931 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:33.914115 22845 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:34.020678 15307 pending_rounds.cc:85] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 13
I20260709 13:11:33.917773 23040 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.031297 15307 pending_rounds.cc:107] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:11:34.034790 15307 raft_consensus.cc:2889] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:34.032626 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 138920us
I20260709 13:11:34.039672 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:34.041025 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:34.021250 23006 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.057976 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.068957 22735 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:34.039049 22822 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.084972 22910 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.085651 22910 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:34.073315 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.072878 15308 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:34.063833 23006 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.044523 22717 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:34.046283 23067 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.028002 23002 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.078843 23027 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:34.079893 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63097.2us
I20260709 13:11:34.084764 22822 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.035013 22948 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.050642 22734 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:34.098402 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.106776 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.120580 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.099355 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.108807 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.105110 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:34.104744 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:34.104377 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.066231 22974 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.104403 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:34.100675 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.061501 23075 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:34.105938 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:34.091434 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 54039.2us
W20260709 13:11:34.224035 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 105887us
I20260709 13:11:34.236172 15299 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:34.103380 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:34.097914 22942 raft_consensus.cc:3060] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:34.166859 22760 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.209474 23027 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.092712 22845 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:34.109717 23037 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:34.241659 15300 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:34.246583 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:34.093597 23040 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.268651 22933 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:34.270143 22717 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:34.272809 15302 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:34.224848 23075 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:34.277278 22954 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:34.278236 23032 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.279731 23067 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.280522 22957 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:34.290944 15301 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:11:34.278291 22822 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.297215 22687 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:34.324115 22957 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.324538 22687 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.327458 22957 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.309978 22741 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:34.330297 22741 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:34.331409 22910 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:34.306250 15348 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:34.307667 22948 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.298382 23075 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:34.281939 22974 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.308820 22933 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.345001 22933 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.309187 23032 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.350239 23032 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.309937 22931 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:34.309885 23002 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.311386 23006 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:34.322644 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 60970.3us
I20260709 13:11:34.312318 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:34.282915 23027 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.337960 22954 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.288357 22861 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:34.283164 22760 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.292127 22734 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.327464 22687 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:34.420421 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:34.394251 22910 raft_consensus.cc:2804] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:11:34.430990 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 363001us
I20260709 13:11:34.393846 22861 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:34.459031 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:34.439184 22974 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:34.459882 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:34.484786 23076 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:11:34.486181 22954 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.487844 22734 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:34.488596 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 194862us
I20260709 13:11:34.443054 22967 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.468910 22735 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:34.493549 23006 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:34.484892 22861 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:11:34.511277 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 111144us
W20260709 13:11:34.515830 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57134.8us
I20260709 13:11:34.547842 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:34.555454 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:34.567575 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:34.577570 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 293941us
I20260709 13:11:34.554198 22910 raft_consensus.cc:697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:34.579591 22910 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.524731 22974 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.577631 22822 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:11:34.512713 22735 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:34.522280 22931 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:34.540518 22922 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:34.484777 22923 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.126s
I20260709 13:11:34.603756 22735 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:34.650614 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.643836 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:34.513546 22967 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.659265 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.565104 22741 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:11:34.659549 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.661356 15307 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:34.621773 22922 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.666472 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:34.690806 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.695899 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:34.675416 22922 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.712077 23081 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:34.680867 22932 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.715204 22932 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.717806 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:34.647171 23032 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:34.721133 23032 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:34.722565 23077 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 13:11:34.723506 23082 consensus_queue.cc:1059] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.159s
I20260709 13:11:34.723930 23032 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:34.728611 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 97060.2us
I20260709 13:11:34.650931 22931 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:34.732426 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 56131us
I20260709 13:11:34.612577 23006 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.747494 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:34.747871 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.748414 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.748833 15302 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:34.749384 15300 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:34.750177 15304 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:34.751554 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:34.751976 23082 raft_consensus.cc:3055] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:34.752529 23082 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:34.765713 22861 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:34.766424 22861 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.766832 22861 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.768812 22932 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.769832 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:34.771486 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.772253 15306 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
I20260709 13:11:34.773289 23076 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:34.773942 23076 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:34.781095 22861 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:34.782775 22741 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.783591 22822 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.783780 22741 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:34.784245 22822 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.786598 22741 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:34.788100 23037 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:34.788152 22747 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.789110 23037 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.789355 22747 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.789798 22923 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:34.790270 22923 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:34.791458 22923 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:34.791844 22747 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.792879 22923 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.793073 22687 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:34.795626 22687 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.799824 23040 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.800889 23055 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.800655 23040 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.801807 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:34.801671 23055 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.802531 16005 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
I20260709 13:11:34.677276 23002 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:34.803514 23040 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.804081 22717 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.809896 22717 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.753592 22734 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:34.804243 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59241.9us
I20260709 13:11:34.813122 22734 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.813699 22734 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:34.805361 22920 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:11:34.786712 22822 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.813768 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:34.818255 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:34.840418 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55940.3us
I20260709 13:11:34.862166 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:34.873510 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 55369.8us
I20260709 13:11:34.753589 23082 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.755198 23006 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.791908 23037 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.813169 22717 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.829217 23055 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:34.897831 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 84168.8us
I20260709 13:11:34.887178 22747 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:11:34.910625 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 451640us
I20260709 13:11:34.808454 23002 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:34.887305 22931 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:34.796279 22687 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.915561 15345 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:34.887533 23076 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:34.930871 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:34.932523 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:34.933254 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 72300us
I20260709 13:11:34.892287 22822 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:34.910084 22747 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:34.942204 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.926656 23006 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:35.014109 15300 pending_rounds.cc:85] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 11
I20260709 13:11:35.014640 15300 pending_rounds.cc:107] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:11:34.971738 15373 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:35.009672 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.010501 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.011536 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.019779 15307 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:35.011971 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.020857 15302 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 23.
I20260709 13:11:34.961133 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:34.963563 15374 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:34.965576 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:34.959141 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.108075 15304 raft_consensus.cc:2410] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:35.014977 15300 raft_consensus.cc:2889] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:35.106958 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.110653 15374 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:35.022511 15381 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:34.959503 15377 raft_consensus.cc:1275] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:34.957976 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:34.967191 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.008823 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:34.951597 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:35.102905 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.114352 15378 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
W20260709 13:11:34.979835 22942 consensus_meta.cc:287] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.704s	user 0.014s	sys 0.000s
W20260709 13:11:34.981105 23075 consensus_meta.cc:287] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.008s
W20260709 13:11:35.141096 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 403537us
I20260709 13:11:34.958815 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:35.159025 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 207549us
W20260709 13:11:35.005165 23074 log.cc:927] Time spent T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
W20260709 13:11:35.004585 23027 consensus_meta.cc:287] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.005s
I20260709 13:11:34.956919 23082 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.951850 23055 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:34.952893 23076 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.163887 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:34.958554 22861 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:35.105265 22910 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.966598 23002 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:34.960752 22967 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.002713 22687 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:34.981308 22747 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.955300 23096 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:35.000147 23092 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:35.000123 23067 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:35.177181 15379 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:35.177767 23087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.019s	sys 0.062s
I20260709 13:11:35.178138 23086 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:35.178920 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.178185 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:35.176014 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.223994 15380 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
W20260709 13:11:35.200711 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.103351 22735 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:35.209920 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:34.961776 23006 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:34.971457 22922 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.168447 23055 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.219552 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.166081 23075 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.201040 23077 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.220933 23087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.019s	sys 0.062s
W20260709 13:11:35.232534 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.235052 15305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.026s	sys 0.024s
W20260709 13:11:35.246739 15305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.026s	sys 0.025s
I20260709 13:11:35.223747 23086 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.254073 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.251183 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.256083 15380 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:35.174675 23027 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:35.201538 22910 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.229013 22861 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.250337 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.245311 23055 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:35.276427 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.223999 23067 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.279305 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.280191 15374 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:35.279156 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 4060) took 1567 ms. Trace:
I20260709 13:11:35.236479 23092 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:35.255295 22734 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:35.302829 15308 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.025s	sys 0.058s
I20260709 13:11:35.260152 23086 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:35.248898 23077 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:35.320663 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.309760 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:35.327438 23098 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:35.322209 15381 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:11:35.328332 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.295850 23075 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:35.308823 15308 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.025s	sys 0.058s
I20260709 13:11:35.310487 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:35.283634 15974 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.283152 15376 rpcz_store.cc:276] 0709 13:11:33.711837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.724679 (+ 12842us) service_pool.cc:224] Handling call
0709 13:11:33.787885 (+ 63206us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:33.841140 (+ 53255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.841176 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:33.841995 (+   819us) log.cc:844] Serialized 52 byte log entry
0709 13:11:34.007602 (+165607us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:34.238573 (+230971us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.238960 (+   387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.239082 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.278706 (+1039624us) raft_consensus.cc:1685] finished
0709 13:11:35.278824 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.279075 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3629,"prepare.queue_time_us":576907,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":12844,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":44257,"thread_start_us":370307,"threads_started":2,"wal-append.queue_time_us":804462}
W20260709 13:11:35.302613 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.016s	sys 0.033s
I20260709 13:11:35.313948 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:35.280299 23081 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.028s	sys 0.069s
I20260709 13:11:35.429603 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.416712 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:35.411850 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.305151 23087 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.267282 22861 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:35.428674 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.017s	sys 0.033s
W20260709 13:11:35.439378 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 709579us
W20260709 13:11:35.421196 15345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.329438 15377 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 23.
I20260709 13:11:35.419914 15375 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:35.433085 15381 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:35.440028 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.444872 22922 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:35.447432 23094 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:35.429647 23081 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.029s	sys 0.069s
I20260709 13:11:35.433784 23096 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.448104 23094 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.448837 23096 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.450745 23094 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.451340 23096 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.451463 23094 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.452005 23096 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:35.452729 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.452198 23094 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.453249 22932 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.454725 15307 raft_consensus.cc:1275] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:35.415580 22687 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.458280 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:35.467847 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:35.415369 22931 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.443842 15301 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:35.471009 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.473616 15382 raft_consensus.cc:1240] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:35.474191 15271 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.474448 15379 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:35.476231 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:35.485818 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.487895 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:35.482781 15304 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:35.491050 15302 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
W20260709 13:11:35.492522 23099 log.cc:927] Time spent T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:11:35.493968 23092 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:35.495533 22734 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.496775 22910 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.497448 22932 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:35.481398 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.499895 23076 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:35.526453 15375 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:11:35.575943 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 118104us
I20260709 13:11:35.548591 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:11:35.541307 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 269346us
I20260709 13:11:35.511428 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:35.579463 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.569784 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 82722.2us
I20260709 13:11:35.585098 16005 raft_consensus.cc:2368] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:35.586005 15305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49780 (request call id 1150) took 1498 ms. Trace:
I20260709 13:11:35.501010 22967 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:35.502759 23101 consensus_queue.cc:1048] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:11:35.500228 22932 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:35.583094 15348 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.493988 22861 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.589619 22910 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.589650 23107 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:35.527172 22760 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.521430 23027 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:35.525324 23067 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:35.485739 23096 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:35.612953 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 385931us
I20260709 13:11:35.486052 22687 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.616184 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:35.618332 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:35.511024 23077 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:35.505074 22942 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.510017 22717 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:35.588521 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77196.8us
I20260709 13:11:35.587577 15305 rpcz_store.cc:276] 0709 13:11:34.074039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.080610 (+  6571us) service_pool.cc:224] Handling call
0709 13:11:34.109683 (+ 29073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:34.229129 (+119446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:34.229174 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:34.300020 (+ 70846us) log.cc:844] Serialized 26 byte log entry
0709 13:11:34.683994 (+383974us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:35.247245 (+563251us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.571497 (+324252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.571603 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:35.571654 (+    51us) raft_consensus.cc:1685] finished
0709 13:11:35.571671 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.571863 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30828,"prepare.queue_time_us":124742,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":127780,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":34900,"spinlock_wait_cycles":5899648,"thread_start_us":1088582,"threads_started":3,"wal-append.queue_time_us":413415}
I20260709 13:11:35.528787 23006 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:35.580202 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.520792 22735 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:35.502619 23094 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.500721 23097 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.590929 22967 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.593554 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:35.588097 15198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.000s	sys 0.021s
W20260709 13:11:35.679229 15198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.001s	sys 0.022s
W20260709 13:11:35.679648 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 739990us
W20260709 13:11:35.607986 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.681332 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 84090.1us
I20260709 13:11:35.480767 23087 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.641214 15196 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:35.642864 15199 leader_election.cc:400] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
W20260709 13:11:35.643766 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63617.9us
W20260709 13:11:35.686563 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45510us
I20260709 13:11:35.687974 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:35.689347 15199 leader_election.cc:403] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:11:35.521970 22931 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.680572 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:35.689795 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.694562 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:35.695986 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 51064.8us
I20260709 13:11:35.611408 22910 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.703550 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:35.685561 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.595960 23086 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:35.711618 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 103654us
I20260709 13:11:35.692824 22717 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:35.683938 22967 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:35.719218 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:35.709704 15380 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:35.645598 22942 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.700623 22735 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:35.709348 23085 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:35.731539 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.711833 23094 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:35.725356 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.734375 15273 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:35.739770 15274 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.740487 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:35.655721 23027 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:35.751379 23101 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:35.752446 23101 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:35.757087 23101 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:35.750423 23027 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:35.763314 23027 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.716081 22717 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.683454 23097 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:35.708842 23076 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:11:35.776473 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.724202 23075 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:35.719653 23108 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.733079 23085 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.729547 22735 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.780809 15301 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 24: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:35.715056 23112 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:35.794577 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.777534 22717 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:35.791648 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 94596.2us
I20260709 13:11:35.803083 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:35.724025 22922 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:11:35.806387 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:35.813041 15373 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:35.783748 23067 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:35.789662 22687 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.783417 23075 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:35.822187 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 135622us
I20260709 13:11:35.823148 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.790112 23085 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.825675 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.794639 22735 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:35.839943 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 260220us
I20260709 13:11:35.809252 22760 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:35.817886 23067 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.821134 23006 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:35.841005 15348 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.856142 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:35.831288 23075 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:35.863521 22942 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:35.864641 23091 log.cc:927] Time spent T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.602s	user 0.007s	sys 0.000s
W20260709 13:11:35.866963 22747 consensus_meta.cc:287] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 13:11:35.836951 23117 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:35.885253 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:35.912407 15300 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:35.832142 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:35.913748 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 81996.5us
W20260709 13:11:35.886564 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 80959.5us
I20260709 13:11:35.905339 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.916008 15304 raft_consensus.cc:2410] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:11:35.869655 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4278) took 1252 ms. Trace:
I20260709 13:11:35.855309 23067 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:35.914808 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.827659 23112 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:35.948057 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 213796us
W20260709 13:11:35.926753 23082 consensus_meta.cc:287] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.747s	user 0.005s	sys 0.011s
I20260709 13:11:35.949512 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:35.954735 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.937629 22687 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:35.959342 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 219628us
I20260709 13:11:35.859982 22760 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:35.975072 15974 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.13.196.126:35597, user_credentials={real_user=slave}} blocked reactor thread for 44358.3us
I20260709 13:11:35.921018 22747 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:35.967454 15196 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:35.979602 22747 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:35.981655 23121 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.982188 23077 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:35.982478 23121 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:35.985455 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:35.986387 23122 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:35.986474 23117 consensus_queue.cc:1048] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:35.968708 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:35.990553 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:35.993026 23006 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:35.994042 23006 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:35.996060 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:35.997443 15304 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 24: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:35.998932 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.000695 22910 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:35.916697 15308 rpcz_store.cc:276] 0709 13:11:34.617446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.617661 (+   215us) service_pool.cc:224] Handling call
0709 13:11:34.644003 (+ 26342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:34.800801 (+156798us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:35.373958 (+573157us) log.cc:844] Serialized 14 byte log entry
0709 13:11:35.710261 (+336303us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:35.710353 (+    92us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:35.710415 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:35.869209 (+158794us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540026c0d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:35.869301 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:35.869543 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10265,"prepare.queue_time_us":8580,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":80139,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4392,"spinlock_wait_cycles":359764224,"thread_start_us":789817,"threads_started":2,"wal-append.queue_time_us":406439}
I20260709 13:11:35.945668 22932 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:36.007185 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 166213us
W20260709 13:11:36.008299 15348 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.008857 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:36.011009 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.012216 15273 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.046576 15301 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 15.
I20260709 13:11:36.015641 23121 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.016573 22932 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:36.006497 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 79115.2us
W20260709 13:11:35.966317 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.960502 23096 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:36.033063 23087 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:36.053296 22760 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:36.053830 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 48480.7us
I20260709 13:11:36.034296 23112 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.034937 22910 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:36.018886 23128 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:35.953895 22942 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:11:36.054745 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.057580 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:11:36.034289 23124 log.cc:927] Time spent T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:11:36.069800 16005 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:36.064530 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 98242.9us
W20260709 13:11:36.070819 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.076749 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:36.083374 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 75118.1us
W20260709 13:11:36.084969 15348 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.089996 15348 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:36.100515 16005 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
W20260709 13:11:36.109989 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55324.8us
I20260709 13:11:36.111056 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:36.112869 23112 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:36.059923 22931 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.113857 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.068765 23128 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:36.073716 23097 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:36.118964 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 415485us
W20260709 13:11:36.085237 23055 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.005s
I20260709 13:11:36.121346 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:36.122797 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:36.133463 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48545us
I20260709 13:11:36.138007 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.142114 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:36.142382 15974 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.142863 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:36.146386 15974 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.146979 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:36.153122 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.117764 23092 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:36.158305 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.120388 23128 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:36.167722 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.165608 15199 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:36.152148 22931 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:36.145716 22922 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.154986 23127 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:36.156826 23121 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:36.195868 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53829.1us
I20260709 13:11:36.139477 23055 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.178321 22931 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.200286 23130 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:36.184783 23131 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:11:36.201707 23133 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:36.205614 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:36.208801 15274 consensus_peers.cc:597] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.169862 23112 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:36.210659 23123 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.211169 23134 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:36.227208 23086 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:36.236038 15300 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
I20260709 13:11:36.240676 23129 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.241490 23006 consensus_queue.cc:1059] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:11:36.245220 22932 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.245507 23077 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:11:36.244100 22967 consensus_meta.cc:287] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.002s
W20260709 13:11:36.275215 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 117754us
W20260709 13:11:36.258553 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 187139us
W20260709 13:11:36.288054 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 82584.1us
I20260709 13:11:36.296060 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:36.299858 15378 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:36.192642 22942 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:36.191057 23127 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:36.287578 23117 raft_consensus.cc:2764] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:11:36.309126 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.319166 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:36.319952 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 185380us
W20260709 13:11:36.307785 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.328518 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.255230 22931 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:36.322198 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.323137 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.323560 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.337597 15375 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:36.324389 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.322923 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.326977 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.324455 15382 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:36.330523 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:36.340878 16005 raft_consensus.cc:2393] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:36.266592 23108 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:36.274272 23145 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:36.327044 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:36.350646 15378 raft_consensus.cc:2368] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16.
I20260709 13:11:36.350292 23145 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:36.340083 15380 raft_consensus.cc:2468] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:36.351722 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.352449 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.352692 22922 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.353607 15378 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:36.261219 23112 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.345448 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.354219 23112 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:36.289117 23134 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.356590 23134 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:36.356724 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:36.345526 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:36.357537 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:36.359282 22920 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:36.358330 15123 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 13 to 14, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 14 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.277789 22717 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.363134 15378 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:36.346803 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:36.364107 15382 raft_consensus.cc:2368] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:36.364162 22920 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:36.330976 22932 raft_consensus.cc:3055] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:36.372579 15380 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:36.311971 22942 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.374764 22942 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:36.380147 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:36.384513 23113 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:36.385824 23120 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.386454 23120 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.388513 23132 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:36.389050 23132 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.389487 23132 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:36.325608 23127 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:36.326364 23092 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:36.402153 23092 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:36.260283 23085 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:36.336402 23086 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:11:36.407696 23085 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:36.409873 22717 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.410211 23055 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:36.412746 23133 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.413515 23133 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:36.340978 23077 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 24 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:36.417711 23077 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:36.307431 22967 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.420859 15376 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 24: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:36.259240 23075 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.424459 23075 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:36.349793 23094 consensus_meta.cc:287] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260709 13:11:36.349393 23067 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.353302 22922 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.346395 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.367803 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:36.337977 15274 leader_election.cc:336] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.432298 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:36.422137 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.451629 15381 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:36.450361 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:36.462283 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 289457us
I20260709 13:11:36.466993 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:36.470507 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 132571us
W20260709 13:11:36.471350 15274 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.472667 15274 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.473631 15274 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.476584 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 108892us
I20260709 13:11:36.371307 22932 raft_consensus.cc:740] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:36.480476 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:11:36.478415 15974 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.481946 16005 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.482465 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:36.474259 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:36.450423 22687 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:36.466219 23142 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:11:36.487404 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.489338 15974 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.489531 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:36.495069 15274 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.466583 23094 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:36.502084 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:36.505122 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.498826 15274 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.510684 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:36.511410 15274 leader_election.cc:336] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.511894 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:36.491832 23075 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:11:36.520498 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 182166us
I20260709 13:11:36.521920 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:36.525992 15379 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:36.493638 23129 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:36.515203 22735 consensus_meta.cc:287] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.627s	user 0.013s	sys 0.002s
I20260709 13:11:36.498093 23086 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:36.538133 16005 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:36.528103 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:36.529495 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.493261 23100 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:36.535570 15274 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.540378 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:36.527081 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:36.512691 23092 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:36.517537 22967 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:36.512280 23085 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.541282 15377 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.541620 15198 leader_election.cc:400] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16.
I20260709 13:11:36.547642 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:36.542032 15381 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 24: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:36.497239 23113 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:36.543138 23086 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:36.599570 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51992us
I20260709 13:11:36.539805 22735 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.601145 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:36.534605 23107 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:36.607848 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.608212 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.607594 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.611362 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.612932 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.548789 23076 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:36.615970 15306 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:36.615996 15307 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:36.617513 15129 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 102) took 16256 ms (client timeout 15000 ms). Trace:
I20260709 13:11:36.619731 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:36.621317 15381 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.616096 15299 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:36.554224 23075 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:36.625113 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.625285 23075 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.627259 22922 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.630899 23134 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.607544 15123 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.641538 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:36.655422 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 113127us
I20260709 13:11:36.555378 23120 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:36.665585 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 130044us
W20260709 13:11:36.666574 15274 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.668877 15196 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:36.635414 23086 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:36.608111 23149 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.675146 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.621691 23108 raft_consensus.cc:2804] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:36.632246 23117 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:36.635675 23067 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:36.687238 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 50603.7us
I20260709 13:11:36.689050 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.691733 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:36.692461 15299 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:36.702165 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.670609 22922 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:36.612668 22932 consensus_queue.cc:260] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.632023 23128 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:36.685746 23108 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.724076 15307 raft_consensus.cc:2468] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:36.719197 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.731118 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.731946 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.702993 23153 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:36.683265 23120 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.737262 15307 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
W20260709 13:11:36.744138 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52497.4us
I20260709 13:11:36.728727 23108 raft_consensus.cc:3060] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:36.683764 23086 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.762739 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.764494 15299 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:11:36.764988 15299 pending_rounds.cc:85] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 11
I20260709 13:11:36.765370 15299 pending_rounds.cc:107] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:11:36.766459 15299 raft_consensus.cc:2889] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:36.765839 15307 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:36.749651 22922 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:36.781647 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 112741us
I20260709 13:11:36.782998 15198 leader_election.cc:400] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18.
I20260709 13:11:36.791299 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.792737 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.793496 15304 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.793262 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.699074 15123 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.808718 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.809667 15301 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 24: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:36.805480 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:36.804073 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.812676 15300 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.808494 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.814798 15377 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:36.768486 23086 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:36.814225 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.818167 15304 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:36.621047 15129 rpcz_store.cc:269] 0709 13:11:20.247074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.247338 (+   264us) service_pool.cc:224] Handling call
0709 13:11:36.494227 (+16246889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:30.516590 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:30.605101 (+ 88511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:30.605161 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:11:30.605183 (+    22us) tablet.cc:662] Decoding operations
0709 13:11:30.606448 (+  1265us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:30.606544 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:30.606573 (+    29us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:11:30.867149 (+260576us) tablet.cc:701] Row locks acquired
0709 13:11:30.867203 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:11:30.867380 (+   177us) write_op.cc:270] Start()
0709 13:11:30.867545 (+   165us) write_op.cc:276] Timestamp: P: 1783602690867306 usec, L: 0
0709 13:11:30.867586 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:11:30.868270 (+   684us) log.cc:844] Serialized 5545 byte log entry
0709 13:11:31.792192 (+923922us) op_driver.cc:464] REPLICATION: finished
0709 13:11:31.868287 (+ 76095us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f50a1c0ac 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f5755cef0
0709 13:11:32.180618 (+312331us) write_op.cc:301] APPLY: starting
0709 13:11:32.180764 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:33.034826 (+854062us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:33.034884 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:33.930347 (+895463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:33.931010 (+   663us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:11:33.931100 (+    90us) write_op.cc:312] APPLY: finished
0709 13:11:33.931906 (+   806us) log.cc:844] Serialized 129 byte log entry
0709 13:11:34.048711 (+116805us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:34.384778 (+336067us) write_op.cc:454] Released schema lock
0709 13:11:34.403319 (+ 18541us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:34.492831 (+ 89512us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:34.492872 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4709954,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":351681,"apply.run_cpu_time_us":52451,"apply.run_wall_time_us":2312172,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62591,"num_ops":14,"prepare.queue_time_us":125880,"prepare.run_cpu_time_us":37501,"prepare.run_wall_time_us":733625,"raft.queue_time_us":342861,"raft.run_cpu_time_us":17616,"raft.run_wall_time_us":415954,"replication_time_us":924378,"spinlock_wait_cycles":34434944,"thread_start_us":890471,"threads_started":5,"wal-append.queue_time_us":1034298,"wal-append.run_cpu_time_us":16999,"wal-append.run_wall_time_us":2227641}]]}
I20260709 13:11:36.822882 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:36.749604 23120 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.820847 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.720671 23113 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:36.800175 23075 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:36.840130 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:36.840478 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55848us
I20260709 13:11:36.834908 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:36.852638 23094 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:36.853223 23094 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.853591 23094 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:36.848137 23148 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:36.778995 23153 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:11:36.863730 23148 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:36.866879 23148 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:36.811188 22747 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:36.846242 22735 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.837863 22967 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:36.845784 23134 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.841100 23092 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:36.884438 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.891804 15306 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.885459 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:36.894613 15299 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 24: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:36.900897 15381 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:36.911060 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:36.883497 23147 log.cc:927] Time spent T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.167s	user 0.002s	sys 0.001s
W20260709 13:11:36.912362 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 68896.9us
W20260709 13:11:36.910393 23127 consensus_meta.cc:287] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.517s	user 0.001s	sys 0.014s
I20260709 13:11:36.934813 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:36.878830 23092 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:36.874128 23128 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:36.877007 22967 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:36.912226 23112 consensus_meta.cc:287] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.002s
I20260709 13:11:36.876159 23120 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.909657 23085 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.955188 15300 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:36.922266 23133 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.508s	user 0.015s	sys 0.000s
I20260709 13:11:36.912583 23134 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:36.970999 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:36.872282 22942 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:36.956351 23092 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:37.040402 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69553.6us
I20260709 13:11:37.042392 23076 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:36.980770 22922 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:37.044545 15348 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.044880 22922 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.045176 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.045522 22922 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:37.051026 23162 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:11:37.021512 23133 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.066793 22922 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.071005 22922 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:36.967979 22967 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.956326 23127 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:36.966600 23075 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 24 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:37.033365 23097 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:37.030206 23055 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:36.980036 23085 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.038132 23128 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:36.966231 22735 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.150s
I20260709 13:11:37.107844 23133 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.141669 23075 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.031137 23134 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.111900 15123 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 8 to 10, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 10 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.158783 23134 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:36.976584 23112 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.163409 23112 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.170540 23128 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:37.195668 23160 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:37.158986 15123 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:37.218607 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 308189us
W20260709 13:11:37.213315 23132 consensus_meta.cc:287] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.823s	user 0.016s	sys 0.000s
W20260709 13:11:37.216370 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 173951us
I20260709 13:11:37.237835 15198 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:37.138266 23097 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.144856 23055 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:37.248158 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 203612us
W20260709 13:11:37.257253 15348 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.258605 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.249998 15198 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:37.234010 23128 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.253306 23154 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:37.306954 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:37.305940 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:37.308632 15381 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:37.247361 23108 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.346508 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:37.347527 15377 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:37.351186 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 130887us
I20260709 13:11:37.351282 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:37.297830 22922 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:37.245428 23132 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.365248 15380 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:37.363234 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:37.389351 15306 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:37.351744 23183 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:37.360960 23154 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:37.360308 23178 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:37.394116 22931 consensus_meta.cc:287] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 1.047s	user 0.018s	sys 0.000s
I20260709 13:11:37.476025 15377 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
W20260709 13:11:37.478629 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 221425us
I20260709 13:11:37.389937 22942 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:37.485642 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 123520us
I20260709 13:11:37.490267 15381 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
I20260709 13:11:37.489868 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:37.501031 23167 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:11:37.501885 23145 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:37.519390 23108 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.520076 23085 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.462121 22922 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:37.521008 23097 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:37.483346 22931 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.521824 22922 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.458178 23183 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:37.525892 23152 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.713s	user 0.001s	sys 0.004s
I20260709 13:11:37.527563 23183 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:37.529848 23132 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.532941 23127 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:37.535697 15376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 4110) took 1139 ms. Trace:
W20260709 13:11:37.537675 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.536403 15376 rpcz_store.cc:276] 0709 13:11:36.396292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.427544 (+ 31252us) service_pool.cc:224] Handling call
0709 13:11:36.466688 (+ 39144us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:36.476188 (+  9500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.476225 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:36.485494 (+  9269us) log.cc:844] Serialized 52 byte log entry
0709 13:11:36.644242 (+158748us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:37.125263 (+481021us) log.cc:844] Serialized 14 byte log entry
0709 13:11:37.270805 (+145542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.270922 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:37.524806 (+253884us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:37.535174 (+ 10368us) raft_consensus.cc:1685] finished
0709 13:11:37.535365 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:37.535611 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44163,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":355751,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":48104,"spinlock_wait_cycles":14319488,"thread_start_us":694960,"threads_started":3,"wal-append.queue_time_us":252705}
I20260709 13:11:37.539152 23154 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.492676 15123 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 9 to 7, term changed from 16 to 12, leader changed from <none> to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from VOTER to NON_VOTER. New cstate: current_term: 12 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:11:37.546452 15375 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:37.548820 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:37.555169 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 887463us
W20260709 13:11:37.552992 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63233.4us
I20260709 13:11:37.561517 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:37.549324 22931 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:37.568173 23170 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:11:37.574155 23181 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:37.563613 23184 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:37.579802 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 190364us
I20260709 13:11:37.600375 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:37.579085 23097 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:37.574045 23176 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:37.614949 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:37.616128 15304 raft_consensus.cc:2393] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:37.590734 23181 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.604972 22735 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.624377 15345 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:37.620908 23094 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.764s	user 0.014s	sys 0.002s
I20260709 13:11:37.614580 23127 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:37.638437 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:37.640712 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 160968us
W20260709 13:11:37.621002 23086 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.725s	user 0.014s	sys 0.000s
W20260709 13:11:37.642071 15348 leader_election.cc:336] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.641762 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:37.618805 23055 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:37.643581 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.613225 23097 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:37.629614 23164 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.622396 23181 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:37.614542 23075 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:37.606391 23184 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:37.654929 15348 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:37.656165 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.656625 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:37.656869 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:37.627115 22967 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.635707 22735 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.647580 23176 raft_consensus.cc:2804] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:37.648891 23097 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:37.639312 23187 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:37.693512 15375 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
W20260709 13:11:37.657478 15348 leader_election.cc:336] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.685065 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:37.695488 15301 raft_consensus.cc:2393] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 13: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:37.689996 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:37.696444 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.664618 23191 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:37.698030 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:37.660017 23172 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:37.699688 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:37.652293 23055 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:37.698236 23191 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:37.704730 23191 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:37.707214 23182 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:37.638550 23094 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:37.708516 23092 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.002s
I20260709 13:11:37.709013 23092 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.709731 23176 raft_consensus.cc:697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:37.710391 23094 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:37.711320 23092 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:37.645112 23086 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.711637 15373 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:11:37.699738 23172 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:37.713438 23086 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.713601 23172 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:37.710845 23176 consensus_queue.cc:237] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.713833 22967 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:37.679162 23180 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:37.716876 15378 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:37.657903 23075 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.659382 23164 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.692891 23183 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:11:37.644598 23127 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.672149 23184 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:37.716768 23180 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:37.741127 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 83655.7us
W20260709 13:11:37.742259 15348 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.742748 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.743902 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:37.745880 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:37.747509 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.747666 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:37.751608 23067 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:37.753072 23191 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.755685 23191 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:37.759223 23189 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:11:37.761245 22735 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.762481 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:37.764870 23030 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:37.765714 23030 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.767376 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:37.746261 22967 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:37.769311 15374 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:11:37.749347 23184 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:37.771275 23164 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:37.752211 23067 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:37.773074 23127 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:37.772794 23067 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.740721 23180 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:37.774719 23067 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:37.775099 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:37.737228 22920 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.776777 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.779455 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:37.780184 16005 raft_consensus.cc:2468] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:37.777782 15376 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 11.
I20260709 13:11:37.770401 23030 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:37.793671 22932 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:37.796370 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48894.7us
W20260709 13:11:37.797389 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.787636 23193 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:37.784468 23187 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:37.786407 22920 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.806010 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:37.892582 15302 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 20: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:37.808935 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:37.809825 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:37.893491 15373 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:37.814121 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:37.815026 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:37.819597 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:37.895234 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75716.6us
I20260709 13:11:37.897094 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:37.820400 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:37.823561 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 257760us
W20260709 13:11:37.899303 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 79038.8us
I20260709 13:11:37.831984 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.910941 15305 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 17: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:37.910936 23155 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:37.787213 23172 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:37.933892 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:37.918323 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 120985us
I20260709 13:11:37.917245 23077 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:37.913646 22922 raft_consensus.cc:2804] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:37.919847 23092 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:37.896848 23193 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.824047 23127 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:11:37.937947 15373 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
W20260709 13:11:37.971562 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 190172us
I20260709 13:11:37.972754 23198 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:37.973716 23198 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:37.977735 23198 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:37.903353 23131 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.930987 22920 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:37.920073 22942 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:37.926033 23075 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:37.938764 15348 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:37.988312 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 49589.9us
W20260709 13:11:37.990010 15348 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.990758 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.992077 23092 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:37.994100 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.998059 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:37.945134 22922 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:38.007386 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.009188 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:37.986388 23127 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:37.986645 22942 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:37.999035 23184 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:38.013765 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 98287.7us
I20260709 13:11:38.014828 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:37.984071 23131 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:11:38.017190 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.033264 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:38.034013 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 112482us
I20260709 13:11:38.023401 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.017607 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.030834 15971 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.035759 15377 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:37.968832 23077 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.010733 22922 raft_consensus.cc:3060] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:38.038518 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.031440 23191 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:38.041838 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.045944 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:38.039846 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:38.048156 15348 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.048614 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:38.040764 15274 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:38.059322 15274 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.032034 22942 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:38.029070 23127 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
W20260709 13:11:38.061262 15274 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:38.062992 15274 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.064406 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.039458 22967 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:38.040550 23140 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:38.052083 15348 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.072281 15348 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:38.073853 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:38.066154 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:38.074329 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.082309 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.083005 15373 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:38.076753 15274 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.058609 23191 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.059118 23153 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:38.087349 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.088021 15377 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:38.089191 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.089998 15377 raft_consensus.cc:2368] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:38.041160 23184 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.083786 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:38.085717 15348 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.081513 23092 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:38.066485 23086 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:38.099473 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 272738us
I20260709 13:11:38.072378 23075 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:38.086576 23187 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:38.118193 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:38.122568 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:38.104573 15348 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.118480 15373 raft_consensus.cc:2468] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
W20260709 13:11:38.126014 23204 log.cc:927] Time spent T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:38.127785 22955 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:38.128140 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.129138 15381 raft_consensus.cc:2393] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:38.130141 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.131352 16008 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 24: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:38.101469 23153 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.107059 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.116137 15378 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
W20260709 13:11:38.105791 15274 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.093355 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.135617 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:38.108076 23113 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:38.144176 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.144908 15999 raft_consensus.cc:2368] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:38.144038 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.094931 22920 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:11:38.149051 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.152199 15307 raft_consensus.cc:2410] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:11:38.153666 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.154520 15377 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:38.103991 23097 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.156198 23193 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.161082 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:38.156801 23155 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.163326 23155 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.140514 23172 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:38.149083 23191 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.160137 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:38.166893 23181 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.168865 23081 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:38.168982 23207 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:38.168902 22735 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.169346 23153 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.170137 22735 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.172387 22735 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:38.169360 23081 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:38.173297 23081 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:38.173730 23184 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:38.140225 23129 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:38.140399 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:38.181630 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 75864.3us
I20260709 13:11:38.129778 23075 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 23 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.155429 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.156306 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:38.183871 15274 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.187417 15373 raft_consensus.cc:2393] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 24: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:38.188206 15274 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.189532 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:38.189523 15274 leader_election.cc:336] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.191475 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.194012 15380 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:38.193941 15274 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:38.196204 15274 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.166893 23131 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:38.187062 23113 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:38.203886 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.207209 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.207888 15381 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:11:38.211277 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.212081 15373 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:38.135881 23127 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:38.218645 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72711.4us
I20260709 13:11:38.219825 15196 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:38.220947 23154 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:38.221518 23154 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.222576 23154 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:38.225399 15307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 4328) took 1422 ms (client timeout 1675 ms). Trace:
W20260709 13:11:38.225924 15307 rpcz_store.cc:269] 0709 13:11:36.802909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.805200 (+  2291us) service_pool.cc:224] Handling call
0709 13:11:38.225121 (+1419921us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540025add4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:38.225297 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3079809408}
I20260709 13:11:38.229394 15376 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:38.230369 15274 leader_election.cc:400] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:38.230999 15274 leader_election.cc:403] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:38.195472 22932 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:38.237080 23202 log.cc:927] Time spent T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:38.243119 23181 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:38.244485 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.245151 23081 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.245613 15304 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:38.246713 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.204429 22922 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.249737 23081 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:38.250579 22922 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.251828 15307 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:38.252696 23077 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.256956 23075 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.258564 23097 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:38.261478 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.261907 15304 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:38.254667 23127 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:38.261724 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.254091 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.264158 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.267189 15373 raft_consensus.cc:1240] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:38.267546 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.264273 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:38.276541 15301 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:38.277675 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.278054 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.278793 15301 raft_consensus.cc:2468] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:38.279796 23067 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:38.280328 23067 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.280915 23067 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.288451 15378 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:38.292173 23196 log.cc:927] Time spent T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.593s	user 0.002s	sys 0.010s
I20260709 13:11:38.296299 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:38.301743 23201 log.cc:927] Time spent T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.210s	user 0.002s	sys 0.000s
I20260709 13:11:38.293085 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.294381 15378 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:38.301640 15301 raft_consensus.cc:1240] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:38.279968 15303 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:38.293334 15304 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:38.271692 22932 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351) with higher term. Message: Invalid argument: T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:38.323585 15304 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:38.325796 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.324544 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.337633 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.342625 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.344406 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:38.344466 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.346407 23128 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:38.347097 23128 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.314735 23113 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.340137 15378 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:38.348970 23113 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.314924 22931 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.350901 22931 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.315160 23164 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.328732 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.352610 23164 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.353921 15307 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:38.333444 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.355283 23164 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.272137 23180 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.357679 22942 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.358251 23180 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.359239 15377 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:38.359337 15306 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:38.366771 15378 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:38.311741 23081 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:38.328251 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.351284 15301 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:11:38.378350 15303 raft_consensus.cc:2468] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:38.381501 23176 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.381667 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.382747 16000 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:38.384656 15378 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:38.378077 15301 pending_rounds.cc:85] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 17
I20260709 13:11:38.386138 15378 raft_consensus.cc:1240] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:38.386422 15301 pending_rounds.cc:107] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:11:38.386822 15301 raft_consensus.cc:2889] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:38.387465 15378 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:38.382530 23176 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.390477 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:38.391840 15299 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:38.395268 15378 raft_consensus.cc:1240] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:11:38.398202 15305 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:38.396618 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.407734 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.414415 15273 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:38.419219 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:38.420259 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.426622 15273 leader_election.cc:400] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Vote denied by peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043) with higher term. Message: Invalid argument: T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20.
I20260709 13:11:38.429358 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:38.427829 15273 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:38.432457 15378 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:11:38.410883 22741 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:38.430996 15196 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.454339 15374 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:38.402799 23067 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:38.488438 15308 raft_consensus.cc:2410] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:11:38.489760 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.490571 15305 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:38.417775 23006 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:38.421092 23077 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:38.490332 23154 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:38.453066 23175 raft_consensus.cc:2804] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:38.457746 23197 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:38.493818 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.514008 15303 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.491372 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.515326 15307 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:38.430647 22932 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:38.492290 23127 raft_consensus.cc:2804] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:38.455329 22741 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.415926 23194 consensus_queue.cc:1059] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:11:38.454227 22735 consensus_queue.cc:1059] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
W20260709 13:11:38.500528 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 190843us
I20260709 13:11:38.509084 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.526515 15305 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:11:38.453970 23152 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:11:38.488700 23193 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.425438 23086 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:38.430341 23131 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:38.519296 15375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54656 (request call id 4101) took 2172 ms (client timeout 1940 ms). Trace:
I20260709 13:11:38.505091 23175 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:38.556512 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68486.3us
I20260709 13:11:38.557061 23175 raft_consensus.cc:3060] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:38.526922 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.492017 23075 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:11:38.496814 23006 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.573097 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.570420 23155 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:38.543963 23193 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.520975 23192 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:11:38.576392 23077 raft_consensus.cc:3055] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:38.576933 23077 raft_consensus.cc:740] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.577234 23192 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:38.577715 23193 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.536063 23067 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:38.578045 23077 consensus_queue.cc:260] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.579573 23077 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.545511 15381 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:38.580602 23213 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.155s
I20260709 13:11:38.581660 23213 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.582206 23154 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:38.582199 23213 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.582937 23154 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.583998 23154 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:38.556635 15375 rpcz_store.cc:269] 0709 13:11:36.334746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.338448 (+  3702us) service_pool.cc:224] Handling call
0709 13:11:38.506616 (+2168168us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400224054. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:38.506752 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731895552}
I20260709 13:11:38.550418 23194 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.015s
I20260709 13:11:38.590950 23154 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.591754 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:38.567106 23082 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:38.598783 15381 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.598989 23082 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.599682 15305 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:38.529197 23128 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:38.568733 22735 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.570026 23176 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.572778 23075 raft_consensus.cc:3055] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:38.575100 23006 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:38.523533 22932 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:38.559628 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.584510 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.592865 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:38.623102 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 96212us
I20260709 13:11:38.566448 15304 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:38.560465 15303 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
W20260709 13:11:38.597808 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 144344us
I20260709 13:11:38.625471 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:38.609589 15307 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 18.
I20260709 13:11:38.530128 22741 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.614678 15196 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.640861 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.561192 23129 raft_consensus.cc:3055] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:38.642503 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.644093 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.645529 15374 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:38.646106 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:38.620055 23212 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:11:38.623656 15380 raft_consensus.cc:2376] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24. Re-sending same reply.
W20260709 13:11:38.629910 23214 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.003s
I20260709 13:11:38.577744 23192 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:38.619658 23075 raft_consensus.cc:740] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.639603 23135 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:38.649153 23067 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:38.644081 23153 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:38.674553 15381 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:38.675676 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.650671 22922 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:38.618140 23131 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:11:38.673022 23127 raft_consensus.cc:697] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:38.644342 23129 raft_consensus.cc:740] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:38.662873 23082 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:38.685369 23217 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:38.656412 23164 raft_consensus.cc:2804] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:38.679127 15274 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.690287 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.675595 22932 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.619534 22735 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.671878 23213 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.654428 23193 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:38.676234 23086 raft_consensus.cc:697] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:38.689073 23131 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.691987 23164 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.677878 23194 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:11:38.703560 23082 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.730054 15377 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:38.726282 23220 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:11:38.725190 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 46094.8us
W20260709 13:11:38.733088 15274 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.700829 23226 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:38.733615 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.704737 23113 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:38.712603 23216 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.740446 23081 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:38.721463 23164 raft_consensus.cc:3060] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:38.711910 23131 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.757237 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.760797 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:38.745682 23227 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:38.749322 23200 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.674s	user 0.000s	sys 0.002s
I20260709 13:11:38.726373 23223 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.706390 23075 consensus_queue.cc:260] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:38.778935 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 123351us
W20260709 13:11:38.767449 15199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.773104 22747 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:38.775377 23067 consensus_queue.cc:1059] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:11:38.789379 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 400610us
I20260709 13:11:38.790473 23220 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:38.834529 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 107405us
I20260709 13:11:38.785871 23153 consensus_queue.cc:1059] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:11:38.739207 23216 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.847290 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:38.839711 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.196.67:39043 timed out after 1.569s (SENT) [suppressed 140 similar messages]
I20260709 13:11:38.842950 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.854125 15382 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:38.845203 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:38.855015 15376 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:38.783320 23175 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.858349 15378 raft_consensus.cc:2393] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:38.712540 23129 consensus_queue.cc:260] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.784132 23127 consensus_queue.cc:237] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.837015 22735 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:38.814178 22747 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:11:38.703701 23192 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:38.879046 23050 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:38.783659 23223 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.838903 23067 raft_consensus.cc:3055] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:38.849758 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:38.905589 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55969.6us
I20260709 13:11:38.908531 15345 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:38.911314 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 720763us
W20260709 13:11:38.926955 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:38.927678 15348 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.908267 22747 consensus_queue.cc:1243] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:38.887281 23067 raft_consensus.cc:740] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:38.933653 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 94149us
W20260709 13:11:38.930734 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 124049us
W20260709 13:11:38.925194 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 192137us
W20260709 13:11:38.918355 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 140531us
I20260709 13:11:38.911933 23172 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:38.910609 22735 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:38.932871 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.914428 23231 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.934790 15345 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:38.935041 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:38.946249 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:38.937824 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.942121 15301 raft_consensus.cc:1275] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:38.948383 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:38.948288 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:38.949620 15274 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.886984 23086 consensus_queue.cc:237] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:38.953491 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 173489us
I20260709 13:11:38.954834 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:38.936105 22747 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.936311 22760 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:38.957192 15274 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.957696 15274 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.958799 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:38.966145 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:38.938815 23172 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:38.971081 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:38.999933 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:38.999402 22747 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.967900 23183 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:38.970551 23184 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:38.965713 23127 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:38.967092 23128 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:39.021281 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72104.1us
I20260709 13:11:39.009503 23227 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:38.985450 23131 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.012369 23172 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.952868 23231 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.013271 22932 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:39.010650 23067 consensus_queue.cc:260] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:38.969530 23220 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:11:38.948143 22735 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.013888 22760 raft_consensus.cc:697] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:39.025434 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 88442.8us
W20260709 13:11:39.032161 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 61134.8us
I20260709 13:11:39.024580 23110 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:11:39.064074 15274 leader_election.cc:336] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.065604 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.027933 23230 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:11:38.883894 23213 consensus_queue.cc:1175] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec140f610ed4500ba58208c0e5519bb" responder_term: 17 status { last_received { term: 16 index: 10 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:39.044689 23175 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.046005 23223 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.088562 23154 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:39.031039 23128 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.049604 23172 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:39.093057 23240 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:11:39.032924 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 76762.8us
I20260709 13:11:39.032327 23127 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.068434 23110 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:11:39.079632 15274 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.081760 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 88021.6us
I20260709 13:11:39.021014 23208 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:11:39.036908 22932 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.094400 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:39.071859 23228 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 13:11:39.098208 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.099244 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:39.102258 22747 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.104496 23077 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:39.096215 23216 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:39.131866 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52285.3us
W20260709 13:11:39.133582 15274 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.105262 23234 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:39.109247 15345 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:39.135836 23234 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:39.136210 23244 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:39.136322 23234 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:39.111593 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 141412us
I20260709 13:11:39.137593 23244 consensus_queue.cc:1048] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:39.137861 23234 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.139413 23234 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:39.105628 22920 raft_consensus.cc:3055] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:39.134234 15274 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.144279 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:39.097577 23227 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:39.145355 15304 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:39.098052 23110 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:39.107944 23231 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.154414 15377 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:11:39.155198 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:39.150732 15274 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.155062 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.107208 22932 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:39.156163 15382 raft_consensus.cc:2393] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 19: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:39.115020 23180 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:39.114823 23172 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:39.143537 22920 raft_consensus.cc:740] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:39.160774 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.142241 23190 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:39.162024 15274 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.110030 23239 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:39.189944 15274 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.187475 15273 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.140816 22741 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.114763 23085 consensus_queue.cc:1059] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:11:39.241320 23127 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.241050 23110 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.185353 23230 consensus_queue.cc:1059] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:11:39.186167 22760 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.100569 23245 consensus_queue.cc:1059] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:11:39.244946 23239 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.152396 23113 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:39.190428 15378 raft_consensus.cc:2410] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:11:39.245018 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 83047us
W20260709 13:11:39.295595 15274 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.297384 15274 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.297928 15274 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.235409 23241 consensus_queue.cc:1059] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.126s
I20260709 13:11:39.249496 23164 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:39.254459 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 630138us
I20260709 13:11:39.158862 23183 raft_consensus.cc:697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:39.250581 23082 consensus_meta.cc:287] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.511s	user 0.015s	sys 0.000s
I20260709 13:11:39.249923 23216 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:11:39.313832 15274 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.300607 22735 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.144955 23220 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:39.277263 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 183993us
W20260709 13:11:39.287303 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 278354us
W20260709 13:11:39.312290 15974 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.317966 15274 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.274852 15304 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
W20260709 13:11:39.318166 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 130807us
I20260709 13:11:39.322942 23183 consensus_queue.cc:237] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.324904 22741 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.326882 22932 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.313593 23250 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:39.327936 23110 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:39.334944 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.330466 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:39.343330 15274 leader_election.cc:336] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.345119 15308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50788 (request call id 4335) took 1111 ms. Trace:
I20260709 13:11:39.346482 15373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 4130) took 1503 ms. Trace:
I20260709 13:11:39.334136 15345 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:39.352110 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.348690 15308 rpcz_store.cc:276] 0709 13:11:38.233579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.234420 (+   841us) service_pool.cc:224] Handling call
0709 13:11:39.344789 (+1110369us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003e21d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:39.345018 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483688320}
W20260709 13:11:39.355754 15274 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.356482 15274 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.357010 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:39.357731 16005 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:39.359468 22735 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:39.362165 23256 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:39.363615 23256 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:39.363652 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:39.364918 23155 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:39.365623 15198 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:39.367496 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:39.368634 23247 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:39.369112 23085 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:39.369314 23247 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.369756 23085 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:39.369966 23077 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:39.370819 23085 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:39.371662 23245 raft_consensus.cc:3055] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:11:39.368703 23252 log.cc:927] Time spent T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:11:39.372402 23245 raft_consensus.cc:740] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:39.369762 23247 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:39.373189 22955 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:39.373683 22955 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:39.373610 23245 consensus_queue.cc:260] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.375128 23245 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.374728 22955 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.371745 23077 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:39.379288 23237 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:39.383104 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:39.384047 15274 leader_election.cc:336] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.385043 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.385385 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.389755 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.353586 15373 rpcz_store.cc:276] 0709 13:11:37.843176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.268443 (+425267us) service_pool.cc:224] Handling call
0709 13:11:38.309341 (+ 40898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.309593 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:38.376006 (+ 66413us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.287969 (+911963us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b18003054a0. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f59901de1 00007f2f5990e5b1 00007f2f50a1be07 00007f2f59876ab9 00007f2f50a3869b 00007f2f50a3693f 00007f2f50a38c02 00007f2f536c020b 00007f2f536c5d23 00007f2f536c623a 00007f2f53b30a2a
0709 13:11:39.344008 (+ 56039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.344082 (+    74us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:39.344148 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.346257 (+  2109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.346402 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65893,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":303,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":7975680,"thread_start_us":55164,"threads_started":1,"wal-append.queue_time_us":967652}
I20260709 13:11:39.339147 23223 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:39.349052 23113 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:39.401489 23247 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.405839 23239 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.406431 23067 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.386336 23248 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:39.407538 23248 raft_consensus.cc:697] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:39.376204 22955 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:39.408852 23248 consensus_queue.cc:237] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.410670 22942 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:39.414880 23253 log.cc:927] Time spent T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:39.417814 23164 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.394363 23155 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:39.383524 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.418838 22920 consensus_queue.cc:260] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.395870 23229 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:39.422222 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.423609 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
W20260709 13:11:39.397730 15274 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.427443 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:39.428802 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.364205 23256 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:39.441903 23153 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.442600 23153 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.443044 23247 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.443804 23256 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.445458 23256 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:39.446928 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.448028 15381 raft_consensus.cc:2393] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:39.448318 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.448865 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.449543 15374 raft_consensus.cc:1240] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:39.449821 23127 raft_consensus.cc:3055] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:39.450385 23127 raft_consensus.cc:740] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:39.456300 22741 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:39.456869 23234 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:39.457158 22741 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.457433 23234 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.459583 22741 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.451619 23127 consensus_queue.cc:260] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:39.460990 23127 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.461292 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.462178 23153 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.462611 23192 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:39.465193 23197 raft_consensus.cc:3055] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:39.465631 23197 raft_consensus.cc:740] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:39.433593 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:39.466491 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:39.466459 23197 consensus_queue.cc:260] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.467347 15374 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:39.467798 23197 raft_consensus.cc:3060] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:39.456524 23193 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:39.470160 23193 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.471570 22932 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.459587 23234 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.473065 22932 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.473613 22932 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.435559 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.477106 15380 raft_consensus.cc:1240] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 19. Current term is 20. Ops: [19.13-19.13]
W20260709 13:11:39.477715 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 80041.7us
I20260709 13:11:39.478485 23193 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:39.478853 15274 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.479853 15274 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.480235 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.480108 23233 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:39.486614 22920 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:39.487483 23129 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:39.449775 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.493018 15274 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.502516 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.504779 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.505654 15382 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:39.507992 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.476042 22932 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.511087 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:39.512986 15304 raft_consensus.cc:1240] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:39.486192 22931 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:39.516952 23233 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:39.523207 15302 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:39.526243 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:39.533295 15381 raft_consensus.cc:1275] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:39.526825 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.534916 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:39.535184 15379 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:39.535570 15375 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:39.536238 15302 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:39.537832 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:39.542536 15374 raft_consensus.cc:2468] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:39.544253 15380 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:39.545467 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.546896 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:39.529711 23259 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:11:39.549722 15303 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:39.553220 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:39.550506 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:39.546896 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:39.558224 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 245966us
I20260709 13:11:39.574399 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:39.556739 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:39.581177 15379 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:39.589097 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:39.591610 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:39.591192 15375 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:39.596678 15198 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:39.595536 23164 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:39.602805 23164 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.603642 23153 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:39.605901 23242 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:11:39.606431 23075 raft_consensus.cc:3060] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:39.610201 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:39.611145 15304 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:39.615012 15300 raft_consensus.cc:1217] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:11:39.615713 15300 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:11:39.616042 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 72088.2us
I20260709 13:11:39.616896 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:39.618230 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:39.618333 23222 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:39.618884 23222 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.619292 23222 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:39.618482 22942 consensus_queue.cc:1048] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:11:39.629428 23226 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:39.629972 23226 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:39.631816 15308 raft_consensus.cc:2410] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:11:39.633154 15375 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:39.612234 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:39.644943 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:39.603302 23164 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:39.685163 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44383.7us
I20260709 13:11:39.682608 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:39.690183 15303 raft_consensus.cc:2393] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:39.676836 23234 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:39.702900 15380 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:39.652455 23226 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.742411 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:39.747956 15376 raft_consensus.cc:1275] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:39.752287 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:39.736909 23234 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:39.759142 23234 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.760316 23245 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:39.746222 23110 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:39.761169 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:39.762044 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:39.828418 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 67357.6us
I20260709 13:11:39.762471 23085 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:39.765187 23128 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:39.775568 16001 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
I20260709 13:11:39.777278 15376 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:39.778301 15373 raft_consensus.cc:1217] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Deduplicated request from leader. Original: 14.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:11:39.835235 15373 raft_consensus.cc:1240] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:39.781142 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:39.744823 23229 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.820039 15273 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:39.833818 15380 raft_consensus.cc:1217] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Deduplicated request from leader. Original: 20.10->[22.11-22.11]   Dedup: 22.11->[]
I20260709 13:11:39.844408 15380 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 22. Current term is 23. Ops: [22.11-22.11]
W20260709 13:11:39.845708 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 286102us
W20260709 13:11:39.861465 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 99525us
I20260709 13:11:39.861843 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:39.862938 16008 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:39.862572 15196 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:39.832109 23233 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:39.867926 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 235658us
I20260709 13:11:39.875016 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:39.887769 16000 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:11:39.891474 15348 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.892055 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:39.893957 15348 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.895718 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.889405 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:39.897403 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:39.848711 22931 raft_consensus.cc:2804] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:39.916774 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:39.918982 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:39.907512 15348 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.832442 23110 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:39.867904 23190 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:39.877661 23254 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:39.945436 23243 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.946239 23243 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:39.946975 23266 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:39.954548 23226 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:39.863297 23127 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:11:39.934442 22931 raft_consensus.cc:697] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:39.958684 16001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 739) took 1029 ms. Trace:
I20260709 13:11:39.958576 22931 consensus_queue.cc:237] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.959299 16001 rpcz_store.cc:276] 0709 13:11:38.929228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.929410 (+   182us) service_pool.cc:224] Handling call
0709 13:11:39.958389 (+1028979us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540068d654. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:39.958575 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904370048}
I20260709 13:11:39.877199 23129 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:39.863037 23227 consensus_queue.cc:1048] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:11:39.849050 23229 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.899323 23082 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:39.944185 23190 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:39.965302 16005 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:11:39.924659 15348 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.016136 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:39.877278 23197 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.915946 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:39.996712 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 77833us
I20260709 13:11:39.909444 23097 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:40.009298 15274 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.010622 16002 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 12.
I20260709 13:11:39.928717 23194 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:40.028653 23263 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:11:40.032600 23243 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.033147 23197 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:39.995592 23184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.010s	sys 0.007s
W20260709 13:11:40.042497 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 126778us
I20260709 13:11:40.081809 15199 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:39.914919 23154 consensus_queue.cc:1059] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 13:11:40.047499 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:40.034369 23110 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:40.013659 22922 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:39.978619 23085 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:11:40.025869 23006 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:40.052927 23254 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:40.097470 15199 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:40.086393 23184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.010s	sys 0.007s
W20260709 13:11:40.114857 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 105592us
W20260709 13:11:40.116600 15274 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.117475 23227 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:40.121147 23275 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:40.107615 23082 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:40.111184 23194 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:40.129212 23197 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.130852 23229 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.110765 23154 consensus_queue.cc:1243] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 0ec140f610ed4500ba58208c0e5519bb log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:40.134547 15199 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:40.167146 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:40.142840 15274 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.168828 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:40.108592 23181 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:40.139261 23221 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.159641 22920 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.002s
W20260709 13:11:40.187251 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44450.7us
W20260709 13:11:40.188233 15274 leader_election.cc:336] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.188840 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.190227 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 170528us
I20260709 13:11:40.191433 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:40.108477 23006 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:40.178795 23082 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:40.109318 23184 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:40.163122 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 207415us
W20260709 13:11:40.243467 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55277.8us
I20260709 13:11:40.253216 16008 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
W20260709 13:11:40.258265 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 333659us
W20260709 13:11:40.259229 15348 leader_election.cc:336] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.259720 15348 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.158931 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 155217us
I20260709 13:11:40.261374 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:40.248108 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:40.196202 23194 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:11:40.196754 23197 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:40.269572 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:40.203572 23221 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.247563 23127 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:40.272190 15348 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.249481 23229 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:40.249718 23213 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:40.283044 15348 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:40.284569 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.285132 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.288297 15348 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.289062 15348 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.271370 23222 consensus_meta.cc:287] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.013s
I20260709 13:11:40.296191 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.296602 15379 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:40.277000 22920 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:40.397686 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 109493us
I20260709 13:11:40.273435 23176 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:40.404245 15272 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.404222 15348 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.404582 23184 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.395534 23281 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:40.405856 15348 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.406481 15348 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:40.407984 23221 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.398800 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:40.417071 23283 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:40.417514 22760 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:40.419775 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.280129 23256 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:40.420547 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.426362 15348 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.429450 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.421301 23067 consensus_meta.cc:287] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.014s	user 0.012s	sys 0.006s
W20260709 13:11:40.432032 15274 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.450631 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.426455 23242 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.426482 22760 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:40.399931 23222 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:40.490744 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 64490us
W20260709 13:11:40.491730 15348 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:40.492779 15348 leader_election.cc:336] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.437398 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.498344 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 66372.9us
W20260709 13:11:40.499231 15274 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.499650 15274 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:40.493265 15348 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.514405 15274 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.484825 23227 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:40.499488 23181 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:40.522900 15306 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:40.500775 23256 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.501286 23229 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:40.522646 23258 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:40.520255 15274 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.558434 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44078.6us
W20260709 13:11:40.559574 15274 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.525909 23234 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.562932 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:40.541730 23276 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.339s	user 0.000s	sys 0.002s
I20260709 13:11:40.560060 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:40.570925 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:40.496860 23242 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.525094 23233 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.525782 23281 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:40.574551 23229 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:40.589767 15348 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.592617 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:40.531809 23227 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:40.573391 22922 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.551810 23256 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.578305 23006 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:40.579833 22920 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.589553 23279 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:40.585603 23258 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:40.589413 23285 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.607609 22741 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.580843 23234 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.630921 23281 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:40.649575 15381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 4184) took 1015 ms. Trace:
I20260709 13:11:40.589166 23233 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:40.640246 23277 log.cc:927] Time spent T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:11:40.651693 15381 rpcz_store.cc:276] 0709 13:11:39.634606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.680223 (+ 45617us) service_pool.cc:224] Handling call
0709 13:11:39.696845 (+ 16622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.728732 (+ 31887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.728767 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.729437 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.996183 (+266746us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:39.996264 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.996426 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.649244 (+652818us) raft_consensus.cc:1685] finished
0709 13:11:40.649278 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.649500 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42058,"raft.queue_time_us":27523,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7830,"thread_start_us":234075,"threads_started":1,"wal-append.queue_time_us":397316}
I20260709 13:11:40.643383 23153 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.704900 23153 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.626453 22922 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.709161 23258 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:11:40.710335 23291 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:11:40.710067 23258 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.634976 23239 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.711792 23239 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.712455 23258 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.714708 23239 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.715485 23239 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.717895 22922 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.721237 23153 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.716122 23239 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.726069 23239 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:40.733834 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 174271us
W20260709 13:11:40.709498 23287 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:11:40.735737 15274 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:40.737701 15274 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:40.738834 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.637701 22920 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:40.747153 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 146908us
I20260709 13:11:40.647465 22741 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.648813 23285 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:40.756537 23222 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.776265 23229 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:40.792878 22920 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.783057 22741 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.785344 23242 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.787855 23127 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:40.789530 23234 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.795636 23227 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:40.796826 23256 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:40.798635 23226 consensus_meta.cc:287] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Time spent flushing consensus metadata: real 0.843s	user 0.016s	sys 0.000s
I20260709 13:11:40.799755 15300 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:40.801702 23233 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:40.803472 23293 log.cc:927] Time spent T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:11:40.807507 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.808192 15974 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:40.808542 23164 consensus_meta.cc:287] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 1.114s	user 0.010s	sys 0.009s
I20260709 13:11:40.809885 23243 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:40.813920 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.809374 15974 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.818051 23285 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:40.811281 23081 raft_consensus.cc:3055] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:40.823899 23081 raft_consensus.cc:740] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:40.825480 15300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4387) took 1217 ms. Trace:
W20260709 13:11:40.819954 23271 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.711s	user 0.005s	sys 0.013s
I20260709 13:11:40.825981 15300 rpcz_store.cc:276] 0709 13:11:39.607927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.620158 (+ 12231us) service_pool.cc:224] Handling call
0709 13:11:39.647103 (+ 26945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.800260 (+1153157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.825175 (+ 24915us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001d6854. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:40.825413 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649586560}
I20260709 13:11:40.825105 23081 consensus_queue.cc:260] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.834826 23256 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:40.835942 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:40.858383 15377 raft_consensus.cc:2468] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:40.836114 23082 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:40.859817 23082 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:40.862660 23082 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:40.864621 23082 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.865972 23082 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.813184 23164 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:40.868191 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:40.870549 15302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4381) took 1264 ms. Trace:
W20260709 13:11:40.871805 15274 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.886626 15304 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:11:40.887151 15304 pending_rounds.cc:85] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 12
I20260709 13:11:40.887393 15304 pending_rounds.cc:107] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:11:40.887651 15304 raft_consensus.cc:2889] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:40.888906 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.889407 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.889719 15304 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:40.887403 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.872656 15302 rpcz_store.cc:276] 0709 13:11:39.605735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.612453 (+  6718us) service_pool.cc:224] Handling call
0709 13:11:39.612835 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.613263 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.613295 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.613834 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.871165 (+257331us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:39.871237 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.878938 (+  7701us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.819223 (+940285us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f5095fc85 00007f2f509606a2 00007f2f536d21db 00007f2f536cdaaf 00007f2f536c186e 00007f2f536c0bb6 00007f2f536c07d8 00007f2f536ca221 00007f2f536ca1d9 00007f2f536ca169
0709 13:11:40.856838 (+ 37615us) raft_consensus.cc:1685] finished
0709 13:11:40.856865 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.870449 (+ 13584us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1929,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":7105408,"thread_start_us":233915,"threads_started":1,"wal-append.queue_time_us":425293}
I20260709 13:11:40.890635 15308 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:40.891068 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.891623 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.891736 15302 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:40.892680 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.892802 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.894985 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.897750 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.898321 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.893538 15304 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:40.872545 23081 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:40.904208 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 55463us
I20260709 13:11:40.901779 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.904903 15301 raft_consensus.cc:2410] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:11:40.908579 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:40.909214 15274 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.875905 23242 raft_consensus.cc:2804] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:40.911680 15300 raft_consensus.cc:1240] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: []
W20260709 13:11:40.918649 15274 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.913451 23302 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:40.914546 23193 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:40.876264 23243 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:40.921672 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:40.925420 15274 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.930789 23305 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:40.931308 23305 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.931675 23305 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:40.918222 23242 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.937697 23242 raft_consensus.cc:3060] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:40.930802 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:40.943156 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.945421 23164 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:40.949905 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.942817 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:40.950718 15303 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
I20260709 13:11:40.926379 23193 consensus_queue.cc:1243] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:40.954598 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:40.956718 23164 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:40.952781 23129 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:40.971040 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:40.972510 23194 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.977504 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:40.962205 23164 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.929946 23243 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:40.967914 23081 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:40.995568 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:40.996646 15307 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:40.969485 23233 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:40.974520 23299 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:41.001569 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:40.975183 23129 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.008685 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:41.011291 15304 raft_consensus.cc:2410] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:11:40.982926 23285 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:40.984105 23164 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.001876 23081 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.002724 23234 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:41.030516 23082 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.016719 23129 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:40.984337 23194 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.033716 23234 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.049008 23234 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:41.011405 23233 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.055333 23233 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.014716 23299 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.028472 23127 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:41.056836 23127 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:41.055897 23305 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.058127 23299 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.057979 23127 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:41.049180 23307 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:11:41.069335 23297 log.cc:927] Time spent T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.364s	user 0.003s	sys 0.000s
I20260709 13:11:41.028290 23081 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:41.039211 15307 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:41.060645 23305 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.087301 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:41.078940 15307 raft_consensus.cc:1275] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:41.084493 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:41.084941 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.031436 23222 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.031209 23190 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:41.101042 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:41.098731 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.105674 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.105939 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.111011 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.112097 15374 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:41.116701 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:41.117797 15307 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.031788 23229 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:11:41.135303 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:41.094547 23233 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:41.103917 22741 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:41.106411 23227 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:41.125887 23305 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.173812 15307 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:41.176322 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.179706 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:41.107017 23222 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.152079 23310 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.194124 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.206900 23234 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.175004 23181 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:41.180299 22741 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:41.230343 15299 raft_consensus.cc:2393] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:41.177608 23285 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:41.232717 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 129038us
I20260709 13:11:41.193895 23067 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:41.223120 23246 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:41.243454 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 142509us
I20260709 13:11:41.252035 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:41.254096 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:41.254825 15974 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.254926 16002 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:41.231217 23190 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:41.256094 23190 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.258807 23190 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:41.152987 23233 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.177253 23227 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.188916 23305 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.245250 23181 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.251950 23222 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.288059 23197 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.233767 23299 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:41.248649 23243 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.218380 23310 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.245956 23313 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:41.262966 23067 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:41.322744 23082 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:41.360154 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 186494us
W20260709 13:11:41.318089 23271 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:11:41.380851 15306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50788 (request call id 4379) took 1775 ms. Trace:
I20260709 13:11:41.381634 15306 rpcz_store.cc:276] 0709 13:11:39.604990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.631688 (+ 26698us) service_pool.cc:224] Handling call
0709 13:11:39.632046 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:40.543619 (+911573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.380396 (+836777us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54003e21d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:41.380745 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048270720}
W20260709 13:11:41.401463 15123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 101) took 41458 ms (client timeout 15000 ms). Trace:
W20260709 13:11:41.402273 15123 rpcz_store.cc:269] 0709 13:10:59.948982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.006294 (+ 57312us) service_pool.cc:224] Handling call
0709 13:11:41.401336 (+41395042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.148443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.227439 (+ 78996us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.227502 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:11:38.227530 (+    28us) tablet.cc:662] Decoding operations
0709 13:11:38.260483 (+ 32953us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.260604 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.260639 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:38.261372 (+   733us) tablet.cc:701] Row locks acquired
0709 13:11:38.261425 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:11:38.261627 (+   202us) write_op.cc:270] Start()
0709 13:11:38.261809 (+   182us) write_op.cc:276] Timestamp: P: 1783602698261543 usec, L: 0
0709 13:11:38.261835 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.288665 (+ 26830us) log.cc:844] Serialized 2515 byte log entry
0709 13:11:38.701884 (+413219us) op_driver.cc:464] REPLICATION: finished
0709 13:11:39.018796 (+316912us) write_op.cc:301] APPLY: starting
0709 13:11:39.027539 (+  8743us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:39.090449 (+ 62910us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:39.090591 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:39.239580 (+148989us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:39.273698 (+ 34118us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:11:39.279386 (+  5688us) write_op.cc:312] APPLY: finished
0709 13:11:39.279714 (+   328us) log.cc:844] Serialized 65 byte log entry
0709 13:11:39.279924 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:39.280084 (+   160us) write_op.cc:454] Released schema lock
0709 13:11:39.280141 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:39.280661 (+   520us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:39.280700 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1307114,"reported_tablets":18,"spinlock_wait_cycles":3968,"child_traces":[["op",{"apply.queue_time_us":252787,"apply.run_cpu_time_us":13549,"apply.run_wall_time_us":268978,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29183,"num_ops":6,"prepare.queue_time_us":396749,"prepare.run_cpu_time_us":16956,"prepare.run_wall_time_us":313361,"raft.queue_time_us":107924,"raft.run_cpu_time_us":10590,"raft.run_wall_time_us":239940,"replication_time_us":419675,"thread_start_us":689653,"threads_started":4,"wal-append.queue_time_us":219083,"wal-append.run_cpu_time_us":22421,"wal-append.run_wall_time_us":1770549}]]}
I20260709 13:11:41.410741 15306 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:41.247968 23246 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.261293 23285 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.431159 15303 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:41.436254 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.356627 23234 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.440721 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.445426 15376 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:41.453080 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.453831 15378 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
I20260709 13:11:41.347466 23197 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.459187 15381 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:41.447753 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:41.462700 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:41.442167 23242 consensus_meta.cc:287] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.504s	user 0.014s	sys 0.000s
I20260709 13:11:41.441967 23194 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.451112 23258 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.354775 23299 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.476831 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.417162 23082 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.512821 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.513648 15376 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
W20260709 13:11:41.514210 23318 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:11:41.507985 23181 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:41.516646 23181 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:41.517439 23181 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.519809 23181 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:41.469040 23127 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:41.524950 23127 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.484844 23097 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:41.529678 23097 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.512184 23164 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.535396 23299 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:41.537307 23321 log.cc:927] Time spent T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:41.539561 23285 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:41.358438 22741 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.541587 23310 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.542882 23227 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:41.527972 23127 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.535332 23164 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:41.545713 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 98054.5us
I20260709 13:11:41.550390 23226 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:41.543998 23181 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.486068 15375 raft_consensus.cc:2410] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:11:41.554723 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.557111 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.463584 15378 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:41.552887 23226 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:41.560860 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:41.473595 23242 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.563163 15302 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:41.545032 23190 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:41.570015 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 204530us
I20260709 13:11:41.626065 23233 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:41.647284 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:41.550642 23254 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.621035 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:41.750581 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.615614 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:41.615471 23305 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.566149 23226 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:41.617811 23242 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.575237 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:41.768406 15299 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:41.574162 23154 consensus_queue.cc:1059] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:11:41.570816 23127 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.563836 23181 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:41.582669 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.775029 15381 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 17.
I20260709 13:11:41.622546 23097 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:41.486878 23258 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.575268 23190 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:41.649855 23332 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:41.569068 23246 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:41.675412 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:41.790248 15375 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.759543 22955 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.482612 23067 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.678529 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.684286 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:41.794993 15307 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:41.586491 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:41.687680 15999 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:41.690205 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:41.728125 23328 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:41.722114 15273 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:41.800426 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 78420.6us
I20260709 13:11:41.801219 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:41.733029 23197 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.819674 15373 raft_consensus.cc:2410] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 13:11:41.804064 23129 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.732s	user 0.016s	sys 0.000s
I20260709 13:11:41.819651 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:41.749890 15302 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 25.
W20260709 13:11:41.601208 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 51194.7us
I20260709 13:11:41.576232 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:41.757265 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:41.769721 15300 pending_rounds.cc:85] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 10
I20260709 13:11:41.822759 15300 pending_rounds.cc:107] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 22.11
W20260709 13:11:41.718660 23081 consensus_meta.cc:287] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.003s
I20260709 13:11:41.823120 15300 raft_consensus.cc:2889] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.780372 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.824311 15304 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.824396 15381 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:41.796279 15382 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.797080 15308 raft_consensus.cc:2468] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:41.797534 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:41.768471 23243 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:41.817938 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:41.826964 15379 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:41.782488 23154 consensus_queue.cc:1243] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:11:41.829262 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 72121.3us
I20260709 13:11:41.830205 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:41.818572 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:41.818760 15273 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:41.825830 15196 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:41.834964 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:41.841559 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:41.842877 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:41.837106 15196 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:41.848095 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:41.828887 23129 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.851567 23085 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:41.853590 23129 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.854424 23075 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:41.768110 23254 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.785569 23127 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.872432 15375 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:41.822925 23229 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:41.877758 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:41.877887 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:41.879770 15381 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:41.884963 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:41.833215 23242 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:41.821689 23336 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:41.849520 23193 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:41.858116 23335 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:41.849296 23233 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:41.839862 23154 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:41.818392 22955 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.908955 23085 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:41.865964 23227 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:41.933202 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.907919 23129 raft_consensus.cc:2804] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:41.833861 23081 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:41.839610 23243 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.944216 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:41.927019 23325 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:41.913234 23242 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.823140 23328 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:41.925146 23193 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.971716 15301 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:41.925189 15379 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 25.
I20260709 13:11:41.975841 16001 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 12: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:41.979871 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.980278 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:41.981249 15379 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:41.982316 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:41.983623 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:41.946177 15348 connection.cc:256] RPC call timeout handler was delayed by -1.1007386419998966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:11:41.968483 23129 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.917853 23338 consensus_queue.cc:1048] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:11:41.968457 23085 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 25 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:41.974181 15304 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:42.002969 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:41.976029 23097 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.977178 23242 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:42.017375 15381 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:42.017354 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.016239 15301 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:41.980432 23193 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:41.978161 23261 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.003417 23197 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:42.064549 15373 raft_consensus.cc:2393] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf in current term 16: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:42.082644 15303 raft_consensus.cc:1275] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:42.054780 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.018201 23190 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:42.052433 23075 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.055729 23129 raft_consensus.cc:3060] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.026268 23243 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:42.003569 23194 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.098016 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.058597 23322 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:42.015980 22955 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.014539 23081 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:41.981180 23325 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:42.104054 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 49425.5us
I20260709 13:11:42.088966 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.067171 23258 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.065816 23247 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
W20260709 13:11:42.112498 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 223069us
I20260709 13:11:42.079298 23330 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:42.125094 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.117664 23164 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:42.134101 15379 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 11.
I20260709 13:11:42.075387 23097 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.100210 23075 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.166116 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.091583 23197 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.134806 23330 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.124107 23081 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:42.176970 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.185314 16008 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:42.181133 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.088277 23261 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.106618 23194 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.189040 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:42.166749 23337 log.cc:927] Time spent T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.261s	user 0.002s	sys 0.000s
I20260709 13:11:42.152174 23338 raft_consensus.cc:2764] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:42.195138 23325 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:42.196048 23127 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.202519 23075 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.244953 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.169064 23221 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:42.214028 23194 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.168164 23254 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.139991 23164 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.216440 23085 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.217233 23330 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.218575 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:42.280361 15304 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:42.219023 23197 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.220217 23305 raft_consensus.cc:3055] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:42.250499 23325 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.224697 23082 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.226225 23328 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.323436 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.326984 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.325239 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:42.239418 15382 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:42.118516 23322 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.131168 23247 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.352752 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.354102 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.245368 23226 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.246383 16005 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:42.210156 23097 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.187631 23234 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.369318 23234 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.370684 23097 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:42.371804 23234 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:42.221083 23341 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:42.299247 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.310072 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.312269 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.322337 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.340049 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:42.378289 23213 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:42.379093 23213 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:42.381165 15196 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:42.383821 23213 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.341424 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:42.344996 23075 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.351159 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.300477 23305 raft_consensus.cc:740] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:42.297374 23254 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.350348 23110 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:42.394910 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 53597.3us
I20260709 13:11:42.258813 23221 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.371583 23097 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.401407 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:42.403453 15304 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
W20260709 13:11:42.408833 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 296856us
I20260709 13:11:42.407511 15306 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:11:42.347220 23329 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:42.410591 15196 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:42.398610 23245 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:42.416291 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 413393us
I20260709 13:11:42.400776 23261 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.336964 23325 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.399863 23319 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:42.428236 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.413043 23347 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:42.428642 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 292829us
I20260709 13:11:42.408493 23181 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:42.402990 23254 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.419473 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.465093 15304 raft_consensus.cc:2468] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:42.400434 23075 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.431991 23310 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:42.457119 23347 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.437408 15348 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.459554 23245 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:42.461061 23322 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.484922 15348 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:42.416875 23329 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.459134 23193 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:42.512070 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74699.2us
W20260709 13:11:42.514755 15348 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.515334 15348 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:42.481472 23226 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.479681 23347 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:42.519064 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.442442 23305 consensus_queue.cc:260] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.521529 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:42.520378 23348 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:42.523216 23358 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.523902 23358 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.524721 23254 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:42.525189 23351 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:11:42.525403 23254 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:42.526046 23254 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.526624 23358 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:42.533527 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 69821.3us
W20260709 13:11:42.555377 15348 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.557964 15348 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:42.561729 15348 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.513567 23366 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.563957 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.562570 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:42.509830 23129 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.621887 23381 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:42.559226 23181 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:42.550660 23254 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.553700 23164 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.564071 23221 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.575904 23328 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:42.614255 23097 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.614926 23372 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:42.615437 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:42.532270 23226 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:11:42.617040 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 55380.9us
W20260709 13:11:42.658744 15348 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.659408 15348 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:42.618579 23310 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:42.619818 23370 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.622334 23129 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.582453 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.625636 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:42.632447 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 66930.5us
I20260709 13:11:42.593078 23247 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:42.627588 23355 log.cc:927] Time spent T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:42.624768 23325 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:42.665831 15348 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.648320 23330 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:42.666682 23370 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.660699 23372 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.673484 23348 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:42.562474 23067 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:11:42.674407 23366 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:42.657879 23350 log.cc:927] Time spent T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:11:42.681386 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 179091us
I20260709 13:11:42.579377 23245 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.703250 15198 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.705245 23067 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:42.705595 15198 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.706995 23067 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.707469 23067 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.707858 23067 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.688858 23097 consensus_queue.cc:1048] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:11:42.712321 23310 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.714267 23193 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.638031 23381 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.722626 23381 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:42.723942 23242 consensus_meta.cc:287] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.002s
W20260709 13:11:42.682791 15348 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.692713 23330 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.727833 23330 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:42.729504 15348 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.729967 23372 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:42.730674 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:42.731316 15348 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.712779 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.735653 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.664157 23226 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.625952 23360 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:42.662199 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.745401 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:42.749289 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:42.750079 15376 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:42.750247 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.748153 15198 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:42.754189 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.755832 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:42.757628 15348 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.766844 15198 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.768951 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.769934 15381 raft_consensus.cc:2410] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:11:42.773068 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.744850 23164 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:42.789978 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.763339 23247 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.757967 23377 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.795091 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.772804 23254 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.744755 23242 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.797399 23360 raft_consensus.cc:3060] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:42.805824 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:42.803144 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 141455us
I20260709 13:11:42.806679 15373 raft_consensus.cc:2468] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:42.808084 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.809067 15373 raft_consensus.cc:2410] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0f9eceec749442cb9a06c87f00f3caf for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:11:42.806783 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 137728us
I20260709 13:11:42.809535 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.811991 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.813349 16008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.813640 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.818445 16000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.812507 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
W20260709 13:11:42.821659 14097 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:42.834659 23347 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.838001 23181 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.840718 23181 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.843228 23181 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:42.824651 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:42.848759 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.849445 23348 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:42.850736 23348 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:42.851063 23348 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:42.853988 23377 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:42.854751 23377 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:42.866670 15376 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:42.865104 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:42.874244 15375 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:11:42.876664 15198 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.877903 16003 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:42.862457 15374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54656 (request call id 4215) took 1287 ms. Trace:
W20260709 13:11:42.881343 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59363.4us
I20260709 13:11:42.860754 23377 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.883384 23310 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.863034 23347 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.883407 16002 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:42.889295 23384 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:42.913744 23384 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.914050 23067 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.891644 15122 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 15 to 18, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 18 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.863335 23226 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:42.859771 23097 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:42.916332 15122 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:42.860015 23242 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.878638 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.918676 23384 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.918191 15122 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:42.918869 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.916905 23097 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:42.912221 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.917090 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:42.932068 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 83414.8us
I20260709 13:11:42.941021 15373 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:42.943390 15381 raft_consensus.cc:1275] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:42.943395 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:42.944748 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 58771.6us
I20260709 13:11:42.946291 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.906890 15374 rpcz_store.cc:276] 0709 13:11:41.668474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.674504 (+  6030us) service_pool.cc:224] Handling call
0709 13:11:41.674982 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:41.793411 (+118429us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:42.119252 (+325841us) log.cc:844] Serialized 14 byte log entry
0709 13:11:42.464271 (+345019us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:42.472500 (+  8229us) log.cc:844] Serialized 26 byte log entry
0709 13:11:42.533326 (+ 60826us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:42.533696 (+   370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.836644 (+302948us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400218c54. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:42.836698 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.845755 (+  9057us) raft_consensus.cc:1685] finished
0709 13:11:42.862215 (+ 16460us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.862384 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":386065,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":494,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":27777,"spinlock_wait_cycles":271185280,"thread_start_us":629617,"threads_started":2,"wal-append.queue_time_us":579327}
I20260709 13:11:42.920298 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.950477 15274 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:42.957156 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.955873 15375 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 13.
I20260709 13:11:42.966322 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:42.969301 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:42.965368 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 48373.4us
I20260709 13:11:42.974144 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.920576 23242 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.977973 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:42.978899 23330 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:42.938331 23075 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:42.957540 23310 raft_consensus.cc:2804] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:42.985031 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.981982 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.968597 23226 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:42.965211 23335 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.982599 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.967773 15348 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:42.997474 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.980708 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.968297 23197 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.967914 23181 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:42.971993 23357 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:42.995042 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:42.994581 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:42.998185 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
I20260709 13:11:43.012177 15380 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 15: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:43.004874 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.013047 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:43.016765 15375 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:42.924086 23360 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:43.018435 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.017228 15377 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:42.989164 23310 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.043262 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.036865 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:43.027698 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:43.045469 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.046586 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.047783 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.050022 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.002532 23385 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:43.057545 15306 raft_consensus.cc:2468] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:43.010090 23067 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.054056 23324 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:43.026022 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.041997 15345 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:43.028966 23234 raft_consensus.cc:2804] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:43.092747 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.099115 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:43.099797 15374 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.050904 23310 raft_consensus.cc:3060] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:43.088764 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.102914 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:43.108867 15198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.061030 23381 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:43.113955 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:43.114868 15381 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.115538 23348 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.010654 23335 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.119108 23335 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.094137 23234 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.090015 23325 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:43.120496 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83821.4us
I20260709 13:11:43.098402 23385 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:43.143929 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:43.132298 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:43.136387 23226 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:43.133118 15273 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:43.145916 23325 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.152096 23226 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:43.087692 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45913.9us
I20260709 13:11:43.154681 23325 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:43.130295 15381 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:43.157866 23396 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.102336 15122 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 23, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 23 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.162725 23396 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.161782 15377 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:43.172442 15299 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:43.131785 23234 raft_consensus.cc:3060] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:43.172714 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.128055 23299 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:43.178262 15308 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.144441 23385 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.142722 23348 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:43.182137 15374 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:43.120491 23381 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.092649 23324 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.174479 23392 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:43.205600 23388 log.cc:927] Time spent T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:43.207152 15373 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:43.214334 23097 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:43.216658 23324 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.217700 15302 raft_consensus.cc:2468] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 14.
I20260709 13:11:43.225379 16001 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:11:43.231437 23305 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:43.196146 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:43.190042 23325 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:43.176626 15122 catalog_manager.cc:5697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 8 to 15, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 15 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.159933 23395 consensus_queue.cc:1048] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:11:43.195510 15974 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:43.242849 15974 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:43.244328 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 51409.6us
I20260709 13:11:43.184428 23385 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:43.236553 15306 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.239631 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.246454 15304 raft_consensus.cc:2468] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:43.259753 15373 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:11:43.267071 23352 log.cc:927] Time spent T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.746s	user 0.004s	sys 0.000s
I20260709 13:11:43.269155 15300 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:43.270232 23081 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.270819 23081 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.253611 23346 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:43.274341 15306 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:43.276643 15304 raft_consensus.cc:1240] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:11:43.277078 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.275287 15196 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:43.277742 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.283463 15304 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:43.239570 23324 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:11:43.290212 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.296981 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:43.297842 15300 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:43.301745 15307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50774 (request call id 3095) took 1220 ms. Trace:
I20260709 13:11:43.302281 15307 rpcz_store.cc:276] 0709 13:11:42.081296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.081522 (+   226us) service_pool.cc:224] Handling call
0709 13:11:42.087861 (+  6339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.400489 (+312628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.400525 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:42.400578 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:42.400613 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:43.301451 (+900838us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540006bdd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b26e01 00007f2f53b2583e 00007f2f58aea419 00007f2f52061bd4 00007f2f52061b62 00007f2f52061a91 00007f2f52061a0c 00007f2f52060cc2 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:43.301513 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:43.301672 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718330752}
I20260709 13:11:43.303639 23164 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:43.307768 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:43.311142 23383 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:43.312309 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:43.321658 15379 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:43.343670 23081 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:43.348658 23384 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:43.349233 23384 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:43.349913 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:43.350211 23384 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.351986 23384 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:43.356940 15373 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:43.289587 23067 raft_consensus.cc:2804] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:43.359115 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 187978us
I20260709 13:11:43.255854 23325 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.364529 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:43.367090 15273 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:43.372988 15373 raft_consensus.cc:1240] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:43.377871 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:43.379678 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:43.377588 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 78751.3us
I20260709 13:11:43.384295 15196 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:43.384822 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:43.387471 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.388491 15303 raft_consensus.cc:1240] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Rejecting Update request from peer 0ec140f610ed4500ba58208c0e5519bb for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:43.365800 23067 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:43.391743 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:43.379479 23357 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:43.391676 22741 raft_consensus.cc:2804] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:43.401156 22741 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.401556 22741 raft_consensus.cc:3060] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:43.402956 23325 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:43.406996 23193 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:43.408188 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.376670 23227 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:43.411636 15300 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:43.386921 23379 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:43.397630 23081 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:43.478184 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.434293 23357 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
W20260709 13:11:43.504114 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 118814us
W20260709 13:11:43.506875 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 115226us
I20260709 13:11:43.511396 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:11:43.498687 15273 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.514672 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.512161 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:43.515591 15374 raft_consensus.cc:2393] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate b0f9eceec749442cb9a06c87f00f3caf in this term.
I20260709 13:11:43.513865 15196 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:43.513681 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.527794 15198 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:43.549988 15308 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:43.400216 23067 raft_consensus.cc:3060] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:43.520242 23227 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.553624 15196 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:43.533919 23081 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:43.509019 23366 consensus_queue.cc:1059] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:11:43.534262 23256 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:43.538965 23258 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:43.543857 23381 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:43.552498 23234 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.590242 23329 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:43.562266 23227 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.591542 23234 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.524885 23194 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:11:43.592736 23227 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.593348 23227 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:43.576882 23258 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.584833 23385 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.574966 23366 raft_consensus.cc:3055] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:43.625459 23366 raft_consensus.cc:740] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:43.597568 23310 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.550887 23299 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.611187 23396 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.642272 23299 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:43.647375 22741 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.662009 23258 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.663421 22741 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.637113 23357 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.669471 23067 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.639951 23227 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.653245 23366 consensus_queue.cc:260] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.683951 23366 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:43.685089 23310 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.688710 23385 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:43.489146 15122 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 14 to 17, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 17 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:11:43.741120 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 139743us
W20260709 13:11:43.746809 15274 leader_election.cc:336] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:43.747831 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:43.749956 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 123338us
W20260709 13:11:43.751040 15274 leader_election.cc:336] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:43.751816 15274 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:43.754565 15274 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:43.754711 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:43.755913 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:43.757659 15348 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:43.758342 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:43.765161 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 217318us
W20260709 13:11:43.766290 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:43.766855 23067 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.779745 23329 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.781276 23329 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.783202 23322 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:43.784880 23335 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:43.798064 22741 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.809975 15122 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 18, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 18 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.815790 23338 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.817090 23227 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.820983 23320 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:43.822435 14097 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:43.822050 23320 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.824401 23385 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:43.825747 23385 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.830474 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.831156 22955 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:43.832649 22955 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.836228 22955 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:43.842530 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 77617us
I20260709 13:11:43.848467 23320 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:43.800047 22741 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:11:43.845933 15122 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 12 to 15, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:43.878494 23385 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:43.884362 23127 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.879746 15122 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 11 to 13, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:43.902494 23329 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:43.905049 23322 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.912065 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 145230us
I20260709 13:11:43.914047 23067 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:43.915056 23067 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:43.903846 15122 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 17 to 21, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 21 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:43.921063 23081 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:43.925233 23081 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.930501 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.931402 15379 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:43.934890 22955 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:43.936121 22955 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:43.934301 23067 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:43.943840 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 189464us
I20260709 13:11:43.915784 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:43.932312 15122 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 11 to 13, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 13 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:11:43.945703 15274 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:43.975620 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 428408us
I20260709 13:11:43.976470 15274 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:43.980738 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65262.5us
I20260709 13:11:43.947495 23322 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:43.982187 23419 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:43.982695 15122 catalog_manager.cc:5697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 14 to 20, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 20 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:43.986052 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:43.989296 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:43.988502 15348 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 110 similar messages]
I20260709 13:11:43.947147 23127 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.003703 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.004882 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.005476 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.006731 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:44.007409 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:44.009532 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 63951.8us
W20260709 13:11:44.011308 15274 leader_election.cc:336] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:44.011637 23127 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.011898 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.012542 23258 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.012897 15308 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 19: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:44.018263 15376 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 23.
I20260709 13:11:44.020596 23419 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:44.025880 15122 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 18, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 18 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:44.021229 15347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.026222 23419 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.015811 22955 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.024077 23322 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.036777 15379 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:44.031049 23258 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:44.042227 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:44.043473 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 489772us
W20260709 13:11:44.050127 15274 leader_election.cc:336] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:44.050875 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.053997 23258 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:44.056298 15307 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:44.057689 15305 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:44.065006 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.068884 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:44.073215 15274 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:44.073864 15274 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.074218 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.075592 15299 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:44.080025 23085 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:11:44.096773 23417 consensus_queue.cc:1059] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:44.099244 23082 raft_consensus.cc:3055] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:44.099911 23082 raft_consensus.cc:740] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:44.068027 23299 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.033768 23081 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:11:44.111896 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.123395 15379 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:44.113559 23258 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.140561 15122 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 12 to 15, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 15 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.131829 23082 consensus_queue.cc:260] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:44.147576 23082 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:44.157106 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 83978.1us
I20260709 13:11:44.161547 23416 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:44.162503 23416 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:44.164623 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
W20260709 13:11:44.169265 23421 log.cc:927] Time spent T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 13:11:44.172572 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:44.173859 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:44.175513 23227 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:44.176029 23227 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.176503 23227 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:44.176506 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.164456 23418 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:11:44.155840 23420 log.cc:927] Time spent T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.138s	user 0.000s	sys 0.004s
W20260709 13:11:44.160181 15274 leader_election.cc:336] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:44.191201 15274 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.199231 15122 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.201996 15122 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.205137 15122 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 11 to 14, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.206512 23075 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:11:44.209455 15122 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.212847 23324 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:44.213584 23324 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:44.213750 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.214139 23324 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:44.215306 15378 raft_consensus.cc:2410] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:11:44.217239 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.211970 15122 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.218168 15382 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:44.219843 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.221403 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:44.220290 15122 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.230170 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.232633 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:44.233780 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:44.234828 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:44.238200 15301 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:44.180686 23417 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.252010 15375 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:44.253016 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:44.254062 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:44.277364 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.255434 23416 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:44.264395 23324 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.290325 23402 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:44.290513 23324 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:44.291571 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 104415us
W20260709 13:11:44.309696 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 149569us
I20260709 13:11:44.310487 23404 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.311225 23404 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:44.312952 15274 leader_election.cc:336] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:44.314028 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 60093.5us
I20260709 13:11:44.314183 23404 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.314776 23381 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:44.316581 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:44.318262 23299 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.320703 15274 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.330178 23395 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:44.332195 23335 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.332968 23335 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.335891 23335 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.330878 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb
W20260709 13:11:44.338958 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 57642.5us
I20260709 13:11:44.340548 23154 raft_consensus.cc:2804] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:44.287696 23417 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:44.341101 23154 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:44.344157 23154 raft_consensus.cc:3060] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:44.344762 23417 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:44.346354 23395 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:44.346905 23395 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:44.348012 15348 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:44.346460 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52967.1us
I20260709 13:11:44.349291 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:44.349741 15348 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:44.350334 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.350400 23335 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:44.352916 23335 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:44.354851 23335 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:44.356544 23416 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:44.356729 23418 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:44.362905 15122 catalog_manager.cc:5697] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.364813 15122 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 9 to 17, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 17 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:44.357595 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:44.371549 23397 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:44.372501 23397 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.373111 23397 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:44.380955 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:44.382124 23381 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:44.385033 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:44.389412 23366 consensus_meta.cc:287] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.013s
I20260709 13:11:44.390475 15379 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:11:44.390978 15379 pending_rounds.cc:85] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Aborting all ops after (but not including) 11
I20260709 13:11:44.391234 15379 pending_rounds.cc:107] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:11:44.391541 15379 raft_consensus.cc:2889] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.392783 23322 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:44.393167 15373 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:11:44.394511 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 81649.4us
W20260709 13:11:44.410132 15274 leader_election.cc:336] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:44.410709 15274 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:44.410863 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:44.402437 23404 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:44.400075 23417 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.410946 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:44.415606 23404 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:44.415699 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.418255 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.406757 22741 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:44.411590 23322 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:44.418983 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.427158 15377 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:44.415592 23366 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:44.430469 23366 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.430898 23366 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:44.434307 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.423188 23417 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.368315 15122 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 9 to 16, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 16 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.439317 23417 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.439498 15307 raft_consensus.cc:1240] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:44.438486 15122 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 10 to 16, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 16 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.439945 23417 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.434521 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.449800 23227 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.450043 23397 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.452677 15308 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:11:44.456477 15198 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:44.445525 15306 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:44.485750 22741 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:44.485327 15122 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 7 to 9, term changed from 12 to 14, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:44.487092 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.452246 23227 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:44.486837 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 199605us
I20260709 13:11:44.486835 23154 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.493516 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.498090 15308 raft_consensus.cc:1240] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:11:44.503362 23366 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:44.505339 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 59683.2us
I20260709 13:11:44.507680 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:44.508612 23082 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:44.458422 23335 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.517043 15377 raft_consensus.cc:2468] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 23.
I20260709 13:11:44.518702 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.519397 15382 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 18.
I20260709 13:11:44.490545 23397 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.461956 23417 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.508641 23395 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:44.523409 23154 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.532722 15306 raft_consensus.cc:1240] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:44.534723 15381 raft_consensus.cc:1240] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:11:44.534812 23404 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:44.537147 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:44.538141 15308 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:44.549382 23417 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:44.678967 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 214480us
W20260709 13:11:44.677531 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 118677us
I20260709 13:11:44.686509 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:44.694445 15273 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:44.691262 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.663658 22741 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:44.664115 23320 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:44.686117 23418 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:44.714846 23110 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:44.720944 23110 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:44.723555 23110 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.719931 15308 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:44.716790 23381 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:44.740969 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:44.741838 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.765208 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.896529 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.902298 23395 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:44.823026 14097 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:44.916034 23335 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.732281 23418 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:44.924594 23418 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:44.734284 23402 raft_consensus.cc:2804] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:44.776613 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:44.743957 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:44.742399 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 52334.3us
I20260709 13:11:44.770622 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:44.777664 15382 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:11:44.996526 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 275122us
I20260709 13:11:44.949944 15300 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:11:44.760808 23428 log.cc:927] Time spent T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.272s	user 0.000s	sys 0.002s
I20260709 13:11:44.793588 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:45.008287 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:45.009747 23443 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:45.009692 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:45.010594 23443 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.011049 22741 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.011260 23443 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:45.014158 23417 consensus_queue.cc:1059] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:45.015875 23417 raft_consensus.cc:3055] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:45.016458 23417 raft_consensus.cc:740] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:45.017556 23417 consensus_queue.cc:260] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.021924 23417 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:45.028905 23075 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.029475 23075 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.031680 23075 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.004166 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:44.779098 22955 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.044020 15375 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:44.750159 23366 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:45.042766 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:45.046257 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 51911.8us
W20260709 13:11:45.046744 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 279268us
I20260709 13:11:45.056763 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.749912 23445 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.299s
I20260709 13:11:45.048508 15382 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:45.051120 23258 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:45.052788 15308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.054728 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:44.768522 23381 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.055287 23442 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:45.055796 15306 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:11:45.085361 15306 pending_rounds.cc:85] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 8
I20260709 13:11:45.085659 15306 pending_rounds.cc:107] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:11:45.085901 15306 raft_consensus.cc:2889] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.724308 23110 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.330s
I20260709 13:11:44.754683 23329 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:45.088671 23329 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.046254 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.048580 15379 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:45.057390 23322 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:45.057471 23335 raft_consensus.cc:493] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:45.091833 23335 raft_consensus.cc:515] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.091708 23322 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.094460 23335 leader_election.cc:290] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.095414 23075 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.095505 23443 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.096051 23075 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.098172 23075 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.098443 23258 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.100883 23258 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.101192 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:44.994407 23437 log.cc:927] Time spent T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:11:45.102041 23322 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:44.762567 23320 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.104303 23320 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:45.104579 23067 consensus_queue.cc:1059] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:45.105967 23067 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:45.106832 23067 raft_consensus.cc:3055] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:45.107230 23067 raft_consensus.cc:740] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:45.107584 23443 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.001624 23402 raft_consensus.cc:697] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 23 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:45.112020 23418 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:45.112840 23402 consensus_queue.cc:237] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.117341 23085 consensus_queue.cc:1059] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:45.118287 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:45.119040 15379 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:45.062304 23082 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:45.086469 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 293071us
I20260709 13:11:45.101437 23416 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.056802 22955 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.118638 23085 raft_consensus.cc:3055] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:45.139153 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.139987 16003 raft_consensus.cc:2468] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:45.140668 23329 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.142910 22955 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.145323 15999 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:45.137987 23227 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.148989 23227 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.150110 23442 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.151607 23227 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.159987 15196 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:45.165498 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:45.135062 23085 raft_consensus.cc:740] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:45.172636 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.184274 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:45.125480 23419 consensus_queue.cc:1059] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:11:45.187592 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.190145 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.155705 23442 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.186936 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.108279 23067 consensus_queue.cc:260] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.198071 15376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.155022 23443 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
W20260709 13:11:45.205542 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 123423us
I20260709 13:11:45.164952 23416 consensus_queue.cc:1059] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:11:45.214143 15274 leader_election.cc:336] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.189811 23081 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:45.228745 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.232010 15377 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 13.
I20260709 13:11:45.198004 23075 raft_consensus.cc:2804] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:45.226433 15274 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.236601 15974 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.244582 15974 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.250047 15273 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:45.231307 22741 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:45.257194 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.266327 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.268803 23335 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:45.268946 23127 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:45.269696 23127 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.270108 23127 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:45.238787 23075 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:45.272415 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.272621 23075 raft_consensus.cc:3060] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:45.268220 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 77812.7us
I20260709 13:11:45.245599 23381 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.277978 15374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.249485 23081 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:45.261933 23446 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.295461 15374 raft_consensus.cc:2393] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:45.295526 15381 raft_consensus.cc:2393] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 16: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:45.225911 23085 consensus_queue.cc:260] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.298492 15377 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
W20260709 13:11:45.306618 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 92501.1us
I20260709 13:11:45.313477 15999 raft_consensus.cc:2468] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:45.289079 23320 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:45.274245 23418 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:11:45.292466 23445 raft_consensus.cc:3055] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:45.308367 15274 leader_election.cc:336] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.321885 15274 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.326579 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 90016.3us
I20260709 13:11:45.291455 23081 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:45.332459 23450 log.cc:927] Time spent T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:11:45.333374 23081 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.339401 23067 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:45.299654 23446 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.342705 23448 raft_consensus.cc:3055] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:45.343207 23448 raft_consensus.cc:740] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:45.343328 23446 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.348455 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.350714 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.352476 23227 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:45.323359 23445 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:45.354686 23445 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.360149 23445 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:45.330446 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:45.427302 15379 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:45.362673 15974 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.443816 15974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 81161.7us
I20260709 13:11:45.457130 15381 raft_consensus.cc:1240] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 13:11:45.450747 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.467447 15348 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.468472 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.470140 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.470986 23381 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.468078 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.471920 16003 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 13.
W20260709 13:11:45.472214 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.473016 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.473717 23381 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:45.475066 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.475485 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.476318 23381 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:45.477514 15348 leader_election.cc:336] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.478067 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.478771 23329 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:45.479997 15348 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.484596 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.485253 15974 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.483788 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.491782 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 262451us
W20260709 13:11:45.497258 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 188934us
I20260709 13:11:45.344146 23448 consensus_queue.cc:260] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:45.500258 15274 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.511180 15274 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.517670 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.499032 23329 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:45.517681 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.515655 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:45.519462 15302 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:45.518009 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.520665 15306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.520973 15303 raft_consensus.cc:2468] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
W20260709 13:11:45.518021 15348 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.523484 15300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.523690 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.517948 23085 raft_consensus.cc:3060] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:45.524542 23329 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:45.525043 15348 leader_election.cc:336] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.525445 15348 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.527297 15307 raft_consensus.cc:1240] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Rejecting Update request from peer b0f9eceec749442cb9a06c87f00f3caf for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:45.527547 23329 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:45.532574 15302 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:45.502298 23320 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.555307 15198 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:45.573295 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 73046.1us
W20260709 13:11:45.575568 15274 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.585184 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.594242 23463 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.594941 23463 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.564632 23335 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:45.611745 15274 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.614573 15974 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.573699 23458 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:45.617201 15974 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.618589 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.616521 15274 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.619530 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 92984.4us
I20260709 13:11:45.629524 23463 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.566179 23075 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.616914 23227 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:45.575814 23127 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.637833 23335 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:45.638458 23335 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.645860 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:45.647178 23466 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:45.647807 23456 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:45.649864 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.652942 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:45.634680 23468 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:45.660686 15348 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.637110 23463 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.672425 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd2d399eb3d45818234b2fb03159dbe" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.672793 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.680847 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.688155 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.689507 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.689718 23075 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.689905 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7b07c0f0a5432f94b6b20964332362" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:45.694718 23335 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.664522 22955 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:45.719744 15274 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.851939 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 208674us
W20260709 13:11:45.853930 15348 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.854326 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.679729 23381 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:45.681082 23397 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:45.845402 23082 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:45.861531 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 141817us
W20260709 13:11:45.870348 15274 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.871641 15274 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.873423 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.874859 15274 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.876106 15274 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.876664 15274 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.878189 15274 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.879455 15274 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.681604 23463 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.880193 15274 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.890219 15274 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.893354 15348 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.893860 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.896016 15999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46148 (request call id 752) took 1176 ms. Trace:
I20260709 13:11:45.878554 23227 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:45.896445 15999 rpcz_store.cc:276] 0709 13:11:44.734463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.740722 (+  6259us) service_pool.cc:224] Handling call
0709 13:11:45.895793 (+1155071us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54004ecfd4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a8f571 00007f2f53b2a2fa 00007f2f58aebb17 00007f2f520666d4 00007f2f52066662 00007f2f52066591 00007f2f5206650c 00007f2f520657c2 00007f2f51e6148c 00007f2f51e608c6 00007f2f51e6026f
0709 13:11:45.895930 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599155584}
I20260709 13:11:45.897698 23463 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:45.881781 23402 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:45.879492 23322 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:45.878998 23397 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.900736 16005 raft_consensus.cc:1240] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:45.901643 23397 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:45.907606 14097 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:45.912969 23127 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.920902 23381 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:45.922603 23467 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:45.923308 23467 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.924059 23329 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:45.924504 15348 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.924962 15348 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.873042 23458 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:45.890856 15274 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:45.936167 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.936498 23366 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.936712 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.938534 23381 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:45.937983 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.939862 15348 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.923979 23435 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:45.941043 23460 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.940804 23435 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.933283 23448 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:45.941547 23460 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:45.944278 23460 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:45.941461 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.944999 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.946043 23381 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.947583 23468 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:45.949098 23458 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.950433 23467 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:45.951197 23322 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:45.969468 23322 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:11:45.956991 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74844.9us
W20260709 13:11:45.961443 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 253759us
I20260709 13:11:45.940794 23366 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:45.971026 15274 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.973155 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.972803 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:45.974805 23484 raft_consensus.cc:2804] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:45.974972 23467 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:45.975315 23484 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:45.975827 23484 raft_consensus.cc:3060] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:45.975594 23467 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:45.976634 23127 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.978947 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:45.981108 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:45.983224 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:45.983494 23487 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:45.984277 22955 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:45.972240 23402 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.987171 15301 raft_consensus.cc:1240] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Rejecting Update request from peer 5c70ddb5aae14b059dc90fd40125b034 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:11:45.987805 23322 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:45.990535 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:45.990700 15274 leader_election.cc:304] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:45.991896 23443 consensus_queue.cc:1059] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:45.992542 23322 raft_consensus.cc:2749] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:45.992663 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:45.992784 23459 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:45.994043 23443 raft_consensus.cc:3055] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:45.994594 23443 raft_consensus.cc:740] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:45.995345 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:45.994087 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:45.997634 16001 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
W20260709 13:11:45.998927 15274 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.999504 15274 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.001530 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:46.003321 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:46.003922 15274 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.004567 15274 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:46.006415 15274 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.006925 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:46.008265 15274 leader_election.cc:336] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.008806 15274 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.016162 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:46.005158 23402 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.018815 23227 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:46.018725 23443 consensus_queue.cc:260] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.020047 23443 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.024966 15381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.026654 23467 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:45.998431 23322 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:11:46.027822 15382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:46.025414 15375 raft_consensus.cc:1275] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:46.029500 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.029994 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.030553 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:46.030993 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.031648 23436 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.032498 23436 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:46.032861 23436 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:46.033216 23436 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.015202 23468 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:46.036623 23227 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:46.037232 23227 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.039495 23227 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.041966 23436 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:46.043571 23335 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:46.043583 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.048026 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.032151 15348 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
W20260709 13:11:46.015364 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.028296 23322 raft_consensus.cc:3055] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:11:46.055428 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.056025 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:46.069841 15348 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.013594 23397 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.066080 15375 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:46.073547 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.077103 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:46.078045 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:46.079126 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.044169 23335 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.053121 23127 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:46.082304 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.070327 23467 raft_consensus.cc:2804] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:46.064811 23322 raft_consensus.cc:740] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:46.102051 23396 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:46.102499 23436 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:46.099445 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44007.5us
I20260709 13:11:46.056293 23466 consensus_queue.cc:1059] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:11:46.090466 23366 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.066419 23227 consensus_queue.cc:1059] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:11:46.109592 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.104745 23435 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:46.113556 15348 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:46.116181 15348 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.118310 23459 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:46.126077 23459 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.126569 23459 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.144870 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:46.145505 15120 maintenance_manager.cc:419] P 476e7efc84e541a3bd0f38661ad40403: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033356
W20260709 13:11:46.159950 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69918.6us
W20260709 13:11:46.160672 15199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 45304.3us
I20260709 13:11:46.162221 23460 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.162706 23460 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.109283 23467 raft_consensus.cc:697] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:46.165238 23467 consensus_queue.cc:237] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:46.167543 23458 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.168095 23458 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.170006 23335 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:46.182935 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 63229us
I20260709 13:11:46.172840 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:46.189662 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 75473.4us
I20260709 13:11:46.190994 15299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.170279 23458 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:46.189239 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.194154 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:46.193017 15348 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.122586 23381 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.207283 15196 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.111783 23396 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.269053 15196 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.245060 23417 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.207379 23484 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:46.289127 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.294828 23404 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:46.296219 23396 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.299429 23442 raft_consensus.cc:3055] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:46.299855 23442 raft_consensus.cc:740] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:46.300832 23442 consensus_queue.cc:260] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:46.302060 23442 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.312065 23396 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:46.312633 23488 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:46.312711 23396 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.314492 23417 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:46.326469 23484 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:46.314970 23396 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.305310 23459 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:46.338789 23459 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:46.345633 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:46.354562 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:46.361820 16005 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.376895 23322 consensus_queue.cc:260] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:46.378575 23322 raft_consensus.cc:3060] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:46.404109 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 215456us
I20260709 13:11:46.417814 16005 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:46.411834 15274 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:46.438885 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.444236 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:46.447044 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:46.445055 23396 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:11:46.449942 23396 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.450333 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.450847 23127 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:46.445300 23335 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:46.451930 23396 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.448096 23227 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:46.467592 15199 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.469558 23085 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:46.471752 23460 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.476357 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.479358 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:46.479707 15199 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:46.480091 15380 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.480798 23418 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:46.481299 23418 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:46.489317 15304 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:46.489292 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.482138 23418 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:46.498394 23460 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.500851 23460 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:46.501530 23460 consensus_queue.cc:1243] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Peer 841138f50ace4746978e72d7f13878de log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:46.504264 15304 pending_rounds.cc:85] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 9
I20260709 13:11:46.504624 15304 pending_rounds.cc:107] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:46.504928 15304 raft_consensus.cc:2889] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.510731 15380 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:46.521387 23504 consensus_queue.cc:1048] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:11:46.559983 23467 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:46.560886 23467 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.568899 23467 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:46.584213 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:46.585121 15274 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.585538 15274 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.592293 23322 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:46.594403 15274 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:46.595113 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.616845 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.619897 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.625909 16005 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:46.631630 23381 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:11:46.665719 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 44674.7us
I20260709 13:11:46.666371 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:46.677054 23458 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.677572 23458 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.678267 23417 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.678829 23417 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.679674 23458 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.683001 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.684764 15124 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 12 to 16, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.686642 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.686431 15124 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 16 to 17, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 17 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.687211 15380 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 23.
I20260709 13:11:46.688248 15124 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 16 to 18, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.689980 15124 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 15 to 16, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.690819 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:46.696020 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.696698 15301 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 24.
I20260709 13:11:46.702203 23154 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:46.703245 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.704970 15305 raft_consensus.cc:2393] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:46.711930 15301 raft_consensus.cc:1275] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:11:46.712261 15301 pending_rounds.cc:85] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Aborting all ops after (but not including) 10
I20260709 13:11:46.712574 15301 pending_rounds.cc:107] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:11:46.712949 15301 raft_consensus.cc:2889] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.703284 23154 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.717689 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.718883 15375 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:46.719063 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.720958 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.725970 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.717213 23154 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:46.728014 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.732695 23417 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.712631 15119 maintenance_manager.cc:643] P 476e7efc84e541a3bd0f38661ad40403: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.566s	user 0.034s	sys 0.000s Metrics: {"bytes_written":4440,"delete_count":0,"lbm_write_time_us":778,"lbm_writes_lt_1ms":5,"reinsert_count":0,"update_count":177}
I20260709 13:11:46.736093 15120 maintenance_manager.cc:419] P 476e7efc84e541a3bd0f38661ad40403: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.249543
I20260709 13:11:46.741993 23460 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.742678 23460 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.749207 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.749811 23490 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:11:46.751477 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.759254 23481 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:46.765498 15124 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:46.767519 15124 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 18 to 19, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 19 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.792043 23460 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.796180 15378 raft_consensus.cc:1240] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Rejecting Update request from peer 841138f50ace4746978e72d7f13878de for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:46.797991 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.800462 23490 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.800994 23490 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.803270 23490 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.804385 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.805011 15378 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:46.805069 23154 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.807849 15124 catalog_manager.cc:5697] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.812026 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.813687 15124 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 18 to 19, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 19 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.815501 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.811183 15198 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:46.813261 23435 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:46.822041 23435 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.822441 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.823024 15301 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:46.824455 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:46.825318 15301 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:46.827958 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:46.831966 15274 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:46.832832 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.833007 15124 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:46.836776 15274 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.824216 23435 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:46.839823 15274 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:46.848906 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.839044 23484 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:46.836097 23460 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:46.848186 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:46.853417 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:46.845022 23481 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:46.844540 23154 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.861094 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:46.856837 15124 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 18 to 19, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 19 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.863729 15378 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Advancing to term 25
W20260709 13:11:46.855624 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:46.864663 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.847870 23445 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.865293 23445 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.852583 23484 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:46.869328 15274 leader_election.cc:336] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.870596 15124 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.859905 23460 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.872933 23484 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:46.890093 15348 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.889649 15124 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 12 to 18, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:46.887959 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:46.897341 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.900461 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.901691 15124 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.903724 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:46.908038 14097 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:46.911638 15273 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:46.909565 15122 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 199) took 32852 ms (client timeout 15000 ms). Trace:
I20260709 13:11:46.904717 23322 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:46.905877 23227 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:46.921696 15124 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.934373 23445 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:46.934969 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:46.935402 23503 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.937296 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:46.908872 23396 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.939800 15198 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:46.933867 15124 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:46.940907 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:46.941763 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:46.942379 15124 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 14 to 16, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.944463 23481 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.946623 15378 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 25.
W20260709 13:11:46.922811 15122 rpcz_store.cc:269] 0709 13:11:14.062504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.063028 (+   524us) service_pool.cc:224] Handling call
0709 13:11:14.484265 (+421237us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5400260110. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a01b71 00007f2f50a020b2 00007f2f5997ba89 00007f2f59913da6 00007f2f598e5088 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc
0709 13:11:46.904597 (+32420332us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:44.764228 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:44.764932 (+   704us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:44.764986 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:11:44.765019 (+    33us) tablet.cc:662] Decoding operations
0709 13:11:44.791595 (+ 26576us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:44.791689 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:44.791720 (+    31us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:11:44.794175 (+  2455us) tablet.cc:701] Row locks acquired
0709 13:11:44.794220 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:11:44.794620 (+   400us) write_op.cc:270] Start()
0709 13:11:44.794795 (+   175us) write_op.cc:276] Timestamp: P: 1783602704794542 usec, L: 0
0709 13:11:44.794834 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:11:44.795625 (+   791us) log.cc:844] Serialized 9908 byte log entry
0709 13:11:45.493264 (+697639us) op_driver.cc:464] REPLICATION: finished
0709 13:11:45.627190 (+133926us) write_op.cc:301] APPLY: starting
0709 13:11:45.633855 (+  6665us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:45.919456 (+285601us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:45.919624 (+   168us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:45.968975 (+ 49351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:45.974612 (+  5637us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:11:45.974686 (+    74us) write_op.cc:312] APPLY: finished
0709 13:11:45.975266 (+   580us) log.cc:844] Serialized 220 byte log entry
0709 13:11:45.975446 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:45.975644 (+   198us) write_op.cc:454] Released schema lock
0709 13:11:45.975736 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:45.980072 (+  4336us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:45.980117 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2119232,"reported_tablets":53,"spinlock_wait_cycles":51148032,"child_traces":[["op",{"apply.queue_time_us":64937,"apply.run_cpu_time_us":36968,"apply.run_wall_time_us":376578,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108527,"num_ops":25,"prepare.queue_time_us":220499,"prepare.run_cpu_time_us":42671,"prepare.run_wall_time_us":426617,"raft.queue_time_us":136801,"raft.run_cpu_time_us":11472,"raft.run_wall_time_us":26885,"replication_time_us":698254,"thread_start_us":676301,"threads_started":4,"wal-append.queue_time_us":455480}]]}
I20260709 13:11:46.944135 15124 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 10 to 15, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.949375 23461 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.950456 15198 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:46.957620 15273 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:46.963166 15124 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 13 to 20, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 20 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:46.955588 23445 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.953771 23461 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:46.955669 23404 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.974838 15301 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 25.
I20260709 13:11:46.959054 23417 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:46.963817 23322 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.964185 23496 consensus_queue.cc:1059] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:11:46.954787 23481 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.003841 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.004839 23504 raft_consensus.cc:3055] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:47.005276 23504 raft_consensus.cc:740] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:47.006168 23504 consensus_queue.cc:260] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:47.010573 23504 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.984863 23404 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:47.018472 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67290.6us
W20260709 13:11:47.019241 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.999401 23417 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 25 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:47.028833 23417 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.033298 23484 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.036448 16005 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:47.041419 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.042055 15304 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 20.
I20260709 13:11:47.043458 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:47.020180 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:47.048112 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:47.048759 15305 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.051237 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.047686 15124 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 14 to 15, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.058238 23484 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.059017 23418 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:47.059244 15124 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf reported cstate change: term changed from 14 to 15, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 15 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:47.064352 23461 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:47.069736 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 68385.7us
I20260709 13:11:47.052848 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:47.073524 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:47.074154 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.075215 15345 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:47.076746 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.080468 15345 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.074898 15304 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:47.082042 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:47.084172 23435 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:47.087226 23481 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.098959 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:47.101035 15305 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:47.102415 15196 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:47.124643 23509 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:47.083245 23381 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:47.125473 23509 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.126434 23381 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:47.103977 23514 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:47.127925 23509 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:47.083600 23491 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:47.102089 23484 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.128793 23491 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.129033 23484 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.129289 23491 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:47.129576 23484 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.117869 23154 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:47.142393 23404 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.143671 23460 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.147477 23154 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:47.148439 23154 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.152465 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.165652 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.166520 15380 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 19.
I20260709 13:11:47.168955 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:47.171425 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 72689.6us
I20260709 13:11:47.172165 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:47.172650 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:47.173240 15375 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.175248 23509 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:47.183789 23509 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:47.187736 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.188060 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:47.190584 15375 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:47.188519 15380 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:47.196131 23520 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:47.168810 23418 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:47.201375 23418 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:47.203720 23418 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:47.204245 23521 consensus_queue.cc:1048] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:47.205704 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.206527 15304 raft_consensus.cc:2393] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:47.207567 23491 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.210299 23484 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.212779 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:47.213096 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:47.213378 23484 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.213706 15305 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.214344 15375 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:47.215408 23445 raft_consensus.cc:493] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.215476 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.218039 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:47.222608 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.230572 15377 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.224054 15305 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:47.240955 23491 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.249673 23445 raft_consensus.cc:515] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.251943 23445 leader_election.cc:290] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.253934 15377 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:47.233279 15196 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
W20260709 13:11:47.266794 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44265.4us
I20260709 13:11:47.268213 23463 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:47.268846 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.270152 23491 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:47.272099 23490 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:47.272679 23490 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:47.273296 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:47.273888 15378 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:11:47.273540 23490 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.276839 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.283581 15378 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:47.295337 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:47.295956 15305 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:47.298463 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b75da66513484f36a3807f62f4177e56" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.311930 15305 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:47.331146 23481 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:47.332592 23417 raft_consensus.cc:493] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.333124 23417 raft_consensus.cc:515] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:47.336292 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:47.335738 23417 leader_election.cc:290] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:47.401357 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.405699 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:47.406087 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:47.408429 23511 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:47.414186 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.436471 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.437291 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.437825 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.457113 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf87f25409d4351a79d5be897b18ddb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.460254 23511 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:47.469452 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 159129us
I20260709 13:11:47.471521 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:47.482277 15196 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:47.484476 15196 leader_election.cc:304] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.486250 23445 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:47.487977 23085 raft_consensus.cc:2749] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:47.473913 23463 raft_consensus.cc:493] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.492749 23463 raft_consensus.cc:515] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.495525 23463 leader_election.cc:290] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.475231 23404 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.496485 23404 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.499091 23404 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.502630 15198 leader_election.cc:304] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.479373 23490 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:47.536269 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.537237 15375 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:47.544771 15373 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:11:47.546850 15196 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 59607.6us
I20260709 13:11:47.548676 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.526348 23461 raft_consensus.cc:2749] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:47.564438 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:47.547964 23418 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:47.565634 15198 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:47.566579 23529 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:47.566314 23418 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:47.566794 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.567114 23529 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.567536 15302 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 21.
I20260709 13:11:47.567678 23529 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.579206 23529 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.587836 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8860a3924290420bb9fbf4a44cd89f06" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.597899 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.611865 23085 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:47.613472 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.620625 15196 leader_election.cc:304] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.621951 23085 raft_consensus.cc:2749] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:47.625545 23481 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.626466 23481 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.629719 23481 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.632678 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.641460 23529 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:47.644670 23418 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:47.645887 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:47.646943 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:47.649690 15302 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:11:47.654387 15307 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.650969 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.652484 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fbb0d4cfecd47d08011ea23dbbb5965" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:47.653878 15377 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:47.549419 23445 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
W20260709 13:11:47.662046 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.663506 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.666106 23404 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.666827 23404 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:47.667335 23463 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:47.675840 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.676174 23404 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:47.662243 15199 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.680079 15302 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:47.680188 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:47.679843 23533 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:11:47.681734 23085 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:47.694741 15377 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:47.698167 15307 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0f9eceec749442cb9a06c87f00f3caf in term 22.
I20260709 13:11:47.699502 15196 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf; no voters: 
I20260709 13:11:47.688447 23404 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:11:47.727723 15199 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:47.730466 23085 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:47.725984 23154 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:47.757941 23532 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:47.753357 23154 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Becoming Leader. State: Replica: b0f9eceec749442cb9a06c87f00f3caf, State: Running, Role: LEADER
I20260709 13:11:47.778328 23154 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.758772 23532 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:47.797870 23532 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:47.799978 23514 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:47.800740 23514 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:47.804912 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:47.805475 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:47.806138 16005 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:47.807950 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.745550 23445 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.807902 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:47.810604 15301 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:47.820902 23511 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:47.821491 23511 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:47.813582 23514 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:47.851083 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:47.822054 23511 raft_consensus.cc:3060] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:47.856292 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:47.869689 15375 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:47.875097 15307 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:47.868757 23461 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:47.902571 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.908484 14097 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:47.888563 23067 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:47.909551 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.910142 23532 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:11:47.913482 23067 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.919410 23067 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:47.922603 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.936688 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:47.944911 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:47.946157 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.946194 15381 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:47.951994 23463 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:47.972570 15196 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:48.041949 15119 tablet_replica.cc:1406] Time spent applying in-flights took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:11:48.048321 23085 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:48.099471 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.100214 23417 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.100819 23417 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:48.102800 23533 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.103442 23417 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:48.103407 23533 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:47.992539 23463 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:11:48.106640 23533 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:48.108157 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.111007 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.113269 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.129168 15302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.129664 23491 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:48.130295 23491 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.131809 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.132901 23491 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:48.136541 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.138485 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:48.092307 23511 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.178866 23511 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:48.186234 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:48.193954 15198 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.195567 15198 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.196935 23481 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:48.196980 23533 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:48.216409 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:48.221415 15301 raft_consensus.cc:2393] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 14: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:11:48.228214 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.252692 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:48.262228 23067 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:48.258327 16005 raft_consensus.cc:2468] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 14.
I20260709 13:11:48.279537 15348 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.280490 23511 raft_consensus.cc:2804] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:48.281065 23511 raft_consensus.cc:697] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:48.282116 23511 consensus_queue.cc:237] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.305429 23539 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.308661 23539 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.313248 23539 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:48.322167 23539 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.324589 23532 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.325249 23532 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:48.326629 15304 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:48.323026 23539 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.330109 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.331775 23481 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:48.334769 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3005d9c450974fc299b5f0c0e92c745a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:48.335922 15999 raft_consensus.cc:2410] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:11:48.337946 15274 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:48.341106 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.341974 15377 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 14.
I20260709 13:11:48.341806 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.343415 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:48.344241 15380 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:48.358095 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:48.354547 23544 log.cc:927] Time spent T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.077s	user 0.003s	sys 0.009s
I20260709 13:11:48.361562 23532 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:48.356314 23531 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: Append to log took a long time: real 0.059s	user 0.005s	sys 0.003s
I20260709 13:11:48.366112 23397 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:48.370471 23397 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.371013 23397 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:48.367175 23322 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:48.356289 23542 log.cc:927] Time spent T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.064s	user 0.003s	sys 0.008s
I20260709 13:11:48.357571 23445 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:11:48.355005 23539 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:48.409427 15307 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:11:48.410631 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 60063.1us
I20260709 13:11:48.412544 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.417429 23445 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:48.418620 23445 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.427446 23404 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:48.420086 15127 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:48.442325 23397 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:48.443847 15124 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 206) took 25306 ms (client timeout 15000 ms). Trace:
I20260709 13:11:48.445726 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:48.438958 15198 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.455243 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.455559 23067 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:48.456557 15373 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer b0f9eceec749442cb9a06c87f00f3caf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:48.472661 23397 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:48.474340 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:48.433427 15119 maintenance_manager.cc:643] P 476e7efc84e541a3bd0f38661ad40403: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 1.656s	user 0.095s	sys 0.017s Metrics: {"cfile_cache_miss":8,"cfile_cache_miss_bytes":26038,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":26299,"dirs.run_cpu_time_us":456,"dirs.run_wall_time_us":2624,"lbm_read_time_us":19030,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":23,"lbm_write_time_us":19208,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":10,"peak_mem_usage":274343,"reinsert_count":0,"thread_start_us":43444,"threads_started":1,"update_count":211}
W20260709 13:11:48.444355 15124 rpcz_store.cc:269] 0709 13:11:23.137224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.137596 (+   372us) service_pool.cc:224] Handling call
0709 13:11:48.443736 (+25306140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:47.192662 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:47.200901 (+  8239us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:47.200936 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:11:47.200955 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:47.203566 (+  2611us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:47.203644 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:47.203683 (+    39us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:11:47.214756 (+ 11073us) tablet.cc:701] Row locks acquired
0709 13:11:47.214771 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:11:47.229913 (+ 15142us) write_op.cc:270] Start()
0709 13:11:47.244480 (+ 14567us) write_op.cc:276] Timestamp: P: 1783602707214872 usec, L: 0
0709 13:11:47.244506 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:47.245275 (+   769us) log.cc:844] Serialized 7900 byte log entry
0709 13:11:47.349266 (+103991us) op_driver.cc:464] REPLICATION: finished
0709 13:11:47.484267 (+135001us) write_op.cc:301] APPLY: starting
0709 13:11:47.512031 (+ 27764us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:47.671088 (+159057us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:47.671224 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:47.905004 (+233780us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:47.986504 (+ 81500us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=52,mrs_lookups=0
0709 13:11:47.986567 (+    63us) write_op.cc:312] APPLY: finished
0709 13:11:47.987063 (+   496us) log.cc:844] Serialized 180 byte log entry
0709 13:11:47.987349 (+   286us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.987573 (+   224us) write_op.cc:454] Released schema lock
0709 13:11:47.987640 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:48.045530 (+ 57890us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.049423 (+  3893us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":701071,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":125463,"apply.run_cpu_time_us":35514,"apply.run_wall_time_us":508509,"cfile_cache_hit":84,"cfile_cache_hit_bytes":91774,"cfile_init":1,"lbm_read_time_us":512,"lbm_reads_lt_1ms":4,"num_ops":20,"prepare.queue_time_us":73612,"prepare.run_cpu_time_us":5583,"prepare.run_wall_time_us":74990,"replication_time_us":99792,"thread_start_us":141424,"threads_started":2}]]}
I20260709 13:11:48.478529 15120 maintenance_manager.cc:419] P 476e7efc84e541a3bd0f38661ad40403: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:11:48.481523 23067 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.482304 23067 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:48.452242 15127 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 12 to 16, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:48.489512 23067 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:48.469522 15198 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:48.494786 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.495543 23067 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:48.497749 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.493173 15127 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:48.451103 23445 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:48.499641 23532 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:48.500725 15119 maintenance_manager.cc:643] P 476e7efc84e541a3bd0f38661ad40403: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 13:11:48.509604 15198 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.510491 23532 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:48.509202 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:48.518564 15373 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:48.551235 23320 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:11:48.552017 23320 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.556496 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.556674 23320 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:48.556843 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.557485 15305 raft_consensus.cc:2368] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15.
I20260709 13:11:48.558627 15373 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 15.
I20260709 13:11:48.559437 15971 leader_election.cc:400] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15.
I20260709 13:11:48.561909 15971 leader_election.cc:403] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:48.565204 23320 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:11:48.567855 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.569494 15273 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:48.570829 23397 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:48.571414 23397 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:48.572423 23397 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.582139 23320 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121) with higher term. Message: Invalid argument: T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 for earlier term 14. Current term is 15.
I20260709 13:11:48.619915 23533 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.620673 23533 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:48.624485 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.627983 23533 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:48.636272 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.645287 15196 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.646850 23532 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:48.675810 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.775583 15999 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:48.777534 23435 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:48.789019 23533 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.789772 23533 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:48.793025 23533 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:48.794252 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:48.800297 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.802759 15301 raft_consensus.cc:1275] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:48.805967 15196 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.807505 23445 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:48.809499 23521 consensus_queue.cc:1048] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:48.829859 15123 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.848301 23445 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.836225 15123 catalog_manager.cc:5697] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.853338 23445 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:48.856930 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.860642 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.860970 23445 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:48.864748 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.866097 23445 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:48.895725 15123 catalog_manager.cc:5697] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 16 to 17, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 17 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.898681 15123 catalog_manager.cc:5697] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:11:48.904752 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:48.909096 14097 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:48.909904 23067 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.910737 23067 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:48.912918 23067 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:48.918335 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:48.920228 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:48.922868 15196 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:48.923908 23404 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:48.906544 15123 catalog_manager.cc:5697] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 19 to 26. New cstate: current_term: 26 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.933771 15123 catalog_manager.cc:5697] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 18 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 19 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:11:48.905124 15127 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 197) took 51420 ms (client timeout 15000 ms). Trace:
I20260709 13:11:48.968560 15123 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 18 to 19, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 19 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:48.976509 15123 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:48.965114 15127 rpcz_store.cc:269] 0709 13:10:57.484849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.485040 (+   191us) service_pool.cc:224] Handling call
0709 13:10:57.602040 (+117000us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5400260110. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f508c1db1 00007f2f50a02640 00007f2f598d9b76 00007f2f599e3c3e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:48.905022 (+51302982us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.574131 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:48.574779 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:48.574820 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:11:48.574841 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:48.575428 (+   587us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:48.575510 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:48.575535 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:48.575864 (+   329us) tablet.cc:701] Row locks acquired
0709 13:11:48.575906 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:11:48.576052 (+   146us) write_op.cc:270] Start()
0709 13:11:48.576176 (+   124us) write_op.cc:276] Timestamp: P: 1783602708576001 usec, L: 0
0709 13:11:48.576209 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:11:48.576988 (+   779us) log.cc:844] Serialized 1317 byte log entry
0709 13:11:48.651690 (+ 74702us) op_driver.cc:464] REPLICATION: finished
0709 13:11:48.669366 (+ 17676us) write_op.cc:301] APPLY: starting
0709 13:11:48.669471 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:48.673873 (+  4402us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:48.673974 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:48.676357 (+  2383us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:48.676610 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:11:48.676666 (+    56us) write_op.cc:312] APPLY: finished
0709 13:11:48.677954 (+  1288us) log.cc:844] Serialized 41 byte log entry
0709 13:11:48.715802 (+ 37848us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.715921 (+   119us) write_op.cc:454] Released schema lock
0709 13:11:48.715979 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:48.716546 (+   567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.716579 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50457,"reported_tablets":53,"spinlock_wait_cycles":3280768,"child_traces":[["op",{"apply.queue_time_us":17390,"apply.run_cpu_time_us":6139,"apply.run_wall_time_us":47129,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":29196,"prepare.run_cpu_time_us":3213,"prepare.run_wall_time_us":3214,"replication_time_us":75319,"spinlock_wait_cycles":27904,"thread_start_us":41119,"threads_started":2}]]}
I20260709 13:11:48.978756 15123 catalog_manager.cc:5697] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:48.996847 15274 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 243 similar messages]
W20260709 13:11:49.013676 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.984156 15123 catalog_manager.cc:5697] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 20 to 21, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 21 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:49.025072 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.097047 16005 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:49.103777 23539 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
W20260709 13:11:49.172013 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.174780 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 69159.8us
I20260709 13:11:49.178071 23533 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.192926 23533 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:49.195480 23533 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:49.198525 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:49.211158 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:49.221128 15196 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:49.223994 23533 raft_consensus.cc:2749] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:49.233338 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:49.234354 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.218998 15123 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 103) took 11673 ms (client timeout 15000 ms). Trace:
I20260709 13:11:49.245402 23533 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.246124 23533 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:49.251324 15373 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:49.254168 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:49.254626 23561 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:49.262518 23533 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:49.263537 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:49.236807 15123 rpcz_store.cc:269] 0709 13:11:37.545822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.407833 (+3862011us) service_pool.cc:224] Handling call
0709 13:11:49.218860 (+7811027us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.028547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.029200 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.029243 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:11:49.029265 (+    22us) tablet.cc:662] Decoding operations
0709 13:11:49.030422 (+  1157us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.030496 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.030533 (+    37us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:11:49.031371 (+   838us) tablet.cc:701] Row locks acquired
0709 13:11:49.031390 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:49.031589 (+   199us) write_op.cc:270] Start()
0709 13:11:49.031744 (+   155us) write_op.cc:276] Timestamp: P: 1783602709031531 usec, L: 0
0709 13:11:49.031776 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.035610 (+  3834us) log.cc:844] Serialized 3984 byte log entry
0709 13:11:49.038533 (+  2923us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.038986 (+   453us) write_op.cc:301] APPLY: starting
0709 13:11:49.039096 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.046019 (+  6923us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.046126 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.057040 (+ 10914us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.057319 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:11:49.057373 (+    54us) write_op.cc:312] APPLY: finished
0709 13:11:49.057734 (+   361us) log.cc:844] Serialized 97 byte log entry
0709 13:11:49.057937 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.058104 (+   167us) write_op.cc:454] Released schema lock
0709 13:11:49.058168 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:49.128890 (+ 70722us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.129902 (+  1012us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110693,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":14026,"apply.run_wall_time_us":73746,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41760,"num_ops":10,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":4441,"prepare.run_wall_time_us":7427,"replication_time_us":6570}]]}
I20260709 13:11:49.265194 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:49.267222 23445 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:49.296205 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.312283 15125 catalog_manager.cc:5697] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:11:49.344076 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.379065 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:49.424243 15125 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 198) took 55136 ms (client timeout 15000 ms). Trace:
W20260709 13:11:49.425732 15125 rpcz_store.cc:269] 0709 13:10:54.288329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.288618 (+   289us) service_pool.cc:224] Handling call
0709 13:10:55.893969 (+1605351us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54003818d4. stack: 00007f2f50a07343 00007f2f50a07240 00007f2f503961d4 00007f2f5a0d4304 00007f2f5a0d4299 00007f2f53a90090 00007f2f53b2ef3a 00007f2f598e51cc 00007f2f599e337e 00007f2f57ea42a4 00007f2f57ea4232 00007f2f57ea4161 00007f2f57ea40dc 00007f2f57ea3392 00007f2f51e6148c 00007f2f51e608c6
0709 13:11:49.424143 (+53530174us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.352699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.353370 (+   671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.353409 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:11:49.353426 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:49.353825 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.353908 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.353942 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:49.354161 (+   219us) tablet.cc:701] Row locks acquired
0709 13:11:49.354177 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:11:49.354343 (+   166us) write_op.cc:270] Start()
0709 13:11:49.354486 (+   143us) write_op.cc:276] Timestamp: P: 1783602709354290 usec, L: 0
0709 13:11:49.354539 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.355344 (+   805us) log.cc:844] Serialized 541 byte log entry
0709 13:11:49.358061 (+  2717us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.359706 (+  1645us) write_op.cc:301] APPLY: starting
0709 13:11:49.359807 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.360757 (+   950us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.360874 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.361669 (+   795us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.361863 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:11:49.361920 (+    57us) write_op.cc:312] APPLY: finished
0709 13:11:49.362155 (+   235us) log.cc:844] Serialized 25 byte log entry
0709 13:11:49.362353 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.362481 (+   128us) write_op.cc:454] Released schema lock
0709 13:11:49.362531 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:49.363098 (+   567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.363157 (+    59us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":315448,"reported_tablets":53,"spinlock_wait_cycles":1783237376,"child_traces":[["op",{"apply.queue_time_us":1339,"apply.run_cpu_time_us":3336,"apply.run_wall_time_us":3337,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":2394,"prepare.run_cpu_time_us":2998,"prepare.run_wall_time_us":2997,"replication_time_us":3354}]]}
W20260709 13:11:49.483574 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:49.487471 15128 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 205) took 50680 ms (client timeout 15000 ms). Trace:
W20260709 13:11:49.488001 15128 rpcz_store.cc:269] 0709 13:10:58.807312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.807590 (+   278us) service_pool.cc:224] Handling call
0709 13:11:49.487247 (+50679657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3538,"reported_tablets":53}
I20260709 13:11:49.538652 23445 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.539466 23445 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:49.543570 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:49.545380 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:49.555374 15196 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:49.556679 23067 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:49.568606 23445 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:49.585108 15130 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 197) took 77638 ms (client timeout 15000 ms). Trace:
W20260709 13:11:49.585805 15130 rpcz_store.cc:269] 0709 13:10:31.947111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.947969 (+   858us) service_pool.cc:224] Handling call
0709 13:11:49.584867 (+77636898us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305041,"reported_tablets":53}
I20260709 13:11:49.608227 23445 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.608894 23445 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:49.612934 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:49.616232 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:49.619593 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:49.621470 23067 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:49.628315 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:49.639510 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.642647 23445 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:49.644940 23533 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.645627 23533 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:49.647986 23533 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:49.660362 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:49.667443 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.667299 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09794c12bb344a25888d56e55d7e90f8" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:49.703109 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.706902 15196 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:49.709334 23532 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:49.770402 23445 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.771162 23445 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:49.781111 23445 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:49.785094 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:49.785812 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20919a13dd564519b54dd5e3c0751736" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:49.789105 15126 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:49.791476 15196 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:49.792514 23562 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:49.829118 23445 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:49.829877 23445 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:49.832365 15131 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 195) took 96813 ms (client timeout 15000 ms). Trace:
W20260709 13:11:49.832916 15131 rpcz_store.cc:269] 0709 13:10:13.019214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.028820 (+  9606us) service_pool.cc:224] Handling call
0709 13:11:49.832100 (+96803280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":392919,"reported_tablets":53}
I20260709 13:11:49.834419 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:49.829288 15126 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 13 to 14, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 14 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.837175 23445 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:49.837852 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:49.841777 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.847839 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:49.849779 23562 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:49.878897 15126 catalog_manager.cc:5697] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 15 to 17, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 17 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:49.910076 14097 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:49.995280 23067 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.996043 23067 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:50.008715 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.009567 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:50.015547 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:50.023052 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55ea5972868497eb17221413640fbea" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:50.028868 15196 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:50.031057 23533 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:50.004199 23067 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:50.068782 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.088093 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.090168 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:50.095214 15129 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 17, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 17 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.102730 15129 catalog_manager.cc:5697] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 23 to 25, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 25 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.104740 15129 catalog_manager.cc:5697] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 17 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 19 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:50.101394 15126 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 198) took 25276 ms (client timeout 15000 ms). Trace:
W20260709 13:11:50.116711 15126 rpcz_store.cc:269] 0709 13:11:24.833433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.921060 (+5087627us) service_pool.cc:224] Handling call
0709 13:11:50.101285 (+20180225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.944511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.945185 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.945242 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:11:49.945262 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:49.946026 (+   764us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.946124 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.946154 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:49.946501 (+   347us) tablet.cc:701] Row locks acquired
0709 13:11:49.946521 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:11:49.946684 (+   163us) write_op.cc:270] Start()
0709 13:11:49.946818 (+   134us) write_op.cc:276] Timestamp: P: 1783602709946627 usec, L: 0
0709 13:11:49.946843 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.947610 (+   767us) log.cc:844] Serialized 1317 byte log entry
0709 13:11:49.959485 (+ 11875us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.971208 (+ 11723us) write_op.cc:301] APPLY: starting
0709 13:11:49.971317 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.973708 (+  2391us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.973833 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.975912 (+  2079us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.976169 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:11:49.976226 (+    57us) write_op.cc:312] APPLY: finished
0709 13:11:49.989410 (+ 13184us) log.cc:844] Serialized 41 byte log entry
0709 13:11:49.994960 (+  5550us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.995203 (+   243us) write_op.cc:454] Released schema lock
0709 13:11:49.995259 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:49.995811 (+   552us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.995848 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77585,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":11424,"apply.run_cpu_time_us":6420,"apply.run_wall_time_us":24565,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":46051,"prepare.run_cpu_time_us":3619,"prepare.run_wall_time_us":7965,"replication_time_us":12442,"spinlock_wait_cycles":28032,"thread_start_us":56013,"threads_started":2}]]}
I20260709 13:11:50.115479 15129 catalog_manager.cc:5697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.122730 15129 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 14, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.126012 15129 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 21 to 22, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 22 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.137629 15129 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 20 to 21, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 21 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.139699 15129 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.156613 15129 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.158341 15129 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:11:50.159283 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:50.162102 15129 catalog_manager.cc:5697] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 15 to 16, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 16 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.172060 15129 catalog_manager.cc:5697] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 17 to 21, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 21 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.175271 15129 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.184302 15129 catalog_manager.cc:5697] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 19 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.186648 15129 catalog_manager.cc:5697] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 20 to 21, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 21 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.191104 15129 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 19 to 20, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.199849 15129 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } }
I20260709 13:11:50.213109 15129 catalog_manager.cc:5697] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 17 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 19 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.215695 15129 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 14 to 18, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 18 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:50.217958 15129 catalog_manager.cc:5697] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 19 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 22 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:50.301249 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.344957 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:50.442050 23562 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.442963 23562 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:50.445670 23562 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:50.455425 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:50.462973 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae61ecbf40014ab3bdd48399d0d8a997" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:50.468886 15198 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:50.471452 23067 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:50.476847 23532 raft_consensus.cc:493] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.477536 23532 raft_consensus.cc:515] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:50.482183 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:50.493816 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:50.498519 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4dc28ca60664c41a529fde0dc6c28aa" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:50.501004 15199 leader_election.cc:304] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:50.502583 23445 raft_consensus.cc:2749] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:50.505344 23532 leader_election.cc:290] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:50.558137 23562 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.558946 23562 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:50.593523 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:50.610828 15131 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.616302 15131 catalog_manager.cc:5697] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 14 to 16, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 16 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.627501 23562 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:50.643949 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:50.669873 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:50.706357 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a781ba18f2704d43b5f36e4e55228b71" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:50.720870 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 44033.4us
I20260709 13:11:50.732462 15198 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:50.734620 23571 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:50.747267 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:50.752162 15131 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.754350 15131 catalog_manager.cc:5697] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 15 to 17, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 17 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.759959 23571 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.761395 23571 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:50.762547 15131 catalog_manager.cc:5697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.769657 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:50.771493 23571 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:50.783530 15131 catalog_manager.cc:5697] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 19 to 20, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 20 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.785749 15131 catalog_manager.cc:5697] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 20, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 20 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.787719 15131 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.789876 15131 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.791579 15131 catalog_manager.cc:5697] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 16, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 16 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
W20260709 13:11:50.792876 15129 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 200) took 16082 ms (client timeout 15000 ms). Trace:
I20260709 13:11:50.793174 15131 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 13 to 19, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 19 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:50.795336 15131 catalog_manager.cc:5697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 20 to 25, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 25 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.798805 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:50.802297 15131 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 21 to 22, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 22 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.809460 15198 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:50.810621 23572 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:50.813338 15131 catalog_manager.cc:5697] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 20 to 23, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 23 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.815223 15131 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.817090 15131 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.818830 15131 catalog_manager.cc:5697] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 19 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.820932 15131 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.822542 15131 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 15 to 22, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 22 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.824615 15131 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 20 to 25, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 25 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.826097 15131 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 15 to 17, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 17 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:50.793397 15129 rpcz_store.cc:269] 0709 13:11:34.711116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.090129 (+2379013us) service_pool.cc:224] Handling call
0709 13:11:50.792771 (+13702642us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:50.239292 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:50.239915 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:50.239954 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:11:50.239969 (+    15us) tablet.cc:662] Decoding operations
0709 13:11:50.241874 (+  1905us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:50.241950 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:50.241995 (+    45us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:11:50.243740 (+  1745us) tablet.cc:701] Row locks acquired
0709 13:11:50.243765 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:11:50.243929 (+   164us) write_op.cc:270] Start()
0709 13:11:50.244066 (+   137us) write_op.cc:276] Timestamp: P: 1783602710243884 usec, L: 0
0709 13:11:50.244089 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:11:50.244882 (+   793us) log.cc:844] Serialized 7968 byte log entry
0709 13:11:50.248130 (+  3248us) op_driver.cc:464] REPLICATION: finished
0709 13:11:50.249154 (+  1024us) write_op.cc:301] APPLY: starting
0709 13:11:50.249254 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:50.277507 (+ 28253us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:50.277627 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:50.343997 (+ 66370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:50.344374 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 13:11:50.344445 (+    71us) write_op.cc:312] APPLY: finished
0709 13:11:50.344962 (+   517us) log.cc:844] Serialized 180 byte log entry
0709 13:11:50.360649 (+ 15687us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:50.360945 (+   296us) write_op.cc:454] Released schema lock
0709 13:11:50.361033 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:50.368922 (+  7889us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:50.368962 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1226,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":744,"apply.run_cpu_time_us":28570,"apply.run_wall_time_us":119676,"cfile_cache_hit":80,"cfile_cache_hit_bytes":83520,"num_ops":20,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":5928,"prepare.run_wall_time_us":8326,"replication_time_us":3891}]]}
I20260709 13:11:50.828377 15131 catalog_manager.cc:5697] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 14 to 16, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 16 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.830348 15131 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.831977 15131 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.838617 15131 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:50.841269 15131 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 20, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 20 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.843564 15131 catalog_manager.cc:5697] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.845237 15131 catalog_manager.cc:5697] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 20 to 21, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 21 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.846932 15131 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 12 to 15, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 15 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:50.849193 15131 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } }
I20260709 13:11:50.851245 15131 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 22, leader changed from 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 22 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } }
I20260709 13:11:50.854641 15131 catalog_manager.cc:5697] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 11 to 14, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:50.856766 15131 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 18 to 20, leader changed from 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) to b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65). New cstate: current_term: 20 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:11:50.910748 14097 thread.cc:527] Waited for 9000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:50.935201 23067 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.935879 23067 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:50.937907 23067 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:50.941960 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:50.942955 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4aa83c2832d5495583c7715993a665e2" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:50.948029 15196 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:50.949086 23067 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.155565 23572 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.156250 23572 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:51.160115 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:51.164821 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:51.169358 15196 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:51.188783 15124 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "b0f9eceec749442cb9a06c87f00f3caf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:51.197499 23571 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:51.201825 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:51.203545 15131 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36078 (request call id 201) took 1350 ms. Trace:
I20260709 13:11:51.199393 23572 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:51.204034 15131 rpcz_store.cc:276] 0709 13:11:49.852816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.852966 (+   150us) service_pool.cc:224] Handling call
0709 13:11:51.203438 (+1350472us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:50.887339 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:50.888243 (+   904us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:50.888283 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:11:50.888304 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:50.891379 (+  3075us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:50.891481 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:50.891519 (+    38us) tablet.cc:685] Acquiring locks for 33 operations
0709 13:11:50.894220 (+  2701us) tablet.cc:701] Row locks acquired
0709 13:11:50.894244 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:11:50.894439 (+   195us) write_op.cc:270] Start()
0709 13:11:50.894591 (+   152us) write_op.cc:276] Timestamp: P: 1783602710894372 usec, L: 0
0709 13:11:50.894620 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:11:50.895576 (+   956us) log.cc:844] Serialized 12983 byte log entry
0709 13:11:50.917166 (+ 21590us) op_driver.cc:464] REPLICATION: finished
0709 13:11:50.926806 (+  9640us) write_op.cc:301] APPLY: starting
0709 13:11:50.926921 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:50.954899 (+ 27978us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:50.955011 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:50.978280 (+ 23269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:50.999285 (+ 21005us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=0,mrs_lookups=0
0709 13:11:50.999356 (+    71us) write_op.cc:312] APPLY: finished
0709 13:11:51.000099 (+   743us) log.cc:844] Serialized 284 byte log entry
0709 13:11:51.026446 (+ 26347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.026761 (+   315us) write_op.cc:454] Released schema lock
0709 13:11:51.026856 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:51.027523 (+   667us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.027559 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142464,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":9346,"apply.run_cpu_time_us":39380,"apply.run_wall_time_us":100711,"cfile_cache_hit":134,"cfile_cache_hit_bytes":141935,"num_ops":33,"prepare.queue_time_us":7162,"prepare.run_cpu_time_us":8411,"prepare.run_wall_time_us":17333,"replication_time_us":22340,"spinlock_wait_cycles":95488,"thread_start_us":16388,"threads_started":2}]]}
I20260709 13:11:51.341527 23562 raft_consensus.cc:493] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.342311 23562 raft_consensus.cc:515] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:51.348472 23562 leader_election.cc:290] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:51.350586 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:51.362005 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911f84bbbf874ced8f15e93fcf73decd" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:51.365702 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:51.368490 15198 leader_election.cc:304] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:51.371589 23562 raft_consensus.cc:2749] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:51.380788 15123 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 104) took 2072 ms. Trace:
I20260709 13:11:51.384136 15123 rpcz_store.cc:276] 0709 13:11:49.306536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.306715 (+   179us) service_pool.cc:224] Handling call
0709 13:11:51.378785 (+2072070us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28532,"reported_tablets":10}
W20260709 13:11:51.394006 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:51.452773 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:51.469987 23572 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.470741 23572 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:51.474077 23562 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:51.474972 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:51.474786 23562 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:51.479594 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "362d7a17088a4e86a51428b5ee97346e" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:51.482146 23562 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:51.482411 15199 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:11:51.484642 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:51.488195 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:51.488830 23572 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:51.490278 23572 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:51.490404 15198 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:51.491999 23572 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:51.542974 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:51.606873 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:51.632020 23572 raft_consensus.cc:493] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:51.642127 23572 raft_consensus.cc:515] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:51.636322 15124 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36062 (request call id 199) took 6840 ms. Trace:
I20260709 13:11:51.643332 23532 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.656397 23532 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:51.663630 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:51.665321 23532 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:51.667196 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:51.670563 15307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:51.662436 15124 rpcz_store.cc:276] 0709 13:11:44.795792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.484603 (+3688811us) service_pool.cc:224] Handling call
0709 13:11:51.636197 (+3151594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:51.247834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:51.248461 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:51.248499 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:11:51.248522 (+    23us) tablet.cc:662] Decoding operations
0709 13:11:51.248947 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:51.249014 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:51.249046 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:51.249249 (+   203us) tablet.cc:701] Row locks acquired
0709 13:11:51.249266 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:11:51.249411 (+   145us) write_op.cc:270] Start()
0709 13:11:51.249531 (+   120us) write_op.cc:276] Timestamp: P: 1783602711249367 usec, L: 0
0709 13:11:51.249553 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:51.250305 (+   752us) log.cc:844] Serialized 536 byte log entry
0709 13:11:51.254462 (+  4157us) op_driver.cc:464] REPLICATION: finished
0709 13:11:51.255022 (+   560us) write_op.cc:301] APPLY: starting
0709 13:11:51.255116 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:51.256038 (+   922us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:51.256146 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:51.256991 (+   845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:51.257169 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:11:51.257217 (+    48us) write_op.cc:312] APPLY: finished
0709 13:11:51.257454 (+   237us) log.cc:844] Serialized 25 byte log entry
0709 13:11:51.257643 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.257741 (+    98us) write_op.cc:454] Released schema lock
0709 13:11:51.257788 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:51.258171 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.258200 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54014,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":269,"apply.run_cpu_time_us":3135,"apply.run_wall_time_us":3135,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":2089,"prepare.run_cpu_time_us":2830,"prepare.run_wall_time_us":2829,"replication_time_us":4773,"spinlock_wait_cycles":44800}]]}
I20260709 13:11:51.676509 15196 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:51.680737 23571 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:51.683838 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:51.694293 23572 leader_election.cc:290] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:51.695026 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30992f1a0d1949a7aacbc6cbd114a206" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:51.700577 15199 leader_election.cc:304] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:51.714046 23572 raft_consensus.cc:2749] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:51.758420 23532 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.759052 23532 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:51.762475 23532 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:51.768010 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:51.791392 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:51.812148 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:51.815002 23572 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:51.854960 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:51.855948 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:51.911375 14097 thread.cc:527] Waited for 10000ms trying to join with heartbeat (tid 15258)
I20260709 13:11:51.917692 23562 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.918591 23562 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:51.922159 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:51.930244 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:51.940512 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:51.945576 23562 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:51.956553 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1065d4b5964e7f8603f56553ecdb3b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:51.958900 15198 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:51.961004 23067 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:52.015597 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.025533 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:52.032850 23562 raft_consensus.cc:493] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.033579 23562 raft_consensus.cc:515] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:52.034384 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.046481 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.075253 23571 raft_consensus.cc:493] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:52.076035 23571 raft_consensus.cc:515] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:52.088413 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:52.107038 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:52.113663 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75432bd549b3481d83070979a305922b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:52.123945 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.135046 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56abc7f6c348d58ce156f066549f7d" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:52.140224 23571 leader_election.cc:290] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:52.143028 15198 leader_election.cc:304] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:52.144362 23572 raft_consensus.cc:2749] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:52.147054 23562 leader_election.cc:290] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:52.168658 15198 leader_election.cc:304] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:52.169621 23572 raft_consensus.cc:2749] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:52.253306 15122 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36060 (request call id 207) took 7731 ms. Trace:
I20260709 13:11:52.253855 15122 rpcz_store.cc:276] 0709 13:11:44.521615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.040924 (+2519309us) service_pool.cc:224] Handling call
0709 13:11:52.253216 (+5212292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195944,"reported_tablets":53,"spinlock_wait_cycles":11520}
I20260709 13:11:52.316320 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:11:52.334228 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 53207.8us
I20260709 13:11:52.354056 14097 tablet_replica.cc:333] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.356235 14097 raft_consensus.cc:2243] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:11:52.362346 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 55358us
I20260709 13:11:52.477789 23592 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.478471 23592 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:52.495126 23592 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:52.500327 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:52.508833 14097 raft_consensus.cc:2272] T 1ca5c0c807fd42129fc4ee147149c313 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:52.515985 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.543318 14097 tablet_replica.cc:333] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
W20260709 13:11:52.544973 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:52.546218 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.550153 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2466cf62f214b16bdaa21d868e54b04" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:52.557835 14097 raft_consensus.cc:2243] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.558727 14097 raft_consensus.cc:2272] T 75432bd549b3481d83070979a305922b P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.562548 14097 tablet_replica.cc:333] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.563750 14097 raft_consensus.cc:2243] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.564998 14097 raft_consensus.cc:2272] T 9229ceef9fef4706b1e835456a589647 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.568073 14097 tablet_replica.cc:333] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.569290 14097 raft_consensus.cc:2243] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.570577 14097 raft_consensus.cc:2272] T dc5a1ea32aef45d1b6e1ff8b0718d178 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.573875 14097 tablet_replica.cc:333] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.575003 14097 raft_consensus.cc:2243] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.575773 14097 raft_consensus.cc:2272] T 3fbb0d4cfecd47d08011ea23dbbb5965 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:52.579766 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.580754 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.582756 14097 tablet_replica.cc:333] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.589958 15198 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:11:52.591096 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.591837 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.596102 23067 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:52.629339 14097 raft_consensus.cc:2243] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:52.631323 15118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 50086.8us
W20260709 13:11:52.641453 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): ChangeConfig:REMOVE_PEER RPC failed for tablet 0066b5a9791e4a30856433ed14864d2f: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:52.631383 14097 raft_consensus.cc:2272] T bec569d5083b416380cac661b1b44368 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:52.677188 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.696844 14097 tablet_replica.cc:333] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.705438 14097 raft_consensus.cc:2243] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.708823 14097 raft_consensus.cc:2272] T ae61ecbf40014ab3bdd48399d0d8a997 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.723980 14097 tablet_replica.cc:333] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.725708 14097 raft_consensus.cc:2243] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.749042 14097 raft_consensus.cc:2272] T 8860a3924290420bb9fbf4a44cd89f06 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.767014 14097 tablet_replica.cc:333] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.768437 14097 raft_consensus.cc:2243] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.772720 14097 raft_consensus.cc:2272] T 012aeb5edb4346c8b15a323d6a0a1934 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.795270 14097 tablet_replica.cc:333] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.824708 14097 raft_consensus.cc:2243] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.833055 14097 raft_consensus.cc:2272] T 6bf87f25409d4351a79d5be897b18ddb P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.851202 14097 tablet_replica.cc:333] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.864400 14097 raft_consensus.cc:2243] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.865953 14097 raft_consensus.cc:2272] T 315a39052c3a4aa189e80239d6709f0e P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.915143 14097 tablet_replica.cc:333] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.931564 14097 raft_consensus.cc:2243] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.932880 14097 raft_consensus.cc:2272] T b75da66513484f36a3807f62f4177e56 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.935585 23583 raft_consensus.cc:493] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.939369 23583 raft_consensus.cc:515] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:52.942018 23583 leader_election.cc:290] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:52.944607 14097 tablet_replica.cc:333] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:52.946794 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:52.951903 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720e51950072462e9d16f75b27995387" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:52.955796 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.957597 15196 leader_election.cc:304] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:52.958988 23592 raft_consensus.cc:2749] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:52.974107 14097 raft_consensus.cc:2243] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.975378 14097 raft_consensus.cc:2272] T 4aa83c2832d5495583c7715993a665e2 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.007587 14097 tablet_replica.cc:333] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.009119 14097 raft_consensus.cc:2243] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:53.010372 14097 raft_consensus.cc:2272] T bb30c1248aaf4663a734d0eb93201e7b P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.013536 14097 tablet_replica.cc:333] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.017900 14097 raft_consensus.cc:2243] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:53.019117 14097 raft_consensus.cc:2272] T fec6e03dbf19483e8e0a5c9d25c73def P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.034088 23592 raft_consensus.cc:493] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:11:53.034749 23592 raft_consensus.cc:515] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:53.039081 23592 leader_election.cc:290] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:53.042609 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:53.046998 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc5207f2ece48c7ba4d2a23b902610b" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:53.052151 15199 leader_election.cc:304] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:11:53.053228 23067 raft_consensus.cc:2749] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:53.110462 14097 tablet_replica.cc:333] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.111579 14097 raft_consensus.cc:2243] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.112255 14097 pending_rounds.cc:70] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Trying to abort 1 pending ops.
I20260709 13:11:53.112591 14097 pending_rounds.cc:77] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf: Aborting op as it isn't in flight: id { term: 15 index: 9 } timestamp: 7305636645387755520 op_type: NO_OP noop_request { }
I20260709 13:11:53.113060 14097 raft_consensus.cc:2889] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:53.113436 14097 raft_consensus.cc:2272] T 720e51950072462e9d16f75b27995387 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:53.175501 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:53.194316 14097 tablet_replica.cc:333] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.195412 14097 raft_consensus.cc:2243] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.196008 14097 pending_rounds.cc:70] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Trying to abort 1 pending ops.
I20260709 13:11:53.196282 14097 pending_rounds.cc:77] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf: Aborting op as it isn't in flight: id { term: 22 index: 14 } timestamp: 7305636675839946752 op_type: NO_OP noop_request { }
I20260709 13:11:53.196686 14097 raft_consensus.cc:2889] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 13:11:53.209353 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.209697 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.264111 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:53.197041 14097 raft_consensus.cc:2272] T fb1065d4b5964e7f8603f56553ecdb3b P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.292495 14097 tablet_replica.cc:333] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.295315 14097 raft_consensus.cc:2243] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:53.296965 14097 raft_consensus.cc:2272] T 0952b977f0484de9aeb6cb7ca74a0580 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.307503 14097 tablet_replica.cc:333] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.308784 14097 raft_consensus.cc:2243] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.309444 14097 raft_consensus.cc:2272] T 7f56abc7f6c348d58ce156f066549f7d P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.345454 14097 tablet_replica.cc:333] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.346918 14097 raft_consensus.cc:2243] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.347903 14097 raft_consensus.cc:2272] T d55ea5972868497eb17221413640fbea P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.367885 14097 tablet_replica.cc:333] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.369123 14097 raft_consensus.cc:2243] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.390441 14097 raft_consensus.cc:2272] T 439569a190ca4e8fbb5f6ad2dce20957 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.394284 14097 tablet_replica.cc:333] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.413630 14097 raft_consensus.cc:2243] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.414309 14097 raft_consensus.cc:2272] T a781ba18f2704d43b5f36e4e55228b71 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.429857 14097 tablet_replica.cc:333] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.436789 14097 raft_consensus.cc:2243] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.437810 14097 pending_rounds.cc:70] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Trying to abort 3 pending ops.
I20260709 13:11:53.438148 14097 pending_rounds.cc:77] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Aborting op as it isn't in flight: id { term: 26 index: 18 } timestamp: 7305636615790555136 op_type: NO_OP noop_request { }
I20260709 13:11:53.438555 14097 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:53.438868 14097 pending_rounds.cc:77] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7305636597571092480 op_type: NO_OP noop_request { }
I20260709 13:11:53.439167 14097 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:53.439424 14097 pending_rounds.cc:77] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf: Aborting op as it isn't in flight: id { term: 23 index: 16 } timestamp: 7305636558836649984 op_type: NO_OP noop_request { }
I20260709 13:11:53.439708 14097 raft_consensus.cc:2889] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:53.443313 14097 raft_consensus.cc:2272] T 3fc5207f2ece48c7ba4d2a23b902610b P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.493158 23569 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:53.493814 23569 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:53.496140 23569 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:53.503391 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:53.506300 15274 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:53.512238 15273 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:53.513764 23569 raft_consensus.cc:2749] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:53.549289 23587 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:53.550043 23587 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:53.554167 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:53.557471 23587 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:53.569871 14097 tablet_replica.cc:333] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.571779 14097 raft_consensus.cc:2243] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:53.577557 14097 raft_consensus.cc:2272] T 2578a36ef3a84d208c1736eedfe8f2bf P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:53.600426 15348 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:53.600854 14097 tablet_replica.cc:333] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.602136 14097 raft_consensus.cc:2243] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:53.607537 15348 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:53.616503 23576 raft_consensus.cc:2749] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:53.617573 14097 raft_consensus.cc:2272] T 657606da148d404bbcad5ee674c9b9d2 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.626892 14097 tablet_replica.cc:333] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.627866 14097 raft_consensus.cc:2243] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.628552 14097 raft_consensus.cc:2272] T 20919a13dd564519b54dd5e3c0751736 P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:53.609078 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:53.643199 14097 tablet_replica.cc:333] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.644254 14097 raft_consensus.cc:2243] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:53.648159 14097 raft_consensus.cc:2272] T 0066b5a9791e4a30856433ed14864d2f P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.651153 14097 tablet_replica.cc:333] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
W20260709 13:11:53.660025 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:53.660772 14097 raft_consensus.cc:2243] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.665974 14097 raft_consensus.cc:2272] T d8ad749c34474d4db0fa33ca64452d80 P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.669900 14097 tablet_replica.cc:333] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.675513 23596 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:53.676546 14097 raft_consensus.cc:2243] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.676249 23596 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:53.677450 14097 raft_consensus.cc:2272] T 30992f1a0d1949a7aacbc6cbd114a206 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:53.689606 15274 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:53.690824 23596 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:53.692830 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:53.693468 15375 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:53.698544 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:53.699682 23596 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:53.700089 23596 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:53.700465 23596 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:53.751106 23596 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:53.752290 14097 tablet_replica.cc:333] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.754607 14097 raft_consensus.cc:2243] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:11:53.760701 15274 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:53.763361 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9229ceef9fef4706b1e835456a589647" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:53.764662 15380 raft_consensus.cc:3060] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:53.787089 14097 raft_consensus.cc:2272] T 965cf4b237ec478b978733b437297652 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.765304 23596 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:53.788794 23576 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:53.789661 23576 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:53.793319 15380 raft_consensus.cc:2468] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:53.796742 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:53.796056 15273 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:53.799103 23596 raft_consensus.cc:2804] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:11:53.796919 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:53.800676 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:53.801398 23596 raft_consensus.cc:697] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:53.802028 23587 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:53.792232 23576 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:53.802397 23596 consensus_queue.cc:237] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:53.806403 14097 tablet_replica.cc:333] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.806715 23586 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.807489 14097 raft_consensus.cc:2243] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.807231 23586 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:53.808073 14097 raft_consensus.cc:2272] T 911f84bbbf874ced8f15e93fcf73decd P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:53.810750 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:53.811336 14097 tablet_replica.cc:333] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.812125 14097 raft_consensus.cc:2243] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:53.820454 14097 raft_consensus.cc:2272] T bb3022274b1549eb806d68dc808a6ceb P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:53.826925 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:53.827241 14097 tablet_replica.cc:333] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:53.828956 23586 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:53.830660 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168b77c528554771b17206e0062bd8cc" candidate_uuid: "b0f9eceec749442cb9a06c87f00f3caf" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:53.832763 15198 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0f9eceec749442cb9a06c87f00f3caf; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:11:53.834197 23586 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:53.839788 15118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52828.6us
I20260709 13:11:53.842430 14097 raft_consensus.cc:2243] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:53.845254 14097 raft_consensus.cc:2272] T 09794c12bb344a25888d56e55d7e90f8 P b0f9eceec749442cb9a06c87f00f3caf [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:53.893060 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.941290 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 108427us
I20260709 13:11:53.943887 14097 tablet_replica.cc:333] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
W20260709 13:11:53.946667 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): ChangeConfig:REMOVE_PEER RPC failed for tablet 0066b5a9791e4a30856433ed14864d2f: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:53.970963 15122 catalog_manager.cc:5697] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 21 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 22 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.002360 23570 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.003451 23570 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.006299 23576 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.007254 23576 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:53.947499 14097 raft_consensus.cc:2243] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.009486 14097 raft_consensus.cc:2272] T 58ced12ec3004fab89f76f924edf0925 P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.022254 23576 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:54.048178 15974 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 297 similar messages]
W20260709 13:11:54.052773 15198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 64576.2us
I20260709 13:11:54.052207 23570 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.070075 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:54.071830 15380 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 18.
W20260709 13:11:54.074998 15974 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:54.085825 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:54.089599 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 112862us
I20260709 13:11:54.093484 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.094432 23570 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:54.094903 23570 raft_consensus.cc:493] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.095342 23570 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:54.094444 23613 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.099820 23613 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.102636 23613 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.104380 14097 tablet_replica.cc:333] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.104977 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:54.105786 14097 raft_consensus.cc:2243] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.106616 14097 pending_rounds.cc:70] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Trying to abort 1 pending ops.
I20260709 13:11:54.106907 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:54.107784 15303 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 25.
W20260709 13:11:54.114204 15974 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.114638 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:54.115374 15348 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.115808 23613 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:54.131788 23604 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.132813 23604 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.137290 23604 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.106940 14097 pending_rounds.cc:77] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf: Aborting op as it isn't in flight: id { term: 17 index: 14 } timestamp: 7305636626075140096 op_type: NO_OP noop_request { }
I20260709 13:11:54.149287 14097 raft_consensus.cc:2889] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:54.149513 23596 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.150046 14097 raft_consensus.cc:2272] T c4dc28ca60664c41a529fde0dc6c28aa P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.150405 23596 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.154066 23570 raft_consensus.cc:515] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.155547 14097 tablet_replica.cc:333] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.160488 14097 raft_consensus.cc:2243] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:54.161144 15274 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.165649 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:54.169077 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:54.169468 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:54.174865 15380 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 16.
I20260709 13:11:54.180536 23596 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:54.185361 15274 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.187458 14097 raft_consensus.cc:2272] T e8be1b1f251d4292b0b299f3c0c48c25 P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.188954 23603 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.191221 23603 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.193537 23570 leader_election.cc:290] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.194022 23603 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:54.197449 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc5a1ea32aef45d1b6e1ff8b0718d178" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:54.198261 15380 raft_consensus.cc:3060] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:54.199707 23605 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:54.199954 15348 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.200677 23605 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.200075 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.207688 23602 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:54.208176 23602 raft_consensus.cc:493] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.208611 23602 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:54.214133 15273 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.215624 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:54.214102 15974 leader_election.cc:336] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.217197 23569 raft_consensus.cc:2749] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:54.217974 23569 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:54.218176 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:54.218971 15304 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:54.218415 23569 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.221426 23569 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:54.225703 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.226848 23605 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:54.227103 23606 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:54.227596 23606 raft_consensus.cc:493] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.227965 23606 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:54.232260 15348 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.231333 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:54.237123 15348 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.238269 23605 raft_consensus.cc:2749] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:54.232976 15274 consensus_peers.cc:597] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.205817 14097 tablet_replica.cc:333] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.241760 14097 raft_consensus.cc:2243] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.243404 14097 raft_consensus.cc:2272] T 9be9d73e985345e39f20d23687e60a85 P b0f9eceec749442cb9a06c87f00f3caf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.248359 15380 raft_consensus.cc:2468] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:54.250697 15973 leader_election.cc:304] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.252182 23613 raft_consensus.cc:2804] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:54.252825 23613 raft_consensus.cc:697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:54.253979 23613 consensus_queue.cc:237] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.268265 23569 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.272892 23570 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.274206 23570 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.264631 23606 raft_consensus.cc:515] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.278501 23606 leader_election.cc:290] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:54.254575 23602 raft_consensus.cc:515] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.319624 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec6e03dbf19483e8e0a5c9d25c73def" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:54.320389 15301 raft_consensus.cc:3060] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:54.328281 15348 leader_election.cc:336] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.330750 15301 raft_consensus.cc:2468] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:54.337802 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:54.338132 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:54.338569 15380 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 19.
I20260709 13:11:54.339813 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:54.340747 23613 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:54.341276 23613 raft_consensus.cc:493] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.341720 23613 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:54.319783 14097 tablet_replica.cc:333] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.354046 23569 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:54.354462 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.357846 15274 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.365935 14097 raft_consensus.cc:2243] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.346930 23570 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.366654 15124 catalog_manager.cc:5697] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 18 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 19 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.368031 14097 raft_consensus.cc:2272] T f2466cf62f214b16bdaa21d868e54b04 P b0f9eceec749442cb9a06c87f00f3caf [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:54.368678 15348 leader_election.cc:336] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.369890 23602 leader_election.cc:290] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:54.381287 15974 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.383644 23576 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.385402 14097 tablet_replica.cc:333] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.386745 14097 raft_consensus.cc:2243] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.387629 14097 raft_consensus.cc:2272] T 389bc861d7d5427b88bae4655d5ef6b8 P b0f9eceec749442cb9a06c87f00f3caf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.387948 23576 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.390689 23576 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:54.391090 14097 tablet_replica.cc:333] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.392314 14097 raft_consensus.cc:2243] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.397400 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:54.402271 14097 raft_consensus.cc:2272] T 872a48310a1f4a28b75d05f83ce6b20b P b0f9eceec749442cb9a06c87f00f3caf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.402422 15999 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:54.405539 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 
I20260709 13:11:54.406086 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca5c0c807fd42129fc4ee147149c313" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:54.406713 15301 raft_consensus.cc:3060] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:54.397440 23613 raft_consensus.cc:515] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:54.413885 15348 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.414659 23602 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:54.415318 23602 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.415745 23602 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:54.415530 23613 leader_election.cc:290] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.416579 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb30c1248aaf4663a734d0eb93201e7b" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:54.417155 15380 raft_consensus.cc:3060] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:54.423576 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012aeb5edb4346c8b15a323d6a0a1934" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:54.424259 15375 raft_consensus.cc:3060] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:54.424410 15378 raft_consensus.cc:1275] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:54.426658 15345 leader_election.cc:304] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.428274 15301 raft_consensus.cc:2468] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 26.
I20260709 13:11:54.428390 23576 raft_consensus.cc:2804] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:54.429908 23576 raft_consensus.cc:697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 22 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:54.430943 23576 consensus_queue.cc:237] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.434918 23596 consensus_queue.cc:1048] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:54.437487 15974 leader_election.cc:336] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.439587 23596 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.440164 23596 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.443120 15380 raft_consensus.cc:2468] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:11:54.444259 15973 leader_election.cc:304] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.445271 23613 raft_consensus.cc:2804] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:54.445783 23613 raft_consensus.cc:697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:54.446918 23613 consensus_queue.cc:237] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.445627 23596 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:54.448791 15274 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:54.451802 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:54.440503 15375 raft_consensus.cc:2468] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:54.452572 14097 tablet_replica.cc:333] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.453621 14097 raft_consensus.cc:2243] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.454511 14097 raft_consensus.cc:2272] T 362d7a17088a4e86a51428b5ee97346e P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.466334 14097 tablet_replica.cc:333] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.467293 14097 raft_consensus.cc:2243] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.469210 15345 leader_election.cc:304] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.470986 23603 raft_consensus.cc:2804] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:54.471336 15273 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.471786 23602 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.472393 23569 raft_consensus.cc:2804] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:54.472937 23569 raft_consensus.cc:697] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:54.471510 23603 raft_consensus.cc:697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 26 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:54.471421 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:54.476671 23569 consensus_queue.cc:237] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.477176 23603 consensus_queue.cc:237] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:54.480203 15348 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.483407 15273 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.485057 23604 raft_consensus.cc:2749] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:54.488381 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:54.497915 23602 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:54.499136 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "315a39052c3a4aa189e80239d6709f0e" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:54.500123 15999 raft_consensus.cc:3060] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:54.517503 15999 raft_consensus.cc:2468] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:54.528100 14097 raft_consensus.cc:2272] T 2de1580a2d944ae884df67f226c8b71d P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.533710 15348 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.540009 14097 tablet_replica.cc:333] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.543166 15124 catalog_manager.cc:5697] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 19 to 20, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 20 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:54.559087 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:54.551610 23603 raft_consensus.cc:2804] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:54.572137 15122 catalog_manager.cc:5697] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 21 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 22 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.575376 14097 raft_consensus.cc:2243] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.576375 14097 raft_consensus.cc:2272] T 66c844c3ac2f40469051bf49c46469c6 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.581032 23603 raft_consensus.cc:697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 22 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:54.614305 23603 consensus_queue.cc:237] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.621912 14097 tablet_replica.cc:333] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.622977 14097 raft_consensus.cc:2243] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.623586 14097 raft_consensus.cc:2272] T 7236188a1607470eb04fb303bc4a928b P b0f9eceec749442cb9a06c87f00f3caf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.626765 15124 catalog_manager.cc:5697] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 16 to 17, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 17 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.643219 14097 tablet_replica.cc:333] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.644202 14097 raft_consensus.cc:2243] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:11:54.650785 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.651544 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.672919 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.668054 15124 catalog_manager.cc:5697] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 25 to 26, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 26 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.678061 23576 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.678884 23576 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.682288 23576 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:54.684684 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:54.657372 14097 raft_consensus.cc:2272] T f5cd793e143d45cf9e32447e33602536 P b0f9eceec749442cb9a06c87f00f3caf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.691696 14097 tablet_replica.cc:333] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
W20260709 13:11:54.701036 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:54.702364 23576 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.703806 23576 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.710839 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:54.714084 23576 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:54.706900 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:11:54.707048 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:54.701092 14097 raft_consensus.cc:2243] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.725507 15373 raft_consensus.cc:1275] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:54.728554 23613 consensus_queue.cc:1048] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:54.739135 14097 raft_consensus.cc:2272] T 4e535be5fc0f4cf7b8401a4c737a091f P b0f9eceec749442cb9a06c87f00f3caf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.740249 15348 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
W20260709 13:11:54.746904 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:54.747479 23576 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:54.717732 15124 catalog_manager.cc:5697] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 21 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 22 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.750041 23603 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.756036 23603 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.762010 14097 tablet_replica.cc:333] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.767774 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:54.769889 23603 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:54.791785 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:54.833590 15303 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:54.836380 14097 raft_consensus.cc:2243] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.841929 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:54.843504 23569 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:54.844950 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.849982 23603 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:54.850531 23603 raft_consensus.cc:493] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.850950 23603 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:54.861831 23569 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.870904 23569 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.873880 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:54.874492 15274 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.882548 15273 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.884016 23569 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:54.875805 14097 raft_consensus.cc:2272] T 10888684198543f19c54c7cbcb094157 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:54.876717 15348 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:54.888435 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.888933 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.889775 23602 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:54.896201 23602 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.896950 23602 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:54.899590 23602 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:54.901386 14097 tablet_replica.cc:333] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.901547 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:54.902488 14097 raft_consensus.cc:2243] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.903998 14097 raft_consensus.cc:2272] T c27cdc2356514f4ea31d68df9ee2fa02 P b0f9eceec749442cb9a06c87f00f3caf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.920253 15378 raft_consensus.cc:1275] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:54.922299 23569 consensus_queue.cc:1048] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:54.939792 23603 raft_consensus.cc:515] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:54.954046 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:54.955583 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0952b977f0484de9aeb6cb7ca74a0580" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:54.956507 15305 raft_consensus.cc:3060] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:54.963167 15348 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.971297 14097 tablet_replica.cc:333] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:54.972293 23570 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:54.973079 23570 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:54.973827 15305 raft_consensus.cc:2468] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 23.
I20260709 13:11:54.974546 23603 leader_election.cc:290] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:54.977190 23570 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:54.979107 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:54.980145 15375 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 20.
I20260709 13:11:54.982506 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:54.990389 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:54.991161 15974 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:54.993731 23570 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:55.019554 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 47093.2us
I20260709 13:11:55.019793 23569 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.020737 23569 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.026024 15345 leader_election.cc:304] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:55.024946 23577 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.039155 23577 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.042253 23577 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:55.044858 23606 raft_consensus.cc:2804] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:55.046895 23606 raft_consensus.cc:697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:55.029945 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 65380.5us
I20260709 13:11:55.032148 23605 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.048902 23605 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.048092 23606 consensus_queue.cc:237] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.051445 23605 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:55.037086 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): ChangeConfig:REMOVE_PEER RPC failed for tablet 0066b5a9791e4a30856433ed14864d2f: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.039595 23569 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:55.054863 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 52318.2us
I20260709 13:11:55.057528 15999 raft_consensus.cc:1275] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:55.063347 15378 raft_consensus.cc:1275] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:55.065557 23570 consensus_queue.cc:1048] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:55.069542 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:55.070276 15375 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
W20260709 13:11:55.078405 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:55.082049 15274 consensus_peers.cc:597] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:55.084633 15274 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.088091 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:55.088963 15380 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
W20260709 13:11:55.090662 15274 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.096740 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.112771 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:55.113643 15305 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:55.109438 14097 raft_consensus.cc:2243] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.115339 23625 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:55.115526 23576 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.115940 23625 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.116493 23625 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:55.116330 23576 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.118697 23587 consensus_queue.cc:1048] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:55.120086 23576 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:55.123373 14097 raft_consensus.cc:2272] T 3f803fff1dbc4b87b787f25b1659c2ae P b0f9eceec749442cb9a06c87f00f3caf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.128599 23596 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.129499 23596 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:55.131930 23625 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.132361 23577 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.132572 15303 raft_consensus.cc:1275] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:55.137930 15303 raft_consensus.cc:1275] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 13:11:55.138195 15274 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:55.139613 15274 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.140488 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.141582 23569 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:55.142048 23569 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.142590 23569 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:55.143687 14097 tablet_replica.cc:333] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:55.144764 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:55.145049 23625 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:55.148293 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:55.152295 23603 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:55.152815 23603 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.153245 23603 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:55.133100 23577 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.156586 23605 consensus_queue.cc:1048] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:55.159003 23605 consensus_queue.cc:1048] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:55.160308 23577 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:55.161033 15274 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.161188 15305 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 19.
I20260709 13:11:55.162859 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2578a36ef3a84d208c1736eedfe8f2bf" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:55.163574 15380 raft_consensus.cc:3060] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:55.168299 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:55.169255 15375 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:55.173513 16005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:55.174335 16005 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:55.177151 23596 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:55.186463 14097 raft_consensus.cc:2243] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.191304 14097 raft_consensus.cc:2272] T e879ecfd4de9483e8b42ea01de447fdc P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:55.195307 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.142037 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.207252 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.208149 23576 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:55.209421 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 67426.5us
W20260709 13:11:55.210870 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.211593 15348 leader_election.cc:336] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.214847 23569 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.218132 23603 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.222666 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:55.223928 23576 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:55.224409 23576 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.225301 23576 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:55.236421 15380 raft_consensus.cc:2468] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 23.
I20260709 13:11:55.222914 14097 tablet_replica.cc:333] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:55.238397 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:55.247685 15378 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:55.249411 14097 raft_consensus.cc:2243] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.251853 14097 raft_consensus.cc:2272] T d13483d024d54c9e929c90baefab4d3a P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.257364 15273 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.258529 23596 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:55.259006 23596 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.259387 23596 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:55.263851 14097 tablet_replica.cc:333] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:55.278918 14097 raft_consensus.cc:2243] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:11:55.282678 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:55.285574 14097 raft_consensus.cc:2272] T 67a795b9e21446b4be65705c76ee1d94 P b0f9eceec749442cb9a06c87f00f3caf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.289033 23569 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:55.290501 15273 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:55.291637 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:55.296737 15274 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.321658 14097 tablet_replica.cc:333] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf: stopping tablet replica
I20260709 13:11:55.323482 14097 raft_consensus.cc:2243] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.325205 14097 raft_consensus.cc:2272] T 168b77c528554771b17206e0062bd8cc P b0f9eceec749442cb9a06c87f00f3caf [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:55.356750 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 66324.1us
I20260709 13:11:55.369231 23624 raft_consensus.cc:2804] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:55.371611 23603 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:55.399199 23624 raft_consensus.cc:697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 23 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:55.401630 23624 consensus_queue.cc:237] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.396121 15273 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:55.410705 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 52337.4us
I20260709 13:11:55.411571 23569 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:55.412168 23569 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.413311 23569 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:55.405860 15348 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.419276 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3022274b1549eb806d68dc808a6ceb" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:55.420027 15380 raft_consensus.cc:3060] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:55.422040 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:55.422788 15301 raft_consensus.cc:3060] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:55.443535 23596 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.455739 15301 raft_consensus.cc:2468] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 23.
I20260709 13:11:55.466996 23596 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:55.467964 23602 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.468820 23602 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:55.462138 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:55.471117 23602 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:55.460084 15380 raft_consensus.cc:2468] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 23.
I20260709 13:11:55.480257 15124 catalog_manager.cc:5697] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 22 to 23, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 23 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:55.487972 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:55.489777 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:55.491309 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:55.504065 15348 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.506927 23576 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.508378 15380 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 20: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:55.513396 15273 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:55.517325 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 95248.7us
I20260709 13:11:55.516415 23625 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.520639 23625 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.528394 15345 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:55.537379 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.541463 23569 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:55.540916 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:55.535961 23596 raft_consensus.cc:2804] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:55.538230 23603 raft_consensus.cc:2804] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:55.565064 23569 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:11:55.552675 15348 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.544305 23625 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:55.577620 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:55.574054 23596 raft_consensus.cc:697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 23 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:55.586110 23624 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:55.587965 15348 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.586948 23624 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.596444 23596 consensus_queue.cc:237] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.598335 23624 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:55.595414 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.578347 23603 raft_consensus.cc:697] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
W20260709 13:11:55.606755 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.607998 23576 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:55.610527 15348 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.612411 23602 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:55.614289 23603 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.647119 23602 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.648314 23602 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.660873 23602 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:55.676148 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 100151us
I20260709 13:11:55.691427 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:55.709604 15303 raft_consensus.cc:2393] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 20: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:11:55.710520 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.720708 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:55.721561 15301 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
I20260709 13:11:55.722662 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:55.725149 15378 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:55.728654 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:55.729823 15380 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 25.
I20260709 13:11:55.744786 15380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:55.745523 15380 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 17.
I20260709 13:11:55.751168 15305 raft_consensus.cc:1275] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:11:55.769308 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0066b5a9791e4a30856433ed14864d2f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:55.770074 15999 raft_consensus.cc:3060] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:55.751288 23570 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.797688 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:55.798959 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:55.815111 23570 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:55.802917 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.822259 23642 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:55.824669 23569 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.802352 23624 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:55.837746 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.848804 15378 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:55.861994 23569 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:55.870554 15122 catalog_manager.cc:5697] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 22 to 23, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 23 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.887036 23569 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:55.859268 23642 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.893404 23625 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.864936 23602 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:55.864605 23624 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:55.918952 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 108984us
I20260709 13:11:55.922819 15999 raft_consensus.cc:2468] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:55.885174 23587 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:55.931394 15274 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.931975 15274 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:55.925499 23624 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:55.934595 15974 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.903025 23642 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:55.935786 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.937944 15274 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:55.941480 15274 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.889889 23576 consensus_queue.cc:1048] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:11:55.935417 23587 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:55.935150 23570 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:55.940658 23596 raft_consensus.cc:2749] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:55.958642 23587 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:55.935520 23625 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:55.986894 23625 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:55.975437 15274 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:55.944834 23606 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:56.006435 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 87157us
W20260709 13:11:56.029825 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.033385 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.050393 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 89648.3us
I20260709 13:11:56.055102 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:11:56.028678 23637 log.cc:927] Time spent T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:11:56.061832 15380 raft_consensus.cc:1275] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:56.017477 23606 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:56.103641 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:56.116271 23606 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.139773 15274 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.149942 23569 raft_consensus.cc:2804] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:56.150568 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.153785 15303 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 24.
W20260709 13:11:56.160635 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 83713.5us
I20260709 13:11:56.165990 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.171592 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:11:56.172806 15999 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 24.
I20260709 13:11:56.177452 23569 raft_consensus.cc:697] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:56.178858 23569 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:56.147927 23604 consensus_queue.cc:1048] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
W20260709 13:11:56.192643 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:56.193037 23659 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.193579 23645 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.218852 23645 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.220546 15303 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 22.
I20260709 13:11:56.223119 23642 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:56.205161 15274 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.208613 23643 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.225468 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.215183 23624 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.210316 23587 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.233315 15304 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:56.234771 23668 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.234931 23624 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.227675 23643 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.235818 23668 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.238435 23668 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.238547 23643 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.242385 23651 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.243160 23651 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.224042 23645 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.221292 23659 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.248317 23651 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.250491 23659 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.235451 23587 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:56.230297 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.252216 23651 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:56.257303 15380 raft_consensus.cc:1275] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:56.227685 23642 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:56.274312 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.275629 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 74278.7us
I20260709 13:11:56.277554 23624 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:56.286541 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.287401 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:56.288213 15375 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:56.288379 23601 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:56.288945 23601 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.289381 23601 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:56.290289 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:56.291246 15375 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 18: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:56.292726 23659 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.293365 23659 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.296329 23659 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.299005 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.300179 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be9d73e985345e39f20d23687e60a85" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:56.301056 15375 raft_consensus.cc:3060] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:56.301403 15348 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.301585 23645 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:56.302032 23645 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.302532 23645 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:56.305092 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:56.305963 15373 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:56.282276 15122 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 22 to 23, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 23 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:56.310187 15274 consensus_peers.cc:597] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.313752 23644 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.314461 23644 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.321030 23644 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:56.322530 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.334507 15303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:56.334874 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.335433 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.335450 15303 raft_consensus.cc:2393] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 18: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:56.335569 15301 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:11:56.336123 15304 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:56.339746 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.342275 23644 consensus_queue.cc:1048] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:11:56.340291 23601 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:56.326256 15348 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.341507 15274 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.368458 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:56.369956 15974 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.371433 23601 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.374770 23644 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:56.384938 23644 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.385517 23644 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:56.376036 23645 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:56.375531 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
W20260709 13:11:56.376675 15274 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.388841 15274 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.388890 23569 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:56.390084 23569 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.390483 23569 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:56.391119 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.391852 15301 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 24.
I20260709 13:11:56.343886 15375 raft_consensus.cc:2468] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 26.
I20260709 13:11:56.392855 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.393393 23668 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.377252 23643 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:56.394019 23668 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
W20260709 13:11:56.395767 15274 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.379263 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.400314 23668 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:56.401278 23645 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:11:56.394536 23643 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:56.396653 15274 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.405530 15274 consensus_peers.cc:597] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.406845 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.408324 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.409133 23643 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:56.412557 23667 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:56.409231 23651 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:56.404690 15348 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.420719 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.412559 23587 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:56.423162 23657 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:56.424721 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:11:56.432647 23569 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.432607 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:56.445883 15999 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 25: Already voted for candidate 5c70ddb5aae14b059dc90fd40125b034 in this term.
I20260709 13:11:56.429749 23604 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.446574 15305 raft_consensus.cc:2393] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5c70ddb5aae14b059dc90fd40125b034 in current term 25: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:56.449729 23569 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.457067 23662 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:56.457593 23662 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.458153 23662 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:56.444743 23587 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.460734 23587 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.450477 23605 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.462492 23605 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:56.448065 15124 catalog_manager.cc:5697] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 22 to 23, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 23 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.465996 23605 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:56.467933 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:56.469887 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.466668 15124 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 20 to 21, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 21 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:56.475313 15274 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.478763 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.485467 23570 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:56.487737 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:56.488767 15375 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:56.454288 23657 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.489730 23657 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:56.493582 15273 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.495391 23569 raft_consensus.cc:2804] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:56.495684 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:56.496129 23569 raft_consensus.cc:697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 26 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:56.505146 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.506435 15305 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:56.509687 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:56.515094 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:56.526130 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:56.468756 23644 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.513402 23569 consensus_queue.cc:237] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.452975 23604 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.530808 23625 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:56.567946 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:56.575532 23625 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.576212 23625 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:56.551532 23603 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:56.604984 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 74069.8us
I20260709 13:11:56.609575 23641 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:56.615697 23587 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.623106 15378 raft_consensus.cc:2393] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 17: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:56.626065 23587 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.647356 23644 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.611917 23643 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.602005 23603 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:56.671680 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.686246 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:56.688410 15304 raft_consensus.cc:3060] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:56.671020 23603 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:56.674289 23643 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:56.710297 15274 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.696527 23625 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:56.714416 23661 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.725276 23577 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:56.745370 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.758430 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.776865 23604 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.778988 23625 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:56.779987 23577 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.783233 23577 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.790066 23657 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.791544 15377 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:56.764465 23644 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:56.793896 23675 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.794576 23675 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.764001 23661 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:56.797482 23673 log.cc:927] Time spent T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.103s	user 0.004s	sys 0.000s
W20260709 13:11:56.765807 15274 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.801666 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:56.802785 23657 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.815478 23675 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.822618 23668 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:56.823402 23668 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:56.833520 23668 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:56.841094 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:56.842151 15378 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 23: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:56.848390 15274 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.849241 15274 consensus_peers.cc:597] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.849009 23662 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:56.850307 15274 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.851038 23661 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.851491 23662 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:56.853791 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:56.854598 15373 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:56.848443 15377 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:11:56.856664 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 45341.4us
W20260709 13:11:56.857417 15348 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.858049 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.859083 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 45272.6us
I20260709 13:11:56.862212 16001 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:56.863641 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:56.864492 15375 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
W20260709 13:11:56.867748 15274 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.864012 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
W20260709 13:11:56.868661 15274 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.868579 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:56.869855 15373 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 20.
I20260709 13:11:56.876127 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:56.877241 15305 raft_consensus.cc:2393] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 23: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
W20260709 13:11:56.876236 15274 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.895539 23644 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:56.896780 23603 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:56.899528 23603 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:56.899686 15377 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:56.860046 15304 raft_consensus.cc:2468] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 17.
W20260709 13:11:56.901628 15274 consensus_peers.cc:597] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.902423 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:56.911134 15273 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.912492 23642 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.915983 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:56.917096 15304 raft_consensus.cc:2393] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:56.935635 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
W20260709 13:11:56.936316 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.936647 15305 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
W20260709 13:11:56.937458 15348 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:56.938148 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.938189 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:56.939180 15348 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.940109 23668 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:56.942947 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:56.943794 15305 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:56.975052 15273 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.976604 23642 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:56.989506 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:56.993750 23642 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:56.994387 23642 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
W20260709 13:11:56.994701 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:56.994912 23642 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:56.997871 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.000705 23661 raft_consensus.cc:2749] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:57.006882 23642 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:56.992091 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.008971 23668 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:57.010010 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:57.012166 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:57.012176 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.012953 23668 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:57.013406 23668 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:57.013808 23668 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:57.001292 15124 catalog_manager.cc:5697] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 25 to 26, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 26 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:57.021044 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:57.064504 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 46013.7us
I20260709 13:11:57.102524 15345 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.103904 23603 raft_consensus.cc:2804] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:57.104597 23603 raft_consensus.cc:697] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:57.105863 23603 consensus_queue.cc:237] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.108006 23640 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:57.108649 23640 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:57.109246 23640 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:57.112185 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.113303 23662 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:57.114879 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:57.115899 15273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 94982.7us
W20260709 13:11:57.116782 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 64447.3us
I20260709 13:11:57.147315 23642 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:57.149127 23662 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:57.150286 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:57.152611 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.155733 23668 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.167609 15305 raft_consensus.cc:3060] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:57.159646 23640 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.167994 23603 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:57.179845 23603 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:57.167105 23662 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (detected failure of leader b0f9eceec749442cb9a06c87f00f3caf)
I20260709 13:11:57.180840 23662 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:57.180913 23640 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:57.180222 23603 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:57.187685 15305 raft_consensus.cc:2468] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 25.
I20260709 13:11:57.203903 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.204177 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:57.205392 15305 raft_consensus.cc:2393] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:57.207656 23642 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:57.214906 15124 catalog_manager.cc:5697] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 16 to 17, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 17 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.229223 23668 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:57.247612 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.271754 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.277134 23603 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.222453 23662 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.254925 15378 raft_consensus.cc:1275] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:11:57.250458 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:57.284976 23662 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:57.291401 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.307965 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f803fff1dbc4b87b787f25b1659c2ae" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:57.308785 15373 raft_consensus.cc:3060] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:57.321867 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.280220 23603 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:57.331668 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:57.332675 15378 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
I20260709 13:11:57.338641 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:57.339641 15378 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 841138f50ace4746978e72d7f13878de in current term 21: Already voted for candidate 0ec140f610ed4500ba58208c0e5519bb in this term.
W20260709 13:11:57.346583 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:57.351593 15345 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.355306 15373 raft_consensus.cc:2468] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:57.357722 23603 raft_consensus.cc:2804] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:57.360146 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.363719 23603 raft_consensus.cc:697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 25 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:57.364976 23603 consensus_queue.cc:237] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:57.370124 15348 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:57.371346 15348 connection.cc:769] client connection to 127.13.196.65:44011 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:11:57.374451 23662 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:57.382404 15274 connection.cc:769] client connection to 127.13.196.65:44011 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:11:57.429993 23668 consensus_queue.cc:1048] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:11:57.435869 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:57.439432 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:57.441159 15304 raft_consensus.cc:2393] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:57.443720 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:57.444507 15304 raft_consensus.cc:2393] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec140f610ed4500ba58208c0e5519bb in current term 21: Already voted for candidate 841138f50ace4746978e72d7f13878de in this term.
I20260709 13:11:57.459944 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.462793 23662 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:57.482854 15273 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:57.505236 23640 raft_consensus.cc:2804] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:57.506485 23640 raft_consensus.cc:697] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:57.492118 15124 catalog_manager.cc:5697] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 24 to 25, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 25 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:57.508405 23640 consensus_queue.cc:237] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.510083 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.512604 23603 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:57.524940 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.525627 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.529892 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.546936 15304 consensus_queue.cc:237] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:57.548883 15274 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:57.552042 15274 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.556646 23644 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:57.561159 15274 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:57.561669 15274 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.571791 23642 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:57.573989 15274 consensus_peers.cc:597] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.574568 15274 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:11:57.575526 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:57.598453 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.620975 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:57.643919 16001 raft_consensus.cc:1275] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:11:57.652523 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:57.661157 15124 catalog_manager.cc:5697] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 18 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 19 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:57.671710 15274 consensus_peers.cc:597] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.683107 23667 consensus_queue.cc:1048] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:57.717000 23662 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.717636 23662 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:57.722188 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:57.732651 23662 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:57.739257 15303 raft_consensus.cc:1275] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:57.742388 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:57.743183 15305 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 20.
I20260709 13:11:57.746596 23603 consensus_queue.cc:1048] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:57.749691 15348 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:11:57.750759 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.769246 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.808455 23640 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 9 to 14, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:57.812258 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.819722 23662 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:57.817173 15999 raft_consensus.cc:2955] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 9 to 14, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:11:57.820411 23662 raft_consensus.cc:493] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.821089 23662 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:57.823258 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.848237 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.852413 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.871447 15274 consensus_peers.cc:597] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:57.874156 15124 catalog_manager.cc:5697] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 9 to 14, VOTER 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67) evicted. New cstate: current_term: 21 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:11:57.883272 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.894008 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 81855.9us
I20260709 13:11:57.893994 23662 raft_consensus.cc:515] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.903462 15363 tablet_service.cc:1558] Processing DeleteTablet for tablet 0066b5a9791e4a30856433ed14864d2f with delete_type TABLET_DATA_TOMBSTONED (TS 0ec140f610ed4500ba58208c0e5519bb not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:43900
W20260709 13:11:57.910692 15348 leader_election.cc:336] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:57.923717 23662 leader_election.cc:290] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:57.940905 23698 tablet_replica.cc:333] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:11:57.943190 15115 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0066b5a9791e4a30856433ed14864d2f with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
W20260709 13:11:57.944092 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.947364 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:57.948261 15305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965cf4b237ec478b978733b437297652" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:57.948936 15305 raft_consensus.cc:3060] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:57.961247 15304 raft_consensus.cc:1275] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:11:57.962975 15305 raft_consensus.cc:2468] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 21.
I20260709 13:11:57.968058 15345 leader_election.cc:304] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:57.968295 23697 consensus_queue.cc:1048] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:57.942687 23698 raft_consensus.cc:2243] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.970350 23697 raft_consensus.cc:2804] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:57.970873 23697 raft_consensus.cc:697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:57.971792 23697 consensus_queue.cc:237] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:57.981159 23698 raft_consensus.cc:2272] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.999742 23698 ts_tablet_manager.cc:1916] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:11:58.013115 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:58.036625 15373 raft_consensus.cc:1275] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:11:58.036929 15274 consensus_peers.cc:597] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.041738 23642 consensus_queue.cc:1048] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:58.060318 15124 catalog_manager.cc:5697] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 19 to 21, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 21 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:58.081003 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.093951 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:58.103684 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:58.113557 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:58.141039 23698 ts_tablet_manager.cc:1929] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.13
I20260709 13:11:58.141839 23698 log.cc:1199] T 0066b5a9791e4a30856433ed14864d2f P 0ec140f610ed4500ba58208c0e5519bb: Deleting WAL directory at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/wals/0066b5a9791e4a30856433ed14864d2f
I20260709 13:11:58.144914 15117 catalog_manager.cc:5028] TS 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): tablet 0066b5a9791e4a30856433ed14864d2f (table test-workload [id=8fa6196893d945378030cba17992850a]) successfully deleted
W20260709 13:11:58.178900 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.352699 14097 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15254)
W20260709 13:11:58.384241 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:58.420864 23645 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.421659 23645 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:58.429160 15274 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:58.456138 23645 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:58.456398 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:58.457245 15377 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 18.
I20260709 13:11:58.460881 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:58.461906 23703 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:58.462476 23703 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.462955 23703 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:58.473091 23703 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:58.482079 23703 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:11:58.485858 15274 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:58.487869 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "872a48310a1f4a28b75d05f83ce6b20b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:58.488732 15377 raft_consensus.cc:3060] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:58.516755 15377 raft_consensus.cc:2468] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 19.
I20260709 13:11:58.518567 15273 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:58.525127 23645 raft_consensus.cc:2804] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:58.525885 23645 raft_consensus.cc:697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:58.526921 23645 consensus_queue.cc:237] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:58.550769 15305 raft_consensus.cc:1275] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:58.552599 23662 consensus_queue.cc:1048] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:58.559306 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:58.573422 15124 catalog_manager.cc:5697] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 17 to 19, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 19 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:58.589880 15274 consensus_peers.cc:597] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:58.612742 23645 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.613375 23645 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:58.620563 23645 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:58.626271 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:58.627332 15373 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:58.629757 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:58.631857 23703 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:58.632479 23703 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.632992 23703 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:58.637220 15274 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:11:58.659121 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:58.676123 23658 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.676898 23658 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:58.683568 23658 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:58.687649 15974 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:58.690084 23703 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:58.691975 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:58.692792 15301 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 25.
I20260709 13:11:58.700845 23703 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:58.704015 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10888684198543f19c54c7cbcb094157" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:58.705179 15373 raft_consensus.cc:3060] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:58.710641 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:58.714514 23678 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:58.715011 23678 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.715372 23678 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:58.716638 15274 consensus_peers.cc:597] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:58.726307 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:58.726998 15274 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:58.747454 23703 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.748440 23703 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:58.748857 23662 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.760694 15373 raft_consensus.cc:2468] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:58.760841 23662 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:58.763131 15273 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:58.765272 23644 raft_consensus.cc:2804] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:58.767868 23644 raft_consensus.cc:697] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:58.768986 23644 consensus_queue.cc:237] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:58.767182 23678 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:11:58.764295 23662 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:58.775081 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de" is_pre_election: true
I20260709 13:11:58.775836 15301 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 23.
I20260709 13:11:58.779577 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:58.780472 15377 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
W20260709 13:11:58.781539 15974 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:11:58.782323 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:58.788658 23678 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:11:58.789340 23703 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:58.790179 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:58.800134 15304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:58.800961 15304 raft_consensus.cc:3060] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:58.791731 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:58.802739 23640 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:58.803259 23640 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.803602 23640 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:58.813690 15304 raft_consensus.cc:2468] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c70ddb5aae14b059dc90fd40125b034 in term 26.
I20260709 13:11:58.813408 23662 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:58.835451 15971 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:58.832078 23662 raft_consensus.cc:493] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.841441 23662 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:58.857551 23710 raft_consensus.cc:2804] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:11:58.915060 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 53797.6us
W20260709 13:11:58.922781 15274 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:58.916687 23710 raft_consensus.cc:697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 26 LEADER]: Becoming Leader. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Running, Role: LEADER
I20260709 13:11:58.933481 15124 catalog_manager.cc:5697] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 20 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 22 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:58.971347 23710 consensus_queue.cc:237] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:11:58.984124 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 176142us
I20260709 13:11:58.969400 23640 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:58.990361 23640 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:11:59.010362 15373 raft_consensus.cc:1275] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:59.016036 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e879ecfd4de9483e8b42ea01de447fdc" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:59.016911 15375 raft_consensus.cc:3060] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:59.032626 23662 raft_consensus.cc:515] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:59.035089 23662 leader_election.cc:290] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:11:59.042196 15274 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:59.063972 15124 catalog_manager.cc:5697] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: term changed from 24 to 26, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68). New cstate: current_term: 26 leader_uuid: "5c70ddb5aae14b059dc90fd40125b034" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.089519 15301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e535be5fc0f4cf7b8401a4c737a091f" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "841138f50ace4746978e72d7f13878de"
I20260709 13:11:59.090337 15301 raft_consensus.cc:3060] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:59.093197 23712 consensus_queue.cc:1048] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:11:59.094705 15274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111) [suppressed 461 similar messages]
I20260709 13:11:59.076467 15375 raft_consensus.cc:2468] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:59.120491 15301 raft_consensus.cc:2468] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 24.
W20260709 13:11:59.125771 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.126771 15348 leader_election.cc:336] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:59.115124 23712 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.136714 23721 log.cc:927] Time spent T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:11:59.136303 23712 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:59.143950 15345 leader_election.cc:304] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:59.149662 23719 raft_consensus.cc:2804] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:59.150388 23719 raft_consensus.cc:697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 24 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:11:59.150820 23712 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:59.151890 23719 consensus_queue.cc:237] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:59.159667 15273 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:11:59.146078 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.165268 15274 consensus_peers.cc:597] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.168962 23645 raft_consensus.cc:2804] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:59.170066 23645 raft_consensus.cc:697] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:59.171195 23645 consensus_queue.cc:237] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:11:59.185173 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:59.186412 15373 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:59.200119 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:59.201618 23645 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:59.202104 23645 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.202489 23645 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:59.228044 15274 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:59.248111 15124 catalog_manager.cc:5697] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 20 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 22 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:59.291721 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:59.292500 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:59.280300 23645 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:59.297290 15122 catalog_manager.cc:5697] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 22 to 24, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 24 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:59.299417 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a795b9e21446b4be65705c76ee1d94" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:59.300195 15373 raft_consensus.cc:3060] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:59.305146 23645 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:59.320840 15378 raft_consensus.cc:1275] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:59.328670 15373 raft_consensus.cc:2468] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
I20260709 13:11:59.328788 23645 consensus_queue.cc:1048] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:59.330435 15273 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:59.333551 23645 raft_consensus.cc:2804] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:59.334708 23645 raft_consensus.cc:697] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:59.341593 23645 consensus_queue.cc:237] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:59.349205 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.353366 14097 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15254)
W20260709 13:11:59.366243 15274 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:11:59.408836 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:59.432556 15122 catalog_manager.cc:5697] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 20 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 22 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.439232 15301 raft_consensus.cc:1275] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Refusing update from remote peer 5c70ddb5aae14b059dc90fd40125b034: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:11:59.440519 15274 consensus_peers.cc:597] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.441077 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.443991 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.449368 23718 consensus_queue.cc:1048] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:11:59.464529 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:59.472755 23645 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.473556 23645 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:59.476578 23645 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:59.478653 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:11:59.479620 15378 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 21.
I20260709 13:11:59.482007 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: 
I20260709 13:11:59.482997 23645 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:59.483464 23645 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.483848 23645 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:59.491487 15274 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:11:59.525529 15274 consensus_peers.cc:597] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:59.552712 15301 raft_consensus.cc:1275] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:59.554540 23719 consensus_queue.cc:1048] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:59.560246 23645 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:11:59.579417 15274 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:11:59.586484 23645 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Requested vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:11:59.598912 15378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d13483d024d54c9e929c90baefab4d3a" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb"
I20260709 13:11:59.599742 15378 raft_consensus.cc:3060] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:59.615929 15378 raft_consensus.cc:2468] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 841138f50ace4746978e72d7f13878de in term 22.
W20260709 13:11:59.620054 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:59.625528 15273 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de; no voters: b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:11:59.626489 23702 raft_consensus.cc:2804] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:59.628142 23702 raft_consensus.cc:697] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Becoming Leader. State: Replica: 841138f50ace4746978e72d7f13878de, State: Running, Role: LEADER
I20260709 13:11:59.629428 23702 consensus_queue.cc:237] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:11:59.636197 15373 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:11:59.685997 15274 consensus_peers.cc:597] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:59.686523 15348 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.697372 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:59.726545 15378 raft_consensus.cc:1275] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:59.729665 23640 consensus_queue.cc:1048] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:59.728027 15122 catalog_manager.cc:5697] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de reported cstate change: term changed from 20 to 22, leader changed from b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) to 841138f50ace4746978e72d7f13878de (127.13.196.66). New cstate: current_term: 22 leader_uuid: "841138f50ace4746978e72d7f13878de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:59.737535 15274 consensus_peers.cc:597] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.742019 15375 raft_consensus.cc:1275] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:59.746938 23702 consensus_queue.cc:1048] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:59.747709 15304 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:11:59.751798 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8be1b1f251d4292b0b299f3c0c48c25. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.753715 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.760428 23716 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:59.763362 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.814355 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:59.844864 23719 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:11:59.859453 15301 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index -1 to 13, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:11:59.889086 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:11:59.908030 15375 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:11:59.939726 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.963583 15274 consensus_peers.cc:597] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:59.977746 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 657606da148d404bbcad5ee674c9b9d2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.979563 15304 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:11:59.985077 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:59.987984 23719 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:12:00.009523 15124 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index -1 to 13, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 17 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:00.030647 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:00.033589 23716 raft_consensus.cc:2955] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index -1 to 17, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:12:00.036314 15301 raft_consensus.cc:2955] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index -1 to 17, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:12:00.071261 15375 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:12:00.094672 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:00.119107 15124 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 17, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 23 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:12:00.134236 15274 consensus_peers.cc:597] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.138911 15274 consensus_peers.cc:597] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.149909 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.164654 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:00.166087 15301 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:12:00.203168 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:00.225098 15375 raft_consensus.cc:1275] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Refusing update from remote peer 841138f50ace4746978e72d7f13878de: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:12:00.235129 23716 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:00.249990 23645 consensus_queue.cc:1048] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:00.265089 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7236188a1607470eb04fb303bc4a928b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:00.302412 23662 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:12:00.314896 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:00.331485 15301 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:12:00.354090 14097 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15254)
I20260709 13:12:00.401191 15124 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 12, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 20 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:12:00.408119 15274 consensus_peers.cc:597] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:00.425944 15375 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:12:00.439544 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:00.440155 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:00.440644 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:00.447576 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:00.461210 23746 ts_tablet_manager.cc:933] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:00.463126 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:00.498845 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:00.506418 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 66590.6us
W20260709 13:12:00.509136 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:00.511050 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:00.505913 23746 tablet_copy_client.cc:323] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:12:00.531565 15392 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet 657606da148d404bbcad5ee674c9b9d2 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:12:00.532521 15392 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet 657606da148d404bbcad5ee674c9b9d2 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-657606da148d404bbcad5ee674c9b9d2
W20260709 13:12:00.535787 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:00.537155 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351): Couldn't send request to peer 5c70ddb5aae14b059dc90fd40125b034. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 389bc861d7d5427b88bae4655d5ef6b8. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:00.541556 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:00.544629 23749 ts_tablet_manager.cc:933] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:00.556661 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:00.558168 15392 tablet_copy_source_session.cc:215] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:00.562956 23746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657606da148d404bbcad5ee674c9b9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:00.564898 23749 tablet_copy_client.cc:323] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:12:00.567239 15391 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet e8be1b1f251d4292b0b299f3c0c48c25 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:12:00.567895 15391 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet e8be1b1f251d4292b0b299f3c0c48c25 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-e8be1b1f251d4292b0b299f3c0c48c25
W20260709 13:12:00.567530 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 58645.1us
I20260709 13:12:00.597168 15301 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:12:00.607532 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:00.613860 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:00.626080 15391 tablet_copy_source_session.cc:215] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:00.634632 23749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8be1b1f251d4292b0b299f3c0c48c25. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:00.647171 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:00.664582 23662 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:12:00.680974 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:00.688253 23746 tablet_copy_client.cc:806] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:00.690727 23746 tablet_copy_client.cc:670] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:00.688656 23749 tablet_copy_client.cc:806] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:00.702220 23749 tablet_copy_client.cc:670] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:00.702854 23746 tablet_copy_client.cc:538] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:00.712505 23749 tablet_copy_client.cc:538] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:00.737032 15274 consensus_peers.cc:597] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:00.750363 15301 raft_consensus.cc:2955] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:12:00.743283 23719 raft_consensus.cc:2955] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
I20260709 13:12:00.792913 23746 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:12:00.797394 23749 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:12:00.837852 23755 ts_tablet_manager.cc:933] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:00.845371 15124 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index -1 to 10, NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) added. New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } } }
W20260709 13:12:00.896657 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:00.898737 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 65736.9us
I20260709 13:12:00.947804 23755 tablet_copy_client.cc:323] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
W20260709 13:12:00.982990 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 139690us
W20260709 13:12:00.986166 15274 consensus_peers.cc:597] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:01.005399 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:01.006225 15391 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet 7236188a1607470eb04fb303bc4a928b from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:12:01.007134 15391 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet 7236188a1607470eb04fb303bc4a928b from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-7236188a1607470eb04fb303bc4a928b
I20260709 13:12:01.134368 15391 tablet_copy_source_session.cc:215] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:01.141180 23755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7236188a1607470eb04fb303bc4a928b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:01.180987 23765 ts_tablet_manager.cc:933] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: Initiating tablet copy from peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:01.244495 23755 tablet_copy_client.cc:806] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:01.269140 23755 tablet_copy_client.cc:670] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:01.303097 23755 tablet_copy_client.cc:538] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:01.324397 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:01.342032 23765 tablet_copy_client.cc:323] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Beginning tablet copy session from remote peer at address 127.13.196.67:39043
I20260709 13:12:01.345214 15391 tablet_copy_service.cc:140] P 0ec140f610ed4500ba58208c0e5519bb: Received BeginTabletCopySession request for tablet 389bc861d7d5427b88bae4655d5ef6b8 from peer 5c70ddb5aae14b059dc90fd40125b034 ({username='slave'} at 127.0.0.1:52412)
I20260709 13:12:01.345872 15391 tablet_copy_service.cc:161] P 0ec140f610ed4500ba58208c0e5519bb: Beginning new tablet copy session on tablet 389bc861d7d5427b88bae4655d5ef6b8 from peer 5c70ddb5aae14b059dc90fd40125b034 at {username='slave'} at 127.0.0.1:52412: session id = 5c70ddb5aae14b059dc90fd40125b034-389bc861d7d5427b88bae4655d5ef6b8
W20260709 13:12:01.355748 14097 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15254)
I20260709 13:12:01.364240 15391 tablet_copy_source_session.cc:215] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:01.390498 23749 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:01.391784 23749 tablet_bootstrap.cc:492] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:12:01.427380 23765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389bc861d7d5427b88bae4655d5ef6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:01.427695 23755 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:12:01.432927 23749 ts_tablet_manager.cc:1403] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.636s	user 0.066s	sys 0.008s
I20260709 13:12:01.469688 23749 raft_consensus.cc:359] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:12:01.470855 23749 raft_consensus.cc:740] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:12:01.471635 23749 consensus_queue.cc:260] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
W20260709 13:12:01.502960 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:01.519667 23765 tablet_copy_client.cc:806] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:01.523023 23765 tablet_copy_client.cc:670] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:01.508440 23749 ts_tablet_manager.cc:1434] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.005s
I20260709 13:12:01.531143 23765 tablet_copy_client.cc:538] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:01.532028 15391 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-e8be1b1f251d4292b0b299f3c0c48c25 received from {username='slave'} at 127.0.0.1:52412
I20260709 13:12:01.532618 15391 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-e8be1b1f251d4292b0b299f3c0c48c25 on tablet e8be1b1f251d4292b0b299f3c0c48c25 with peer 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:12:01.546638 23765 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap starting.
I20260709 13:12:01.567013 16001 raft_consensus.cc:1217] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.12->[17.13-17.13]   Dedup: 17.13->[]
W20260709 13:12:01.587668 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.598167 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:01.614102 23746 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:01.616725 23746 tablet_bootstrap.cc:492] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:12:01.617662 23746 ts_tablet_manager.cc:1403] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.842s	user 0.042s	sys 0.036s
I20260709 13:12:01.653976 23746 raft_consensus.cc:359] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:12:01.685879 23746 raft_consensus.cc:740] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:12:01.736248 23746 consensus_queue.cc:260] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:12:01.771081 23746 ts_tablet_manager.cc:1434] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.138s	user 0.009s	sys 0.000s
I20260709 13:12:01.795157 15391 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-657606da148d404bbcad5ee674c9b9d2 received from {username='slave'} at 127.0.0.1:52412
I20260709 13:12:01.795770 15391 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-657606da148d404bbcad5ee674c9b9d2 on tablet 657606da148d404bbcad5ee674c9b9d2 with peer 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:12:01.852015 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:01.866343 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 63107.6us
W20260709 13:12:01.879040 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:01.882398 23765 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:01.888501 23765 tablet_bootstrap.cc:492] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:12:01.889559 23765 ts_tablet_manager.cc:1403] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.343s	user 0.059s	sys 0.005s
W20260709 13:12:01.895002 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:01.894551 23765 raft_consensus.cc:359] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:12:01.913633 16001 raft_consensus.cc:1217] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.16->[23.17-23.17]   Dedup: 23.17->[]
I20260709 13:12:01.911500 23765 raft_consensus.cc:740] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:12:01.937388 23765 consensus_queue.cc:260] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:12:01.953833 23765 ts_tablet_manager.cc:1434] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.006s
I20260709 13:12:01.975862 15391 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-389bc861d7d5427b88bae4655d5ef6b8 received from {username='slave'} at 127.0.0.1:52412
I20260709 13:12:01.976596 15391 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-389bc861d7d5427b88bae4655d5ef6b8 on tablet 389bc861d7d5427b88bae4655d5ef6b8 with peer 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:12:01.999547 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 48825.9us
I20260709 13:12:02.016496 23755 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:02.026707 23755 tablet_bootstrap.cc:492] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: Bootstrap complete.
I20260709 13:12:02.031046 23755 ts_tablet_manager.cc:1403] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: Time spent bootstrapping tablet: real 0.604s	user 0.065s	sys 0.006s
W20260709 13:12:02.041868 15274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 128896us
W20260709 13:12:02.046342 15274 consensus_peers.cc:597] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:02.051752 23755 raft_consensus.cc:359] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:12:02.057053 23755 raft_consensus.cc:740] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 5c70ddb5aae14b059dc90fd40125b034, State: Initialized, Role: LEARNER
I20260709 13:12:02.057965 23755 consensus_queue.cc:260] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: NON_VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: true } }
I20260709 13:12:02.078572 23755 ts_tablet_manager.cc:1434] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:12:02.081806 15391 tablet_copy_service.cc:342] P 0ec140f610ed4500ba58208c0e5519bb: Request end of tablet copy session 5c70ddb5aae14b059dc90fd40125b034-7236188a1607470eb04fb303bc4a928b received from {username='slave'} at 127.0.0.1:52412
I20260709 13:12:02.082407 15391 tablet_copy_service.cc:434] P 0ec140f610ed4500ba58208c0e5519bb: ending tablet copy session 5c70ddb5aae14b059dc90fd40125b034-7236188a1607470eb04fb303bc4a928b on tablet 7236188a1607470eb04fb303bc4a928b with peer 5c70ddb5aae14b059dc90fd40125b034
W20260709 13:12:02.116647 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.118022 15274 consensus_peers.cc:597] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.126196 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.127060 15274 consensus_peers.cc:597] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.168414 15274 consensus_peers.cc:597] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.169024 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:02.173133 23751 raft_consensus.cc:1064] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:12:02.176137 23751 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:02.204602 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.215874 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:02.232851 16001 raft_consensus.cc:1217] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 13:12:02.264760 16001 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:02.267805 15302 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:12:02.270622 23751 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:02.273020 23719 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:12:02.275854 15348 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:02.338477 23719 raft_consensus.cc:1064] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:12:02.346225 23719 consensus_queue.cc:237] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:02.356580 14097 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15254)
I20260709 13:12:02.363170 15999 raft_consensus.cc:1217] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:12:02.374130 23716 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:02.378165 15302 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:02.383095 15348 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.399303 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:02.409446 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.432629 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:02.453009 16001 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:12:02.457386 15999 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:02.461970 23751 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:12:02.468276 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:02.468582 15307 raft_consensus.cc:1275] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:12:02.472421 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:02.473066 23716 consensus_queue.cc:1048] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:12:02.480204 15124 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: config changed from index 13 to 14, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:02.481720 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:02.505419 15274 consensus_peers.cc:597] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:02.562392 15274 consensus_peers.cc:597] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.584519 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:02.591060 23720 raft_consensus.cc:2955] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 17 to 18, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:02.594441 15302 raft_consensus.cc:2955] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:02.694703 15274 consensus_peers.cc:597] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.688731 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:02.713950 15999 raft_consensus.cc:2955] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:02.718729 15274 consensus_peers.cc:597] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:02.724491 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:02.741011 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:02.742127 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:02.800257 15373 consensus_queue.cc:237] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:02.833386 23720 raft_consensus.cc:1064] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:12:02.843159 15122 catalog_manager.cc:5697] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 17 to 18, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:02.843737 23720 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:02.854434 15999 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:02.864912 15307 raft_consensus.cc:1275] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:12:02.868898 23716 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:02.871271 23751 consensus_queue.cc:1048] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:02.872184 23776 raft_consensus.cc:1064] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: attempting to promote NON_VOTER 5c70ddb5aae14b059dc90fd40125b034 to VOTER
I20260709 13:12:02.875070 23776 consensus_queue.cc:237] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:02.878439 15274 consensus_peers.cc:597] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:02.886248 23752 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:02.912925 15999 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:02.919530 15307 raft_consensus.cc:2955] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:02.930464 15303 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:12:02.961898 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8be1b1f251d4292b0b299f3c0c48c25 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:02.980871 23716 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:03.004426 15122 catalog_manager.cc:5697] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 14 to 15, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 17 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.024037 15999 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:12:03.040860 15999 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEARNER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:12:03.046226 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:03.051352 23716 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:03.055481 23776 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:03.059085 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:03.067899 15307 raft_consensus.cc:1275] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:12:03.076395 15348 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.077350 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.078548 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:03.085292 15274 consensus_peers.cc:597] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:03.112218 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:03.129514 23716 consensus_queue.cc:1048] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:12:03.143577 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.145193 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:03.175328 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e8be1b1f251d4292b0b299f3c0c48c25: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:03.192499 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:03.193202 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:03.220242 23776 raft_consensus.cc:2955] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.226351 15307 raft_consensus.cc:2955] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:03.234974 15274 consensus_peers.cc:597] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:03.274541 23719 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:03.278430 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:03.286550 15999 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:03.353631 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.357249 14097 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15254)
W20260709 13:12:03.359604 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:03.391793 15123 catalog_manager.cc:5697] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de reported cstate change: config changed from index 10 to 11, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.394349 15307 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:03.411541 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.411753 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:03.416913 15999 raft_consensus.cc:2955] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.424743 15123 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 12 to 13, 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } attrs { replace: true } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.445227 15373 consensus_queue.cc:237] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:03.484221 15999 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:12:03.488408 23719 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:03.505129 15307 raft_consensus.cc:1275] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:12:03.512409 23752 consensus_queue.cc:1048] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:03.516687 15999 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.526428 15307 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.525032 23751 raft_consensus.cc:2955] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
W20260709 13:12:03.539180 15274 consensus_peers.cc:597] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:03.571115 15123 catalog_manager.cc:5697] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 reported cstate change: config changed from index 13 to 14, VOTER b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65) evicted. New cstate: current_term: 20 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } } }
I20260709 13:12:03.578229 15117 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7236188a1607470eb04fb303bc4a928b with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:12:03.663601 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:03.734004 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.741384 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.823678 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.878433 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:03.973815 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:04.096447 15274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111) [suppressed 528 similar messages]
W20260709 13:12:04.346567 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7236188a1607470eb04fb303bc4a928b: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:04.383525 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:04.459105 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.467772 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.520941 15274 consensus_peers.cc:597] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:04.579814 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.629287 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.675798 15274 consensus_peers.cc:597] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:04.678951 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.680572 15274 consensus_peers.cc:597] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:04.684595 15971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 75706.4us
W20260709 13:12:04.832055 15345 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:37121, user_credentials={real_user=slave}} blocked reactor thread for 120484us
W20260709 13:12:04.834838 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 135623us
W20260709 13:12:04.882324 15274 consensus_peers.cc:597] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:04.912916 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:04.919716 15274 consensus_peers.cc:597] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:04.920619 15274 consensus_peers.cc:597] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:04.952473 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:04.957060 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:05.016144 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.043308 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.057880 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.060818 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.058584 15274 consensus_peers.cc:597] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:05.094126 15348 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:05.147917 15274 consensus_peers.cc:597] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:05.160800 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.196864 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.212760 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:05.227809 15274 consensus_peers.cc:597] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:05.348589 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:05.429438 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:05.466627 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e8be1b1f251d4292b0b299f3c0c48c25: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:05.482458 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:05.585270 15274 consensus_peers.cc:597] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:05.602095 15973 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39043, user_credentials={real_user=slave}} blocked reactor thread for 45618us
W20260709 13:12:05.612742 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:05.724714 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.743219 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:05.751082 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.795329 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:05.796062 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:05.844362 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.890739 15274 consensus_peers.cc:597] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.923854 15274 consensus_peers.cc:597] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:05.958033 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:05.976533 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.040709 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.044783 15274 consensus_peers.cc:597] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:06.089444 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:06.191573 15274 consensus_peers.cc:597] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.273841 15274 consensus_peers.cc:597] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.309588 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:06.319540 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:06.355870 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
W20260709 13:12:06.390671 15274 consensus_peers.cc:597] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.512571 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.572584 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:06.827734 15274 consensus_peers.cc:597] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.909848 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.935016 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:06.947719 15274 consensus_peers.cc:597] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:06.952400 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
W20260709 13:12:07.037287 15274 consensus_peers.cc:597] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.095049 15274 consensus_peers.cc:597] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:07.105492 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:07.116791 15971 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.118623 15971 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.128154 15345 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.133582 15345 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.134349 15345 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.133919 15971 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.144790 15345 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.150096 15345 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.156086 15274 consensus_peers.cc:597] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.166392 15345 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.178328 15971 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.186480 15345 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.187412 15274 consensus_peers.cc:597] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:07.194516 15345 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.207144 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.224390 15345 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.235738 15345 consensus_peers.cc:597] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.258131 15345 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.272271 15345 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.289239 15274 consensus_peers.cc:597] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.324934 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:07.336038 15345 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.339579 15345 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.340704 15345 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.352869 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:07.366285 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:07.419555 15348 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:07.423312 15345 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.425901 15345 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.429308 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:12:07.429617 15345 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.430372 15345 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.430642 14097 tablet_replica.cc:333] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.432833 14097 raft_consensus.cc:2243] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.436220 14097 raft_consensus.cc:2272] T 9229ceef9fef4706b1e835456a589647 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:07.443684 15274 consensus_peers.cc:597] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:07.443874 14097 tablet_replica.cc:333] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de: stopping tablet replica
W20260709 13:12:07.450227 15274 consensus_peers.cc:597] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:07.452592 14097 raft_consensus.cc:2243] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.461025 14097 raft_consensus.cc:2272] T 3005d9c450974fc299b5f0c0e92c745a P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.465178 14097 tablet_replica.cc:333] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.466398 14097 raft_consensus.cc:2243] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.467306 14097 raft_consensus.cc:2272] T 1ca5c0c807fd42129fc4ee147149c313 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:07.471673 15345 consensus_peers.cc:597] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.477298 15345 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.480309 15971 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.481178 15971 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:07.483857 15971 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.493089 14097 tablet_replica.cc:333] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.495625 14097 raft_consensus.cc:2243] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.497440 14097 raft_consensus.cc:2272] T 012aeb5edb4346c8b15a323d6a0a1934 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:07.500406 15274 consensus_peers.cc:597] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:07.501282 14097 tablet_replica.cc:333] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.507059 14097 raft_consensus.cc:2243] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.509090 14097 raft_consensus.cc:2272] T ae61ecbf40014ab3bdd48399d0d8a997 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.515007 14097 tablet_replica.cc:333] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.518944 14097 raft_consensus.cc:2243] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.520604 14097 raft_consensus.cc:2272] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:07.568118 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:07.603679 14097 tablet_replica.cc:333] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.605093 14097 raft_consensus.cc:2243] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.606489 14097 raft_consensus.cc:2272] T 5fd2d399eb3d45818234b2fb03159dbe P 841138f50ace4746978e72d7f13878de [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.610682 14097 tablet_replica.cc:333] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.611698 14097 raft_consensus.cc:2243] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.613041 14097 raft_consensus.cc:2272] T 965cf4b237ec478b978733b437297652 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.617084 14097 tablet_replica.cc:333] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
W20260709 13:12:07.632222 15274 consensus_peers.cc:597] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:07.633061 14097 raft_consensus.cc:2243] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.641469 14097 raft_consensus.cc:2272] T 8860a3924290420bb9fbf4a44cd89f06 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.647907 14097 tablet_replica.cc:333] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.649022 14097 raft_consensus.cc:2243] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.650300 14097 raft_consensus.cc:2272] T 6bf87f25409d4351a79d5be897b18ddb P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.703209 14097 tablet_replica.cc:333] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.709460 14097 raft_consensus.cc:2243] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.714030 14097 raft_consensus.cc:2272] T fec6e03dbf19483e8e0a5c9d25c73def P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.718580 14097 tablet_replica.cc:333] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.735141 14097 raft_consensus.cc:2243] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:12:07.740022 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:07.749744 14097 raft_consensus.cc:2272] T 4aa83c2832d5495583c7715993a665e2 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:07.748554 15274 consensus_peers.cc:597] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.771523 15118 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 116833us
W20260709 13:12:07.757956 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:07.779426 14097 tablet_replica.cc:333] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
W20260709 13:12:07.782362 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e8be1b1f251d4292b0b299f3c0c48c25: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:07.796375 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:07.804584 14097 raft_consensus.cc:2243] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:07.818333 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:07.822423 14097 raft_consensus.cc:2272] T b75da66513484f36a3807f62f4177e56 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.849295 14097 tablet_replica.cc:333] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.850416 14097 raft_consensus.cc:2243] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.851120 14097 raft_consensus.cc:2272] T 720e51950072462e9d16f75b27995387 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.885248 14097 tablet_replica.cc:333] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.886341 14097 raft_consensus.cc:2243] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:07.887670 14097 raft_consensus.cc:2272] T fb1065d4b5964e7f8603f56553ecdb3b P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.923031 14097 tablet_replica.cc:333] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
W20260709 13:12:07.933575 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:07.941453 14097 raft_consensus.cc:2243] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.956597 14097 raft_consensus.cc:2272] T 0952b977f0484de9aeb6cb7ca74a0580 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.962803 23806 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:12:07.963650 23806 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:07.970685 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:07.971204 23806 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:07.975907 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:12:07.980576 14097 tablet_replica.cc:333] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:07.985589 14097 raft_consensus.cc:2243] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:07.993304 14097 raft_consensus.cc:2272] T 7f56abc7f6c348d58ce156f066549f7d P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:07.986892 15274 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:12:08.001327 23814 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:08.022827 14097 tablet_replica.cc:333] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.028796 14097 raft_consensus.cc:2243] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.040052 14097 raft_consensus.cc:2272] T 88d57b3730d2404eb078514e05f127c2 P 841138f50ace4746978e72d7f13878de [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.047217 14097 tablet_replica.cc:333] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
W20260709 13:12:08.048008 15274 consensus_peers.cc:597] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:08.083328 23832 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.084115 23832 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.087081 23832 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:08.092769 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.101812 14097 raft_consensus.cc:2243] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.108036 14097 raft_consensus.cc:2272] T a781ba18f2704d43b5f36e4e55228b71 P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.124607 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8be1b1f251d4292b0b299f3c0c48c25" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:12:08.125937 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:08.134959 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:08.147248 23806 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.148036 23806 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.151216 23806 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:08.157230 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.161732 23832 raft_consensus.cc:493] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:12:08.162777 23832 raft_consensus.cc:515] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.166590 23832 leader_election.cc:290] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:08.174043 23806 raft_consensus.cc:493] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.174858 23806 raft_consensus.cc:515] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:08.179165 23806 leader_election.cc:290] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:08.183831 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:08.190941 14097 tablet_replica.cc:333] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.192333 14097 raft_consensus.cc:2243] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.193562 14097 raft_consensus.cc:2272] T 2e7b07c0f0a5432f94b6b20964332362 P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.195470 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ced12ec3004fab89f76f924edf0925" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.214025 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657606da148d404bbcad5ee674c9b9d2" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:12:08.203999 14097 tablet_replica.cc:333] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.221398 14097 raft_consensus.cc:2243] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.223881 23814 raft_consensus.cc:493] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.224680 23814 raft_consensus.cc:515] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:08.227530 23814 leader_election.cc:290] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:08.223158 14097 raft_consensus.cc:2272] T 4e535be5fc0f4cf7b8401a4c737a091f P 841138f50ace4746978e72d7f13878de [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.228792 23814 raft_consensus.cc:493] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.229451 23814 raft_consensus.cc:515] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:08.231819 14097 tablet_replica.cc:333] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.232569 23814 leader_election.cc:290] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:08.232951 14097 raft_consensus.cc:2243] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.233857 14097 raft_consensus.cc:2272] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.251531 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "439569a190ca4e8fbb5f6ad2dce20957" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:12:08.256464 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:08.257731 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c844c3ac2f40469051bf49c46469c6" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.259723 14097 tablet_replica.cc:333] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.260525 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5cd793e143d45cf9e32447e33602536" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.260887 14097 raft_consensus.cc:2243] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.261723 14097 raft_consensus.cc:2272] T 911f84bbbf874ced8f15e93fcf73decd P 841138f50ace4746978e72d7f13878de [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.268024 23814 raft_consensus.cc:493] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.268867 23814 raft_consensus.cc:515] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:08.271577 23814 leader_election.cc:290] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:08.274169 23814 raft_consensus.cc:493] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:12:08.274941 23814 raft_consensus.cc:515] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.277643 23814 leader_election.cc:290] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:08.274475 15274 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:12:08.289017 23814 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:08.289896 14097 tablet_replica.cc:333] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.290940 14097 raft_consensus.cc:2243] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.300741 15274 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:12:08.303450 23814 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:08.308905 14097 raft_consensus.cc:2272] T bb3022274b1549eb806d68dc808a6ceb P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.315330 14097 tablet_replica.cc:333] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.316515 14097 raft_consensus.cc:2243] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:08.325054 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:08.330322 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c27cdc2356514f4ea31d68df9ee2fa02" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.338531 14097 raft_consensus.cc:2272] T c4dc28ca60664c41a529fde0dc6c28aa P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.343961 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de1580a2d944ae884df67f226c8b71d" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:12:08.351054 15274 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.351595 23806 raft_consensus.cc:493] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
W20260709 13:12:08.352316 15274 leader_election.cc:336] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.352182 23806 raft_consensus.cc:515] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.352787 15274 leader_election.cc:304] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:08.352995 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:08.354425 23806 leader_election.cc:290] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:12:08.353861 15274 leader_election.cc:336] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.366775 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.377662 15274 leader_election.cc:304] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:08.378589 15274 raft_consensus.cc:2686] T 58ced12ec3004fab89f76f924edf0925 P 841138f50ace4746978e72d7f13878de: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:08.353572 23814 raft_consensus.cc:2749] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:08.375627 14097 tablet_replica.cc:333] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.381834 14097 raft_consensus.cc:2243] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.384001 14097 raft_consensus.cc:2272] T e8be1b1f251d4292b0b299f3c0c48c25 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.394529 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:08.401288 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f082f323814ed98886bca799e3d232" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:12:08.400432 15274 leader_election.cc:336] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.404076 15274 leader_election.cc:304] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:08.413589 23814 raft_consensus.cc:2749] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:08.414799 23814 raft_consensus.cc:493] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
W20260709 13:12:08.413717 15274 leader_election.cc:336] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.415535 15274 leader_election.cc:304] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:08.417547 15274 consensus_peers.cc:597] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:08.418095 15274 leader_election.cc:336] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.415526 23814 raft_consensus.cc:515] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:08.418525 15274 leader_election.cc:304] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:08.420591 23814 leader_election.cc:290] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:08.420771 23806 raft_consensus.cc:2749] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:08.420609 23832 raft_consensus.cc:2749] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:08.424685 15274 leader_election.cc:336] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.425174 15274 leader_election.cc:304] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:08.427088 23832 raft_consensus.cc:2749] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:08.435441 14097 tablet_replica.cc:333] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.441826 14097 raft_consensus.cc:2243] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.443500 14097 raft_consensus.cc:2272] T 9be9d73e985345e39f20d23687e60a85 P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.447077 14097 tablet_replica.cc:333] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.448623 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8ad749c34474d4db0fa33ca64452d80" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.452739 23832 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.453534 23832 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.457933 23832 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:08.459182 23814 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:08.460007 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.459774 23814 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.464658 23814 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:08.465006 15274 leader_election.cc:304] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:12:08.466219 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
I20260709 13:12:08.472818 23814 raft_consensus.cc:2749] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:08.474888 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389bc861d7d5427b88bae4655d5ef6b8" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
W20260709 13:12:08.475032 15274 consensus_peers.cc:597] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:08.475607 14097 raft_consensus.cc:2243] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.477818 14097 raft_consensus.cc:2272] T 20919a13dd564519b54dd5e3c0751736 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.484946 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7236188a1607470eb04fb303bc4a928b" candidate_uuid: "841138f50ace4746978e72d7f13878de" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:12:08.491480 14097 tablet_replica.cc:333] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.485167 15274 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:12:08.501011 23814 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:08.500779 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:08.503255 14097 raft_consensus.cc:2243] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:08.516574 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:08.504578 14097 raft_consensus.cc:2272] T d3f082f323814ed98886bca799e3d232 P 841138f50ace4746978e72d7f13878de [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.532363 15274 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034
I20260709 13:12:08.536851 23814 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:08.540709 14097 tablet_replica.cc:333] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.542057 14097 raft_consensus.cc:2243] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:12:08.545643 15274 leader_election.cc:336] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.546317 15274 leader_election.cc:304] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 841138f50ace4746978e72d7f13878de; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:08.547616 15274 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.547829 23814 raft_consensus.cc:2749] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:08.551864 14097 raft_consensus.cc:2272] T 0066b5a9791e4a30856433ed14864d2f P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.588217 14097 tablet_replica.cc:333] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
W20260709 13:12:08.593686 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:08.607650 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:08.608554 14097 raft_consensus.cc:2243] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.609629 14097 raft_consensus.cc:2272] T d8ad749c34474d4db0fa33ca64452d80 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.620416 14097 tablet_replica.cc:333] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.621438 14097 raft_consensus.cc:2243] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.624922 14097 raft_consensus.cc:2272] T 2578a36ef3a84d208c1736eedfe8f2bf P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.634593 14097 tablet_replica.cc:333] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.649358 14097 raft_consensus.cc:2243] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.651234 14097 raft_consensus.cc:2272] T f2466cf62f214b16bdaa21d868e54b04 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.654811 14097 tablet_replica.cc:333] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.655820 14097 raft_consensus.cc:2243] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.657311 14097 raft_consensus.cc:2272] T 389bc861d7d5427b88bae4655d5ef6b8 P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.694096 14097 tablet_replica.cc:333] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.695119 14097 raft_consensus.cc:2243] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.696835 14097 raft_consensus.cc:2272] T 872a48310a1f4a28b75d05f83ce6b20b P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.700060 14097 tablet_replica.cc:333] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
W20260709 13:12:08.706192 15274 consensus_peers.cc:597] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:08.715983 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:08.719935 14097 raft_consensus.cc:2243] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.723937 14097 raft_consensus.cc:2272] T f5cd793e143d45cf9e32447e33602536 P 841138f50ace4746978e72d7f13878de [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.733922 14097 tablet_replica.cc:333] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.739114 14097 raft_consensus.cc:2243] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.745729 14097 raft_consensus.cc:2272] T 09794c12bb344a25888d56e55d7e90f8 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.756237 14097 tablet_replica.cc:333] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.764659 23839 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:08.765409 23839 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:08.771833 15345 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:08.772590 23839 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:08.772790 14097 raft_consensus.cc:2243] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.774016 14097 raft_consensus.cc:2272] T 8218e039c251425fb97ad83094c709da P 841138f50ace4746978e72d7f13878de [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.777354 14097 tablet_replica.cc:333] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.785189 14097 raft_consensus.cc:2243] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.789091 14097 raft_consensus.cc:2272] T 657606da148d404bbcad5ee674c9b9d2 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.790573 15348 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.791190 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:08.792977 23838 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:08.794900 14097 tablet_replica.cc:333] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.803037 14097 raft_consensus.cc:2243] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.817142 14097 raft_consensus.cc:2272] T 362d7a17088a4e86a51428b5ee97346e P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.826351 14097 tablet_replica.cc:333] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.836910 23833 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:08.837322 14097 raft_consensus.cc:2243] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.837738 23833 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:08.838798 14097 raft_consensus.cc:2272] T 2de1580a2d944ae884df67f226c8b71d P 841138f50ace4746978e72d7f13878de [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.840559 23833 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:08.845943 15348 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:08.848277 15345 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:08.848882 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:08.849768 23839 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:08.848883 14097 tablet_replica.cc:333] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.853369 14097 raft_consensus.cc:2243] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.854163 14097 raft_consensus.cc:2272] T 439569a190ca4e8fbb5f6ad2dce20957 P 841138f50ace4746978e72d7f13878de [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.867865 14097 tablet_replica.cc:333] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.870386 14097 raft_consensus.cc:2243] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.873595 14097 raft_consensus.cc:2272] T d55ea5972868497eb17221413640fbea P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.884583 14097 tablet_replica.cc:333] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.888659 14097 raft_consensus.cc:2243] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.889660 14097 raft_consensus.cc:2272] T c27cdc2356514f4ea31d68df9ee2fa02 P 841138f50ace4746978e72d7f13878de [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.892737 14097 tablet_replica.cc:333] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.893554 14097 raft_consensus.cc:2243] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.907505 14097 raft_consensus.cc:2272] T 3f803fff1dbc4b87b787f25b1659c2ae P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.910939 14097 tablet_replica.cc:333] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.911890 14097 raft_consensus.cc:2243] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.913551 14097 raft_consensus.cc:2272] T e879ecfd4de9483e8b42ea01de447fdc P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.938087 14097 tablet_replica.cc:333] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.939016 14097 raft_consensus.cc:2243] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.941211 14097 raft_consensus.cc:2272] T 10888684198543f19c54c7cbcb094157 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.945050 14097 tablet_replica.cc:333] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.945945 14097 raft_consensus.cc:2243] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.946806 14097 raft_consensus.cc:2272] T 66c844c3ac2f40469051bf49c46469c6 P 841138f50ace4746978e72d7f13878de [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.950153 14097 tablet_replica.cc:333] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.950953 14097 raft_consensus.cc:2243] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.952540 23827 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:08.953244 23827 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:08.961794 14097 raft_consensus.cc:2272] T 7236188a1607470eb04fb303bc4a928b P 841138f50ace4746978e72d7f13878de [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.968184 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:08.970170 23827 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:08.973402 14097 tablet_replica.cc:333] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.974375 14097 raft_consensus.cc:2243] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:12:08.975207 15971 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:08.976022 14097 raft_consensus.cc:2272] T d13483d024d54c9e929c90baefab4d3a P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.981472 14097 tablet_replica.cc:333] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.975826 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:08.983601 14097 raft_consensus.cc:2243] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.984972 23833 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:08.985599 23833 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:08.987370 14097 raft_consensus.cc:2272] T 67a795b9e21446b4be65705c76ee1d94 P 841138f50ace4746978e72d7f13878de [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.990787 23833 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:08.991614 14097 tablet_replica.cc:333] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de: stopping tablet replica
I20260709 13:12:08.992439 14097 raft_consensus.cc:2243] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.993623 14097 raft_consensus.cc:2272] T 168b77c528554771b17206e0062bd8cc P 841138f50ace4746978e72d7f13878de [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:09.003038 15345 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:08.983533 23827 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:09.036224 23839 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.036849 23839 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:09.039072 23839 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:09.040490 23839 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.040998 23839 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:09.043076 15345 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:09.043428 23839 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.059461 15345 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:09.060607 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:09.061120 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.061894 23839 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:09.071317 15348 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:09.071801 15348 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.072654 23833 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:09.082706 15348 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:09.083211 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.084000 23833 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:09.107240 15348 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111) [suppressed 622 similar messages]
W20260709 13:12:09.138327 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:09.143946 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:09.219802 23833 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.220498 23833 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:09.226336 23833 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.231475 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:09.241878 15345 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:09.242336 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.243103 23833 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:09.245138 23792 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.245689 23792 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:09.247991 23792 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:09.253657 15379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "5c70ddb5aae14b059dc90fd40125b034" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0ec140f610ed4500ba58208c0e5519bb" is_pre_election: true
W20260709 13:12:09.257673 15971 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:09.258157 15971 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:09.259130 23827 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:09.275393 23833 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.276043 23833 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:09.279798 23833 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.282733 15345 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:09.284896 15348 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:09.285368 15348 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.286139 23833 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:09.300595 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.327926 15345 consensus_peers.cc:597] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.436720 23833 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.437292 23833 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:09.440888 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:12:09.441548 16001 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 15.
I20260709 13:12:09.439430 23833 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:12:09.447870 15345 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:09.452137 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:12:09.453099 23833 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:09.453550 23833 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.453992 23833 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:09.479063 15345 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.518570 23833 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:09.539176 15971 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.545231 15345 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.567868 15345 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.572724 15971 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.575102 23833 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Requested vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
W20260709 13:12:09.582392 15345 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:09.587512 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d57b3730d2404eb078514e05f127c2" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034"
I20260709 13:12:09.588184 16001 raft_consensus.cc:3060] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:09.595732 16001 raft_consensus.cc:2468] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec140f610ed4500ba58208c0e5519bb in term 16.
I20260709 13:12:09.598652 23839 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.599314 23839 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:09.601528 23839 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.626441 15971 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.635416 15345 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:09.638470 15345 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.637760 15348 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb, 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de
I20260709 13:12:09.640453 23833 raft_consensus.cc:2804] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:09.641075 23833 raft_consensus.cc:697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Becoming Leader. State: Replica: 0ec140f610ed4500ba58208c0e5519bb, State: Running, Role: LEADER
I20260709 13:12:09.649840 23833 consensus_queue.cc:237] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:09.659037 15348 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:09.661926 15348 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:09.661026 15345 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.664853 23843 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:09.666108 15345 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.666882 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.679136 15345 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.686054 23827 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.686710 23827 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:09.689749 23827 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.697764 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:09.716286 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:09.717090 15971 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:09.718425 15971 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.719533 23827 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:09.745607 15971 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.766022 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:44011, user_credentials={real_user=slave}} blocked reactor thread for 44328.9us
W20260709 13:12:09.777439 15971 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.794440 15122 catalog_manager.cc:5697] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb reported cstate change: term changed from 15 to 16, leader changed from 841138f50ace4746978e72d7f13878de (127.13.196.66) to 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67). New cstate: current_term: 16 leader_uuid: "0ec140f610ed4500ba58208c0e5519bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:09.779096 23845 log.cc:927] Time spent T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:12:09.786309 15345 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.809082 23827 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.809715 23827 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:09.811854 23827 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.826597 15971 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:09.829162 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:09.840900 15345 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.842088 15974 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:09.849061 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.857298 23827 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:09.860677 23833 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.861431 23833 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:09.864225 23833 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.868422 15345 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.878268 15345 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.882045 15345 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.887791 15345 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.887233 15348 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:09.899379 15345 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:09.899840 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.901185 23843 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:09.908646 23843 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.909128 23843 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:09.910895 15345 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:09.911456 15345 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.911628 23843 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:09.923897 15345 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:09.925045 15348 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:09.925666 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:09.928086 23839 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:09.941045 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:09.941632 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:09.962811 15971 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.967614 23843 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.968475 23827 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:09.969034 23827 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:09.969528 15345 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:09.968263 23843 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:09.981540 23827 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:09.996462 23843 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.001202 15971 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:10.006207 15974 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:10.006729 15974 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:10.011950 15345 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.015530 23792 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:10.016980 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.028529 15345 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:10.033438 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.044553 23833 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:10.045454 23833 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.046129 23833 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.048525 23839 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.049048 23839 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.051280 23839 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:10.052647 23833 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.060672 15348 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:10.061143 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:10.066854 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.067549 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.076692 15345 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.077214 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.077993 23833 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:10.078989 15345 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.079478 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.080178 23833 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:10.081161 15345 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.081626 15345 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.095923 15345 consensus_peers.cc:597] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.120103 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.143605 15345 consensus_peers.cc:597] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:10.168576 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:10.208634 14097 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15329)
I20260709 13:12:10.209802 23833 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.210492 23833 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.217155 23850 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.217784 23850 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.218525 16001 raft_consensus.cc:1275] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Refusing update from remote peer 0ec140f610ed4500ba58208c0e5519bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:12:10.219839 23850 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:10.220515 23850 consensus_queue.cc:1048] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:12:10.212808 23833 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.223879 15345 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:10.230465 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:10.231328 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.232082 23850 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:10.235496 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:12:10.227775 23833 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.238191 23833 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.241110 23833 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.239095 15348 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.245431 15345 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.246449 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.250680 23850 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:10.255623 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.269951 15345 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.275532 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:10.277119 15971 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:10.277630 23850 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:10.317906 23851 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.318611 23851 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.321151 23851 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.328119 15348 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.329550 15345 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.330096 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.330921 23851 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:10.349067 23851 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.349606 23851 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.351999 23851 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:10.369383 23851 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.370059 23851 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.374552 23851 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.372601 15348 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.384649 15345 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.385501 23833 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.388761 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.389400 23833 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:12:10.391673 23833 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:12:10.410105 23851 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:10.413579 15348 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.416885 15345 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.417349 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.418143 23850 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:10.427093 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.427449 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:10.431430 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:10.434242 15345 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.434733 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.435496 23833 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:10.478937 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:10.511721 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:10.534071 23827 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.534693 23827 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:10.540081 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:10.554709 23827 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.568598 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.573036 15971 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.573602 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.574774 23827 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:10.640196 23833 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:10.640782 23833 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:10.643244 23833 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:10.664201 15348 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:10.665887 15345 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:10.666385 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:10.667680 23851 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:10.820518 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:10.887866 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:10.926200 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:10.962155 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:11.002960 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:11.016727 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:11.040668 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:11.052654 23833 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.053279 23833 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:11.055917 23833 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.063287 15345 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:11.064797 15348 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:11.065709 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:11.067314 23833 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:11.178543 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:11.209245 14097 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15329)
I20260709 13:12:11.220620 23833 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.221223 23833 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:11.223265 23833 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:11.223747 23833 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.225435 23833 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:11.242694 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:11.245630 23851 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.246268 23851 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:11.248476 23851 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.256626 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:11.257236 15348 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:11.258163 23833 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.259912 15348 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:11.286674 23833 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.287235 23833 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:11.289346 23833 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.295905 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:11.314301 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:11.357028 23792 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.357034 23833 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.357637 23792 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:11.358263 23833 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:11.359966 23792 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:11.360102 23833 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.391129 15348 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:11.403640 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:11.406528 15971 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:11.406971 15971 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:11.410593 23792 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:11.520435 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:11.638389 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:11.725697 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:12:11.746362 23857 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.746958 23857 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:11.749130 23857 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.757050 15974 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:11.759507 15971 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:11.760067 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:11.760865 23827 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:12:11.788996 23827 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.789726 23827 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:11.793325 23827 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.800305 15971 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:11.801148 15974 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:11.801599 15974 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:11.802366 23827 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:11.885619 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:12:11.921913 23856 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.922595 23856 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:11.924741 23856 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.929397 15348 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:11.935381 23856 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:11.936002 23856 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:11.940426 23856 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:11.943418 15348 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:12.004280 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e8be1b1f251d4292b0b299f3c0c48c25: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:12.102069 23827 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.102686 23827 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:12.104789 23827 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:12.108955 23851 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.109593 23851 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:12.111714 23851 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:12.120169 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:12.123981 23851 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.124533 23851 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:12.126731 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:12.128191 15971 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.128633 15971 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.130225 23857 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:12.137521 15971 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:12.140810 23851 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:12.151440 15345 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:12.152070 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:12.158612 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.160918 23851 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:12.162531 15971 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.164296 15345 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.166700 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:12.169744 15971 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:12.170343 23851 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:12.171496 15345 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.172008 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.177561 23851 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:12.178833 15345 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.179314 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.180110 23851 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:12.181311 15345 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.181790 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.182572 23851 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:12.185519 15345 consensus_peers.cc:597] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.194497 15345 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.195024 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.195858 23851 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:12.196992 15345 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.197432 15345 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.198163 23851 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:12.199167 15345 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.199602 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.200352 23851 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:12.201457 15345 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.203055 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.203790 23851 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:12.207453 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:12.216409 14097 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15329)
I20260709 13:12:12.245615 23851 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.246234 23851 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:12.248459 23851 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:12.256515 15345 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.257465 23851 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.260862 23851 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:12.260069 15348 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:12.265175 15348 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.266856 23856 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:12.270706 15345 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.272490 23851 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:12.276290 23851 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.276923 23851 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:12.277747 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:12.283798 15348 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.284632 23856 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:12.290776 15345 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.291646 23851 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:12.311134 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:12.312319 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:12.312858 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.318071 23856 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:12.328799 23856 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.329491 23856 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:12.332067 23856 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:12.680801 23851 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.681365 23851 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:12.683626 23851 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:12.690914 15348 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:12.697175 15971 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.697939 15971 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.698297 15971 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:12.725562 23860 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.726126 23860 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:12.730199 23860 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:12.751176 15345 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.753386 23851 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:12.759328 23851 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:12:12.761420 23851 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:12:12.756924 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:12.762400 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:12.766156 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:12.758565 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:12.767144 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:12.767722 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:12.777112 15345 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.778034 15345 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.779126 15345 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.779599 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:12.781111 23865 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:12.778514 23863 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:12.796922 15348 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:12.797703 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:12.799062 15345 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:12.799309 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:12.799731 15345 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:12.800462 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:12.801652 23851 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:12.802685 15345 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.803411 15345 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.808012 15971 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.819999 15345 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:12.820622 15348 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:12.824200 15345 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:12.824754 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:12.826009 15345 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:12.827684 23833 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:12.919958 15345 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.063736 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:13.066054 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:13.075098 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:13.112124 15345 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:13.143283 23863 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:13.143801 23863 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:13.145862 23863 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:13.149812 15348 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:13.152992 15345 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:13.153427 15345 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:13.155226 23833 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:13.160952 15345 consensus_peers.cc:597] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.166712 15345 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.175169 15345 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.184980 15345 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.187132 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:13.202606 15345 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.216892 14097 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15329)
W20260709 13:12:13.244688 15345 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.293594 15345 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.297508 15345 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.296958 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:13.317813 15345 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.325490 15345 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.326102 15345 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.378556 15345 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:13.387394 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:13.466050 23862 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:13.466740 23862 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:13.468997 23862 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:13.478327 15971 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:13.479727 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:13.481647 15974 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:13.483057 23862 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:13.614318 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:13.644033 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:13.652639 15345 consensus_peers.cc:597] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:13.672981 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:13.697903 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6a60 after lost signal to thread 14100
W20260709 13:12:13.699148 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08003825a0 after lost signal to thread 15165
W20260709 13:12:13.700606 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3360 after lost signal to thread 15406
W20260709 13:12:13.701917 16029 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5a80 after lost signal to thread 16032
W20260709 13:12:13.715862 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:13.768754 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:12:13.770882 23833 raft_consensus.cc:493] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:13.771436 23833 raft_consensus.cc:515] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:13.771857 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:12:13.773806 23833 leader_election.cc:290] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:13.792303 15345 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:13.795370 15348 leader_election.cc:336] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:13.796483 15348 leader_election.cc:304] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:13.797873 23851 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:13.798574 23851 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:13.800992 23851 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:13.804661 23851 raft_consensus.cc:2749] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:13.822719 15345 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:13.833509 15348 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:13.833990 15348 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:13.834112 23833 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:13.834709 23833 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:13.837224 23863 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:13.838905 23833 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:13.855738 15345 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:13.857463 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:13.858021 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:13.868845 23833 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:13.870101 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:13.887065 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:13.894584 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:14.016407 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:12:14.016757 23833 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.017258 23833 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:14.019310 23833 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.023723 15348 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.026530 15345 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:14.026988 15345 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:14.028209 23833 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:14.110062 15974 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111) [suppressed 612 similar messages]
I20260709 13:12:14.115710 23851 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.116374 23851 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:14.118582 23851 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:14.122324 23833 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.122781 23833 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:14.124898 23833 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.131664 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.138820 15348 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.139868 15345 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:14.140656 15345 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:14.142369 23851 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:14.145028 15345 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:14.145572 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:14.146420 23851 raft_consensus.cc:2749] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:14.166899 23833 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.167434 23833 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:14.169261 23833 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.177644 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.200275 15345 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:14.201218 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:14.208995 23851 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:14.217401 14097 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15329)
W20260709 13:12:14.269938 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:12:14.312879 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:12:14.477056 23833 raft_consensus.cc:493] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.478588 23833 raft_consensus.cc:515] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:14.494112 23833 leader_election.cc:290] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.502240 15348 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.505110 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:12:14.512111 23851 raft_consensus.cc:493] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.513183 23851 raft_consensus.cc:515] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:14.516028 23851 leader_election.cc:290] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.525638 15348 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.528404 15345 leader_election.cc:336] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:14.534220 15345 leader_election.cc:304] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:14.535199 23851 raft_consensus.cc:2749] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:14.538720 15345 leader_election.cc:336] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:14.539248 15345 leader_election.cc:304] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:14.540064 23851 raft_consensus.cc:2749] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:14.575044 15345 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:14.790129 15345 consensus_peers.cc:597] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:14.856534 23833 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.857055 23827 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.859014 23827 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:14.857232 23833 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:12:14.863015 23833 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
I20260709 13:12:14.878654 23827 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.884101 15345 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:14.896509 23827 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.899163 23827 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:14.922394 23827 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.923208 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:12:14.938721 23863 raft_consensus.cc:493] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:14.941074 23863 raft_consensus.cc:515] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:14.943527 23863 leader_election.cc:290] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:14.944700 15974 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.945927 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:12:14.952858 15345 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:14.953634 15974 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:14.994994 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:14.997835 15348 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:15.004966 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:15.006995 23869 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:15.014293 15348 leader_election.cc:336] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:15.014889 15348 leader_election.cc:304] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.018536 23869 raft_consensus.cc:2749] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:15.023012 15971 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.023587 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.024434 23827 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:15.025460 15971 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.025967 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.026778 23827 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:15.076648 15345 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.112852 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:12:15.127734 15345 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.160636 15348 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:15.161363 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:15.186923 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:15.206429 15345 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:15.208653 23863 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.212239 23863 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:15.214413 23863 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:15.218072 14097 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15329)
W20260709 13:12:15.222698 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:15.222802 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:12:15.230441 15345 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.231313 23863 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.232998 15345 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.233163 23863 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:15.235458 23863 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:15.239800 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:15.240859 23869 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:15.267807 15345 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.276305 15345 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.277273 23863 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:15.301297 23869 raft_consensus.cc:493] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.302136 23869 raft_consensus.cc:515] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:15.305003 23869 leader_election.cc:290] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:15.313680 15348 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:15.330626 15345 leader_election.cc:336] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:15.331071 15971 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:15.331216 15345 leader_election.cc:304] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.332202 23869 raft_consensus.cc:2749] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:15.361896 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:15.385239 15345 consensus_peers.cc:597] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:15.396201 23869 raft_consensus.cc:493] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.396943 23869 raft_consensus.cc:515] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:15.397601 23863 raft_consensus.cc:493] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.398185 23863 raft_consensus.cc:515] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:15.399077 23869 leader_election.cc:290] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:15.400146 23863 leader_election.cc:290] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:15.419368 15348 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:15.420027 15348 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:15.420619 15345 leader_election.cc:336] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.421717 15345 leader_election.cc:304] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.422466 23863 raft_consensus.cc:2749] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:15.422636 15345 leader_election.cc:336] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.423206 15345 leader_election.cc:304] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.424015 23863 raft_consensus.cc:2749] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:15.437485 15345 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.449720 15348 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:15.451242 15971 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.504925 15971 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.560702 15345 consensus_peers.cc:597] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.621601 15345 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.622732 15345 consensus_peers.cc:597] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.637651 15348 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:15.638700 23863 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.639667 23863 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:15.641651 15971 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:15.642136 23863 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:15.653680 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:15.655717 15345 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.657202 15345 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.665627 23863 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:15.702396 15345 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.715585 15345 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.725302 15345 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:15.760530 23827 raft_consensus.cc:493] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.761298 23827 raft_consensus.cc:515] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:15.768575 15974 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:15.771263 23827 leader_election.cc:290] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:15.772696 15345 consensus_peers.cc:597] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.776250 15971 leader_election.cc:336] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.776820 15971 leader_election.cc:304] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.779366 23862 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.782177 23862 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:15.790310 15971 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:15.798262 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:15.799561 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.778530 23827 raft_consensus.cc:2749] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:15.798803 23862 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:15.808952 23862 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:15.840283 15345 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.852520 15971 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:15.854249 23863 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:15.855031 23863 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:15.857168 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:15.857443 23863 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:15.868507 15348 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:15.869059 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:15.880213 15345 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.911458 15348 consensus_peers.cc:597] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:15.913805 15348 consensus_peers.cc:597] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:15.916038 15345 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.916710 15345 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:15.917150 15345 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:15.942150 15345 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:15.943038 23869 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:15.966948 15345 consensus_peers.cc:597] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.001216 15345 consensus_peers.cc:597] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.027921 15971 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.038498 15348 consensus_peers.cc:597] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:16.043273 23871 raft_consensus.cc:493] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:16.043998 23871 raft_consensus.cc:515] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:16.047142 23871 leader_election.cc:290] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:16.051484 15348 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:16.055354 15345 leader_election.cc:336] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:16.057703 15345 leader_election.cc:304] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:16.058670 23871 raft_consensus.cc:2749] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:16.140588 15971 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.166801 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:16.197052 15345 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:16.234651 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:12:16.239893 23863 raft_consensus.cc:493] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:16.240775 23863 raft_consensus.cc:515] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:16.243287 23863 leader_election.cc:290] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:16.251907 15345 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:16.253118 15348 leader_election.cc:336] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:16.253777 15348 leader_election.cc:304] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:16.254675 23863 raft_consensus.cc:2749] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:16.256182 23863 raft_consensus.cc:493] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:16.256855 23863 raft_consensus.cc:515] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:16.258019 15348 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:12:16.258987 23863 leader_election.cc:290] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:16.263819 15345 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:16.276978 15348 leader_election.cc:336] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:16.277558 15348 leader_election.cc:304] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:16.285104 23871 raft_consensus.cc:2749] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:16.284185 15345 consensus_peers.cc:597] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:16.330149 15348 consensus_peers.cc:597] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:16.349512 15348 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:16.378590 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:12:16.466974 15348 consensus_peers.cc:597] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:12:16.491505 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
W20260709 13:12:16.556036 15348 consensus_peers.cc:597] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:12:16.574640 23873 raft_consensus.cc:493] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:16.575343 23873 raft_consensus.cc:515] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } }
I20260709 13:12:16.577716 23873 leader_election.cc:290] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011)
W20260709 13:12:16.596546 15348 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:16.599829 15345 leader_election.cc:336] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:16.600376 15345 leader_election.cc:304] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:16.602321 23863 raft_consensus.cc:2749] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:16.663358 15348 consensus_peers.cc:597] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:16.829986 15348 consensus_peers.cc:597] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:12:16.898307 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:12:16.911470 23863 raft_consensus.cc:493] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:16.912278 23863 raft_consensus.cc:515] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:16.914542 23863 leader_election.cc:290] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:16.938985 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
W20260709 13:12:16.954362 15345 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:16.954965 15345 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:16.956811 15348 leader_election.cc:336] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:16.958639 15348 leader_election.cc:304] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:16.960173 23863 raft_consensus.cc:2749] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:16.962848 15973 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.963794 15348 consensus_peers.cc:597] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:12:16.980286 15973 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.086314 23863 raft_consensus.cc:493] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.086962 23863 raft_consensus.cc:515] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
W20260709 13:12:17.094760 15973 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.099107 23863 leader_election.cc:290] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:17.104555 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:12:17.105700 15348 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:17.114287 14097 tablet_replica.cc:333] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.115468 14097 raft_consensus.cc:2243] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:12:17.116497 15345 leader_election.cc:336] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:17.117396 15345 leader_election.cc:304] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:17.118180 23873 raft_consensus.cc:2749] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:17.119778 14097 raft_consensus.cc:2272] T 1ca5c0c807fd42129fc4ee147149c313 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.125041 14097 tablet_replica.cc:333] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.126259 14097 raft_consensus.cc:2243] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.127674 14097 raft_consensus.cc:2272] T 9229ceef9fef4706b1e835456a589647 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.131392 14097 tablet_replica.cc:333] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.132453 14097 raft_consensus.cc:2243] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.133659 14097 raft_consensus.cc:2272] T 75432bd549b3481d83070979a305922b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.145638 15973 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.148471 14097 tablet_replica.cc:333] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
W20260709 13:12:17.164747 15973 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.168102 23863 raft_consensus.cc:493] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.168886 23863 raft_consensus.cc:515] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:17.184291 23863 leader_election.cc:290] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:17.185250 15973 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.186820 15345 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:17.194561 14097 raft_consensus.cc:2243] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:12:17.197377 15348 leader_election.cc:336] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:17.199641 15348 leader_election.cc:304] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:17.198971 14097 raft_consensus.cc:2272] T 3005d9c450974fc299b5f0c0e92c745a P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.201287 23873 raft_consensus.cc:2749] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:17.205926 14097 tablet_replica.cc:333] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.219170 14097 raft_consensus.cc:2243] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.221604 14097 raft_consensus.cc:2272] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.225871 14097 tablet_replica.cc:333] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.227027 14097 raft_consensus.cc:2243] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.229581 14097 raft_consensus.cc:2272] T 8860a3924290420bb9fbf4a44cd89f06 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.233151 14097 tablet_replica.cc:333] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.234256 14097 raft_consensus.cc:2243] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.235247 14097 raft_consensus.cc:2272] T 5fd2d399eb3d45818234b2fb03159dbe P 0ec140f610ed4500ba58208c0e5519bb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.264271 14097 tablet_replica.cc:333] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.265410 14097 raft_consensus.cc:2243] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.266705 14097 raft_consensus.cc:2272] T 012aeb5edb4346c8b15a323d6a0a1934 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.270282 14097 tablet_replica.cc:333] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.271198 14097 raft_consensus.cc:2243] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.273661 14097 raft_consensus.cc:2272] T fec6e03dbf19483e8e0a5c9d25c73def P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.276669 14097 tablet_replica.cc:333] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.280164 14097 raft_consensus.cc:2243] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:12:17.297731 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:12:17.298214 15345 consensus_peers.cc:597] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:17.310350 15973 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.313620 14097 raft_consensus.cc:2272] T 315a39052c3a4aa189e80239d6709f0e P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.318524 14097 tablet_replica.cc:333] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.319595 14097 raft_consensus.cc:2243] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.324280 14097 raft_consensus.cc:2272] T 4aa83c2832d5495583c7715993a665e2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.330853 15345 consensus_peers.cc:597] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:17.331815 15973 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.335631 23870 raft_consensus.cc:493] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.336236 23870 raft_consensus.cc:515] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:17.338560 15973 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:17.345454 15974 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:17.356390 15971 leader_election.cc:336] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:17.356870 15971 leader_election.cc:304] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:17.357898 23870 leader_election.cc:290] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:17.361852 23863 raft_consensus.cc:493] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.362416 23863 raft_consensus.cc:515] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:17.364539 23863 leader_election.cc:290] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:17.365208 23875 raft_consensus.cc:2749] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:17.369798 15345 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:17.373660 15348 leader_election.cc:336] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:17.378894 15348 leader_election.cc:304] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:17.381788 23863 raft_consensus.cc:2749] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:17.409076 14097 tablet_replica.cc:333] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.410247 14097 raft_consensus.cc:2243] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.411065 14097 raft_consensus.cc:2272] T bb30c1248aaf4663a734d0eb93201e7b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.414247 14097 tablet_replica.cc:333] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.416364 14097 raft_consensus.cc:2243] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:12:17.417924 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:12:17.418641 14097 raft_consensus.cc:2272] T 720e51950072462e9d16f75b27995387 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.422003 14097 tablet_replica.cc:333] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.423154 14097 raft_consensus.cc:2243] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.424633 14097 raft_consensus.cc:2272] T b75da66513484f36a3807f62f4177e56 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.427650 14097 tablet_replica.cc:333] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.428532 14097 raft_consensus.cc:2243] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.429800 14097 raft_consensus.cc:2272] T 88d57b3730d2404eb078514e05f127c2 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.504407 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:17.512807 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:12:17.529032 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:12:17.626258 23873 raft_consensus.cc:493] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.627596 23863 raft_consensus.cc:493] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.627249 23873 raft_consensus.cc:515] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:17.628211 23863 raft_consensus.cc:515] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:17.632997 23863 leader_election.cc:290] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:17.630266 23873 leader_election.cc:290] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
W20260709 13:12:17.679559 15971 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:17.794109 15345 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:17.799535 15345 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:17.906726 23876 raft_consensus.cc:493] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.907531 23876 raft_consensus.cc:515] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:17.909003 14097 tablet_replica.cc:333] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.909835 14097 raft_consensus.cc:2243] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.910125 23876 leader_election.cc:290] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:17.910928 14097 raft_consensus.cc:2272] T a781ba18f2704d43b5f36e4e55228b71 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.914113 14097 tablet_replica.cc:333] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.915011 14097 raft_consensus.cc:2243] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.916108 14097 raft_consensus.cc:2272] T fb1065d4b5964e7f8603f56553ecdb3b P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.917663 23870 raft_consensus.cc:493] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.919029 14097 tablet_replica.cc:333] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.919863 14097 raft_consensus.cc:2243] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.921298 14097 raft_consensus.cc:2272] T 0952b977f0484de9aeb6cb7ca74a0580 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.918483 23870 raft_consensus.cc:515] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:17.923535 23876 raft_consensus.cc:493] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:12:17.930095 23870 leader_election.cc:290] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:17.928803 14097 tablet_replica.cc:333] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.932045 14097 raft_consensus.cc:2243] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.933732 14097 raft_consensus.cc:2272] T 7f56abc7f6c348d58ce156f066549f7d P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.936616 14097 tablet_replica.cc:333] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.937965 14097 raft_consensus.cc:2243] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.938769 23877 raft_consensus.cc:493] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:17.939105 14097 raft_consensus.cc:2272] T 2e7b07c0f0a5432f94b6b20964332362 P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.940047 23877 raft_consensus.cc:515] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } }
I20260709 13:12:17.943102 14097 tablet_replica.cc:333] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.943408 23877 leader_election.cc:290] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:17.944401 14097 raft_consensus.cc:2243] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.946503 14097 raft_consensus.cc:2272] T 3fc5207f2ece48c7ba4d2a23b902610b P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.925275 23876 raft_consensus.cc:515] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:17.950197 14097 tablet_replica.cc:333] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.951306 14097 raft_consensus.cc:2243] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.952395 14097 raft_consensus.cc:2272] T 2578a36ef3a84d208c1736eedfe8f2bf P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.956197 14097 tablet_replica.cc:333] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.957046 14097 raft_consensus.cc:2243] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.958197 14097 raft_consensus.cc:2272] T 4e535be5fc0f4cf7b8401a4c737a091f P 0ec140f610ed4500ba58208c0e5519bb [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.958678 23876 leader_election.cc:290] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:17.961339 14097 tablet_replica.cc:333] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.962301 14097 raft_consensus.cc:2243] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.963101 14097 raft_consensus.cc:2272] T 09794c12bb344a25888d56e55d7e90f8 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.968487 14097 tablet_replica.cc:333] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.969336 14097 raft_consensus.cc:2243] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:17.969245 15348 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:17.970085 15348 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:12:17.970659 14097 raft_consensus.cc:2272] T ae61ecbf40014ab3bdd48399d0d8a997 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:17.970988 15348 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:17.971948 15348 leader_election.cc:336] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:17.973798 14097 tablet_replica.cc:333] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
W20260709 13:12:17.972587 15348 leader_election.cc:336] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:17.974670 14097 raft_consensus.cc:2243] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:17.976173 15348 leader_election.cc:304] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:17.976436 14097 raft_consensus.cc:2272] T 58ced12ec3004fab89f76f924edf0925 P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:17.977054 23873 raft_consensus.cc:2749] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:17.977216 15348 leader_election.cc:336] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:17.977664 15348 leader_election.cc:304] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:17.978374 23873 raft_consensus.cc:2749] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:17.981596 14097 tablet_replica.cc:333] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:17.981142 16001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec569d5083b416380cac661b1b44368" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:12:17.982363 14097 raft_consensus.cc:2243] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:17.983058 14097 raft_consensus.cc:2272] T d3f082f323814ed98886bca799e3d232 P 0ec140f610ed4500ba58208c0e5519bb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.025316 14097 tablet_replica.cc:333] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.026835 14097 raft_consensus.cc:2243] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:12:18.027920 15971 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:18.025753 15348 leader_election.cc:304] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:18.029063 23876 raft_consensus.cc:2749] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:18.029148 15348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:44351, user_credentials={real_user=slave}} blocked reactor thread for 44150.9us
I20260709 13:12:18.030258 14097 raft_consensus.cc:2272] T d8ad749c34474d4db0fa33ca64452d80 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.033283 14097 tablet_replica.cc:333] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
W20260709 13:12:18.033725 15348 consensus_peers.cc:597] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:18.034317 15348 consensus_peers.cc:597] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:18.035847 14097 raft_consensus.cc:2243] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:18.036310 15974 leader_election.cc:336] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:18.036588 14097 raft_consensus.cc:2272] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.036929 15974 leader_election.cc:304] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:18.039499 14097 tablet_replica.cc:333] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.041217 14097 raft_consensus.cc:2243] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.042292 14097 raft_consensus.cc:2272] T e8be1b1f251d4292b0b299f3c0c48c25 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.045467 14097 tablet_replica.cc:333] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.046363 14097 raft_consensus.cc:2243] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.049183 14097 raft_consensus.cc:2272] T 9be9d73e985345e39f20d23687e60a85 P 0ec140f610ed4500ba58208c0e5519bb [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.052512 14097 tablet_replica.cc:333] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.053407 14097 raft_consensus.cc:2243] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.054795 14097 raft_consensus.cc:2272] T 911f84bbbf874ced8f15e93fcf73decd P 0ec140f610ed4500ba58208c0e5519bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.059587 23879 raft_consensus.cc:2749] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:18.083720 14097 tablet_replica.cc:333] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.086830 14097 raft_consensus.cc:2243] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.088038 14097 raft_consensus.cc:2272] T bb3022274b1549eb806d68dc808a6ceb P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:18.085836 15971 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.088617 15971 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.090284 15345 consensus_peers.cc:597] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.094864 15345 leader_election.cc:336] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:18.098778 15345 leader_election.cc:304] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
W20260709 13:12:18.102789 15345 raft_consensus.cc:2686] T f2466cf62f214b16bdaa21d868e54b04 P 0ec140f610ed4500ba58208c0e5519bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:18.092269 14097 tablet_replica.cc:333] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.104686 14097 raft_consensus.cc:2243] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.105423 14097 raft_consensus.cc:2272] T 30992f1a0d1949a7aacbc6cbd114a206 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:18.106598 15345 consensus_peers.cc:597] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.110276 15345 leader_election.cc:336] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:18.108438 14097 tablet_replica.cc:333] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.112479 14097 raft_consensus.cc:2243] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.114199 14097 raft_consensus.cc:2272] T 965cf4b237ec478b978733b437297652 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.110771 15345 leader_election.cc:304] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:18.115693 23876 raft_consensus.cc:2749] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:18.116180 15971 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:18.121176 14097 tablet_replica.cc:333] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.124428 14097 raft_consensus.cc:2243] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.125818 14097 raft_consensus.cc:2272] T d13483d024d54c9e929c90baefab4d3a P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.130939 14097 tablet_replica.cc:333] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
W20260709 13:12:18.125000 15345 consensus_peers.cc:597] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:18.132208 14097 raft_consensus.cc:2243] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.134125 14097 raft_consensus.cc:2272] T 389bc861d7d5427b88bae4655d5ef6b8 P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.137013 14097 tablet_replica.cc:333] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.137897 14097 raft_consensus.cc:2243] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.138859 14097 raft_consensus.cc:2272] T 872a48310a1f4a28b75d05f83ce6b20b P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.141714 14097 tablet_replica.cc:333] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.142573 14097 raft_consensus.cc:2243] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.144578 14097 raft_consensus.cc:2272] T f5cd793e143d45cf9e32447e33602536 P 0ec140f610ed4500ba58208c0e5519bb [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.147506 14097 tablet_replica.cc:333] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.148451 14097 raft_consensus.cc:2243] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.149695 14097 raft_consensus.cc:2272] T 10888684198543f19c54c7cbcb094157 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.153031 14097 tablet_replica.cc:333] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
W20260709 13:12:18.153469 15971 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:18.153895 14097 raft_consensus.cc:2243] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.158146 14097 raft_consensus.cc:2272] T bec569d5083b416380cac661b1b44368 P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.159060 23876 raft_consensus.cc:493] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5c70ddb5aae14b059dc90fd40125b034)
I20260709 13:12:18.159655 23876 raft_consensus.cc:515] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:18.162220 23876 leader_election.cc:290] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 5c70ddb5aae14b059dc90fd40125b034 (127.13.196.68:44351)
I20260709 13:12:18.165362 14097 tablet_replica.cc:333] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.165596 16002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8218e039c251425fb97ad83094c709da" candidate_uuid: "0ec140f610ed4500ba58208c0e5519bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5c70ddb5aae14b059dc90fd40125b034" is_pre_election: true
I20260709 13:12:18.166539 14097 raft_consensus.cc:2243] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:12:18.168823 15345 leader_election.cc:336] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:18.169417 15345 leader_election.cc:304] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec140f610ed4500ba58208c0e5519bb; no voters: 5c70ddb5aae14b059dc90fd40125b034, 841138f50ace4746978e72d7f13878de
I20260709 13:12:18.170260 23876 raft_consensus.cc:2749] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:18.170624 14097 raft_consensus.cc:2272] T c27cdc2356514f4ea31d68df9ee2fa02 P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.174343 14097 tablet_replica.cc:333] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.175465 14097 raft_consensus.cc:2243] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.176524 14097 raft_consensus.cc:2272] T 3f803fff1dbc4b87b787f25b1659c2ae P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.180632 14097 tablet_replica.cc:333] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.181809 14097 raft_consensus.cc:2243] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.183100 14097 raft_consensus.cc:2272] T e879ecfd4de9483e8b42ea01de447fdc P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.186957 14097 tablet_replica.cc:333] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.187911 23870 raft_consensus.cc:493] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 841138f50ace4746978e72d7f13878de)
I20260709 13:12:18.188659 23870 raft_consensus.cc:515] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:18.196378 15974 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
W20260709 13:12:18.207810 15971 leader_election.cc:336] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:18.208477 15971 leader_election.cc:304] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 841138f50ace4746978e72d7f13878de, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:18.209348 23870 leader_election.cc:290] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121)
I20260709 13:12:18.210337 23827 raft_consensus.cc:2749] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:18.213297 14097 raft_consensus.cc:2243] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.216706 14097 raft_consensus.cc:2272] T 657606da148d404bbcad5ee674c9b9d2 P 0ec140f610ed4500ba58208c0e5519bb [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.221949 14097 tablet_replica.cc:333] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.222942 14097 raft_consensus.cc:2243] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.223763 14097 raft_consensus.cc:2272] T 8218e039c251425fb97ad83094c709da P 0ec140f610ed4500ba58208c0e5519bb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.227548 14097 tablet_replica.cc:333] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.229048 14097 raft_consensus.cc:2243] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.244503 14097 raft_consensus.cc:2272] T 66c844c3ac2f40469051bf49c46469c6 P 0ec140f610ed4500ba58208c0e5519bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.248623 14097 tablet_replica.cc:333] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.249719 14097 raft_consensus.cc:2243] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:18.251744 14097 raft_consensus.cc:2272] T 7236188a1607470eb04fb303bc4a928b P 0ec140f610ed4500ba58208c0e5519bb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.255658 14097 tablet_replica.cc:333] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.256640 14097 raft_consensus.cc:2243] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.257980 14097 raft_consensus.cc:2272] T 67a795b9e21446b4be65705c76ee1d94 P 0ec140f610ed4500ba58208c0e5519bb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.261828 14097 tablet_replica.cc:333] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.263211 14097 raft_consensus.cc:2243] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.264323 14097 raft_consensus.cc:2272] T 168b77c528554771b17206e0062bd8cc P 0ec140f610ed4500ba58208c0e5519bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.268258 14097 tablet_replica.cc:333] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb: stopping tablet replica
I20260709 13:12:18.269526 14097 raft_consensus.cc:2243] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:18.270550 14097 raft_consensus.cc:2272] T d55ea5972868497eb17221413640fbea P 0ec140f610ed4500ba58208c0e5519bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:18.378470 23870 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:18.379278 23870 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:18.387514 15973 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:18.394090 15974 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:18.395514 15974 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:18.394917 23870 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:18.396858 23827 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:18.469986 15971 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.486888 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:18.547907 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:12:18.600772 23870 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:18.601462 23870 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:18.604277 23870 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:18.608678 15971 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:18.610911 15973 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
I20260709 13:12:18.611454 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:18.612306 23870 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:18.640105 15971 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:18.655417 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:18.717963 23870 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:18.718616 23870 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:18.720927 23870 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:18.727180 15971 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:18.729700 15973 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
I20260709 13:12:18.730273 15973 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:18.732138 23870 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:18.838442 15162 debug-util.cc:398] Leaking SignalData structure 0x7b080019d160 after lost signal to thread 14100
W20260709 13:12:18.839973 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800254480 after lost signal to thread 15165
W20260709 13:12:18.840739 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800376880 after lost signal to thread 15406
W20260709 13:12:18.842213 15162 debug-util.cc:398] Leaking SignalData structure 0x7b08003a56a0 after lost signal to thread 16032
W20260709 13:12:18.881448 15974 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:12:18.962635 23870 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:18.963198 23870 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:18.965425 23870 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:18.970685 15973 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
W20260709 13:12:18.987236 15971 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:18.987690 15971 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:18.988437 23870 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:19.111322 15973 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111) [suppressed 564 similar messages]
I20260709 13:12:19.324113 23870 raft_consensus.cc:493] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:19.324693 23870 raft_consensus.cc:515] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:19.329039 23870 leader_election.cc:290] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:19.334807 15973 leader_election.cc:336] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
W20260709 13:12:19.339018 15971 leader_election.cc:336] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:19.339524 15971 leader_election.cc:304] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:19.340677 23870 raft_consensus.cc:2749] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:19.429119 15973 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.430838 14097 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15403)
I20260709 13:12:19.473884 23880 raft_consensus.cc:493] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:19.474730 23880 raft_consensus.cc:515] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:19.482161 15974 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:19.483175 23870 raft_consensus.cc:493] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:19.483736 23870 raft_consensus.cc:515] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:19.488265 23870 leader_election.cc:290] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:19.489548 23870 raft_consensus.cc:493] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:19.490223 23870 raft_consensus.cc:515] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } attrs { replace: true } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:19.495142 15973 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
W20260709 13:12:19.512895 15973 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
W20260709 13:12:19.514786 15974 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:19.516521 15974 leader_election.cc:304] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:19.518632 23870 leader_election.cc:290] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:19.521826 23870 raft_consensus.cc:2749] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:19.528682 23880 leader_election.cc:290] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:19.532110 15973 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
I20260709 13:12:19.539526 15973 leader_election.cc:304] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:19.541216 23882 raft_consensus.cc:2749] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:19.553606 15973 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.562036 15971 leader_election.cc:336] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:19.563585 15971 leader_election.cc:304] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
W20260709 13:12:19.566905 15973 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.568099 23883 raft_consensus.cc:2749] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:19.572492 15971 leader_election.cc:336] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:19.575073 15971 leader_election.cc:336] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:19.585376 15973 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.646684 15974 consensus_peers.cc:597] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:12:19.748800 15973 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.827560 15973 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:19.828317 15974 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:12:19.929040 15974 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:19.959857 15973 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:20.011394 15973 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:20.012127 15974 consensus_peers.cc:597] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:12:20.187947 15973 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Couldn't send request to peer 0ec140f610ed4500ba58208c0e5519bb. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:20.196805 15974 consensus_peers.cc:597] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:12:20.220032 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e8be1b1f251d4292b0b299f3c0c48c25: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:20.239369 23882 raft_consensus.cc:493] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:20.240496 23882 raft_consensus.cc:515] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b0f9eceec749442cb9a06c87f00f3caf" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 44011 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:20.250331 15974 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:20.252271 23883 raft_consensus.cc:493] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:20.252959 23883 raft_consensus.cc:515] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
W20260709 13:12:20.257066 15973 leader_election.cc:336] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
I20260709 13:12:20.257606 15973 leader_election.cc:304] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, b0f9eceec749442cb9a06c87f00f3caf
I20260709 13:12:20.257886 23883 leader_election.cc:290] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
I20260709 13:12:20.258536 23883 raft_consensus.cc:2749] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:20.261152 15971 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
I20260709 13:12:20.263885 23882 leader_election.cc:290] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:20.270476 15974 consensus_peers.cc:597] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:12:20.285890 15973 leader_election.cc:336] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
I20260709 13:12:20.286471 15973 leader_election.cc:304] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:20.287837 23886 raft_consensus.cc:2749] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:20.413269 15971 consensus_peers.cc:597] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:20.501461 15971 consensus_peers.cc:597] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:20.607437 15971 consensus_peers.cc:597] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:20.708145 15971 consensus_peers.cc:597] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:20.777884 23882 raft_consensus.cc:493] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:20.778539 23882 raft_consensus.cc:515] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:20.780977 23882 leader_election.cc:290] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:20.785955 15971 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:20.786887 15973 leader_election.cc:336] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
I20260709 13:12:20.787320 15973 leader_election.cc:304] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:20.788149 23882 raft_consensus.cc:2749] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:20.857960 15974 consensus_peers.cc:597] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:20.871542 15971 consensus_peers.cc:597] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:20.914135 15974 consensus_peers.cc:597] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:12:20.956427 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
I20260709 13:12:20.977406 23886 raft_consensus.cc:493] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0ec140f610ed4500ba58208c0e5519bb)
I20260709 13:12:20.978205 23886 raft_consensus.cc:515] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "841138f50ace4746978e72d7f13878de" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37121 } } peers { permanent_uuid: "0ec140f610ed4500ba58208c0e5519bb" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39043 } } peers { permanent_uuid: "5c70ddb5aae14b059dc90fd40125b034" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 44351 } attrs { promote: false } }
I20260709 13:12:20.981338 23886 leader_election.cc:290] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 841138f50ace4746978e72d7f13878de (127.13.196.66:37121), 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043)
W20260709 13:12:20.987762 15971 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111)
W20260709 13:12:20.989719 15973 leader_election.cc:336] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0ec140f610ed4500ba58208c0e5519bb (127.13.196.67:39043): Network error: Client connection negotiation failed: client connection to 127.13.196.67:39043: connect: Connection refused (error 111)
I20260709 13:12:20.990455 15973 leader_election.cc:304] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5c70ddb5aae14b059dc90fd40125b034; no voters: 0ec140f610ed4500ba58208c0e5519bb, 841138f50ace4746978e72d7f13878de
I20260709 13:12:20.991525 23886 raft_consensus.cc:2749] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:12:21.027891 15974 consensus_peers.cc:597] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 -> Peer b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): Couldn't send request to peer b0f9eceec749442cb9a06c87f00f3caf. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:21.051029 15971 consensus_peers.cc:597] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 -> Peer 841138f50ace4746978e72d7f13878de (127.13.196.66:37121): Couldn't send request to peer 841138f50ace4746978e72d7f13878de. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37121: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:21.098933 14097 tablet_server.cc:179] TabletServer@127.13.196.68:0 shutting down...
I20260709 13:12:21.185195 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:21.186546 14097 tablet_replica.cc:333] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.188112 14097 raft_consensus.cc:2243] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.189245 14097 raft_consensus.cc:2272] T 389bc861d7d5427b88bae4655d5ef6b8 P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.193105 14097 tablet_replica.cc:333] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.194245 14097 raft_consensus.cc:2243] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.195433 14097 raft_consensus.cc:2272] T 7236188a1607470eb04fb303bc4a928b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.199142 14097 tablet_replica.cc:333] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.199859 14097 raft_consensus.cc:2243] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.201282 14097 raft_consensus.cc:2272] T d3f082f323814ed98886bca799e3d232 P 5c70ddb5aae14b059dc90fd40125b034 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.204046 14097 tablet_replica.cc:333] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.204878 14097 raft_consensus.cc:2243] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.205515 14097 raft_consensus.cc:2272] T 20919a13dd564519b54dd5e3c0751736 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.208935 14097 tablet_replica.cc:333] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.210143 14097 raft_consensus.cc:2243] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.211349 14097 raft_consensus.cc:2272] T 0066b5a9791e4a30856433ed14864d2f P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.215891 14097 tablet_replica.cc:333] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.217216 14097 raft_consensus.cc:2243] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.219082 14097 raft_consensus.cc:2272] T 2de1580a2d944ae884df67f226c8b71d P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.223635 14097 tablet_replica.cc:333] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.224969 14097 raft_consensus.cc:2243] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.225932 14097 raft_consensus.cc:2272] T 362d7a17088a4e86a51428b5ee97346e P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.230111 14097 tablet_replica.cc:333] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.231251 14097 raft_consensus.cc:2243] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.232565 14097 raft_consensus.cc:2272] T bec569d5083b416380cac661b1b44368 P 5c70ddb5aae14b059dc90fd40125b034 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.236250 14097 tablet_replica.cc:333] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.237264 14097 raft_consensus.cc:2243] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.238782 14097 raft_consensus.cc:2272] T dc5a1ea32aef45d1b6e1ff8b0718d178 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.242319 14097 tablet_replica.cc:333] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.243355 14097 raft_consensus.cc:2243] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.244839 14097 raft_consensus.cc:2272] T 30992f1a0d1949a7aacbc6cbd114a206 P 5c70ddb5aae14b059dc90fd40125b034 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.248893 14097 tablet_replica.cc:333] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.249841 14097 raft_consensus.cc:2243] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.250639 14097 raft_consensus.cc:2272] T 3005d9c450974fc299b5f0c0e92c745a P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.254240 14097 tablet_replica.cc:333] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.255424 14097 raft_consensus.cc:2243] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.256881 14097 raft_consensus.cc:2272] T 8218e039c251425fb97ad83094c709da P 5c70ddb5aae14b059dc90fd40125b034 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.259663 14097 tablet_replica.cc:333] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.260449 14097 raft_consensus.cc:2243] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.261657 14097 raft_consensus.cc:2272] T 3fc5207f2ece48c7ba4d2a23b902610b P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.264555 14097 tablet_replica.cc:333] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.265265 14097 raft_consensus.cc:2243] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.265897 14097 raft_consensus.cc:2272] T 2e7b07c0f0a5432f94b6b20964332362 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.268512 14097 tablet_replica.cc:333] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.269166 14097 raft_consensus.cc:2243] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.269882 14097 raft_consensus.cc:2272] T 3fbb0d4cfecd47d08011ea23dbbb5965 P 5c70ddb5aae14b059dc90fd40125b034 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.272462 14097 tablet_replica.cc:333] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.273191 14097 raft_consensus.cc:2243] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.274375 14097 raft_consensus.cc:2272] T 6bf87f25409d4351a79d5be897b18ddb P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.277277 14097 tablet_replica.cc:333] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.277976 14097 raft_consensus.cc:2243] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.279040 14097 raft_consensus.cc:2272] T 75432bd549b3481d83070979a305922b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.281853 14097 tablet_replica.cc:333] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.282617 14097 raft_consensus.cc:2243] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.283578 14097 raft_consensus.cc:2272] T e8be1b1f251d4292b0b299f3c0c48c25 P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.286687 14097 tablet_replica.cc:333] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.287423 14097 raft_consensus.cc:2243] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.288195 14097 raft_consensus.cc:2272] T 657606da148d404bbcad5ee674c9b9d2 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.291224 14097 tablet_replica.cc:333] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.291868 14097 raft_consensus.cc:2243] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.293090 14097 raft_consensus.cc:2272] T c4dc28ca60664c41a529fde0dc6c28aa P 5c70ddb5aae14b059dc90fd40125b034 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.295462 14097 tablet_replica.cc:333] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.296407 14097 raft_consensus.cc:2243] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.297170 14097 raft_consensus.cc:2272] T 88d57b3730d2404eb078514e05f127c2 P 5c70ddb5aae14b059dc90fd40125b034 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.300117 14097 tablet_replica.cc:333] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.300904 14097 raft_consensus.cc:2243] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.302373 14097 raft_consensus.cc:2272] T 439569a190ca4e8fbb5f6ad2dce20957 P 5c70ddb5aae14b059dc90fd40125b034 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.305467 14097 tablet_replica.cc:333] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.306098 14097 raft_consensus.cc:2243] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.307102 14097 raft_consensus.cc:2272] T 315a39052c3a4aa189e80239d6709f0e P 5c70ddb5aae14b059dc90fd40125b034 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.311173 14097 tablet_replica.cc:333] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.311827 14097 raft_consensus.cc:2243] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.312961 14097 raft_consensus.cc:2272] T 5fd2d399eb3d45818234b2fb03159dbe P 5c70ddb5aae14b059dc90fd40125b034 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.315507 14097 tablet_replica.cc:333] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034: stopping tablet replica
I20260709 13:12:21.316082 14097 raft_consensus.cc:2243] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.317279 14097 raft_consensus.cc:2272] T bb30c1248aaf4663a734d0eb93201e7b P 5c70ddb5aae14b059dc90fd40125b034 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.843750 14097 tablet_server.cc:196] TabletServer@127.13.196.68:0 shutdown complete.
I20260709 13:12:21.909328 14097 master.cc:562] Master@127.13.196.126:35597 shutting down...
W20260709 13:12:21.964408 15179 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:12:21.964973 15179 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:21.965238 15179 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:31.179890 15162 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5ee0 after lost signal to thread 14100
W20260709 13:12:31.180663 15162 debug-util.cc:398] Leaking SignalData structure 0x7b0800323480 after lost signal to thread 15165
W20260709 13:12:36.625231 15118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111) [suppressed 132 similar messages]
W20260709 13:12:36.629786 15118 catalog_manager.cc:4755] TS b0f9eceec749442cb9a06c87f00f3caf (127.13.196.65:44011): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e8be1b1f251d4292b0b299f3c0c48c25: Network error: Client connection negotiation failed: client connection to 127.13.196.65:44011: connect: Connection refused (error 111)
I20260709 13:12:38.996537 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:38.997838 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:38.998322 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P 476e7efc84e541a3bd0f38661ad40403: stopping tablet replica
I20260709 13:12:39.242116 14097 master.cc:584] Master@127.13.196.126:35597 shutdown complete.
I20260709 13:12:39.314407 14097 test_util.cc:182] -----------------------------------------------
I20260709 13:12:39.314741 14097 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602431295977-14097-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (302974 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:39.319732 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:42321
I20260709 13:12:39.321231 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:39.328140 23892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.328675 23893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:39.332553 14097 server_base.cc:1061] running on GCE node
W20260709 13:12:39.332705 23895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:39.337355 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:39.337651 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:39.337788 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602759337774 us; error 0 us; skew 500 ppm
I20260709 13:12:39.338336 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:39.341480 14097 webserver.cc:533] Webserver started at http://127.13.196.126:34707/ using document root <none> and password file <none>
I20260709 13:12:39.342062 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:39.342240 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:39.342494 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:39.343990 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "ee6be353560a46edb7dcae64ec30501d"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.349530 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:39.354490 23900 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.355533 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:12:39.355954 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "ee6be353560a46edb7dcae64ec30501d"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.356302 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:39.379770 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:39.381395 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:39.435393 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:42321
I20260709 13:12:39.435503 23951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:42321 every 8 connection(s)
I20260709 13:12:39.441190 23952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:39.456763 23952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d: Bootstrap starting.
I20260709 13:12:39.464084 23952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.469779 23952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d: No bootstrap required, opened a new log
I20260709 13:12:39.472689 23952 raft_consensus.cc:359] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6be353560a46edb7dcae64ec30501d" member_type: VOTER }
I20260709 13:12:39.473285 23952 raft_consensus.cc:385] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.473532 23952 raft_consensus.cc:740] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6be353560a46edb7dcae64ec30501d, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.474246 23952 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6be353560a46edb7dcae64ec30501d" member_type: VOTER }
I20260709 13:12:39.474818 23952 raft_consensus.cc:399] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:39.475080 23952 raft_consensus.cc:493] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:39.475430 23952 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.481645 23952 raft_consensus.cc:515] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6be353560a46edb7dcae64ec30501d" member_type: VOTER }
I20260709 13:12:39.482376 23952 leader_election.cc:304] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee6be353560a46edb7dcae64ec30501d; no voters: 
I20260709 13:12:39.483899 23952 leader_election.cc:290] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:39.484539 23955 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.486382 23955 raft_consensus.cc:697] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 1 LEADER]: Becoming Leader. State: Replica: ee6be353560a46edb7dcae64ec30501d, State: Running, Role: LEADER
I20260709 13:12:39.487334 23955 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6be353560a46edb7dcae64ec30501d" member_type: VOTER }
I20260709 13:12:39.487933 23952 sys_catalog.cc:565] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:39.500609 23956 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee6be353560a46edb7dcae64ec30501d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6be353560a46edb7dcae64ec30501d" member_type: VOTER } }
I20260709 13:12:39.500742 23957 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6be353560a46edb7dcae64ec30501d. Latest consensus state: current_term: 1 leader_uuid: "ee6be353560a46edb7dcae64ec30501d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee6be353560a46edb7dcae64ec30501d" member_type: VOTER } }
I20260709 13:12:39.501727 23956 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:39.501741 23957 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:39.504410 23966 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:39.510095 23966 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:39.511713 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:39.521622 23966 catalog_manager.cc:1383] Generated new cluster ID: e3b7851b2b0240c8835e0e6f273cdb9f
I20260709 13:12:39.522020 23966 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:39.549031 23966 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:39.550889 23966 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:39.569970 23966 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d: Generated new TSK 0
I20260709 13:12:39.570752 23966 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:39.579737 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:39.587815 23973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.589418 23974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.591061 23976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:39.593403 14097 server_base.cc:1061] running on GCE node
I20260709 13:12:39.597232 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:39.597683 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:39.598024 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602759597977 us; error 0 us; skew 500 ppm
I20260709 13:12:39.598737 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:39.603042 14097 webserver.cc:533] Webserver started at http://127.13.196.65:38811/ using document root <none> and password file <none>
I20260709 13:12:39.603713 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:39.603925 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:39.604260 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:39.605741 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.611222 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:39.615899 23981 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.616990 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:39.617518 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.617977 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:39.662825 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:39.664291 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:39.666102 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:39.669093 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:39.669301 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.669654 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:39.669828 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.728307 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:35647
I20260709 13:12:39.728546 24043 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:35647 every 8 connection(s)
I20260709 13:12:39.734964 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:39.744465 24048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.745151 24049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.749017 24052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:39.751454 14097 server_base.cc:1061] running on GCE node
I20260709 13:12:39.756275 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:39.756695 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:39.756927 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602759756905 us; error 0 us; skew 500 ppm
I20260709 13:12:39.757594 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:39.757742 24044 heartbeater.cc:344] Connected to a master server at 127.13.196.126:42321
I20260709 13:12:39.758245 24044 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:39.759598 24044 heartbeater.cc:507] Master 127.13.196.126:42321 requested a full tablet report, sending...
I20260709 13:12:39.761154 14097 webserver.cc:533] Webserver started at http://127.13.196.66:44679/ using document root <none> and password file <none>
I20260709 13:12:39.761950 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:39.762224 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:39.762606 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:39.762701 23917 ts_manager.cc:194] Registered new tserver with Master: 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:39.764936 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "22ba00a563f342be8b8432bb050f9cad"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.765964 23917 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44898
I20260709 13:12:39.771293 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:39.776265 24056 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.777652 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:39.778046 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "22ba00a563f342be8b8432bb050f9cad"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.778344 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:39.807513 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:39.809139 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:39.811707 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:39.814767 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:39.815001 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.815359 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:39.815526 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.877660 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:36367
I20260709 13:12:39.877806 24118 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:36367 every 8 connection(s)
I20260709 13:12:39.884434 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:39.896068 24122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.897753 24123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:39.899816 24125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:39.901350 24119 heartbeater.cc:344] Connected to a master server at 127.13.196.126:42321
I20260709 13:12:39.901685 14097 server_base.cc:1061] running on GCE node
I20260709 13:12:39.901913 24119 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:39.903208 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:39.903429 24119 heartbeater.cc:507] Master 127.13.196.126:42321 requested a full tablet report, sending...
W20260709 13:12:39.903839 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:39.904078 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602759904052 us; error 0 us; skew 500 ppm
I20260709 13:12:39.905130 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:39.907549 23917 ts_manager.cc:194] Registered new tserver with Master: 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:39.909173 14097 webserver.cc:533] Webserver started at http://127.13.196.67:42613/ using document root <none> and password file <none>
I20260709 13:12:39.909909 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:39.910058 23917 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44902
I20260709 13:12:39.910205 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:39.911741 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:39.913857 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "411dcd784dc842ecb490506483244223"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.919857 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:39.925027 24130 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.926187 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:12:39.926774 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "411dcd784dc842ecb490506483244223"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:39.927197 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:39.959899 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:39.961575 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:39.963564 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:39.966602 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:39.966886 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:39.967176 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:39.967374 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:40.029714 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:33929
I20260709 13:12:40.029796 24192 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:33929 every 8 connection(s)
I20260709 13:12:40.036370 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:40.048053 24196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:40.049256 24197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:40.052145 14097 server_base.cc:1061] running on GCE node
W20260709 13:12:40.053355 24199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:40.054626 24193 heartbeater.cc:344] Connected to a master server at 127.13.196.126:42321
I20260709 13:12:40.054919 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:40.055173 24193 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:40.055284 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:40.055635 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602760055613 us; error 0 us; skew 500 ppm
I20260709 13:12:40.056455 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:40.056457 24193 heartbeater.cc:507] Master 127.13.196.126:42321 requested a full tablet report, sending...
I20260709 13:12:40.059680 23917 ts_manager.cc:194] Registered new tserver with Master: 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:40.060137 14097 webserver.cc:533] Webserver started at http://127.13.196.68:34567/ using document root <none> and password file <none>
I20260709 13:12:40.061028 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:40.061331 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:40.061669 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:40.061795 23917 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44918
I20260709 13:12:40.063357 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-3-root/instance:
uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
format_stamp: "Formatted at 2026-07-09 13:12:40 on dist-test-slave-ftjc"
I20260709 13:12:40.069495 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:12:40.074092 24204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:40.075280 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:12:40.075766 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-3-root
uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
format_stamp: "Formatted at 2026-07-09 13:12:40 on dist-test-slave-ftjc"
I20260709 13:12:40.076114 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:40.096971 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:40.098627 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:40.101223 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:40.104709 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:40.104959 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:40.105316 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:40.105499 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:40.164888 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.68:40339
I20260709 13:12:40.165225 24266 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.68:40339 every 8 connection(s)
I20260709 13:12:40.181851 24267 heartbeater.cc:344] Connected to a master server at 127.13.196.126:42321
I20260709 13:12:40.182433 24267 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:40.183663 24267 heartbeater.cc:507] Master 127.13.196.126:42321 requested a full tablet report, sending...
I20260709 13:12:40.186549 23917 ts_manager.cc:194] Registered new tserver with Master: 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:40.187216 14097 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018491567s
I20260709 13:12:40.189364 23917 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44922
I20260709 13:12:40.227519 23917 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44930:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:40.504408 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:40.538431 24232 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc852f89c8f4fafbb28f064daeebdb2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:40.540385 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc852f89c8f4fafbb28f064daeebdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.546980 24009 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc852f89c8f4fafbb28f064daeebdb2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:40.548605 24006 tablet_service.cc:1511] Processing CreateTablet for tablet f5fde7706e764fa8bcd5109c6e23f970 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:40.549758 24008 tablet_service.cc:1511] Processing CreateTablet for tablet c4fbad4af3f44d4fb97dfaca23e0e07b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:40.550539 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fde7706e764fa8bcd5109c6e23f970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.553905 24005 tablet_service.cc:1511] Processing CreateTablet for tablet 3f402838ece44ca68fc177563a3827af (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:40.555147 24008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fbad4af3f44d4fb97dfaca23e0e07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.555585 24231 tablet_service.cc:1511] Processing CreateTablet for tablet f2a7e71c709e4b1096bce054322ed8dd (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:40.557227 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a7e71c709e4b1096bce054322ed8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.558813 24007 tablet_service.cc:1511] Processing CreateTablet for tablet f2a7e71c709e4b1096bce054322ed8dd (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:40.560554 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a7e71c709e4b1096bce054322ed8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.561910 24157 tablet_service.cc:1511] Processing CreateTablet for tablet f2a7e71c709e4b1096bce054322ed8dd (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:40.563709 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a7e71c709e4b1096bce054322ed8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.564903 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc852f89c8f4fafbb28f064daeebdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.565851 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 06398d76b1694a4490f087dd6e52c33e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:40.566870 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 06398d76b1694a4490f087dd6e52c33e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:40.567831 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06398d76b1694a4490f087dd6e52c33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.568717 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06398d76b1694a4490f087dd6e52c33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.569764 24155 tablet_service.cc:1511] Processing CreateTablet for tablet f5fde7706e764fa8bcd5109c6e23f970 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:40.572105 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fde7706e764fa8bcd5109c6e23f970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.559594 24158 tablet_service.cc:1511] Processing CreateTablet for tablet c4fbad4af3f44d4fb97dfaca23e0e07b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:40.574390 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f402838ece44ca68fc177563a3827af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.574921 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 9df15e7ed7b64fc5a86f821e0330cef7 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:40.581981 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df15e7ed7b64fc5a86f821e0330cef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.583297 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fbad4af3f44d4fb97dfaca23e0e07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.603120 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 3f402838ece44ca68fc177563a3827af (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:40.603852 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 9df15e7ed7b64fc5a86f821e0330cef7 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:40.605404 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f402838ece44ca68fc177563a3827af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.608165 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df15e7ed7b64fc5a86f821e0330cef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.627913 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 58c5d2e9bae44e1cbc8eb9673d4e7b72 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:40.629823 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c5d2e9bae44e1cbc8eb9673d4e7b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.636612 24008 tablet_service.cc:1511] Processing CreateTablet for tablet 9df15e7ed7b64fc5a86f821e0330cef7 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:40.638394 24008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df15e7ed7b64fc5a86f821e0330cef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.648058 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc852f89c8f4fafbb28f064daeebdb2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:40.648722 24227 tablet_service.cc:1511] Processing CreateTablet for tablet 58c5d2e9bae44e1cbc8eb9673d4e7b72 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:40.650247 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc852f89c8f4fafbb28f064daeebdb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.650607 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c5d2e9bae44e1cbc8eb9673d4e7b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.655480 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 06398d76b1694a4490f087dd6e52c33e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:40.656749 24083 tablet_service.cc:1511] Processing CreateTablet for tablet c4fbad4af3f44d4fb97dfaca23e0e07b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:40.657769 24081 tablet_service.cc:1511] Processing CreateTablet for tablet f5fde7706e764fa8bcd5109c6e23f970 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:40.661703 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 58c5d2e9bae44e1cbc8eb9673d4e7b72 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:40.659842 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 3f402838ece44ca68fc177563a3827af (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:40.665184 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06398d76b1694a4490f087dd6e52c33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.673050 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fde7706e764fa8bcd5109c6e23f970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.676802 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f402838ece44ca68fc177563a3827af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.677266 24287 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:40.677770 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c5d2e9bae44e1cbc8eb9673d4e7b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.689468 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 7813bb792671456d923416caa83dba55 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:40.690876 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7813bb792671456d923416caa83dba55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.693395 24288 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:40.696978 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4fbad4af3f44d4fb97dfaca23e0e07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.722648 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 7813bb792671456d923416caa83dba55 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:40.729736 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7813bb792671456d923416caa83dba55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.737473 24009 tablet_service.cc:1511] Processing CreateTablet for tablet b5d1b8f8cfaa4c65b287b5f68413022a (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:40.740751 24228 tablet_service.cc:1511] Processing CreateTablet for tablet b5d1b8f8cfaa4c65b287b5f68413022a (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:40.750412 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d1b8f8cfaa4c65b287b5f68413022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.755497 24077 tablet_service.cc:1511] Processing CreateTablet for tablet b5d1b8f8cfaa4c65b287b5f68413022a (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:40.757361 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d1b8f8cfaa4c65b287b5f68413022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.735080 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 7813bb792671456d923416caa83dba55 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:40.759734 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7813bb792671456d923416caa83dba55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.760818 24288 tablet_bootstrap.cc:654] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.750525 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d1b8f8cfaa4c65b287b5f68413022a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.767405 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 9400c6e36c194339911221cf57386f55 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:40.769088 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9400c6e36c194339911221cf57386f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.769989 24044 heartbeater.cc:499] Master 127.13.196.126:42321 was elected leader, sending a full tablet report...
I20260709 13:12:40.785599 24289 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:40.786657 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 9400c6e36c194339911221cf57386f55 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:40.788370 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9400c6e36c194339911221cf57386f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.804800 24076 tablet_service.cc:1511] Processing CreateTablet for tablet 585e77c0a29944dfaecf265201b92507 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:40.806555 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585e77c0a29944dfaecf265201b92507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.806546 24157 tablet_service.cc:1511] Processing CreateTablet for tablet 585e77c0a29944dfaecf265201b92507 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:40.810070 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585e77c0a29944dfaecf265201b92507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.802291 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 9400c6e36c194339911221cf57386f55 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:40.809573 24287 tablet_bootstrap.cc:654] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.821853 24288 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:40.828936 24288 ts_tablet_manager.cc:1403] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.003s
I20260709 13:12:40.823339 24290 tablet_bootstrap.cc:492] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:40.823616 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 585e77c0a29944dfaecf265201b92507 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:40.827577 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9400c6e36c194339911221cf57386f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.844986 24288 raft_consensus.cc:359] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:40.852788 24288 raft_consensus.cc:385] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.853408 24288 raft_consensus.cc:740] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.845546 24289 tablet_bootstrap.cc:654] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.852123 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585e77c0a29944dfaecf265201b92507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.868542 24287 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:40.869218 24287 ts_tablet_manager.cc:1403] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.007s
I20260709 13:12:40.868814 24288 consensus_queue.cc:260] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:40.880307 24009 tablet_service.cc:1511] Processing CreateTablet for tablet 619297e96cc440a391ca25a2d881345e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:40.882521 24290 tablet_bootstrap.cc:654] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.882668 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619297e96cc440a391ca25a2d881345e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.884945 24267 heartbeater.cc:499] Master 127.13.196.126:42321 was elected leader, sending a full tablet report...
I20260709 13:12:40.887799 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 619297e96cc440a391ca25a2d881345e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:40.889489 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619297e96cc440a391ca25a2d881345e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.883388 24287 raft_consensus.cc:359] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:40.895648 24287 raft_consensus.cc:385] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.896072 24287 raft_consensus.cc:740] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.897032 24287 consensus_queue.cc:260] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:40.884995 24288 ts_tablet_manager.cc:1434] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.056s	user 0.012s	sys 0.001s
I20260709 13:12:40.902058 24289 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:40.903932 24288 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:40.914409 24119 heartbeater.cc:499] Master 127.13.196.126:42321 was elected leader, sending a full tablet report...
I20260709 13:12:40.915048 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 619297e96cc440a391ca25a2d881345e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:40.921218 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619297e96cc440a391ca25a2d881345e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:40.921433 24268 tablet.cc:2406] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:40.942591 24009 tablet_service.cc:1511] Processing CreateTablet for tablet e1a25f18b7864945a89a86966153a568 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:40.944617 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a25f18b7864945a89a86966153a568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.945076 24229 tablet_service.cc:1511] Processing CreateTablet for tablet e1a25f18b7864945a89a86966153a568 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:40.947366 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a25f18b7864945a89a86966153a568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.902863 24289 ts_tablet_manager.cc:1403] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.004s
I20260709 13:12:40.959896 24287 ts_tablet_manager.cc:1434] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.090s	user 0.027s	sys 0.029s
I20260709 13:12:40.961270 24287 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:40.965824 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 799e2a0152b140759a74a55581347755 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:40.969067 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799e2a0152b140759a74a55581347755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.966351 24080 tablet_service.cc:1511] Processing CreateTablet for tablet e1a25f18b7864945a89a86966153a568 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:40.969758 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 799e2a0152b140759a74a55581347755 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:40.972189 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799e2a0152b140759a74a55581347755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.971840 24227 tablet_service.cc:1511] Processing CreateTablet for tablet 799e2a0152b140759a74a55581347755 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:40.976225 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 799e2a0152b140759a74a55581347755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.978077 24290 tablet_bootstrap.cc:492] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:40.978765 24290 ts_tablet_manager.cc:1403] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.020s
I20260709 13:12:40.979946 24288 tablet_bootstrap.cc:654] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.988091 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1a25f18b7864945a89a86966153a568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:40.997498 24289 raft_consensus.cc:359] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:40.997965 24290 raft_consensus.cc:359] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:40.998492 24289 raft_consensus.cc:385] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.998878 24289 raft_consensus.cc:740] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.000519 24289 consensus_queue.cc:260] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.005201 24084 tablet_service.cc:1511] Processing CreateTablet for tablet b33cdb2ec12446faa2231acb16092baa (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:40.998816 24290 raft_consensus.cc:385] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.006731 24290 raft_consensus.cc:740] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.007021 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33cdb2ec12446faa2231acb16092baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.007733 24290 consensus_queue.cc:260] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.012636 24153 tablet_service.cc:1511] Processing CreateTablet for tablet b33cdb2ec12446faa2231acb16092baa (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:41.017557 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33cdb2ec12446faa2231acb16092baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.017733 24230 tablet_service.cc:1511] Processing CreateTablet for tablet b33cdb2ec12446faa2231acb16092baa (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:41.019462 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33cdb2ec12446faa2231acb16092baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.020083 24008 tablet_service.cc:1511] Processing CreateTablet for tablet e6700a2c5fd44373aae4bf17748f91b0 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:41.021781 24008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6700a2c5fd44373aae4bf17748f91b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.032217 24289 ts_tablet_manager.cc:1434] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.009s
I20260709 13:12:41.033108 24076 tablet_service.cc:1511] Processing CreateTablet for tablet e6700a2c5fd44373aae4bf17748f91b0 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:41.034644 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6700a2c5fd44373aae4bf17748f91b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.036749 24193 heartbeater.cc:499] Master 127.13.196.126:42321 was elected leader, sending a full tablet report...
I20260709 13:12:41.037474 24290 ts_tablet_manager.cc:1434] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 13:12:41.038916 24290 tablet_bootstrap.cc:492] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:41.040447 24287 tablet_bootstrap.cc:654] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.048079 24289 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:41.059252 24157 tablet_service.cc:1511] Processing CreateTablet for tablet e6700a2c5fd44373aae4bf17748f91b0 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:41.061059 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6700a2c5fd44373aae4bf17748f91b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.061575 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 3e9e1136d57e4ad0b7b229647d268d85 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:41.061682 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 1b5f299f0dd64ce2a6147e78c234d2b2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:41.063208 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e9e1136d57e4ad0b7b229647d268d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.063208 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b5f299f0dd64ce2a6147e78c234d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.060158 24005 tablet_service.cc:1511] Processing CreateTablet for tablet 3e9e1136d57e4ad0b7b229647d268d85 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:41.065359 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e9e1136d57e4ad0b7b229647d268d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.069375 24288 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:41.070123 24288 ts_tablet_manager.cc:1403] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.005s
I20260709 13:12:41.082862 24294 raft_consensus.cc:493] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.083591 24294 raft_consensus.cc:515] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:41.089272 24294 leader_election.cc:290] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:41.123286 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 1b5f299f0dd64ce2a6147e78c234d2b2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:41.125242 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b5f299f0dd64ce2a6147e78c234d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.133375 24290 tablet_bootstrap.cc:654] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.133121 24288 raft_consensus.cc:359] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.134218 24288 raft_consensus.cc:385] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.134625 24288 raft_consensus.cc:740] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.159682 24289 tablet_bootstrap.cc:654] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.170454 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 1b5f299f0dd64ce2a6147e78c234d2b2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:41.175962 24083 tablet_service.cc:1511] Processing CreateTablet for tablet fa1bc51404a8482fb802e2ba85e80e88 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:41.177340 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b5f299f0dd64ce2a6147e78c234d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.177603 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1bc51404a8482fb802e2ba85e80e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.173718 24288 consensus_queue.cc:260] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.161522 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 3e9e1136d57e4ad0b7b229647d268d85 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:41.194479 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e9e1136d57e4ad0b7b229647d268d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.200224 24287 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:41.205767 24156 tablet_service.cc:1511] Processing CreateTablet for tablet fa1bc51404a8482fb802e2ba85e80e88 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:41.209844 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1bc51404a8482fb802e2ba85e80e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.222087 24227 tablet_service.cc:1511] Processing CreateTablet for tablet fa1bc51404a8482fb802e2ba85e80e88 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:41.223991 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1bc51404a8482fb802e2ba85e80e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.226670 24288 ts_tablet_manager.cc:1434] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.156s	user 0.013s	sys 0.000s
I20260709 13:12:41.230310 24295 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.203751 24287 ts_tablet_manager.cc:1403] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.243s	user 0.015s	sys 0.035s
I20260709 13:12:41.232255 24290 tablet_bootstrap.cc:492] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:41.235188 24295 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:41.240769 24290 ts_tablet_manager.cc:1403] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.202s	user 0.008s	sys 0.031s
I20260709 13:12:41.247821 24295 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:41.249869 24009 tablet_service.cc:1511] Processing CreateTablet for tablet deeadb805a464c1bb34f499463f846e3 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:41.250819 24289 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:41.252723 24076 tablet_service.cc:1511] Processing CreateTablet for tablet deeadb805a464c1bb34f499463f846e3 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:41.256798 24288 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:41.257576 24289 ts_tablet_manager.cc:1403] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.215s	user 0.024s	sys 0.009s
I20260709 13:12:41.258064 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeadb805a464c1bb34f499463f846e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.261317 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeadb805a464c1bb34f499463f846e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.264446 24289 raft_consensus.cc:359] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:41.265616 24289 raft_consensus.cc:385] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.265956 24289 raft_consensus.cc:740] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.271229 24289 consensus_queue.cc:260] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:41.274003 24287 raft_consensus.cc:359] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:41.293217 24287 raft_consensus.cc:385] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.293726 24287 raft_consensus.cc:740] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.294822 24287 consensus_queue.cc:260] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:41.296440 24289 ts_tablet_manager.cc:1434] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.003s
I20260709 13:12:41.282593 24290 raft_consensus.cc:359] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.297046 24290 raft_consensus.cc:385] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.297389 24290 raft_consensus.cc:740] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.298316 24290 consensus_queue.cc:260] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.299638 24157 tablet_service.cc:1511] Processing CreateTablet for tablet deeadb805a464c1bb34f499463f846e3 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:41.301376 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deeadb805a464c1bb34f499463f846e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.301079 24290 ts_tablet_manager.cc:1434] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.004s
I20260709 13:12:41.308911 24287 ts_tablet_manager.cc:1434] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.005s
I20260709 13:12:41.311924 24287 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:41.310030 24288 tablet_bootstrap.cc:654] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.317193 24289 tablet_bootstrap.cc:492] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:41.322469 24229 tablet_service.cc:1511] Processing CreateTablet for tablet a5abba1ca42243bd8be8d7b1d77fded2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:41.340157 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5abba1ca42243bd8be8d7b1d77fded2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.344254 24290 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:41.350695 24289 tablet_bootstrap.cc:654] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.364634 24287 tablet_bootstrap.cc:654] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.366032 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:41.374816 24005 tablet_service.cc:1511] Processing CreateTablet for tablet a5abba1ca42243bd8be8d7b1d77fded2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:41.376597 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5abba1ca42243bd8be8d7b1d77fded2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:41.383610 24205 leader_election.cc:343] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.383495 24083 tablet_service.cc:1511] Processing CreateTablet for tablet a5abba1ca42243bd8be8d7b1d77fded2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:41.386152 24227 tablet_service.cc:1511] Processing CreateTablet for tablet e6fd3c07e7b741e0a01e60ebf1092778 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:41.393767 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5abba1ca42243bd8be8d7b1d77fded2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.394714 24156 tablet_service.cc:1511] Processing CreateTablet for tablet e6fd3c07e7b741e0a01e60ebf1092778 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:41.395895 24288 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:41.396633 24288 ts_tablet_manager.cc:1403] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.003s
I20260709 13:12:41.398515 24228 tablet_service.cc:1511] Processing CreateTablet for tablet f42f9b12b00946d9a5420824dac647b6 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:41.400210 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42f9b12b00946d9a5420824dac647b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.400470 24007 tablet_service.cc:1511] Processing CreateTablet for tablet e6fd3c07e7b741e0a01e60ebf1092778 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:41.400759 24008 tablet_service.cc:1511] Processing CreateTablet for tablet e12d688dc9954b58b54c3ef416ca0da6 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:41.404704 24153 tablet_service.cc:1511] Processing CreateTablet for tablet f42f9b12b00946d9a5420824dac647b6 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:41.405184 24077 tablet_service.cc:1511] Processing CreateTablet for tablet f42f9b12b00946d9a5420824dac647b6 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:41.406535 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42f9b12b00946d9a5420824dac647b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.409898 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd52e84d46949fd9d8789814378866c (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:41.396268 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fd3c07e7b741e0a01e60ebf1092778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.409662 24158 tablet_service.cc:1511] Processing CreateTablet for tablet e12d688dc9954b58b54c3ef416ca0da6 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:41.412989 24084 tablet_service.cc:1511] Processing CreateTablet for tablet e12d688dc9954b58b54c3ef416ca0da6 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:41.414619 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12d688dc9954b58b54c3ef416ca0da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.415196 24006 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd52e84d46949fd9d8789814378866c (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:41.423458 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fd3c07e7b741e0a01e60ebf1092778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.424873 24008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12d688dc9954b58b54c3ef416ca0da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.429025 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd52e84d46949fd9d8789814378866c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.411219 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f42f9b12b00946d9a5420824dac647b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.411388 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd52e84d46949fd9d8789814378866c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.443032 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12d688dc9954b58b54c3ef416ca0da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.447794 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:41.448701 24154 tablet_service.cc:1511] Processing CreateTablet for tablet f3007d344bdd4a2a81bf4ae8ae79f446 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:41.449054 24231 tablet_service.cc:1511] Processing CreateTablet for tablet f3007d344bdd4a2a81bf4ae8ae79f446 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:41.450382 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3007d344bdd4a2a81bf4ae8ae79f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.450552 24299 raft_consensus.cc:493] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.451262 24299 raft_consensus.cc:515] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:41.453502 24205 leader_election.cc:343] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.480263 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fd3c07e7b741e0a01e60ebf1092778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.450416 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3007d344bdd4a2a81bf4ae8ae79f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.487883 24004 tablet_service.cc:1511] Processing CreateTablet for tablet f3007d344bdd4a2a81bf4ae8ae79f446 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:41.489907 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 20a307a7186f4c828e6851401a78c276 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:41.491626 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a307a7186f4c828e6851401a78c276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.454850 24205 leader_election.cc:304] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:41.489910 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3007d344bdd4a2a81bf4ae8ae79f446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.500247 24155 tablet_service.cc:1511] Processing CreateTablet for tablet 20a307a7186f4c828e6851401a78c276 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:41.494896 24288 raft_consensus.cc:359] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.501339 24288 raft_consensus.cc:385] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.501703 24288 raft_consensus.cc:740] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.508472 24290 tablet_bootstrap.cc:654] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.511171 24298 raft_consensus.cc:493] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.510761 24288 consensus_queue.cc:260] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.511754 24298 raft_consensus.cc:515] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.520538 24289 tablet_bootstrap.cc:492] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:41.531375 24314 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:41.510844 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:41.533689 24299 leader_election.cc:290] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:41.536873 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a307a7186f4c828e6851401a78c276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.532415 24314 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:41.536302 24294 raft_consensus.cc:2749] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.546994 24289 ts_tablet_manager.cc:1403] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.033s
W20260709 13:12:41.550215 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 96776.4us
I20260709 13:12:41.565642 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 0cd52e84d46949fd9d8789814378866c (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:41.592249 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cd52e84d46949fd9d8789814378866c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.595382 24288 ts_tablet_manager.cc:1434] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.198s	user 0.012s	sys 0.001s
I20260709 13:12:41.597033 24288 tablet_bootstrap.cc:492] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:41.574559 24294 raft_consensus.cc:493] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.570299 24298 leader_election.cc:290] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:41.652068 24290 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:41.652841 24290 ts_tablet_manager.cc:1403] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.309s	user 0.019s	sys 0.022s
I20260709 13:12:41.633383 24294 raft_consensus.cc:515] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.654870 24009 tablet_service.cc:1511] Processing CreateTablet for tablet 886dbd0c6f0243208c008309eab923ac (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:41.663265 24320 raft_consensus.cc:493] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.693032 24320 raft_consensus.cc:515] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.693701 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886dbd0c6f0243208c008309eab923ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.694839 24294 leader_election.cc:290] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:41.669867 24314 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:41.697254 24320 leader_election.cc:290] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:41.697443 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:41.699847 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df15e7ed7b64fc5a86f821e0330cef7" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:41.674767 24290 raft_consensus.cc:359] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:41.676815 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 886dbd0c6f0243208c008309eab923ac (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:41.689204 24289 raft_consensus.cc:359] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.676815 24157 tablet_service.cc:1511] Processing CreateTablet for tablet 886dbd0c6f0243208c008309eab923ac (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:41.705056 24289 raft_consensus.cc:385] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.708537 24289 raft_consensus.cc:740] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.709933 24007 tablet_service.cc:1511] Processing CreateTablet for tablet 732349b9a3cc4721af4b19673ecb3db7 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:41.711587 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732349b9a3cc4721af4b19673ecb3db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.712204 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886dbd0c6f0243208c008309eab923ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.704804 24288 tablet_bootstrap.cc:654] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.717999 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886dbd0c6f0243208c008309eab923ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.721837 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 732349b9a3cc4721af4b19673ecb3db7 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:41.745266 24232 tablet_service.cc:1511] Processing CreateTablet for tablet 20a307a7186f4c828e6851401a78c276 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:41.745266 24295 raft_consensus.cc:493] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.747232 24289 consensus_queue.cc:260] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.748220 24295 raft_consensus.cc:515] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:41.749094 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a307a7186f4c828e6851401a78c276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.723469 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 998f8cd3c00740049cb50291b59df964 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:41.752507 24287 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:41.704309 24290 raft_consensus.cc:385] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.751906 24226 tablet_service.cc:1511] Processing CreateTablet for tablet 732349b9a3cc4721af4b19673ecb3db7 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:41.732969 24299 raft_consensus.cc:493] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.764892 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732349b9a3cc4721af4b19673ecb3db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.765575 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 732349b9a3cc4721af4b19673ecb3db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.769872 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 998f8cd3c00740049cb50291b59df964. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:41.724004 24205 leader_election.cc:343] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.772900 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 65786.6us
W20260709 13:12:41.773892 24205 leader_election.cc:343] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.766028 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:41.778002 23982 leader_election.cc:343] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.796520 24225 tablet_service.cc:1511] Processing CreateTablet for tablet 998f8cd3c00740049cb50291b59df964 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:41.798295 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 998f8cd3c00740049cb50291b59df964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.765035 24299 raft_consensus.cc:515] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.792904 24287 ts_tablet_manager.cc:1403] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.481s	user 0.016s	sys 0.017s
I20260709 13:12:41.828006 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 1a52f9f7e19642978555231fddcdc38e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:41.830775 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a52f9f7e19642978555231fddcdc38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.788691 24290 raft_consensus.cc:740] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.839763 24295 leader_election.cc:290] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:41.841590 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:41.843057 24288 tablet_bootstrap.cc:492] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:41.843317 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:41.843736 24288 ts_tablet_manager.cc:1403] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.247s	user 0.017s	sys 0.013s
W20260709 13:12:41.845468 24059 leader_election.cc:343] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:41.846491 23982 leader_election.cc:343] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.848635 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 998f8cd3c00740049cb50291b59df964 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:41.850297 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 998f8cd3c00740049cb50291b59df964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.852855 24289 ts_tablet_manager.cc:1434] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.292s	user 0.006s	sys 0.019s
I20260709 13:12:41.854143 24289 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:41.858508 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 1a52f9f7e19642978555231fddcdc38e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:41.860325 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a52f9f7e19642978555231fddcdc38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.862530 24083 tablet_service.cc:1511] Processing CreateTablet for tablet 1a52f9f7e19642978555231fddcdc38e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:41.865103 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a52f9f7e19642978555231fddcdc38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.829301 24287 raft_consensus.cc:359] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.870913 24287 raft_consensus.cc:385] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.871353 24287 raft_consensus.cc:740] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.872290 24287 consensus_queue.cc:260] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.875110 24287 ts_tablet_manager.cc:1434] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:12:41.879057 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df15e7ed7b64fc5a86f821e0330cef7" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:41.879964 24242 raft_consensus.cc:2468] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:41.881973 24133 leader_election.cc:304] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:41.883208 24314 raft_consensus.cc:2804] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.883693 24314 raft_consensus.cc:493] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.883715 24299 leader_election.cc:290] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:41.883474 24076 tablet_service.cc:1511] Processing CreateTablet for tablet 504e7d24d8c24d4bbc62ae3b0eaa4ca5 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:41.884275 24314 raft_consensus.cc:3060] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.886132 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06398d76b1694a4490f087dd6e52c33e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:41.886654 24155 tablet_service.cc:1511] Processing CreateTablet for tablet 504e7d24d8c24d4bbc62ae3b0eaa4ca5 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:41.887259 24290 consensus_queue.cc:260] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:41.897521 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504e7d24d8c24d4bbc62ae3b0eaa4ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.897823 24005 tablet_service.cc:1511] Processing CreateTablet for tablet 504e7d24d8c24d4bbc62ae3b0eaa4ca5 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:41.899338 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504e7d24d8c24d4bbc62ae3b0eaa4ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.901461 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504e7d24d8c24d4bbc62ae3b0eaa4ca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.908802 24290 ts_tablet_manager.cc:1434] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.256s	user 0.005s	sys 0.008s
I20260709 13:12:41.910183 24290 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:41.889477 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 566862ace4e445a998adbca005d9316b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:41.918145 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566862ace4e445a998adbca005d9316b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.921407 24288 raft_consensus.cc:359] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.922722 24288 raft_consensus.cc:385] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:41.922914 24059 leader_election.cc:343] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.923197 24288 raft_consensus.cc:740] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.924649 24288 consensus_queue.cc:260] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.934574 24314 raft_consensus.cc:515] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:41.937938 24298 raft_consensus.cc:493] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.945461 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:41.951956 24298 raft_consensus.cc:515] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:41.952615 24168 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:41.946882 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:41.949381 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df15e7ed7b64fc5a86f821e0330cef7" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:41.954411 24298 leader_election.cc:290] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:41.949616 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:41.957263 24018 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:41.950685 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06398d76b1694a4490f087dd6e52c33e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:41.950706 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:41.959401 24166 raft_consensus.cc:2468] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:41.960397 24289 tablet_bootstrap.cc:654] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.941169 24288 ts_tablet_manager.cc:1434] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.003s
I20260709 13:12:41.961344 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:41.962823 24288 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
W20260709 13:12:41.963465 24133 leader_election.cc:343] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.967007 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df15e7ed7b64fc5a86f821e0330cef7" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:41.970772 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 566862ace4e445a998adbca005d9316b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:41.973284 24242 raft_consensus.cc:3060] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.974058 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566862ace4e445a998adbca005d9316b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:41.976903 24287 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:41.983958 23982 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad
I20260709 13:12:41.985378 24295 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.985857 24295 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.986251 24295 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:41.986514 23982 leader_election.cc:343] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.987140 23982 leader_election.cc:304] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
W20260709 13:12:41.990288 24057 leader_election.cc:343] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.990945 24057 leader_election.cc:304] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:41.992376 24299 raft_consensus.cc:2749] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.995645 24057 leader_election.cc:304] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487
W20260709 13:12:42.000025 24131 leader_election.cc:343] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.002483 24299 raft_consensus.cc:2804] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.003161 24299 raft_consensus.cc:493] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.003592 24299 raft_consensus.cc:3060] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.006115 24290 tablet_bootstrap.cc:654] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.006843 24295 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:42.010842 24156 tablet_service.cc:1511] Processing CreateTablet for tablet cb615a7452f542cebc700c8750746552 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:42.012598 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb615a7452f542cebc700c8750746552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.013623 24295 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:42.014346 24295 raft_consensus.cc:2749] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.016958 24314 leader_election.cc:290] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:42.037019 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 437f3547914b45e2a61c419bdd3fe09f (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:42.038669 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437f3547914b45e2a61c419bdd3fe09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.039041 24005 tablet_service.cc:1511] Processing CreateTablet for tablet 77236aeb1698485ebbe657a40d6f6d72 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:42.040663 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77236aeb1698485ebbe657a40d6f6d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.041688 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 77236aeb1698485ebbe657a40d6f6d72 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:42.023229 24242 raft_consensus.cc:2468] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:42.025305 24007 tablet_service.cc:1511] Processing CreateTablet for tablet cb615a7452f542cebc700c8750746552 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:42.026489 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:42.045238 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77236aeb1698485ebbe657a40d6f6d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.046499 24287 tablet_bootstrap.cc:654] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:42.047462 23982 leader_election.cc:343] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.049973 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 77236aeb1698485ebbe657a40d6f6d72 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:42.051520 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77236aeb1698485ebbe657a40d6f6d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.051894 24299 raft_consensus.cc:515] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.027190 24225 tablet_service.cc:1511] Processing CreateTablet for tablet cb615a7452f542cebc700c8750746552 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:42.031071 24226 tablet_service.cc:1511] Processing CreateTablet for tablet aa9fdacd398142bb98d711e9a9a13697 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:42.056429 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:42.056901 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9fdacd398142bb98d711e9a9a13697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.057112 24288 tablet_bootstrap.cc:654] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:42.058437 24059 leader_election.cc:343] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.031452 24080 tablet_service.cc:1511] Processing CreateTablet for tablet aa9fdacd398142bb98d711e9a9a13697 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:42.060194 24299 leader_election.cc:290] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:42.060520 24133 leader_election.cc:304] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:42.061410 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9fdacd398142bb98d711e9a9a13697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.061559 24314 raft_consensus.cc:2804] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.064073 24314 raft_consensus.cc:697] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:42.012579 24131 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
W20260709 13:12:42.065303 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 52830.6us
I20260709 13:12:42.068202 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df15e7ed7b64fc5a86f821e0330cef7" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:42.069607 24298 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.070086 24298 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.070654 24298 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.072974 24007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb615a7452f542cebc700c8750746552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.073786 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb615a7452f542cebc700c8750746552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.075610 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.034152 24157 tablet_service.cc:1511] Processing CreateTablet for tablet aa9fdacd398142bb98d711e9a9a13697 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:42.082721 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:42.081974 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.084865 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9df15e7ed7b64fc5a86f821e0330cef7" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:42.086360 24094 raft_consensus.cc:2393] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:42.021574 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 566862ace4e445a998adbca005d9316b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:42.087450 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 41a5dbaa1db84031bb226476b1bfdccb (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:42.090634 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a5dbaa1db84031bb226476b1bfdccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.093899 24009 tablet_service.cc:1511] Processing CreateTablet for tablet 437f3547914b45e2a61c419bdd3fe09f (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:42.094498 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 437f3547914b45e2a61c419bdd3fe09f (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:42.094749 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff3617135ac4b94a68ffb136a68c4b8 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:42.096088 24009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437f3547914b45e2a61c419bdd3fe09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.102530 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff3617135ac4b94a68ffb136a68c4b8 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:42.107707 24326 raft_consensus.cc:493] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.110087 24326 raft_consensus.cc:515] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:42.084331 24314 consensus_queue.cc:237] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:42.125083 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:42.125878 24167 raft_consensus.cc:3060] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.089502 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566862ace4e445a998adbca005d9316b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.127288 24227 tablet_service.cc:1511] Processing CreateTablet for tablet 068410948a164d408611c73e52af845e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:42.096107 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff3617135ac4b94a68ffb136a68c4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.141567 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0f4ea311bb4330ba8fc5081e593dc2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:42.144629 24298 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:42.147243 24298 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:42.127777 24326 leader_election.cc:290] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:42.152463 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff3617135ac4b94a68ffb136a68c4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.152170 24083 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0f4ea311bb4330ba8fc5081e593dc2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:42.154810 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0f4ea311bb4330ba8fc5081e593dc2 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:42.155519 24153 tablet_service.cc:1511] Processing CreateTablet for tablet f20bd0670e6e43e3a412db4836eacf00 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:42.155993 24289 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:42.156917 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068410948a164d408611c73e52af845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.160164 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437f3547914b45e2a61c419bdd3fe09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.165506 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:42.185571 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:42.186281 24165 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:42.181044 24289 ts_tablet_manager.cc:1403] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.327s	user 0.015s	sys 0.023s
I20260709 13:12:42.190945 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0f4ea311bb4330ba8fc5081e593dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.186395 24242 raft_consensus.cc:2468] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:42.193558 23984 leader_election.cc:304] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:42.194651 24151 tablet_service.cc:1511] Processing CreateTablet for tablet edfb89428db741ae9e1417e2ece21538 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:42.196239 24288 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:42.196388 24151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfb89428db741ae9e1417e2ece21538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.196662 24326 raft_consensus.cc:2804] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.196952 24288 ts_tablet_manager.cc:1403] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.234s	user 0.014s	sys 0.014s
I20260709 13:12:42.197125 24326 raft_consensus.cc:493] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.197576 24326 raft_consensus.cc:3060] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.200229 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20bd0670e6e43e3a412db4836eacf00. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:42.206602 24131 leader_election.cc:343] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.207298 24289 raft_consensus.cc:359] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:42.207904 24131 leader_election.cc:343] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.208716 24232 tablet_service.cc:1511] Processing CreateTablet for tablet edfb89428db741ae9e1417e2ece21538 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:42.209908 24299 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.209751 24082 tablet_service.cc:1511] Processing CreateTablet for tablet f20bd0670e6e43e3a412db4836eacf00 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:42.195721 24006 tablet_service.cc:1511] Processing CreateTablet for tablet 41a5dbaa1db84031bb226476b1bfdccb (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:42.210974 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:42.208279 24289 raft_consensus.cc:385] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.211285 24003 tablet_service.cc:1511] Processing CreateTablet for tablet edfb89428db741ae9e1417e2ece21538 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:42.213855 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 41a5dbaa1db84031bb226476b1bfdccb (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:42.214963 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:42.244654 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a5dbaa1db84031bb226476b1bfdccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.216125 24320 raft_consensus.cc:493] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.245481 24320 raft_consensus.cc:515] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.216976 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9fdacd398142bb98d711e9a9a13697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.240173 24289 raft_consensus.cc:740] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.248111 24289 consensus_queue.cc:260] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:42.248728 24003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfb89428db741ae9e1417e2ece21538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.250844 24289 ts_tablet_manager.cc:1434] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:12:42.218315 24005 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff3617135ac4b94a68ffb136a68c4b8 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:42.253316 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff3617135ac4b94a68ffb136a68c4b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.252972 23917 catalog_manager.cc:5697] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.220129 24155 tablet_service.cc:1511] Processing CreateTablet for tablet 068410948a164d408611c73e52af845e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:42.165105 24167 raft_consensus.cc:2468] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:42.256610 24165 raft_consensus.cc:2468] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:42.257274 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068410948a164d408611c73e52af845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.258090 24287 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:42.258845 24287 ts_tablet_manager.cc:1403] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.282s	user 0.026s	sys 0.016s
I20260709 13:12:42.259500 24326 raft_consensus.cc:515] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:42.227392 23982 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:12:42.228682 24299 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:42.260509 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 52638.7us
I20260709 13:12:42.229173 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 068410948a164d408611c73e52af845e (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:42.261574 24131 leader_election.cc:304] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:42.262492 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:42.262768 24299 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
W20260709 13:12:42.263062 24131 leader_election.cc:343] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:42.229714 24205 leader_election.cc:343] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.264146 24205 leader_election.cc:304] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:42.264705 24298 raft_consensus.cc:2749] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.230288 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0f4ea311bb4330ba8fc5081e593dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.230816 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0f4ea311bb4330ba8fc5081e593dc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.268826 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfb89428db741ae9e1417e2ece21538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.222555 24008 tablet_service.cc:1511] Processing CreateTablet for tablet f20bd0670e6e43e3a412db4836eacf00 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:42.272725 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20bd0670e6e43e3a412db4836eacf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.273012 24008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20bd0670e6e43e3a412db4836eacf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.252103 24289 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:42.263612 24018 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:42.287760 24295 raft_consensus.cc:2749] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.243103 24288 raft_consensus.cc:359] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.276218 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068410948a164d408611c73e52af845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.277554 24320 leader_election.cc:290] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:42.278460 24290 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:42.281751 24076 tablet_service.cc:1511] Processing CreateTablet for tablet f3101771b367478999c4973ad7df868f (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:42.282495 24057 leader_election.cc:304] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:42.295059 24320 raft_consensus.cc:2749] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.302934 24004 tablet_service.cc:1511] Processing CreateTablet for tablet f3101771b367478999c4973ad7df868f (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:42.310547 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a5dbaa1db84031bb226476b1bfdccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.311107 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3101771b367478999c4973ad7df868f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.298326 24288 raft_consensus.cc:385] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.320902 24288 raft_consensus.cc:740] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.322084 24288 consensus_queue.cc:260] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.324649 24289 tablet_bootstrap.cc:654] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.331768 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3101771b367478999c4973ad7df868f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.309198 24290 ts_tablet_manager.cc:1403] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.399s	user 0.009s	sys 0.020s
W20260709 13:12:42.307075 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 77425.1us
I20260709 13:12:42.340565 24205 leader_election.cc:304] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:42.342082 24320 raft_consensus.cc:2749] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.345029 24299 raft_consensus.cc:2804] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.346848 24131 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:42.348232 24314 raft_consensus.cc:2749] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.371239 24326 leader_election.cc:290] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:42.383893 24289 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:42.375910 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:42.384670 24289 ts_tablet_manager.cc:1403] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.133s	user 0.031s	sys 0.026s
I20260709 13:12:42.385198 24242 raft_consensus.cc:3060] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.262831 24287 raft_consensus.cc:359] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.397506 24288 ts_tablet_manager.cc:1434] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.200s	user 0.009s	sys 0.001s
I20260709 13:12:42.399156 24288 tablet_bootstrap.cc:492] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
W20260709 13:12:42.345304 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 65089.1us
I20260709 13:12:42.401883 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06398d76b1694a4490f087dd6e52c33e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.402791 24094 raft_consensus.cc:2468] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:42.404902 24205 leader_election.cc:304] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:42.405931 24320 raft_consensus.cc:2804] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.406491 24320 raft_consensus.cc:493] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.406929 24320 raft_consensus.cc:3060] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.407158 24242 raft_consensus.cc:2468] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:42.408782 23984 leader_election.cc:304] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:42.413262 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:42.413662 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06398d76b1694a4490f087dd6e52c33e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:42.415545 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:42.416229 24167 raft_consensus.cc:3060] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.421584 24057 leader_election.cc:343] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:42.376331 23901 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 68019.9us
I20260709 13:12:42.427618 24156 tablet_service.cc:1511] Processing CreateTablet for tablet f3101771b367478999c4973ad7df868f (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:42.429363 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3101771b367478999c4973ad7df868f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.390280 24287 raft_consensus.cc:385] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.432808 24287 raft_consensus.cc:740] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.433844 24287 consensus_queue.cc:260] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.435043 24295 raft_consensus.cc:2804] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.386807 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf86c23dc92446f955db3e85bb4b3df (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:42.444394 24299 raft_consensus.cc:697] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:42.446663 24299 consensus_queue.cc:237] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.447527 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf86c23dc92446f955db3e85bb4b3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.456111 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
W20260709 13:12:42.458180 24057 leader_election.cc:343] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:42.450453 24205 leader_election.cc:343] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.452953 24287 ts_tablet_manager.cc:1434] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.194s	user 0.010s	sys 0.001s
I20260709 13:12:42.462265 24057 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:42.473371 24289 raft_consensus.cc:359] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.474362 24289 raft_consensus.cc:385] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.474694 24289 raft_consensus.cc:740] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.475749 24289 consensus_queue.cc:260] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.477970 24167 raft_consensus.cc:2468] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:42.481345 24335 raft_consensus.cc:2749] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.483405 24287 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:42.488270 24006 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf86c23dc92446f955db3e85bb4b3df (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:42.490152 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf86c23dc92446f955db3e85bb4b3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.488471 24290 raft_consensus.cc:359] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:42.518949 24290 raft_consensus.cc:385] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.535238 24290 raft_consensus.cc:740] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
W20260709 13:12:42.536505 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:42.541821 24289 ts_tablet_manager.cc:1434] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.157s	user 0.010s	sys 0.001s
I20260709 13:12:42.543414 24289 tablet_bootstrap.cc:492] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:42.508694 24320 raft_consensus.cc:515] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.518028 24295 raft_consensus.cc:697] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:42.554752 23915 catalog_manager.cc:5697] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.560601 24320 leader_election.cc:290] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:42.562880 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06398d76b1694a4490f087dd6e52c33e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:42.563966 24094 raft_consensus.cc:3060] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.567201 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06398d76b1694a4490f087dd6e52c33e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:42.564668 24290 consensus_queue.cc:260] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:42.569726 24205 leader_election.cc:343] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.564275 24287 tablet_bootstrap.cc:654] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.570405 24290 ts_tablet_manager.cc:1434] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.233s	user 0.012s	sys 0.002s
W20260709 13:12:42.570494 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 112369us
I20260709 13:12:42.571758 24290 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:42.577174 24288 tablet_bootstrap.cc:654] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.576747 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf86c23dc92446f955db3e85bb4b3df (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:42.565229 24295 consensus_queue.cc:237] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:42.596321 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf86c23dc92446f955db3e85bb4b3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.597074 24290 tablet_bootstrap.cc:654] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.579450 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfb395be48d4df5895b77cd94ea1512 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:42.574632 24157 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfb395be48d4df5895b77cd94ea1512 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:42.599041 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfb395be48d4df5895b77cd94ea1512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.601841 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfb395be48d4df5895b77cd94ea1512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.628659 24094 raft_consensus.cc:2468] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:42.634673 24205 leader_election.cc:304] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:42.635807 24320 raft_consensus.cc:2804] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.636396 24320 raft_consensus.cc:697] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:42.637329 24320 consensus_queue.cc:237] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:42.640465 23901 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 51056.9us
W20260709 13:12:42.640897 23903 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 48040.9us
I20260709 13:12:42.642299 24289 tablet_bootstrap.cc:654] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.662827 24288 tablet_bootstrap.cc:492] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:42.665632 24288 ts_tablet_manager.cc:1403] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.267s	user 0.019s	sys 0.001s
I20260709 13:12:42.670190 24288 raft_consensus.cc:359] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.670471 24006 tablet_service.cc:1511] Processing CreateTablet for tablet 0dfb395be48d4df5895b77cd94ea1512 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:42.671188 24288 raft_consensus.cc:385] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.671696 24288 raft_consensus.cc:740] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.672277 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dfb395be48d4df5895b77cd94ea1512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.661589 23917 catalog_manager.cc:5697] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.681187 24288 consensus_queue.cc:260] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.683140 24295 raft_consensus.cc:493] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.685503 24295 raft_consensus.cc:515] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.686868 24290 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:42.688863 24290 ts_tablet_manager.cc:1403] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.117s	user 0.025s	sys 0.021s
I20260709 13:12:42.688097 24081 tablet_service.cc:1511] Processing CreateTablet for tablet fccea2ecf3fb4019be0a669b6c1b6d2b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:42.692283 24314 raft_consensus.cc:493] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.693066 24314 raft_consensus.cc:515] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.693501 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccea2ecf3fb4019be0a669b6c1b6d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.698357 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:42.699267 24242 raft_consensus.cc:2468] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:42.699788 24314 leader_election.cc:290] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:42.689648 24295 leader_election.cc:290] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:42.702338 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.702886 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.703894 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:42.702971 23984 leader_election.cc:304] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:42.704679 24018 raft_consensus.cc:2468] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:42.705008 24295 raft_consensus.cc:2804] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.705142 24314 consensus_queue.cc:1048] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.707062 24131 leader_election.cc:304] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:42.707700 24287 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
W20260709 13:12:42.708220 24131 leader_election.cc:343] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.709316 24288 ts_tablet_manager.cc:1434] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.004s
I20260709 13:12:42.709530 24298 raft_consensus.cc:2804] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.710335 24298 raft_consensus.cc:493] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.710703 24298 raft_consensus.cc:3060] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.711184 24288 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:42.705606 24295 raft_consensus.cc:493] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.711916 24295 raft_consensus.cc:3060] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.719599 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 9d864e05a46b452780b1d6da88f05538 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:42.721419 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d864e05a46b452780b1d6da88f05538. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:42.721777 24131 consensus_peers.cc:597] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.722528 24156 tablet_service.cc:1511] Processing CreateTablet for tablet fccea2ecf3fb4019be0a669b6c1b6d2b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:42.724098 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccea2ecf3fb4019be0a669b6c1b6d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.708314 24287 ts_tablet_manager.cc:1403] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.225s	user 0.009s	sys 0.013s
I20260709 13:12:42.727560 24076 tablet_service.cc:1511] Processing CreateTablet for tablet 9d864e05a46b452780b1d6da88f05538 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:42.729367 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d864e05a46b452780b1d6da88f05538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.729009 24298 raft_consensus.cc:515] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.733065 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:42.733893 24018 raft_consensus.cc:3060] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.735100 24155 tablet_service.cc:1511] Processing CreateTablet for tablet 9d864e05a46b452780b1d6da88f05538 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:42.737026 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d864e05a46b452780b1d6da88f05538. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:42.743062 23982 leader_election.cc:343] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.748081 24231 tablet_service.cc:1511] Processing CreateTablet for tablet fccea2ecf3fb4019be0a669b6c1b6d2b (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:42.749693 24018 raft_consensus.cc:2468] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:42.750694 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fccea2ecf3fb4019be0a669b6c1b6d2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.751711 24131 leader_election.cc:304] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:42.752082 24299 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.753861 24314 raft_consensus.cc:2804] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.753659 24299 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:42.758201 24299 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:42.767122 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:42.768767 24018 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:42.767441 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:42.769761 24077 tablet_service.cc:1511] Processing CreateTablet for tablet b526e669ce164ea79b4d5b5132eac617 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:42.772106 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b526e669ce164ea79b4d5b5132eac617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.771942 24229 tablet_service.cc:1511] Processing CreateTablet for tablet b526e669ce164ea79b4d5b5132eac617 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:42.769685 24167 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:42.773811 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b526e669ce164ea79b4d5b5132eac617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.776162 24057 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:42.777397 24299 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.777701 24287 raft_consensus.cc:359] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.778585 24287 raft_consensus.cc:385] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.778896 24287 raft_consensus.cc:740] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.752060 24290 raft_consensus.cc:359] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.782390 24290 raft_consensus.cc:385] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.784214 24290 raft_consensus.cc:740] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.789705 24289 tablet_bootstrap.cc:492] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:42.790424 24289 ts_tablet_manager.cc:1403] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.247s	user 0.016s	sys 0.008s
I20260709 13:12:42.791527 24157 tablet_service.cc:1511] Processing CreateTablet for tablet feaea0cd237f463b89076aecb1d55c32 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:42.793184 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaea0cd237f463b89076aecb1d55c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.793037 24232 tablet_service.cc:1511] Processing CreateTablet for tablet feaea0cd237f463b89076aecb1d55c32 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:42.784634 23917 catalog_manager.cc:5697] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.794668 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaea0cd237f463b89076aecb1d55c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.797477 24287 consensus_queue.cc:260] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.798481 24005 tablet_service.cc:1511] Processing CreateTablet for tablet feaea0cd237f463b89076aecb1d55c32 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:42.799994 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feaea0cd237f463b89076aecb1d55c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.804548 24298 leader_election.cc:290] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:42.806926 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:42.813284 24289 raft_consensus.cc:359] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:42.813711 24131 leader_election.cc:343] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.814302 24289 raft_consensus.cc:385] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.814675 24289 raft_consensus.cc:740] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.777510 24295 raft_consensus.cc:515] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.826102 24332 raft_consensus.cc:493] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.827382 24332 raft_consensus.cc:515] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.827853 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 58db1c790ab94c0ba5756b94b1280302 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:42.829595 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58db1c790ab94c0ba5756b94b1280302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.829202 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 58db1c790ab94c0ba5756b94b1280302 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:42.830986 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58db1c790ab94c0ba5756b94b1280302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.827906 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 58db1c790ab94c0ba5756b94b1280302 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:42.831722 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.832566 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58db1c790ab94c0ba5756b94b1280302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.844298 24299 raft_consensus.cc:2749] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.834350 24287 ts_tablet_manager.cc:1434] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.108s	user 0.010s	sys 0.000s
I20260709 13:12:42.824247 24320 raft_consensus.cc:493] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.826472 24006 tablet_service.cc:1511] Processing CreateTablet for tablet b526e669ce164ea79b4d5b5132eac617 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:42.837653 24332 leader_election.cc:290] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:42.845351 24320 raft_consensus.cc:515] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.837059 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:42.847002 24167 raft_consensus.cc:2393] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:42.849457 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:42.850131 24205 leader_election.cc:304] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:12:42.850685 24241 raft_consensus.cc:3060] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.852897 24332 raft_consensus.cc:3060] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.853935 24320 leader_election.cc:290] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:42.857039 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.858697 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:42.857072 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b526e669ce164ea79b4d5b5132eac617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.859907 24295 leader_election.cc:290] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:42.852843 24287 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:12:42.862063 24205 leader_election.cc:343] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.863698 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:42.867061 24018 raft_consensus.cc:2468] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:42.865934 24314 raft_consensus.cc:697] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:42.868257 24289 consensus_queue.cc:260] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:42.868745 24314 consensus_queue.cc:237] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.869024 24205 leader_election.cc:304] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad
I20260709 13:12:42.871006 24289 ts_tablet_manager.cc:1434] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 13:12:42.871766 24320 raft_consensus.cc:2804] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.872118 24289 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:42.879992 24320 raft_consensus.cc:493] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.896916 24008 tablet_service.cc:1511] Processing CreateTablet for tablet e6f7273b2a634d919bc68a4cad26f668 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:42.916720 24320 raft_consensus.cc:3060] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.917531 24008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f7273b2a634d919bc68a4cad26f668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.907744 24288 tablet_bootstrap.cc:700] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent opening tablet: real 0.137s	user 0.003s	sys 0.000s
I20260709 13:12:42.907299 24079 tablet_service.cc:1511] Processing CreateTablet for tablet e6f7273b2a634d919bc68a4cad26f668 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:42.908993 24287 tablet_bootstrap.cc:654] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.887789 24290 consensus_queue.cc:260] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:42.927392 24093 raft_consensus.cc:3060] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.928321 24288 tablet_bootstrap.cc:654] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.916101 24332 raft_consensus.cc:2749] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.938532 24155 tablet_service.cc:1511] Processing CreateTablet for tablet e6f7273b2a634d919bc68a4cad26f668 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:42.941200 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f7273b2a634d919bc68a4cad26f668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.951997 24004 tablet_service.cc:1511] Processing CreateTablet for tablet 668e2b45abf747ec90001e857e9bd660 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:42.953701 24004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668e2b45abf747ec90001e857e9bd660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.956180 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 668e2b45abf747ec90001e857e9bd660 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:42.959117 23917 catalog_manager.cc:5697] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.960041 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f7273b2a634d919bc68a4cad26f668. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.010411 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668e2b45abf747ec90001e857e9bd660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.999737 24289 tablet_bootstrap.cc:654] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.024523 24299 consensus_queue.cc:1048] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.963871 24314 raft_consensus.cc:493] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.025696 24314 raft_consensus.cc:515] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.026240 24339 consensus_queue.cc:1048] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.993113 24076 tablet_service.cc:1511] Processing CreateTablet for tablet 668e2b45abf747ec90001e857e9bd660 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:43.030092 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e77c0a29944dfaecf265201b92507" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:42.976828 24156 tablet_service.cc:1511] Processing CreateTablet for tablet d06fbedd20384f379daf18894c847ae3 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:12:43.031992 24131 leader_election.cc:343] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.979399 24225 tablet_service.cc:1511] Processing CreateTablet for tablet d06fbedd20384f379daf18894c847ae3 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:43.033301 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdc73b179344810934aee531a69b292 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:43.034761 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e77c0a29944dfaecf265201b92507" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:43.035444 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06fbedd20384f379daf18894c847ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.998643 24295 consensus_queue.cc:1048] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:12:43.035861 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668e2b45abf747ec90001e857e9bd660. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:43.036732 24133 leader_election.cc:343] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.031587 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06fbedd20384f379daf18894c847ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.037307 24133 leader_election.cc:304] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:43.039788 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdc73b179344810934aee531a69b292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.039911 24349 raft_consensus.cc:2749] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.042661 24005 tablet_service.cc:1511] Processing CreateTablet for tablet d06fbedd20384f379daf18894c847ae3 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:43.044929 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06fbedd20384f379daf18894c847ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.983192 24093 raft_consensus.cc:2468] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:42.975327 24241 raft_consensus.cc:2468] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:43.052141 24157 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdc73b179344810934aee531a69b292 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:43.055881 24157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdc73b179344810934aee531a69b292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.051211 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdc73b179344810934aee531a69b292 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:43.066867 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdc73b179344810934aee531a69b292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.073676 23982 leader_election.cc:304] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:43.075313 24337 raft_consensus.cc:2804] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.048198 24314 leader_election.cc:290] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:43.090838 24003 tablet_service.cc:1511] Processing CreateTablet for tablet abdb73a1fad747ee8b290ec26121bac5 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:43.091599 24287 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:43.051867 24320 raft_consensus.cc:515] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.115793 24290 ts_tablet_manager.cc:1434] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.421s	user 0.014s	sys 0.002s
I20260709 13:12:43.123587 24287 ts_tablet_manager.cc:1403] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.269s	user 0.016s	sys 0.007s
I20260709 13:12:43.124941 24003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abdb73a1fad747ee8b290ec26121bac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.130215 24337 raft_consensus.cc:697] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:43.151854 24320 leader_election.cc:290] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:43.116315 24295 consensus_queue.cc:1048] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:12:43.158277 24152 tablet_service.cc:1511] Processing CreateTablet for tablet abdb73a1fad747ee8b290ec26121bac5 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:43.160022 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abdb73a1fad747ee8b290ec26121bac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.164582 24332 consensus_queue.cc:1048] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.165923 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:43.170182 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:43.171093 24018 raft_consensus.cc:3060] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.171973 24229 tablet_service.cc:1511] Processing CreateTablet for tablet a961e0b83f93496e8888d704a2d82065 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:43.173413 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a961e0b83f93496e8888d704a2d82065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.189320 24288 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:43.190110 24288 ts_tablet_manager.cc:1403] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.479s	user 0.016s	sys 0.012s
I20260709 13:12:43.193866 24290 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:43.195137 24006 tablet_service.cc:1511] Processing CreateTablet for tablet a961e0b83f93496e8888d704a2d82065 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:43.198356 24081 tablet_service.cc:1511] Processing CreateTablet for tablet abdb73a1fad747ee8b290ec26121bac5 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:12:43.201135 24205 leader_election.cc:343] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.207178 24006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a961e0b83f93496e8888d704a2d82065. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:43.213642 24205 consensus_peers.cc:597] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:43.214087 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abdb73a1fad747ee8b290ec26121bac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.216264 24337 consensus_queue.cc:237] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.216009 24289 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:43.219278 24289 ts_tablet_manager.cc:1403] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.347s	user 0.028s	sys 0.039s
I20260709 13:12:43.224778 24079 tablet_service.cc:1511] Processing CreateTablet for tablet a961e0b83f93496e8888d704a2d82065 (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:43.226647 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a961e0b83f93496e8888d704a2d82065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.228673 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 525d514eaa5240e593495ab5fcc122aa (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:43.230424 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525d514eaa5240e593495ab5fcc122aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.239225 24290 tablet_bootstrap.cc:654] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.221933 24018 raft_consensus.cc:2468] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:43.246414 24205 leader_election.cc:304] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad
I20260709 13:12:43.248375 24320 raft_consensus.cc:2804] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.248987 24320 raft_consensus.cc:697] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:43.250584 24320 consensus_queue.cc:237] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:43.278628 23903 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 48457.2us
I20260709 13:12:43.303124 24288 raft_consensus.cc:359] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.303440 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 525d514eaa5240e593495ab5fcc122aa (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:43.304107 24288 raft_consensus.cc:385] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.304716 24288 raft_consensus.cc:740] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.305562 24288 consensus_queue.cc:260] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.308894 24288 ts_tablet_manager.cc:1434] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.118s	user 0.003s	sys 0.006s
I20260709 13:12:43.310390 24288 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:43.305555 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525d514eaa5240e593495ab5fcc122aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.331424 24288 tablet_bootstrap.cc:654] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.318714 23916 catalog_manager.cc:5697] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.340700 24288 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:43.341367 24288 ts_tablet_manager.cc:1403] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.001s
I20260709 13:12:43.344794 24289 raft_consensus.cc:359] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.345981 24289 raft_consensus.cc:385] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.346511 24289 raft_consensus.cc:740] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.352712 24287 raft_consensus.cc:359] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.385407 24287 raft_consensus.cc:385] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.385845 24287 raft_consensus.cc:740] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.377106 24005 tablet_service.cc:1511] Processing CreateTablet for tablet 525d514eaa5240e593495ab5fcc122aa (DEFAULT_TABLE table=test-workload [id=e243265e0bbb4e94b3ed50360b04d3f5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:43.380674 24288 raft_consensus.cc:359] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.387251 24288 raft_consensus.cc:385] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.387034 24287 consensus_queue.cc:260] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.387826 24288 raft_consensus.cc:740] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.389024 24288 consensus_queue.cc:260] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.391613 24288 ts_tablet_manager.cc:1434] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.050s	user 0.016s	sys 0.004s
I20260709 13:12:43.392876 24288 tablet_bootstrap.cc:492] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:43.395210 24005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525d514eaa5240e593495ab5fcc122aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.395552 24290 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:43.396152 24290 ts_tablet_manager.cc:1403] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.221s	user 0.009s	sys 0.009s
I20260709 13:12:43.400130 24289 consensus_queue.cc:260] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.402635 24289 ts_tablet_manager.cc:1434] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.178s	user 0.011s	sys 0.000s
I20260709 13:12:43.399770 23917 catalog_manager.cc:5697] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.408244 24288 tablet_bootstrap.cc:654] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.404160 24289 tablet_bootstrap.cc:492] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:43.429538 24287 ts_tablet_manager.cc:1434] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.295s	user 0.012s	sys 0.007s
I20260709 13:12:43.399771 24290 raft_consensus.cc:359] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.430971 24287 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:43.431071 24290 raft_consensus.cc:385] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.446915 24314 consensus_queue.cc:1048] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.431568 24290 raft_consensus.cc:740] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.455663 24290 consensus_queue.cc:260] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.458139 24290 ts_tablet_manager.cc:1434] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.001s
I20260709 13:12:43.460222 24289 tablet_bootstrap.cc:654] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.464517 24287 tablet_bootstrap.cc:654] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.466212 24290 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:43.469709 24288 tablet_bootstrap.cc:492] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:43.469869 24320 raft_consensus.cc:493] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.472704 24093 raft_consensus.cc:3060] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.476694 24288 ts_tablet_manager.cc:1403] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.008s
I20260709 13:12:43.478170 24320 raft_consensus.cc:515] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.490237 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9400c6e36c194339911221cf57386f55" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:43.490880 24290 tablet_bootstrap.cc:654] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.491412 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9400c6e36c194339911221cf57386f55" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
W20260709 13:12:43.492537 24205 leader_election.cc:343] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.493041 24320 leader_election.cc:290] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:12:43.493577 24205 leader_election.cc:343] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.492240 24288 raft_consensus.cc:359] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.494264 24205 leader_election.cc:304] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:43.495020 24288 raft_consensus.cc:385] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.495558 24288 raft_consensus.cc:740] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.495976 24320 raft_consensus.cc:2749] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.496646 24288 consensus_queue.cc:260] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.515632 24288 ts_tablet_manager.cc:1434] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:12:43.516548 24339 raft_consensus.cc:493] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.516865 24314 consensus_queue.cc:1048] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:43.517165 24339 raft_consensus.cc:515] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.519995 24288 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:43.522296 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:43.519568 24339 leader_election.cc:290] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:43.525288 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:43.527549 24057 leader_election.cc:304] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:43.529170 24339 raft_consensus.cc:2749] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:43.532032 24288 tablet_bootstrap.cc:654] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.542163 24320 raft_consensus.cc:493] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.542944 24320 raft_consensus.cc:515] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.545572 24320 leader_election.cc:290] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:43.548739 24287 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:43.550028 24287 ts_tablet_manager.cc:1403] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.007s
I20260709 13:12:43.551833 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:43.553860 24205 leader_election.cc:343] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.554905 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:43.555691 24290 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:43.556448 24290 ts_tablet_manager.cc:1403] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.023s
W20260709 13:12:43.557354 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:43.562563 24290 raft_consensus.cc:359] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:43.562913 24205 leader_election.cc:343] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.562824 24287 raft_consensus.cc:359] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.563836 24287 raft_consensus.cc:385] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.563715 24205 leader_election.cc:304] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:43.563582 24290 raft_consensus.cc:385] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.564495 24287 raft_consensus.cc:740] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.564823 24320 raft_consensus.cc:2749] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.562898 24289 tablet_bootstrap.cc:492] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:43.565722 24289 ts_tablet_manager.cc:1403] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.162s	user 0.054s	sys 0.036s
I20260709 13:12:43.565523 24287 consensus_queue.cc:260] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.564836 24290 raft_consensus.cc:740] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.566740 24288 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:43.568621 24288 ts_tablet_manager.cc:1403] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.013s
I20260709 13:12:43.567891 24290 consensus_queue.cc:260] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.569718 24289 raft_consensus.cc:359] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.572913 24288 raft_consensus.cc:359] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.575053 24289 raft_consensus.cc:385] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.575234 24288 raft_consensus.cc:385] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.575443 24289 raft_consensus.cc:740] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.575733 24288 raft_consensus.cc:740] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.574184 24290 ts_tablet_manager.cc:1434] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:12:43.576406 24289 consensus_queue.cc:260] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.578008 24290 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:43.579411 24289 ts_tablet_manager.cc:1434] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:12:43.580886 24289 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:43.580834 24288 consensus_queue.cc:260] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.575728 24287 ts_tablet_manager.cc:1434] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.008s
I20260709 13:12:43.584151 24287 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:43.588315 24288 ts_tablet_manager.cc:1434] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:43.589893 24288 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:43.590286 24289 tablet_bootstrap.cc:654] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.592983 24287 tablet_bootstrap.cc:654] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.596927 24290 tablet_bootstrap.cc:654] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.608430 24288 tablet_bootstrap.cc:654] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.620357 24360 consensus_queue.cc:1048] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.634671 24290 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:43.635743 24290 ts_tablet_manager.cc:1403] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.005s
I20260709 13:12:43.637729 24320 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.638687 24320 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.643921 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:43.648370 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:43.648689 24205 leader_election.cc:343] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.649473 24320 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:12:43.650341 24205 leader_election.cc:343] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.651404 24289 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:43.651017 24205 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:43.652016 24289 ts_tablet_manager.cc:1403] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.071s	user 0.033s	sys 0.031s
I20260709 13:12:43.652212 24320 raft_consensus.cc:2749] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.653945 24287 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:43.654870 24289 raft_consensus.cc:359] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.655252 24287 ts_tablet_manager.cc:1403] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.071s	user 0.030s	sys 0.036s
I20260709 13:12:43.655650 24289 raft_consensus.cc:385] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.656060 24289 raft_consensus.cc:740] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.657166 24289 consensus_queue.cc:260] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.658083 24290 raft_consensus.cc:359] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.659093 24290 raft_consensus.cc:385] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.659437 24290 raft_consensus.cc:740] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.659519 24287 raft_consensus.cc:359] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.660521 24287 raft_consensus.cc:385] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.660970 24287 raft_consensus.cc:740] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.661957 24287 consensus_queue.cc:260] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.665509 24018 raft_consensus.cc:3060] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.668253 24360 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.669320 24287 ts_tablet_manager.cc:1434] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.006s
I20260709 13:12:43.668947 24360 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.671175 24289 ts_tablet_manager.cc:1434] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:12:43.671572 24360 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:43.672457 24289 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:43.672883 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:43.673468 24287 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:43.673825 24093 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:43.675758 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:43.676577 24165 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:43.660591 24290 consensus_queue.cc:260] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.679019 23982 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:43.681632 24290 ts_tablet_manager.cc:1434] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:12:43.683295 24360 raft_consensus.cc:2804] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.683856 24360 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.684255 24360 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.685154 24290 tablet_bootstrap.cc:492] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:43.687199 24093 raft_consensus.cc:3060] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.688640 24337 consensus_queue.cc:1048] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.690280 24289 tablet_bootstrap.cc:654] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.691073 24287 tablet_bootstrap.cc:654] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.694412 24290 tablet_bootstrap.cc:654] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.724188 24320 consensus_queue.cc:1048] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.734284 24360 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.734843 24289 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:43.735558 24289 ts_tablet_manager.cc:1403] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.000s
I20260709 13:12:43.737036 24288 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:43.737802 24288 ts_tablet_manager.cc:1403] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.148s	user 0.018s	sys 0.022s
I20260709 13:12:43.739180 24289 raft_consensus.cc:359] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.740091 24289 raft_consensus.cc:385] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.741048 24288 raft_consensus.cc:359] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.746028 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:43.746461 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:43.747473 24288 raft_consensus.cc:385] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.749084 24288 raft_consensus.cc:740] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.747987 24165 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.750345 24288 consensus_queue.cc:260] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.747699 24092 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.752118 24289 raft_consensus.cc:740] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.745031 24360 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:43.755789 24289 consensus_queue.cc:260] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.757983 24288 ts_tablet_manager.cc:1434] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:12:43.759764 24288 tablet_bootstrap.cc:492] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:43.762311 24289 ts_tablet_manager.cc:1434] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:12:43.765476 24289 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:43.769493 24092 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:43.774922 24167 raft_consensus.cc:3060] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.779845 23982 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:43.782289 24295 raft_consensus.cc:2804] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.782897 24295 raft_consensus.cc:697] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:43.775009 24339 raft_consensus.cc:493] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.776710 24314 raft_consensus.cc:493] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.784886 24314 raft_consensus.cc:515] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.784301 24295 consensus_queue.cc:237] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.792578 24314 leader_election.cc:290] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:43.794137 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:43.795025 24241 raft_consensus.cc:2468] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:43.796801 24133 leader_election.cc:304] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:43.786334 24288 tablet_bootstrap.cc:654] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.784847 24339 raft_consensus.cc:515] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.800549 24289 tablet_bootstrap.cc:654] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.777086 24287 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:43.802407 24287 ts_tablet_manager.cc:1403] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.010s
I20260709 13:12:43.812390 24369 consensus_queue.cc:1048] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.813313 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:43.814666 24241 raft_consensus.cc:2468] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:43.821161 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:43.822839 24339 leader_election.cc:290] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:43.797891 24165 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:43.809089 24314 raft_consensus.cc:2804] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.836440 24314 raft_consensus.cc:493] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:43.832800 24131 leader_election.cc:343] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.833091 24360 raft_consensus.cc:493] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.828265 24059 leader_election.cc:304] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:43.842757 24360 raft_consensus.cc:515] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.843144 24339 raft_consensus.cc:2804] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.843906 24339 raft_consensus.cc:493] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.844414 24339 raft_consensus.cc:3060] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.845530 24360 leader_election.cc:290] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:43.845800 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:43.846594 24019 raft_consensus.cc:2468] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:43.848701 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:43.854640 24290 tablet_bootstrap.cc:492] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:43.855486 24290 ts_tablet_manager.cc:1403] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.029s
I20260709 13:12:43.838569 24314 raft_consensus.cc:3060] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.852684 24287 raft_consensus.cc:359] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.857280 24287 raft_consensus.cc:385] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.857640 24287 raft_consensus.cc:740] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.850656 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:43.859720 24287 consensus_queue.cc:260] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.860745 24241 raft_consensus.cc:2468] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:43.862222 23984 leader_election.cc:304] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:43.866011 24287 ts_tablet_manager.cc:1434] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 13:12:43.867424 24287 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:43.871413 24290 raft_consensus.cc:359] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.875881 24314 raft_consensus.cc:515] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.876750 24287 tablet_bootstrap.cc:654] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.876559 24290 raft_consensus.cc:385] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.878528 24290 raft_consensus.cc:740] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.877735 24295 raft_consensus.cc:2804] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.880475 24314 leader_election.cc:290] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:43.879889 24295 raft_consensus.cc:493] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.882637 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:43.883737 24295 raft_consensus.cc:3060] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.882633 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
W20260709 13:12:43.885078 24131 leader_election.cc:343] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.886178 24241 raft_consensus.cc:3060] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.887154 24288 tablet_bootstrap.cc:492] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:43.887807 24288 ts_tablet_manager.cc:1403] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.007s
I20260709 13:12:43.889163 24290 consensus_queue.cc:260] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.892011 24288 raft_consensus.cc:359] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.891702 24290 ts_tablet_manager.cc:1434] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:12:43.893798 24288 raft_consensus.cc:385] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.894197 24288 raft_consensus.cc:740] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.895114 24290 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:43.894910 24288 consensus_queue.cc:260] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.908532 24290 tablet_bootstrap.cc:654] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.910122 24241 raft_consensus.cc:2468] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:43.911777 24133 leader_election.cc:304] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:43.913156 24314 raft_consensus.cc:2804] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.914281 24314 raft_consensus.cc:697] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:43.915639 24314 consensus_queue.cc:237] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.917301 24288 ts_tablet_manager.cc:1434] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:12:43.920173 24288 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:43.882979 24339 raft_consensus.cc:515] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.931921 24339 leader_election.cc:290] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:43.932272 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:43.932966 24241 raft_consensus.cc:3060] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.934952 24093 raft_consensus.cc:2393] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:43.940944 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:43.952059 24288 tablet_bootstrap.cc:654] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.951694 24369 raft_consensus.cc:493] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.955623 24369 raft_consensus.cc:515] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:43.963789 24241 raft_consensus.cc:2468] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:43.965509 24289 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:43.965703 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e77c0a29944dfaecf265201b92507" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:43.966229 24289 ts_tablet_manager.cc:1403] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.201s	user 0.018s	sys 0.016s
I20260709 13:12:43.966481 24093 raft_consensus.cc:2468] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:43.968142 24059 leader_election.cc:304] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:43.969786 24289 raft_consensus.cc:359] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.970672 24289 raft_consensus.cc:385] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.971004 24289 raft_consensus.cc:740] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.970525 24290 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:43.971918 24298 raft_consensus.cc:493] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.972580 24298 raft_consensus.cc:515] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.972939 24205 leader_election.cc:304] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:43.973177 24289 consensus_queue.cc:260] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:43.974022 24320 raft_consensus.cc:2804] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.974412 24320 raft_consensus.cc:493] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.974749 24320 raft_consensus.cc:3060] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.975747 24289 ts_tablet_manager.cc:1434] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:43.976152 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9400c6e36c194339911221cf57386f55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:43.976948 24242 raft_consensus.cc:2468] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:43.977470 24287 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:43.978035 24287 ts_tablet_manager.cc:1403] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.015s
I20260709 13:12:43.978444 24133 leader_election.cc:304] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:43.980260 24349 raft_consensus.cc:2804] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.980729 24349 raft_consensus.cc:493] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.981074 24349 raft_consensus.cc:3060] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.981756 24289 tablet_bootstrap.cc:492] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:43.984761 24369 leader_election.cc:290] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:43.972067 24290 ts_tablet_manager.cc:1403] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.016s
I20260709 13:12:43.990602 24287 raft_consensus.cc:359] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.992556 24339 raft_consensus.cc:2804] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.991576 24287 raft_consensus.cc:385] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.993642 24339 raft_consensus.cc:697] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:43.993294 24287 raft_consensus.cc:740] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.994858 24339 consensus_queue.cc:237] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:43.995631 24287 consensus_queue.cc:260] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:43.999642 24287 ts_tablet_manager.cc:1434] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:12:44.000881 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e77c0a29944dfaecf265201b92507" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.002813 24167 raft_consensus.cc:2468] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:44.002650 23915 catalog_manager.cc:5697] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.000934 24287 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:43.996116 24289 tablet_bootstrap.cc:654] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.008587 24320 raft_consensus.cc:515] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.018029 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e77c0a29944dfaecf265201b92507" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:44.018923 24093 raft_consensus.cc:3060] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.019124 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9400c6e36c194339911221cf57386f55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:44.019392 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585e77c0a29944dfaecf265201b92507" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:44.019891 24019 raft_consensus.cc:2468] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:44.020099 24167 raft_consensus.cc:3060] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.021602 24287 tablet_bootstrap.cc:654] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.019812 24290 raft_consensus.cc:359] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.023079 24290 raft_consensus.cc:385] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.023362 24290 raft_consensus.cc:740] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.024083 24320 leader_election.cc:290] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.024603 24290 consensus_queue.cc:260] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.016536 24295 raft_consensus.cc:515] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.027684 24017 raft_consensus.cc:2393] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:44.029464 24290 ts_tablet_manager.cc:1434] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:12:44.015407 24298 leader_election.cc:290] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:44.030968 24290 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:44.035730 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:44.036767 24241 raft_consensus.cc:2393] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:44.041268 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
W20260709 13:12:44.030187 24133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 47659.9us
I20260709 13:12:44.042599 24288 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:44.043357 23982 leader_election.cc:304] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:44.043949 24295 leader_election.cc:290] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:44.045387 24288 ts_tablet_manager.cc:1403] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.011s
I20260709 13:12:44.046486 24360 raft_consensus.cc:2749] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.045266 24093 raft_consensus.cc:2468] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:44.057016 24205 leader_election.cc:304] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:44.059175 24320 raft_consensus.cc:2804] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.061085 24290 tablet_bootstrap.cc:654] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.060014 24320 raft_consensus.cc:697] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:44.062678 23917 catalog_manager.cc:5697] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.065294 24288 raft_consensus.cc:359] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.067418 24288 raft_consensus.cc:385] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.068825 24288 raft_consensus.cc:740] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.070779 24320 consensus_queue.cc:237] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.072178 24288 consensus_queue.cc:260] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.054934 24349 raft_consensus.cc:515] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.102275 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9400c6e36c194339911221cf57386f55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:44.103483 24241 raft_consensus.cc:3060] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.104573 24369 raft_consensus.cc:493] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.104923 24288 ts_tablet_manager.cc:1434] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.003s
I20260709 13:12:44.105415 24349 leader_election.cc:290] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:44.105286 24369 raft_consensus.cc:515] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.106424 24288 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:44.108214 24287 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:44.108894 24287 ts_tablet_manager.cc:1403] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.009s
I20260709 13:12:44.108747 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9400c6e36c194339911221cf57386f55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:44.109901 24017 raft_consensus.cc:3060] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.112908 24287 raft_consensus.cc:359] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.113870 24287 raft_consensus.cc:385] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.114531 24287 raft_consensus.cc:740] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.104686 24167 raft_consensus.cc:2468] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:44.114823 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.102873 24289 tablet_bootstrap.cc:492] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:44.117947 24289 ts_tablet_manager.cc:1403] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.137s	user 0.025s	sys 0.024s
I20260709 13:12:44.109000 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:44.122902 24205 leader_election.cc:343] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.115757 24287 consensus_queue.cc:260] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:44.123843 24205 leader_election.cc:343] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.124428 24205 leader_election.cc:304] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:12:44.125473 24332 raft_consensus.cc:2749] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.125876 24241 raft_consensus.cc:2468] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:44.127406 24133 leader_election.cc:304] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:44.115059 24369 leader_election.cc:290] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.128321 24287 ts_tablet_manager.cc:1434] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:44.127527 24289 raft_consensus.cc:359] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.129315 24289 raft_consensus.cc:385] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.129417 24400 raft_consensus.cc:2804] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.129667 24289 raft_consensus.cc:740] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.129618 24287 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:44.130177 24400 raft_consensus.cc:697] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:44.130693 24289 consensus_queue.cc:260] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.133561 24289 ts_tablet_manager.cc:1434] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:12:44.134656 24289 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:44.134979 24290 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:44.135536 24290 ts_tablet_manager.cc:1403] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.001s
I20260709 13:12:44.131313 24400 consensus_queue.cc:237] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.139098 24290 raft_consensus.cc:359] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.140076 24290 raft_consensus.cc:385] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.140448 24290 raft_consensus.cc:740] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.141429 24290 consensus_queue.cc:260] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.142347 24287 tablet_bootstrap.cc:654] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.144555 24290 ts_tablet_manager.cc:1434] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.009s
I20260709 13:12:44.145915 24290 tablet_bootstrap.cc:492] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:44.144809 23916 catalog_manager.cc:5697] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.152941 24289 tablet_bootstrap.cc:654] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.155393 24290 tablet_bootstrap.cc:654] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.158852 24017 raft_consensus.cc:2468] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:44.171483 24288 tablet_bootstrap.cc:654] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.174842 24400 raft_consensus.cc:493] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.175726 24287 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:44.175576 24400 raft_consensus.cc:515] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.176388 24287 ts_tablet_manager.cc:1403] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.011s
I20260709 13:12:44.177909 24290 tablet_bootstrap.cc:492] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:44.178452 24290 ts_tablet_manager.cc:1403] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.002s
I20260709 13:12:44.179443 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:44.180115 24287 raft_consensus.cc:359] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.182041 24290 raft_consensus.cc:359] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.183579 24287 raft_consensus.cc:385] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.183663 24290 raft_consensus.cc:385] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.183943 24287 raft_consensus.cc:740] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.184032 24290 raft_consensus.cc:740] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.183231 24289 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:44.185171 24289 ts_tablet_manager.cc:1403] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.011s
I20260709 13:12:44.184913 24290 consensus_queue.cc:260] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:44.185346 24133 leader_election.cc:343] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.185851 23914 catalog_manager.cc:5697] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.188206 24290 ts_tablet_manager.cc:1434] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:12:44.188684 24287 consensus_queue.cc:260] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.189932 24290 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:44.190038 24295 raft_consensus.cc:493] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.190485 24289 raft_consensus.cc:359] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.191295 24289 raft_consensus.cc:385] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.190711 24295 raft_consensus.cc:515] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.191599 24289 raft_consensus.cc:740] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.192504 24289 consensus_queue.cc:260] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.195663 24287 ts_tablet_manager.cc:1434] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:12:44.197255 24295 leader_election.cc:290] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:44.198278 24290 tablet_bootstrap.cc:654] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.198089 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.200001 24287 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:44.209108 24287 tablet_bootstrap.cc:654] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.214208 24289 ts_tablet_manager.cc:1434] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:12:44.215659 24289 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:44.198228 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:44.218971 24241 raft_consensus.cc:2393] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:44.222420 23984 leader_election.cc:304] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:44.226761 24289 tablet_bootstrap.cc:654] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.255155 24290 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:44.257649 24290 ts_tablet_manager.cc:1403] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.030s
I20260709 13:12:44.258255 24295 raft_consensus.cc:3060] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.261523 24290 raft_consensus.cc:359] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.262504 24290 raft_consensus.cc:385] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.262866 24290 raft_consensus.cc:740] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.264123 24290 consensus_queue.cc:260] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.267016 24290 ts_tablet_manager.cc:1434] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:44.268652 24290 tablet_bootstrap.cc:492] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:44.272231 24339 raft_consensus.cc:493] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.273195 24339 raft_consensus.cc:515] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.274780 24320 raft_consensus.cc:493] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.275617 24320 raft_consensus.cc:515] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.278469 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.278710 24320 leader_election.cc:290] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:44.279412 24165 raft_consensus.cc:2468] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:44.276788 24339 leader_election.cc:290] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:44.282709 24290 tablet_bootstrap.cc:654] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.283555 24057 leader_election.cc:304] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:44.288203 24360 raft_consensus.cc:493] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.289168 24360 raft_consensus.cc:515] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.292017 24287 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:44.293326 24287 ts_tablet_manager.cc:1403] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.010s
I20260709 13:12:44.290966 24337 consensus_queue.cc:1048] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:44.292198 24339 raft_consensus.cc:2804] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.295219 24339 raft_consensus.cc:493] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.295611 24339 raft_consensus.cc:3060] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.296234 24337 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.297083 24337 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.297881 24287 raft_consensus.cc:359] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.298707 24287 raft_consensus.cc:385] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.299005 24287 raft_consensus.cc:740] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.299835 24287 consensus_queue.cc:260] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.304605 24287 ts_tablet_manager.cc:1434] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:12:44.306013 24287 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:44.301831 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9e1136d57e4ad0b7b229647d268d85" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:44.309448 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:44.309448 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.310514 24092 raft_consensus.cc:2468] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:44.310672 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:44.310524 24165 raft_consensus.cc:2468] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:44.312326 24241 raft_consensus.cc:2468] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
W20260709 13:12:44.314299 24205 leader_election.cc:343] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.316959 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:44.308012 24360 leader_election.cc:290] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.317878 24242 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:44.318674 24400 leader_election.cc:290] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:44.316412 23982 leader_election.cc:304] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:44.319597 24337 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:44.320104 23984 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:44.320299 24337 raft_consensus.cc:2804] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.321815 24337 raft_consensus.cc:493] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.323200 24337 raft_consensus.cc:3060] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.323843 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9e1136d57e4ad0b7b229647d268d85" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:44.325054 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:44.326052 24092 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
W20260709 13:12:44.326062 24205 leader_election.cc:343] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.328193 24205 leader_election.cc:304] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:44.329779 24320 raft_consensus.cc:2749] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.331177 24360 raft_consensus.cc:2804] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.331836 24360 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.332304 24360 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.338186 23915 catalog_manager.cc:5697] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.334563 24295 raft_consensus.cc:2749] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.365697 24290 tablet_bootstrap.cc:492] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:44.366528 24290 ts_tablet_manager.cc:1403] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.017s
I20260709 13:12:44.375036 24418 consensus_queue.cc:1048] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.385607 24337 raft_consensus.cc:515] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.373358 24290 raft_consensus.cc:359] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.390734 24290 raft_consensus.cc:385] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.391134 24290 raft_consensus.cc:740] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.392033 24290 consensus_queue.cc:260] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.407255 24290 ts_tablet_manager.cc:1434] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:12:44.408061 24287 tablet_bootstrap.cc:654] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.399704 24339 raft_consensus.cc:515] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.415503 24337 leader_election.cc:290] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.419200 24289 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:44.420554 24289 ts_tablet_manager.cc:1403] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.013s
I20260709 13:12:44.426256 24288 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:44.426919 24288 ts_tablet_manager.cc:1403] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.321s	user 0.068s	sys 0.071s
I20260709 13:12:44.428850 24390 raft_consensus.cc:493] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.429693 24390 raft_consensus.cc:515] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:44.411856 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 88216.6us
I20260709 13:12:44.430873 24288 raft_consensus.cc:359] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.431650 24288 raft_consensus.cc:385] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.431967 24288 raft_consensus.cc:740] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.432744 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:44.432997 24288 consensus_queue.cc:260] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.434900 24288 ts_tablet_manager.cc:1434] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 13:12:44.436285 24131 leader_election.cc:343] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.436944 24131 leader_election.cc:304] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:44.439160 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:44.440129 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:44.440927 24092 raft_consensus.cc:3060] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.441540 24400 raft_consensus.cc:2749] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.440218 24167 raft_consensus.cc:3060] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.446027 24339 leader_election.cc:290] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:44.449070 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:44.449995 24241 raft_consensus.cc:3060] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.452082 24289 raft_consensus.cc:359] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.454010 24420 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.456636 24390 leader_election.cc:290] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.458544 24289 raft_consensus.cc:385] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.459221 24289 raft_consensus.cc:740] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.463908 24420 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.468869 24320 consensus_queue.cc:1048] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.475128 24290 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:44.461114 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:44.474254 24289 consensus_queue.cc:260] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.468214 24420 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.485502 24288 tablet_bootstrap.cc:492] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:44.490325 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.491760 24166 raft_consensus.cc:2468] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:44.492187 24289 ts_tablet_manager.cc:1434] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:12:44.479831 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:44.493794 24165 raft_consensus.cc:3060] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.494081 24289 tablet_bootstrap.cc:492] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:44.497146 24057 leader_election.cc:304] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:44.494145 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.498129 24390 raft_consensus.cc:2804] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.498363 24168 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:44.498719 24390 raft_consensus.cc:493] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.495846 24400 consensus_queue.cc:1048] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.496757 24290 tablet_bootstrap.cc:654] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.499164 24390 raft_consensus.cc:3060] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.507983 24314 consensus_queue.cc:1048] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.509163 24287 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:44.510270 24287 ts_tablet_manager.cc:1403] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.205s	user 0.036s	sys 0.027s
I20260709 13:12:44.516997 24339 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.519421 24339 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.521564 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:44.522500 24093 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:44.523581 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:44.533598 24019 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:44.535712 24057 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:44.512044 23982 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:44.480423 24017 raft_consensus.cc:2468] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:44.537071 24295 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:44.537541 24295 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.537919 24295 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.536998 24288 tablet_bootstrap.cc:654] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.544970 24428 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:44.545621 24428 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.546073 24428 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.546921 24165 raft_consensus.cc:2468] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:44.542783 24241 raft_consensus.cc:2468] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:44.528538 24320 raft_consensus.cc:493] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.574150 24289 tablet_bootstrap.cc:654] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.490322 24167 raft_consensus.cc:2468] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:44.580595 24287 raft_consensus.cc:359] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.581920 24287 raft_consensus.cc:385] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.582345 24287 raft_consensus.cc:740] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.582805 24427 consensus_queue.cc:1048] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.583842 24287 consensus_queue.cc:260] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:44.595242 24287 ts_tablet_manager.cc:1434] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.001s
I20260709 13:12:44.596736 24287 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:44.580220 24320 raft_consensus.cc:515] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:44.628114 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 92497.5us
I20260709 13:12:44.632915 24289 tablet_bootstrap.cc:492] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:44.633665 24289 ts_tablet_manager.cc:1403] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.005s
I20260709 13:12:44.597976 24339 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.629940 24092 raft_consensus.cc:2468] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
W20260709 13:12:44.648685 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:44.657320 24400 consensus_queue.cc:1048] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.658962 24360 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.636140 23982 leader_election.cc:304] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:44.666877 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.653578 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:44.654134 24288 tablet_bootstrap.cc:492] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:44.649222 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:44.667157 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:44.650650 24320 leader_election.cc:290] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:44.671805 24290 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:44.653882 24428 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.672806 24290 ts_tablet_manager.cc:1403] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.198s	user 0.011s	sys 0.013s
I20260709 13:12:44.673851 24288 ts_tablet_manager.cc:1403] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.015s
I20260709 13:12:44.666020 24360 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:44.668977 24164 raft_consensus.cc:2468] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:44.645623 24390 raft_consensus.cc:515] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:44.673185 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 131124us
I20260709 13:12:44.675021 24017 raft_consensus.cc:2468] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:44.677199 24167 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:44.686635 24239 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.713196 24425 raft_consensus.cc:2804] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.714534 24287 tablet_bootstrap.cc:654] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.727100 24205 leader_election.cc:304] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:44.719182 24295 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.728786 24320 consensus_queue.cc:1048] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:44.734441 24295 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.728664 24332 raft_consensus.cc:2804] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.699299 24057 leader_election.cc:304] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:44.738220 24332 raft_consensus.cc:493] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.735877 24290 raft_consensus.cc:359] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.843956 24290 raft_consensus.cc:385] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.845005 24290 raft_consensus.cc:740] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.728741 24425 raft_consensus.cc:697] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:44.749771 24390 leader_election.cc:290] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.847318 24290 consensus_queue.cc:260] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:44.751183 24288 raft_consensus.cc:359] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.747304 24289 raft_consensus.cc:359] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.849697 24288 raft_consensus.cc:385] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.849910 24289 raft_consensus.cc:385] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.849599 24425 consensus_queue.cc:237] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:44.850301 24288 raft_consensus.cc:740] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
W20260709 13:12:44.806819 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 117045us
I20260709 13:12:44.840536 24332 raft_consensus.cc:3060] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.754812 24428 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:44.850414 24289 raft_consensus.cc:740] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.873530 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:44.874814 24094 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.819779 24339 raft_consensus.cc:2804] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.810674 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:44.881209 24164 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:44.894007 24094 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:44.874876 24289 consensus_queue.cc:260] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.904608 24288 consensus_queue.cc:260] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.926259 24289 ts_tablet_manager.cc:1434] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.292s	user 0.010s	sys 0.005s
I20260709 13:12:44.926844 24290 ts_tablet_manager.cc:1434] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.251s	user 0.011s	sys 0.001s
I20260709 13:12:44.933007 24339 raft_consensus.cc:697] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:44.953061 24339 consensus_queue.cc:237] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.956871 24164 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:12:44.960868 24429 raft_consensus.cc:493] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.961055 24427 consensus_queue.cc:1048] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.961989 24429 raft_consensus.cc:515] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:44.964555 24288 ts_tablet_manager.cc:1434] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.288s	user 0.009s	sys 0.003s
I20260709 13:12:44.973757 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:44.975456 24019 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 2: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:44.978420 24290 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:44.982880 24289 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:45.012961 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:45.049973 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:45.051029 24242 raft_consensus.cc:2468] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:45.051937 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:45.038906 24429 leader_election.cc:290] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:45.053236 24093 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:45.054906 24288 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:45.050937 23982 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:45.063129 24418 raft_consensus.cc:2804] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.062947 24445 raft_consensus.cc:493] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.063967 24418 raft_consensus.cc:697] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
W20260709 13:12:45.025089 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 124119us
I20260709 13:12:45.069042 24418 consensus_queue.cc:237] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.077504 24289 tablet_bootstrap.cc:654] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.041920 24019 raft_consensus.cc:3060] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.081480 24059 leader_election.cc:304] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:45.082861 23982 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad
I20260709 13:12:45.084671 24295 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:45.085321 24295 raft_consensus.cc:697] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:45.084890 24427 raft_consensus.cc:2804] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.087306 24427 raft_consensus.cc:493] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.087234 24295 consensus_queue.cc:237] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.067308 24287 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:45.090924 24287 ts_tablet_manager.cc:1403] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.495s	user 0.025s	sys 0.025s
I20260709 13:12:45.091722 24290 tablet_bootstrap.cc:654] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.088070 24427 raft_consensus.cc:3060] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.064503 24445 raft_consensus.cc:515] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.098448 24288 tablet_bootstrap.cc:654] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.091030 24332 raft_consensus.cc:515] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.106724 24429 raft_consensus.cc:493] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.110457 24429 raft_consensus.cc:515] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.114660 24314 raft_consensus.cc:493] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.115383 24314 raft_consensus.cc:515] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.117388 24429 leader_election.cc:290] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:12:45.097892 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 109317us
I20260709 13:12:45.121860 24314 leader_election.cc:290] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:45.124178 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9e1136d57e4ad0b7b229647d268d85" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:45.126273 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9e1136d57e4ad0b7b229647d268d85" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
W20260709 13:12:45.126484 24057 leader_election.cc:343] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.127581 24241 raft_consensus.cc:2468] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:45.127899 24287 raft_consensus.cc:359] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.134898 24287 raft_consensus.cc:385] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.135219 24287 raft_consensus.cc:740] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.129153 24332 leader_election.cc:290] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:45.139946 24059 leader_election.cc:304] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:45.141665 24445 leader_election.cc:290] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:45.143486 24239 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:45.145406 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:45.153822 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:45.155073 24428 raft_consensus.cc:2804] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.161103 24428 raft_consensus.cc:493] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.157007 24287 consensus_queue.cc:260] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.159485 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:45.161603 24428 raft_consensus.cc:3060] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.159708 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:45.162397 24167 raft_consensus.cc:3060] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.164811 24016 raft_consensus.cc:3060] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.166630 24287 ts_tablet_manager.cc:1434] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.003s
I20260709 13:12:45.168169 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:45.171193 24165 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 2: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:45.173007 24287 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:45.174464 24242 raft_consensus.cc:2468] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:45.177690 24133 leader_election.cc:304] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:45.179476 24314 raft_consensus.cc:2804] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.180002 24314 raft_consensus.cc:493] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.180624 24314 raft_consensus.cc:3060] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.192158 24427 raft_consensus.cc:515] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.193043 24443 consensus_queue.cc:1048] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.194104 24093 raft_consensus.cc:2393] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:45.211062 24289 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:45.211766 24289 ts_tablet_manager.cc:1403] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.230s	user 0.017s	sys 0.006s
I20260709 13:12:45.218457 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:45.219853 24093 raft_consensus.cc:2393] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:45.211028 24428 raft_consensus.cc:515] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.231472 24057 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:45.232911 24429 raft_consensus.cc:2749] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:45.233536 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9e1136d57e4ad0b7b229647d268d85" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:45.234308 24242 raft_consensus.cc:3060] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.234740 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e9e1136d57e4ad0b7b229647d268d85" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:45.234892 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:45.235534 24017 raft_consensus.cc:3060] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.237861 24289 raft_consensus.cc:359] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.238988 24289 raft_consensus.cc:385] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.243440 24287 tablet_bootstrap.cc:654] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.246578 24427 leader_election.cc:290] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:45.247623 24019 raft_consensus.cc:2468] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:45.248859 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:45.249831 24239 raft_consensus.cc:3060] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.239394 24289 raft_consensus.cc:740] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.264081 24016 raft_consensus.cc:2468] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:45.265223 24017 raft_consensus.cc:2468] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:45.256004 24167 raft_consensus.cc:2468] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:45.266916 24057 leader_election.cc:304] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:45.268057 24429 raft_consensus.cc:2804] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.268792 24429 raft_consensus.cc:697] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:45.270071 24429 consensus_queue.cc:237] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.270824 24205 leader_election.cc:304] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:45.272152 24290 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:45.272190 24445 raft_consensus.cc:2804] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.273115 24290 ts_tablet_manager.cc:1403] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.295s	user 0.028s	sys 0.000s
I20260709 13:12:45.273151 24445 raft_consensus.cc:697] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:45.267807 24239 raft_consensus.cc:2468] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:45.274447 24445 consensus_queue.cc:237] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.278491 24290 raft_consensus.cc:359] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.279330 24290 raft_consensus.cc:385] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.279606 24290 raft_consensus.cc:740] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.280300 24057 leader_election.cc:304] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:45.280472 24290 consensus_queue.cc:260] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.282049 24430 raft_consensus.cc:2804] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.282622 24430 raft_consensus.cc:697] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:45.283908 24430 consensus_queue.cc:237] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.284794 24289 consensus_queue.cc:260] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.287928 24289 ts_tablet_manager.cc:1434] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.003s
I20260709 13:12:45.232108 24428 leader_election.cc:290] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:45.293687 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:45.296448 24288 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:45.297389 24288 ts_tablet_manager.cc:1403] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.258s	user 0.020s	sys 0.019s
I20260709 13:12:45.299939 24290 ts_tablet_manager.cc:1434] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.003s
I20260709 13:12:45.301532 24290 tablet_bootstrap.cc:492] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:45.301299 24059 leader_election.cc:304] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:45.303344 24428 raft_consensus.cc:2804] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.304092 24428 raft_consensus.cc:697] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:45.306223 24428 consensus_queue.cc:237] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.304536 24242 raft_consensus.cc:2468] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:45.283071 23916 catalog_manager.cc:5697] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.303970 24288 raft_consensus.cc:359] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.314818 24288 raft_consensus.cc:385] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.315305 24288 raft_consensus.cc:740] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.318850 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:45.319867 24167 raft_consensus.cc:3060] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.322866 24288 consensus_queue.cc:260] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.324410 24289 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:45.328233 24290 tablet_bootstrap.cc:654] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.330278 24205 leader_election.cc:304] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:12:45.337908 24332 raft_consensus.cc:2749] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:45.342445 24289 tablet_bootstrap.cc:654] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.345709 24288 ts_tablet_manager.cc:1434] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 13:12:45.347563 24288 tablet_bootstrap.cc:492] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:45.352654 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:45.354193 24314 raft_consensus.cc:515] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.355888 24165 raft_consensus.cc:2393] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:45.363286 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:45.365870 24242 raft_consensus.cc:2393] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:45.361737 24314 leader_election.cc:290] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:45.376771 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1bc51404a8482fb802e2ba85e80e88" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:45.381199 24167 raft_consensus.cc:2468] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:45.382046 24131 leader_election.cc:304] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:45.383323 24443 raft_consensus.cc:2749] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:45.386679 24288 tablet_bootstrap.cc:654] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.405800 24290 tablet_bootstrap.cc:492] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:45.406034 24289 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:45.406528 24290 ts_tablet_manager.cc:1403] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.000s
I20260709 13:12:45.406618 24289 ts_tablet_manager.cc:1403] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.005s
I20260709 13:12:45.407774 24418 consensus_queue.cc:1048] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:45.410123 24289 raft_consensus.cc:359] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.410910 24289 raft_consensus.cc:385] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.410987 24287 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:45.410429 24290 raft_consensus.cc:359] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.411289 24289 raft_consensus.cc:740] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.411507 24290 raft_consensus.cc:385] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.411657 24287 ts_tablet_manager.cc:1403] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.239s	user 0.010s	sys 0.019s
I20260709 13:12:45.412051 24290 raft_consensus.cc:740] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.412245 24289 consensus_queue.cc:260] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.413034 24290 consensus_queue.cc:260] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.415566 24290 ts_tablet_manager.cc:1434] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:45.415457 24287 raft_consensus.cc:359] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.416520 24287 raft_consensus.cc:385] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.417732 24290 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:45.421597 24430 consensus_queue.cc:1048] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.425325 24418 consensus_queue.cc:1048] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:45.425786 24289 ts_tablet_manager.cc:1434] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:12:45.426474 24290 tablet_bootstrap.cc:654] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.427392 24289 tablet_bootstrap.cc:492] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:45.430876 24288 tablet_bootstrap.cc:492] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:45.431492 24288 ts_tablet_manager.cc:1403] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.000s
I20260709 13:12:45.432530 24430 consensus_queue.cc:1048] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:45.420317 24287 raft_consensus.cc:740] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.437793 24287 consensus_queue.cc:260] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.435374 24288 raft_consensus.cc:359] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.444077 24288 raft_consensus.cc:385] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.445240 24288 raft_consensus.cc:740] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.447232 24288 consensus_queue.cc:260] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.455009 24289 tablet_bootstrap.cc:654] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.456801 24287 ts_tablet_manager.cc:1434] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:12:45.462472 24287 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:45.476954 24288 ts_tablet_manager.cc:1434] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.001s
I20260709 13:12:45.482312 24288 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:45.495814 24288 tablet_bootstrap.cc:654] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.495934 24320 raft_consensus.cc:493] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.496614 24320 raft_consensus.cc:515] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.500969 24320 leader_election.cc:290] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:45.502321 24287 tablet_bootstrap.cc:654] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.503255 24428 raft_consensus.cc:493] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.503901 24428 raft_consensus.cc:515] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.505730 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42f9b12b00946d9a5420824dac647b6" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:45.506558 24091 raft_consensus.cc:2468] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:45.507905 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeadb805a464c1bb34f499463f846e3" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:45.508242 24428 leader_election.cc:290] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:45.508747 24019 raft_consensus.cc:2468] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:45.510084 24057 leader_election.cc:304] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:45.511281 24428 raft_consensus.cc:2804] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.511348 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeadb805a464c1bb34f499463f846e3" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:45.511792 24428 raft_consensus.cc:493] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.512198 24428 raft_consensus.cc:3060] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.513690 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42f9b12b00946d9a5420824dac647b6" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:45.512166 24167 raft_consensus.cc:2468] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:45.520005 24205 leader_election.cc:304] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:45.521787 24320 raft_consensus.cc:2804] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.522382 24320 raft_consensus.cc:493] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.522922 24320 raft_consensus.cc:3060] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.523154 24428 raft_consensus.cc:515] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:45.526791 24205 leader_election.cc:343] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.526988 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeadb805a464c1bb34f499463f846e3" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:45.527758 24019 raft_consensus.cc:3060] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.532250 24428 leader_election.cc:290] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:45.540529 24320 raft_consensus.cc:515] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.542155 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deeadb805a464c1bb34f499463f846e3" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:45.543252 24167 raft_consensus.cc:3060] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.571624 24019 raft_consensus.cc:2468] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:45.573542 24057 leader_election.cc:304] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:45.574630 24428 raft_consensus.cc:2804] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.574988 24288 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:45.574919 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42f9b12b00946d9a5420824dac647b6" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:45.575228 24428 raft_consensus.cc:697] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:45.575754 24091 raft_consensus.cc:3060] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.575773 24288 ts_tablet_manager.cc:1403] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.003s
I20260709 13:12:45.576303 24428 consensus_queue.cc:237] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.582437 24289 tablet_bootstrap.cc:492] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:45.583302 24289 ts_tablet_manager.cc:1403] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.156s	user 0.025s	sys 0.007s
I20260709 13:12:45.583515 24425 consensus_queue.cc:1048] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.618503 24165 raft_consensus.cc:1275] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:45.621811 24425 consensus_queue.cc:1048] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.628445 24290 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:45.628800 24287 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:45.629141 24290 ts_tablet_manager.cc:1403] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.212s	user 0.057s	sys 0.042s
I20260709 13:12:45.629278 24287 ts_tablet_manager.cc:1403] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.000s
I20260709 13:12:45.632817 24290 raft_consensus.cc:359] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.633639 24289 raft_consensus.cc:359] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.633653 24290 raft_consensus.cc:385] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.634681 24289 raft_consensus.cc:385] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.634961 24290 raft_consensus.cc:740] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.635267 24289 raft_consensus.cc:740] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.635988 24290 consensus_queue.cc:260] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.636266 24289 consensus_queue.cc:260] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.638603 24290 ts_tablet_manager.cc:1434] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:45.639209 24289 ts_tablet_manager.cc:1434] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.056s	user 0.019s	sys 0.003s
I20260709 13:12:45.639916 24290 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:45.641279 24288 raft_consensus.cc:359] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.642088 24288 raft_consensus.cc:385] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.642544 24288 raft_consensus.cc:740] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.642236 24287 raft_consensus.cc:359] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.643379 24287 raft_consensus.cc:385] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.643730 24288 consensus_queue.cc:260] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.643764 24287 raft_consensus.cc:740] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.649154 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42f9b12b00946d9a5420824dac647b6" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:45.649154 24289 tablet_bootstrap.cc:492] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
W20260709 13:12:45.650765 24205 leader_election.cc:343] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.651988 24287 consensus_queue.cc:260] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.653760 24320 leader_election.cc:290] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:45.653226 24295 consensus_queue.cc:1048] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.656463 24287 ts_tablet_manager.cc:1434] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:12:45.658042 24287 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:45.660506 24288 ts_tablet_manager.cc:1434] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.084s	user 0.013s	sys 0.020s
I20260709 13:12:45.662004 24288 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:45.670215 24354 raft_consensus.cc:493] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.671135 24287 tablet_bootstrap.cc:654] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.672950 24354 raft_consensus.cc:515] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.675081 24289 tablet_bootstrap.cc:654] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.676100 24354 leader_election.cc:290] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:45.676420 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:45.677135 24290 tablet_bootstrap.cc:654] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:45.678122 24131 leader_election.cc:343] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.682238 24288 tablet_bootstrap.cc:654] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.685182 24093 raft_consensus.cc:1275] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:45.687233 24425 consensus_queue.cc:1048] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.696306 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
W20260709 13:12:45.698231 24133 leader_election.cc:343] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.698786 24133 leader_election.cc:304] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:45.699610 24091 raft_consensus.cc:2468] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:45.699797 24354 raft_consensus.cc:2749] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:45.691622 24167 raft_consensus.cc:2468] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:45.708251 24205 leader_election.cc:304] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:45.710438 24445 raft_consensus.cc:2804] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.713964 24445 raft_consensus.cc:697] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:45.715128 24445 consensus_queue.cc:237] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.711658 24320 raft_consensus.cc:493] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.719017 24320 raft_consensus.cc:515] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.721583 24320 leader_election.cc:290] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:45.724282 24354 raft_consensus.cc:493] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.724973 24354 raft_consensus.cc:515] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.726519 24287 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:45.727342 24287 ts_tablet_manager.cc:1403] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.001s
I20260709 13:12:45.727492 24354 leader_election.cc:290] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:45.728933 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:45.730305 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:45.730572 24320 consensus_queue.cc:1048] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:45.732402 24205 leader_election.cc:343] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.733222 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12d688dc9954b58b54c3ef416ca0da6" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:45.733835 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12d688dc9954b58b54c3ef416ca0da6" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:45.734573 24093 raft_consensus.cc:2468] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:45.735085 24287 raft_consensus.cc:359] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:45.733844 24205 leader_election.cc:343] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.735985 24287 raft_consensus.cc:385] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.736477 24287 raft_consensus.cc:740] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.736274 24205 leader_election.cc:304] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:45.737362 24320 raft_consensus.cc:2749] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:45.738368 24287 consensus_queue.cc:260] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.743412 24289 tablet_bootstrap.cc:492] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:45.749044 24288 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:45.754051 24288 ts_tablet_manager.cc:1403] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.006s
I20260709 13:12:45.737473 24131 leader_election.cc:304] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:45.755730 24289 ts_tablet_manager.cc:1403] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.009s
I20260709 13:12:45.756731 23915 catalog_manager.cc:5697] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.762938 23915 catalog_manager.cc:5697] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.764245 24288 raft_consensus.cc:359] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.765159 24288 raft_consensus.cc:385] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.765877 24288 raft_consensus.cc:740] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.766861 24288 consensus_queue.cc:260] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.768380 24290 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:45.769392 24290 ts_tablet_manager.cc:1403] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.027s
I20260709 13:12:45.771471 24428 consensus_queue.cc:1048] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.773451 24288 ts_tablet_manager.cc:1434] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:12:45.772992 24290 raft_consensus.cc:359] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:45.765224 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:45.775695 24290 raft_consensus.cc:385] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.776122 24290 raft_consensus.cc:740] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.776401 24288 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:45.777066 24290 consensus_queue.cc:260] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.779604 24290 ts_tablet_manager.cc:1434] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:45.757638 24287 ts_tablet_manager.cc:1434] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:12:45.781445 24290 tablet_bootstrap.cc:492] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:45.781543 24287 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:45.785960 24288 tablet_bootstrap.cc:654] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.788108 24354 raft_consensus.cc:2804] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.789031 24354 raft_consensus.cc:493] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.789428 24354 raft_consensus.cc:3060] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.791213 24287 tablet_bootstrap.cc:654] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.793534 24290 tablet_bootstrap.cc:654] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.793819 24289 raft_consensus.cc:359] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.794699 24289 raft_consensus.cc:385] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.794996 24289 raft_consensus.cc:740] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.795765 24289 consensus_queue.cc:260] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.798063 24289 ts_tablet_manager.cc:1434] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
W20260709 13:12:45.798683 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 61335.8us
I20260709 13:12:45.799309 24289 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:45.802186 24428 consensus_queue.cc:1048] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:45.810979 24289 tablet_bootstrap.cc:654] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.815866 24290 tablet_bootstrap.cc:492] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
W20260709 13:12:45.799510 24131 leader_election.cc:343] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.817061 24290 ts_tablet_manager.cc:1403] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.007s
I20260709 13:12:45.830785 24427 consensus_queue.cc:1048] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.834172 24290 raft_consensus.cc:359] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.835407 24290 raft_consensus.cc:385] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.835759 24290 raft_consensus.cc:740] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.847992 24287 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:45.841274 24445 consensus_queue.cc:1048] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:12:45.848801 24287 ts_tablet_manager.cc:1403] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.016s
I20260709 13:12:45.765626 23915 catalog_manager.cc:5697] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 2, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.856801 24427 raft_consensus.cc:493] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.857432 24427 raft_consensus.cc:515] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.857878 24287 raft_consensus.cc:359] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.858669 24287 raft_consensus.cc:385] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.859014 24287 raft_consensus.cc:740] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.860494 24287 consensus_queue.cc:260] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.861838 24320 raft_consensus.cc:493] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.862732 24427 leader_election.cc:290] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:45.862443 24320 raft_consensus.cc:515] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.855702 24290 consensus_queue.cc:260] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:45.863000 24287 ts_tablet_manager.cc:1434] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:45.867465 24287 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:45.868613 24320 leader_election.cc:290] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:45.873153 24295 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.874441 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:45.875499 24295 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.876972 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5abba1ca42243bd8be8d7b1d77fded2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:45.878165 24295 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:12:45.879577 24059 leader_election.cc:343] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.880892 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:45.872305 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5abba1ca42243bd8be8d7b1d77fded2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:45.879668 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
W20260709 13:12:45.883468 23982 leader_election.cc:343] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:45.884037 24205 leader_election.cc:343] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:45.885766 24205 leader_election.cc:343] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.886350 24205 leader_election.cc:304] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:45.888773 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:45.882782 24354 raft_consensus.cc:515] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.889678 24290 ts_tablet_manager.cc:1434] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.005s
I20260709 13:12:45.889775 24239 raft_consensus.cc:2468] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:45.891464 24320 raft_consensus.cc:2749] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:45.893250 24057 leader_election.cc:343] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:45.895912 24057 leader_election.cc:304] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:45.897774 23984 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad
I20260709 13:12:45.900905 24295 raft_consensus.cc:2804] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.901518 24295 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.901945 24295 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.902498 24429 raft_consensus.cc:2749] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:45.902815 24354 leader_election.cc:290] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:45.902983 24288 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:45.906121 24289 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:45.906996 24288 ts_tablet_manager.cc:1403] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.131s	user 0.049s	sys 0.042s
I20260709 13:12:45.907565 24289 ts_tablet_manager.cc:1403] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.015s
I20260709 13:12:45.908582 24290 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:45.922891 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12d688dc9954b58b54c3ef416ca0da6" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:45.923874 24093 raft_consensus.cc:3060] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.924860 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12d688dc9954b58b54c3ef416ca0da6" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:45.925884 24019 raft_consensus.cc:3060] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.905758 24427 consensus_queue.cc:1048] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:45.939673 24289 raft_consensus.cc:359] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.940560 24289 raft_consensus.cc:385] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.940848 24289 raft_consensus.cc:740] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.941898 24290 tablet_bootstrap.cc:654] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.942973 24288 raft_consensus.cc:359] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.943840 24288 raft_consensus.cc:385] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.944141 24288 raft_consensus.cc:740] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.944936 24288 consensus_queue.cc:260] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:45.946298 24287 tablet_bootstrap.cc:654] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.946457 24289 consensus_queue.cc:260] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:45.954252 24019 raft_consensus.cc:2468] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:45.956499 24427 consensus_queue.cc:1048] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.973783 24131 leader_election.cc:304] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:45.975059 24443 raft_consensus.cc:2804] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.975687 24443 raft_consensus.cc:697] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:45.978562 24443 consensus_queue.cc:237] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:45.978645 23916 catalog_manager.cc:5697] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.982556 23916 catalog_manager.cc:5697] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.984827 24430 consensus_queue.cc:1048] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.993194 24289 ts_tablet_manager.cc:1434] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.001s
I20260709 13:12:45.995205 24289 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:45.996778 24288 ts_tablet_manager.cc:1434] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 13:12:45.998297 24288 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:46.009297 24288 tablet_bootstrap.cc:654] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.003178 24093 raft_consensus.cc:2468] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:46.003155 24295 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.005317 23916 catalog_manager.cc:5697] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.026826 24287 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:46.027667 24287 ts_tablet_manager.cc:1403] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.161s	user 0.018s	sys 0.001s
I20260709 13:12:46.036478 24289 tablet_bootstrap.cc:654] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.039845 24287 raft_consensus.cc:359] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.041054 24287 raft_consensus.cc:385] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.041452 24287 raft_consensus.cc:740] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.058534 24290 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:46.027863 23916 catalog_manager.cc:5697] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.059388 24290 ts_tablet_manager.cc:1403] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.155s	user 0.036s	sys 0.032s
I20260709 13:12:46.060949 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:46.062991 24241 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.069532 24290 raft_consensus.cc:359] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.070575 24295 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:46.071448 24290 raft_consensus.cc:385] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.071954 24290 raft_consensus.cc:740] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.072966 24290 consensus_queue.cc:260] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.061194 24287 consensus_queue.cc:260] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.075693 24290 ts_tablet_manager.cc:1434] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:12:46.075682 24288 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:46.076436 24288 ts_tablet_manager.cc:1403] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.000s
I20260709 13:12:46.077039 24290 tablet_bootstrap.cc:492] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:46.079721 24288 raft_consensus.cc:359] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.080790 24288 raft_consensus.cc:385] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.081159 24288 raft_consensus.cc:740] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.081296 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:46.082252 24287 ts_tablet_manager.cc:1434] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.001s
I20260709 13:12:46.082166 24288 consensus_queue.cc:260] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.084432 24295 raft_consensus.cc:493] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.085196 23982 leader_election.cc:343] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.085014 24295 raft_consensus.cc:515] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.085629 24287 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:46.090723 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.091538 24242 raft_consensus.cc:2468] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:46.092808 24288 ts_tablet_manager.cc:1434] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:12:46.093161 23984 leader_election.cc:304] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:46.094224 24425 raft_consensus.cc:2804] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.094684 24425 raft_consensus.cc:493] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.095114 24288 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:46.095060 24425 raft_consensus.cc:3060] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.089397 24295 leader_election.cc:290] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:46.101537 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:46.096665 24428 raft_consensus.cc:493] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.104753 24428 raft_consensus.cc:515] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:46.105716 23982 leader_election.cc:343] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.110833 24430 consensus_queue.cc:1048] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.115142 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.115950 24428 leader_election.cc:290] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
W20260709 13:12:46.117394 24059 leader_election.cc:343] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.122090 24288 tablet_bootstrap.cc:654] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.122018 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:46.124378 24290 tablet_bootstrap.cc:654] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.125921 24287 tablet_bootstrap.cc:654] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:46.130679 24057 leader_election.cc:343] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.135913 24289 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:46.136817 24425 raft_consensus.cc:515] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.138067 24445 raft_consensus.cc:493] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.138754 24445 raft_consensus.cc:515] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.141723 24289 ts_tablet_manager.cc:1403] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.147s	user 0.027s	sys 0.004s
I20260709 13:12:46.143770 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:46.149158 24242 raft_consensus.cc:3060] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.131569 24241 raft_consensus.cc:2468] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:46.157723 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:46.145344 24425 leader_election.cc:290] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
W20260709 13:12:46.164038 23982 leader_election.cc:343] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.176331 23913 catalog_manager.cc:5697] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.178196 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5abba1ca42243bd8be8d7b1d77fded2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:46.179153 24093 raft_consensus.cc:2468] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:46.180245 24320 consensus_queue.cc:1048] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.180706 24205 leader_election.cc:304] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:46.181942 24369 raft_consensus.cc:2804] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.182384 24369 raft_consensus.cc:493] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.182792 24369 raft_consensus.cc:3060] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.186218 24314 raft_consensus.cc:493] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.187578 24314 raft_consensus.cc:515] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.172443 24445 leader_election.cc:290] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:46.141599 24057 leader_election.cc:304] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:46.214674 24429 raft_consensus.cc:2749] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:46.214918 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 84300.3us
I20260709 13:12:46.202636 24314 leader_election.cc:290] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:46.205340 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.216071 24241 raft_consensus.cc:2468] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:46.160658 23984 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad
I20260709 13:12:46.220126 24288 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:46.220587 24133 leader_election.cc:304] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:46.192924 24289 raft_consensus.cc:359] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.220800 24288 ts_tablet_manager.cc:1403] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.126s	user 0.037s	sys 0.011s
I20260709 13:12:46.221326 24289 raft_consensus.cc:385] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.221724 24289 raft_consensus.cc:740] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
W20260709 13:12:46.220749 23984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 60285.9us
I20260709 13:12:46.222664 24289 consensus_queue.cc:260] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.225616 24288 raft_consensus.cc:359] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.226581 24288 raft_consensus.cc:385] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.224207 24295 raft_consensus.cc:493] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.227424 24425 raft_consensus.cc:2804] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.228909 24314 raft_consensus.cc:2804] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.229388 24314 raft_consensus.cc:493] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.229779 24314 raft_consensus.cc:3060] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.226931 24288 raft_consensus.cc:740] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.237706 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:46.227772 24295 raft_consensus.cc:515] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.240041 24242 raft_consensus.cc:2468] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:46.240645 24016 raft_consensus.cc:2468] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:46.234709 24425 raft_consensus.cc:697] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:46.249737 24425 consensus_queue.cc:237] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.253763 24295 leader_election.cc:290] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:46.256166 24369 raft_consensus.cc:515] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.256078 24289 ts_tablet_manager.cc:1434] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.001s
I20260709 13:12:46.235888 24288 consensus_queue.cc:260] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.256698 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:46.276906 24289 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:46.279245 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5abba1ca42243bd8be8d7b1d77fded2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:46.285579 24290 tablet_bootstrap.cc:492] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:46.286449 24290 ts_tablet_manager.cc:1403] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.210s	user 0.022s	sys 0.002s
I20260709 13:12:46.287364 24288 ts_tablet_manager.cc:1434] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:12:46.290613 24288 tablet_bootstrap.cc:492] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:46.285465 24314 raft_consensus.cc:515] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.289233 24369 leader_election.cc:290] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:46.291168 24164 raft_consensus.cc:3060] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.297326 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:46.298219 24242 raft_consensus.cc:3060] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.291185 24290 raft_consensus.cc:359] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.288829 23984 leader_election.cc:304] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:46.273461 24429 consensus_queue.cc:1048] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:46.294401 24167 raft_consensus.cc:2393] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:46.304692 24290 raft_consensus.cc:385] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.305244 24287 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:46.305371 24290 raft_consensus.cc:740] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.306679 24314 leader_election.cc:290] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:46.307550 24288 tablet_bootstrap.cc:654] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.307005 24290 consensus_queue.cc:260] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.305951 24287 ts_tablet_manager.cc:1403] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.223s	user 0.028s	sys 0.035s
I20260709 13:12:46.310552 24289 tablet_bootstrap.cc:654] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.312929 24290 ts_tablet_manager.cc:1434] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:12:46.317739 24314 raft_consensus.cc:493] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.318485 24314 raft_consensus.cc:515] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.319545 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5abba1ca42243bd8be8d7b1d77fded2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:46.320600 24091 raft_consensus.cc:3060] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.322085 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.314337 24290 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:46.322340 24314 leader_election.cc:290] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:46.323118 24241 raft_consensus.cc:2393] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:46.325488 24287 raft_consensus.cc:359] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.312017 23915 catalog_manager.cc:5697] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.328238 24287 raft_consensus.cc:385] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.328920 24287 raft_consensus.cc:740] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.331790 24295 raft_consensus.cc:2804] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.332515 24295 raft_consensus.cc:697] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:46.333523 24295 consensus_queue.cc:237] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.338768 24287 consensus_queue.cc:260] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.346439 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:46.347569 24016 raft_consensus.cc:3060] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:46.354496 23984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 65759.5us
I20260709 13:12:46.359089 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
W20260709 13:12:46.359251 24205 leader_election.cc:343] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.360417 24429 raft_consensus.cc:493] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.361093 24429 raft_consensus.cc:515] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.362991 24288 tablet_bootstrap.cc:492] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:46.363760 24288 ts_tablet_manager.cc:1403] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.009s
I20260709 13:12:46.364825 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3007d344bdd4a2a81bf4ae8ae79f446" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.363066 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5abba1ca42243bd8be8d7b1d77fded2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:46.367144 24017 raft_consensus.cc:3060] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.373373 24288 raft_consensus.cc:359] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.374361 24288 raft_consensus.cc:385] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.374653 24288 raft_consensus.cc:740] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.375460 24288 consensus_queue.cc:260] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.382296 23984 leader_election.cc:304] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:46.385030 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732349b9a3cc4721af4b19673ecb3db7" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.386731 24239 raft_consensus.cc:2468] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:46.390882 24287 ts_tablet_manager.cc:1434] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.082s	user 0.010s	sys 0.001s
I20260709 13:12:46.394145 24059 leader_election.cc:304] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:46.380225 24429 leader_election.cc:290] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:46.398252 24288 ts_tablet_manager.cc:1434] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:12:46.398502 24428 raft_consensus.cc:2804] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.373376 24131 leader_election.cc:304] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:46.406395 24290 tablet_bootstrap.cc:654] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.387882 24242 raft_consensus.cc:2468] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:46.387017 23913 catalog_manager.cc:5697] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } }
I20260709 13:12:46.412330 24314 raft_consensus.cc:3060] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.407236 24428 raft_consensus.cc:493] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.413311 24428 raft_consensus.cc:3060] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.420025 24314 raft_consensus.cc:2749] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:46.421378 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 48172us
I20260709 13:12:46.404363 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732349b9a3cc4721af4b19673ecb3db7" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:46.422739 24016 raft_consensus.cc:2468] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:46.423457 24425 raft_consensus.cc:2749] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:46.423977 24057 leader_election.cc:343] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.424368 24287 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:46.429641 24131 leader_election.cc:304] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:46.430212 24289 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:46.430991 24289 ts_tablet_manager.cc:1403] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.015s
I20260709 13:12:46.432127 24314 raft_consensus.cc:2804] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.433104 24314 raft_consensus.cc:697] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:46.434182 24314 consensus_queue.cc:237] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.437220 24017 raft_consensus.cc:2468] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:46.438673 24091 raft_consensus.cc:2468] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:46.438876 24205 leader_election.cc:304] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:46.438805 24443 consensus_queue.cc:1048] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.440632 24369 raft_consensus.cc:2804] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.441268 24369 raft_consensus.cc:697] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:46.442250 24369 consensus_queue.cc:237] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.436987 24289 raft_consensus.cc:359] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.444301 24289 raft_consensus.cc:385] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.444690 24289 raft_consensus.cc:740] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.447901 24289 consensus_queue.cc:260] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.450361 24354 raft_consensus.cc:493] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.451005 24354 raft_consensus.cc:515] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.455047 24320 raft_consensus.cc:493] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.454480 24288 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:46.455837 24320 raft_consensus.cc:515] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.468050 24288 tablet_bootstrap.cc:654] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.471899 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42f9b12b00946d9a5420824dac647b6" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.468191 24354 leader_election.cc:290] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:46.480412 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:46.482290 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:46.483613 24093 raft_consensus.cc:2468] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:46.467880 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f42f9b12b00946d9a5420824dac647b6" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:46.484954 24320 leader_election.cc:290] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:46.487783 24131 leader_election.cc:304] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
W20260709 13:12:46.482609 24205 leader_election.cc:343] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.500450 24205 leader_election.cc:304] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:46.502671 24443 raft_consensus.cc:2749] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:46.505766 24445 raft_consensus.cc:2804] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.506345 24445 raft_consensus.cc:493] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.507097 24445 raft_consensus.cc:3060] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.509092 24443 consensus_queue.cc:1048] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.513244 24289 ts_tablet_manager.cc:1434] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.003s
I20260709 13:12:46.514652 24289 tablet_bootstrap.cc:492] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:46.519315 24320 consensus_queue.cc:1048] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.556171 24287 tablet_bootstrap.cc:654] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:46.564114 24522 log.cc:927] Time spent T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:12:46.523551 23915 catalog_manager.cc:5697] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.573278 23915 catalog_manager.cc:5697] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.597326 24445 raft_consensus.cc:515] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.600201 24445 leader_election.cc:290] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:46.601796 24428 raft_consensus.cc:515] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.604028 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:46.604792 24093 raft_consensus.cc:3060] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.605545 24428 leader_election.cc:290] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:46.608409 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732349b9a3cc4721af4b19673ecb3db7" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:46.609028 24290 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:46.609449 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:46.609825 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "732349b9a3cc4721af4b19673ecb3db7" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:46.615666 24290 ts_tablet_manager.cc:1403] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.302s	user 0.015s	sys 0.009s
W20260709 13:12:46.625064 24057 leader_election.cc:343] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.625923 23913 catalog_manager.cc:5697] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.620484 24239 raft_consensus.cc:3060] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.628479 24093 raft_consensus.cc:2468] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:46.630023 24205 leader_election.cc:304] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:46.630509 24289 tablet_bootstrap.cc:654] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:46.631997 24205 leader_election.cc:343] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.632616 24425 consensus_queue.cc:1048] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.632583 24369 raft_consensus.cc:2804] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.634830 24369 raft_consensus.cc:697] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:46.621246 24428 raft_consensus.cc:493] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.636627 24428 raft_consensus.cc:515] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.639917 24428 leader_election.cc:290] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:46.627884 24290 raft_consensus.cc:359] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.641140 24290 raft_consensus.cc:385] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.641639 24290 raft_consensus.cc:740] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.642685 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
W20260709 13:12:46.644469 24059 leader_election.cc:343] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.641211 24239 raft_consensus.cc:2468] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:46.645527 24369 consensus_queue.cc:237] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.647451 24059 leader_election.cc:304] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:46.652019 24290 consensus_queue.cc:260] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.656320 24445 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.661921 24445 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:46.661134 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:46.664531 24167 raft_consensus.cc:2468] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:46.665779 24445 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:46.654927 24428 raft_consensus.cc:2804] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:46.688230 24290 ts_tablet_manager.cc:1434] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:12:46.699615 24290 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:46.691198 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:46.693411 24057 leader_election.cc:304] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:46.686585 24427 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.708365 24205 leader_election.cc:343] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.712932 24287 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:46.690076 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:46.699004 23916 catalog_manager.cc:5697] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.713685 24287 ts_tablet_manager.cc:1403] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.310s	user 0.018s	sys 0.008s
I20260709 13:12:46.690824 24428 raft_consensus.cc:697] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:46.708891 24427 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.735103 24427 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:46.735782 24427 raft_consensus.cc:2804] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.736610 24427 raft_consensus.cc:493] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.752904 24288 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:46.753767 24288 ts_tablet_manager.cc:1403] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.343s	user 0.012s	sys 0.015s
I20260709 13:12:46.744904 24427 raft_consensus.cc:3060] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:46.760650 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 75864.3us
I20260709 13:12:46.760378 24288 raft_consensus.cc:359] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.764497 24288 raft_consensus.cc:385] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.765417 24288 raft_consensus.cc:740] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.772078 24288 consensus_queue.cc:260] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.775966 24425 consensus_queue.cc:1048] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:46.772742 24205 leader_election.cc:343] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:46.769779 24525 log.cc:927] Time spent T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad: Append to log took a long time: real 0.112s	user 0.000s	sys 0.002s
I20260709 13:12:46.777539 24287 raft_consensus.cc:359] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.765240 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:46.782650 24287 raft_consensus.cc:385] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.783376 24287 raft_consensus.cc:740] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.786372 24290 tablet_bootstrap.cc:654] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.803190 24288 ts_tablet_manager.cc:1434] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 13:12:46.804008 24289 tablet_bootstrap.cc:492] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:46.804719 24289 ts_tablet_manager.cc:1403] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.290s	user 0.015s	sys 0.008s
I20260709 13:12:46.776966 24205 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:46.812582 24287 consensus_queue.cc:260] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.773561 24428 consensus_queue.cc:237] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.820039 24320 raft_consensus.cc:2749] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:46.823272 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 52125.2us
W20260709 13:12:46.824981 24531 log.cc:927] Time spent T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: Append to log took a long time: real 0.057s	user 0.003s	sys 0.000s
I20260709 13:12:46.814235 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:46.837879 24288 tablet_bootstrap.cc:492] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:46.845831 24314 raft_consensus.cc:493] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.846598 24314 raft_consensus.cc:515] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.850173 24057 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:46.851960 24429 raft_consensus.cc:2749] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:46.854969 24314 leader_election.cc:290] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:46.857607 24287 ts_tablet_manager.cc:1434] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.143s	user 0.007s	sys 0.006s
I20260709 13:12:46.859136 24287 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:46.860224 24094 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.862774 24288 tablet_bootstrap.cc:654] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.872752 24287 tablet_bootstrap.cc:654] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:46.881377 24290 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:46.882419 24290 ts_tablet_manager.cc:1403] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.183s	user 0.017s	sys 0.022s
I20260709 13:12:46.884783 24320 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.885470 24320 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:46.888001 24320 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:46.887660 24289 raft_consensus.cc:359] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.890900 24289 raft_consensus.cc:385] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.891444 24289 raft_consensus.cc:740] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.894634 24289 consensus_queue.cc:260] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.897744 24354 consensus_queue.cc:1048] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.897778 24290 raft_consensus.cc:359] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.902907 24290 raft_consensus.cc:385] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:46.903383 24290 raft_consensus.cc:740] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:46.905381 24290 consensus_queue.cc:260] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.913653 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886dbd0c6f0243208c008309eab923ac" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:46.914692 24091 raft_consensus.cc:2468] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:46.930001 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886dbd0c6f0243208c008309eab923ac" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:46.931111 24017 raft_consensus.cc:2468] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
W20260709 13:12:46.932281 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:12:46.941555 24537 log.cc:927] Time spent T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:12:46.943040 24290 ts_tablet_manager.cc:1434] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.001s
I20260709 13:12:46.944983 24290 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:46.948843 23916 catalog_manager.cc:5697] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.951062 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:46.951802 24289 ts_tablet_manager.cc:1434] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.147s	user 0.009s	sys 0.000s
I20260709 13:12:46.953626 24445 consensus_queue.cc:1048] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.967272 24289 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:46.967931 24131 leader_election.cc:304] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:46.969167 24527 raft_consensus.cc:2804] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:46.969642 24527 raft_consensus.cc:493] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.970008 24527 raft_consensus.cc:3060] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:46.962106 24427 raft_consensus.cc:515] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:46.972249 24443 consensus_queue.cc:1048] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.975818 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
W20260709 13:12:46.977955 24059 leader_election.cc:343] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:46.979817 24527 raft_consensus.cc:515] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:46.982336 24527 leader_election.cc:290] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:46.986774 24295 consensus_queue.cc:1048] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:46.990163 24427 leader_election.cc:290] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
W20260709 13:12:46.994199 24205 leader_election.cc:343] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:46.992053 23984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 152409us
I20260709 13:12:47.006363 24290 tablet_bootstrap.cc:654] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.018832 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886dbd0c6f0243208c008309eab923ac" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:47.019364 24287 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:47.019788 24094 raft_consensus.cc:3060] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.020084 24287 ts_tablet_manager.cc:1403] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.007s
I20260709 13:12:47.019956 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886dbd0c6f0243208c008309eab923ac" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:47.024711 24019 raft_consensus.cc:3060] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.026859 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:47.027634 24164 raft_consensus.cc:3060] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.031036 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:47.029558 24287 raft_consensus.cc:359] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.034279 24287 raft_consensus.cc:385] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.034653 24287 raft_consensus.cc:740] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.049351 24287 consensus_queue.cc:260] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.055461 24287 ts_tablet_manager.cc:1434] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 13:12:47.065156 23915 catalog_manager.cc:5697] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:47.080531 24205 leader_election.cc:343] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.081183 24205 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:47.082821 24320 raft_consensus.cc:2749] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.077893 24288 tablet_bootstrap.cc:492] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:47.084797 24289 tablet_bootstrap.cc:654] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.085040 24288 ts_tablet_manager.cc:1403] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.268s	user 0.029s	sys 0.032s
I20260709 13:12:47.083559 24320 consensus_queue.cc:1048] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:47.097543 24443 raft_consensus.cc:493] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.113379 24287 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:47.134246 24094 raft_consensus.cc:2468] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:47.138809 24287 tablet_bootstrap.cc:654] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.140929 24164 raft_consensus.cc:2468] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:47.148135 24019 raft_consensus.cc:2468] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:47.110126 24443 raft_consensus.cc:515] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.161808 24443 leader_election.cc:290] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:47.168560 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:47.175630 24540 consensus_queue.cc:1048] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.193605 24057 leader_election.cc:304] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:47.194633 24427 raft_consensus.cc:2804] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:47.195611 24427 raft_consensus.cc:697] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:47.196623 24427 consensus_queue.cc:237] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.198971 24131 leader_election.cc:304] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:47.201005 24354 raft_consensus.cc:2804] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:47.201622 24354 raft_consensus.cc:697] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:47.202523 24354 consensus_queue.cc:237] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.203184 24288 raft_consensus.cc:359] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.204061 24288 raft_consensus.cc:385] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.204425 24288 raft_consensus.cc:740] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.205334 24288 consensus_queue.cc:260] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.212666 24425 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.213555 24425 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.269279 24288 ts_tablet_manager.cc:1434] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.184s	user 0.006s	sys 0.003s
I20260709 13:12:47.270458 24287 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:47.270787 24288 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:47.270639 24445 consensus_queue.cc:1048] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.271257 24287 ts_tablet_manager.cc:1403] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.018s
I20260709 13:12:47.278012 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:47.279047 24091 raft_consensus.cc:2393] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in this term.
I20260709 13:12:47.279484 24289 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:47.284205 24289 ts_tablet_manager.cc:1403] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.317s	user 0.014s	sys 0.003s
I20260709 13:12:47.292399 24425 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:47.294543 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:47.295512 24165 raft_consensus.cc:3060] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.295779 24241 raft_consensus.cc:2468] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:47.302402 23984 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:47.304508 24425 raft_consensus.cc:2804] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:47.305016 24425 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.305382 24425 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.302524 24287 raft_consensus.cc:359] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:47.317422 24287 raft_consensus.cc:385] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.317898 24287 raft_consensus.cc:740] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.324687 23916 catalog_manager.cc:5697] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:47.326902 24289 raft_consensus.cc:359] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.328025 24289 raft_consensus.cc:385] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.328495 24289 raft_consensus.cc:740] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.334915 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:47.337266 24131 leader_election.cc:304] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:47.329602 24287 consensus_queue.cc:260] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:47.341784 24443 raft_consensus.cc:2749] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.343448 24320 consensus_queue.cc:1048] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.351099 24287 ts_tablet_manager.cc:1434] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.002s
I20260709 13:12:47.370639 24287 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:47.387900 24290 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:47.388849 24290 ts_tablet_manager.cc:1403] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.444s	user 0.025s	sys 0.005s
I20260709 13:12:47.400976 24427 consensus_queue.cc:1048] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.409437 24019 raft_consensus.cc:3060] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.398195 24290 raft_consensus.cc:359] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.411170 24290 raft_consensus.cc:385] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.411649 24290 raft_consensus.cc:740] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.401829 24425 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.439851 24288 tablet_bootstrap.cc:654] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.443604 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:47.447115 24427 consensus_queue.cc:1048] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.446971 24289 consensus_queue.cc:260] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.448194 24165 raft_consensus.cc:2468] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:47.452876 24289 ts_tablet_manager.cc:1434] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.168s	user 0.009s	sys 0.003s
I20260709 13:12:47.454660 24289 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:47.456799 24287 tablet_bootstrap.cc:654] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.438230 24290 consensus_queue.cc:260] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.476200 24425 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:47.477566 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:47.479833 24290 ts_tablet_manager.cc:1434] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.004s
I20260709 13:12:47.481696 24290 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:47.485016 24239 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.487077 23917 catalog_manager.cc:5697] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.508463 24288 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:47.509119 24288 ts_tablet_manager.cc:1403] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.239s	user 0.019s	sys 0.000s
I20260709 13:12:47.514521 24289 tablet_bootstrap.cc:654] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.514292 24288 raft_consensus.cc:359] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:47.522519 24290 tablet_bootstrap.cc:654] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.522837 24288 raft_consensus.cc:385] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.523149 24288 raft_consensus.cc:740] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.524001 24288 consensus_queue.cc:260] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:47.526434 24287 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:47.527087 24287 ts_tablet_manager.cc:1403] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.175s	user 0.013s	sys 0.003s
I20260709 13:12:47.528685 24288 ts_tablet_manager.cc:1434] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:47.530128 24288 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:47.531283 24287 raft_consensus.cc:359] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.532133 24287 raft_consensus.cc:385] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.532842 24287 raft_consensus.cc:740] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.533792 24287 consensus_queue.cc:260] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.536182 24287 ts_tablet_manager.cc:1434] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:47.537483 24287 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:47.541379 24239 raft_consensus.cc:2468] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:47.543022 23984 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:47.545109 24425 raft_consensus.cc:2804] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:47.545838 24287 tablet_bootstrap.cc:654] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.546164 24425 raft_consensus.cc:697] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:47.547271 24425 consensus_queue.cc:237] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.548669 24289 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:47.549672 24289 ts_tablet_manager.cc:1403] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.000s
I20260709 13:12:47.548774 24320 raft_consensus.cc:493] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.550443 24320 raft_consensus.cc:515] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.555559 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:47.564834 24289 raft_consensus.cc:359] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.565815 24289 raft_consensus.cc:385] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.566115 24289 raft_consensus.cc:740] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.566612 24288 tablet_bootstrap.cc:654] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.566903 24289 consensus_queue.cc:260] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.572971 24320 leader_election.cc:290] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:47.575168 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:47.575835 24290 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:47.576138 24165 raft_consensus.cc:2393] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:47.576488 24290 ts_tablet_manager.cc:1403] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.004s
I20260709 13:12:47.577836 24205 leader_election.cc:304] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:12:47.579100 24320 raft_consensus.cc:3060] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.579773 24290 raft_consensus.cc:359] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.580569 24290 raft_consensus.cc:385] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.580842 24290 raft_consensus.cc:740] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.572245 24289 ts_tablet_manager.cc:1434] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:12:47.582746 24289 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:47.588841 24320 raft_consensus.cc:2749] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.594581 24290 consensus_queue.cc:260] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.597851 24290 ts_tablet_manager.cc:1434] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:12:47.599594 24288 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:47.603169 24289 tablet_bootstrap.cc:654] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.605873 24287 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:47.606570 24287 ts_tablet_manager.cc:1403] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.012s
I20260709 13:12:47.600328 24288 ts_tablet_manager.cc:1403] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.006s
I20260709 13:12:47.607686 24290 tablet_bootstrap.cc:492] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:47.610649 24288 raft_consensus.cc:359] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.611824 24288 raft_consensus.cc:385] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.612186 24288 raft_consensus.cc:740] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.612919 24288 consensus_queue.cc:260] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.614840 24288 ts_tablet_manager.cc:1434] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:47.615561 24287 raft_consensus.cc:359] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.616531 24287 raft_consensus.cc:385] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.617000 24287 raft_consensus.cc:740] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.618024 24287 consensus_queue.cc:260] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.620862 24287 ts_tablet_manager.cc:1434] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 13:12:47.623749 24290 tablet_bootstrap.cc:654] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.635216 24288 tablet_bootstrap.cc:492] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:47.636828 24287 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:47.642577 24428 raft_consensus.cc:493] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.643847 24288 tablet_bootstrap.cc:654] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.643404 24428 raft_consensus.cc:515] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.645942 24287 tablet_bootstrap.cc:654] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:47.666553 23913 catalog_manager.cc:5697] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.678471 24428 leader_election.cc:290] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:47.680557 24425 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.682826 24428 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.683259 24425 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.691612 24428 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.695161 24425 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:47.704131 24428 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:47.803642 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504e7d24d8c24d4bbc62ae3b0eaa4ca5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:47.804723 24165 raft_consensus.cc:2468] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:47.805475 24320 raft_consensus.cc:493] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.806103 24320 raft_consensus.cc:515] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.808423 24320 leader_election.cc:290] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:47.811162 24320 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.820829 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504e7d24d8c24d4bbc62ae3b0eaa4ca5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:47.822137 24017 raft_consensus.cc:2468] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:47.841641 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:47.842906 24092 raft_consensus.cc:2468] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:47.811782 24320 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:47.864920 24289 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:47.865711 24289 ts_tablet_manager.cc:1403] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.283s	user 0.047s	sys 0.077s
I20260709 13:12:47.866878 24320 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:12:47.866183 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 61238.9us
I20260709 13:12:47.867902 24287 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:47.869601 24288 tablet_bootstrap.cc:492] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:47.870568 24288 ts_tablet_manager.cc:1403] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.020s
I20260709 13:12:47.870440 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:47.871441 23982 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:47.872483 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:47.872519 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:47.878185 24287 ts_tablet_manager.cc:1403] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.242s	user 0.026s	sys 0.013s
W20260709 13:12:47.890518 24205 leader_election.cc:343] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.890998 24337 raft_consensus.cc:2804] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:47.891561 24337 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:47.891608 24205 leader_election.cc:343] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.892059 24337 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.878361 24290 tablet_bootstrap.cc:492] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
W20260709 13:12:47.878702 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 74885.4us
I20260709 13:12:47.879102 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:47.881245 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:47.895404 24290 ts_tablet_manager.cc:1403] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.296s	user 0.031s	sys 0.030s
I20260709 13:12:47.897966 24057 leader_election.cc:304] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:47.899075 24290 raft_consensus.cc:359] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.899646 24288 raft_consensus.cc:359] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.901346 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:47.903059 24288 raft_consensus.cc:385] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.903416 24527 consensus_queue.cc:1048] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.902185 24427 raft_consensus.cc:2804] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:47.903484 24288 raft_consensus.cc:740] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.904491 24427 raft_consensus.cc:493] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.905205 24427 raft_consensus.cc:3060] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.905591 24288 consensus_queue.cc:260] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:47.906338 24205 leader_election.cc:343] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.906950 24205 leader_election.cc:304] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:47.907846 24320 raft_consensus.cc:2749] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.909667 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:47.912921 24288 ts_tablet_manager.cc:1434] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.005s
I20260709 13:12:47.916273 24288 tablet_bootstrap.cc:492] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:47.918304 24337 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.918671 24527 consensus_queue.cc:1048] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:47.931500 24057 leader_election.cc:343] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:47.925354 23982 leader_election.cc:343] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.927765 24288 tablet_bootstrap.cc:654] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:47.920881 24205 leader_election.cc:343] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:47.932655 24205 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:47.899972 24290 raft_consensus.cc:385] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.933389 24290 raft_consensus.cc:740] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.933123 24577 consensus_queue.cc:1048] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.934613 24290 consensus_queue.cc:260] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:47.936514 24560 raft_consensus.cc:2749] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:47.938093 24337 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:47.933650 24287 raft_consensus.cc:359] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.939476 24287 raft_consensus.cc:385] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.939836 24287 raft_consensus.cc:740] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.941658 24019 raft_consensus.cc:2393] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:47.940815 24287 consensus_queue.cc:260] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:47.945233 24287 ts_tablet_manager.cc:1434] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:12:47.946980 24057 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:47.948137 24290 ts_tablet_manager.cc:1434] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 13:12:47.964818 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:47.966094 24290 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:47.949390 24428 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.985158 24289 raft_consensus.cc:359] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.987332 24289 raft_consensus.cc:385] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:47.959604 24427 raft_consensus.cc:515] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:47.990236 24427 leader_election.cc:290] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:47.996063 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504e7d24d8c24d4bbc62ae3b0eaa4ca5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:47.996914 24018 raft_consensus.cc:3060] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:47.974912 24288 tablet_bootstrap.cc:492] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:48.002779 24288 ts_tablet_manager.cc:1403] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.005s
I20260709 13:12:47.986539 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:47.958729 24578 consensus_queue.cc:1048] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:47.987718 24289 raft_consensus.cc:740] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:47.960407 24287 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:48.007539 24289 consensus_queue.cc:260] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.019589 24165 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.038280 24288 raft_consensus.cc:359] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.039536 24288 raft_consensus.cc:385] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.039942 24288 raft_consensus.cc:740] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.041774 24288 consensus_queue.cc:260] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.038080 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "504e7d24d8c24d4bbc62ae3b0eaa4ca5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:48.051535 24164 raft_consensus.cc:3060] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.056227 24288 ts_tablet_manager.cc:1434] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.002s
I20260709 13:12:48.074404 24287 tablet_bootstrap.cc:654] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.075179 24288 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:48.075529 24560 raft_consensus.cc:493] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.080030 24428 raft_consensus.cc:2749] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.100916 24560 raft_consensus.cc:515] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.143517 24165 raft_consensus.cc:2468] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:48.148777 24162 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.153889 24295 raft_consensus.cc:493] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.154516 24295 raft_consensus.cc:515] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.156698 24295 leader_election.cc:290] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:48.158769 24560 leader_election.cc:290] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:48.148743 24018 raft_consensus.cc:2468] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:48.161680 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb615a7452f542cebc700c8750746552" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:48.161710 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:48.169991 24057 leader_election.cc:304] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
W20260709 13:12:48.170691 24205 leader_election.cc:343] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.161725 24092 raft_consensus.cc:2468] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:48.171967 24428 raft_consensus.cc:2804] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:48.166512 24290 tablet_bootstrap.cc:654] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:48.172714 23984 leader_election.cc:343] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.172884 24295 consensus_queue.cc:1048] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:48.179284 24288 tablet_bootstrap.cc:654] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.179538 24164 raft_consensus.cc:2468] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:48.177472 24428 raft_consensus.cc:697] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:48.190613 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:48.183981 24428 consensus_queue.cc:237] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.223635 23982 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:48.225387 24295 raft_consensus.cc:2804] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:48.226209 24295 raft_consensus.cc:697] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:48.227445 24295 consensus_queue.cc:237] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:48.244398 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 50923.5us
I20260709 13:12:48.254930 24289 ts_tablet_manager.cc:1434] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.325s	user 0.011s	sys 0.000s
I20260709 13:12:48.294559 24289 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
W20260709 13:12:48.296823 24205 leader_election.cc:343] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.297453 24205 leader_election.cc:304] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:12:48.298070 24290 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:48.299064 24369 raft_consensus.cc:2749] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:48.303413 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:48.304049 24290 ts_tablet_manager.cc:1403] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.338s	user 0.020s	sys 0.025s
I20260709 13:12:48.307725 24290 raft_consensus.cc:359] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.266177 24288 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:48.308650 24295 consensus_queue.cc:1048] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:48.309444 24288 ts_tablet_manager.cc:1403] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.235s	user 0.024s	sys 0.042s
I20260709 13:12:48.310870 24289 tablet_bootstrap.cc:654] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.289266 23913 catalog_manager.cc:5697] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.312686 24288 raft_consensus.cc:359] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.320696 24288 raft_consensus.cc:385] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.321275 24288 raft_consensus.cc:740] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.322386 24288 consensus_queue.cc:260] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.282238 24287 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:48.325024 24287 ts_tablet_manager.cc:1403] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.379s	user 0.012s	sys 0.005s
I20260709 13:12:48.308713 24290 raft_consensus.cc:385] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.328552 24290 raft_consensus.cc:740] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.329505 24290 consensus_queue.cc:260] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.332756 24290 ts_tablet_manager.cc:1434] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:12:48.334394 24290 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:48.334636 24287 raft_consensus.cc:359] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.335421 24287 raft_consensus.cc:385] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.335683 24287 raft_consensus.cc:740] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.265763 23915 catalog_manager.cc:5697] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.339121 24369 raft_consensus.cc:493] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.339773 24369 raft_consensus.cc:515] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.341698 24288 ts_tablet_manager.cc:1434] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:12:48.342253 24287 consensus_queue.cc:260] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.245699 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb615a7452f542cebc700c8750746552" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:48.343808 24369 leader_election.cc:290] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
W20260709 13:12:48.345055 23982 leader_election.cc:343] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.345506 24290 tablet_bootstrap.cc:654] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.345819 23982 leader_election.cc:304] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:48.348096 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9fdacd398142bb98d711e9a9a13697" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:48.348629 24295 raft_consensus.cc:2749] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.349203 24092 raft_consensus.cc:2468] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:48.349785 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9fdacd398142bb98d711e9a9a13697" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:48.350823 24205 leader_election.cc:304] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
W20260709 13:12:48.352070 24205 leader_election.cc:343] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.353654 24288 tablet_bootstrap.cc:492] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:48.357430 24369 raft_consensus.cc:2804] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.358119 24369 raft_consensus.cc:493] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.358547 24369 raft_consensus.cc:3060] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.359988 24287 ts_tablet_manager.cc:1434] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:12:48.361747 24287 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:48.372865 24288 tablet_bootstrap.cc:654] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.376595 24369 raft_consensus.cc:515] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.378196 24289 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:48.381623 24287 tablet_bootstrap.cc:654] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.382586 24289 ts_tablet_manager.cc:1403] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.009s
I20260709 13:12:48.386893 24289 raft_consensus.cc:359] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.412576 24289 raft_consensus.cc:385] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.417825 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9fdacd398142bb98d711e9a9a13697" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:48.431299 24289 raft_consensus.cc:740] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.431943 24091 raft_consensus.cc:3060] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.432929 24289 consensus_queue.cc:260] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.421370 24290 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:48.440948 24290 ts_tablet_manager.cc:1403] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.001s
I20260709 13:12:48.442183 24289 ts_tablet_manager.cc:1434] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:12:48.443701 24289 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:48.443886 24091 raft_consensus.cc:2468] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:48.444063 24290 raft_consensus.cc:359] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.423504 24287 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:48.445725 24287 ts_tablet_manager.cc:1403] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.007s
I20260709 13:12:48.426117 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9fdacd398142bb98d711e9a9a13697" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:48.428110 24288 tablet_bootstrap.cc:492] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:48.445135 24290 raft_consensus.cc:385] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.445555 24205 leader_election.cc:304] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:48.450374 24288 ts_tablet_manager.cc:1403] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.021s
I20260709 13:12:48.450389 24290 raft_consensus.cc:740] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.450961 24560 raft_consensus.cc:2804] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:48.452533 24205 leader_election.cc:343] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.449136 24287 raft_consensus.cc:359] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.419622 24369 leader_election.cc:290] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:48.454010 24287 raft_consensus.cc:385] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.454363 24288 raft_consensus.cc:359] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.454711 24287 raft_consensus.cc:740] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.455202 24288 raft_consensus.cc:385] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.456192 24288 raft_consensus.cc:740] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.456979 24288 consensus_queue.cc:260] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.453192 24290 consensus_queue.cc:260] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.463698 24290 ts_tablet_manager.cc:1434] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:12:48.463121 24287 consensus_queue.cc:260] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.467515 24288 ts_tablet_manager.cc:1434] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:12:48.474502 24560 raft_consensus.cc:697] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:48.468888 24290 tablet_bootstrap.cc:492] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:48.475899 24560 consensus_queue.cc:237] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.478812 24288 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:48.470009 24287 ts_tablet_manager.cc:1434] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 13:12:48.512461 24287 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:48.516000 24289 tablet_bootstrap.cc:654] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.521273 24290 tablet_bootstrap.cc:654] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.528666 24288 tablet_bootstrap.cc:654] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.536054 24287 tablet_bootstrap.cc:654] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.538097 23915 catalog_manager.cc:5697] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.558423 24287 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:48.559124 24287 ts_tablet_manager.cc:1403] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:12:48.570132 24354 raft_consensus.cc:493] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.570731 24290 tablet_bootstrap.cc:492] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:48.571359 24290 ts_tablet_manager.cc:1403] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.000s
I20260709 13:12:48.570894 24354 raft_consensus.cc:515] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.573483 24354 leader_election.cc:290] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:48.575050 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb615a7452f542cebc700c8750746552" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:48.578199 24425 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.579046 24290 raft_consensus.cc:359] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.579792 24290 raft_consensus.cc:385] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.579008 24425 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.576133 24241 raft_consensus.cc:2468] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:48.581924 24133 leader_election.cc:304] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:48.582947 24425 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:48.580112 24290 raft_consensus.cc:740] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.585435 24290 consensus_queue.cc:260] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.586408 24288 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:48.587039 24288 ts_tablet_manager.cc:1403] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.022s
I20260709 13:12:48.587203 24287 raft_consensus.cc:359] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.588029 24287 raft_consensus.cc:385] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.588371 24287 raft_consensus.cc:740] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.589185 24287 consensus_queue.cc:260] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.590139 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:48.592320 24290 ts_tablet_manager.cc:1434] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:48.592834 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:48.593619 24241 raft_consensus.cc:2468] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:48.593958 24288 raft_consensus.cc:359] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.595391 23984 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:48.597059 24295 raft_consensus.cc:2804] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.594722 24288 raft_consensus.cc:385] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.597711 24295 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.597970 24288 raft_consensus.cc:740] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.598136 24295 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.599584 24287 ts_tablet_manager.cc:1434] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:12:48.593770 24290 tablet_bootstrap.cc:492] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:48.601192 24288 consensus_queue.cc:260] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.603977 24287 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:12:48.608615 23982 leader_election.cc:343] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.610237 24288 ts_tablet_manager.cc:1434] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 13:12:48.613021 24288 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:48.614598 24290 tablet_bootstrap.cc:654] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.620391 24287 tablet_bootstrap.cc:654] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.628976 24288 tablet_bootstrap.cc:654] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.634508 24287 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:48.635179 24287 ts_tablet_manager.cc:1403] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.002s
I20260709 13:12:48.638823 24287 raft_consensus.cc:359] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.639811 24287 raft_consensus.cc:385] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.639346 24425 raft_consensus.cc:493] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.640662 24425 raft_consensus.cc:515] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.643100 24354 raft_consensus.cc:2804] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.645051 24425 leader_election.cc:290] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:48.643989 24354 raft_consensus.cc:493] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.646966 24354 raft_consensus.cc:3060] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.647532 24560 raft_consensus.cc:493] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.648566 24290 tablet_bootstrap.cc:492] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:48.648113 24560 raft_consensus.cc:515] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.650712 24560 leader_election.cc:290] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:48.653003 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:48.653965 24018 raft_consensus.cc:2468] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:48.655822 24205 leader_election.cc:304] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:48.656546 24290 ts_tablet_manager.cc:1403] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.001s
I20260709 13:12:48.657176 24287 raft_consensus.cc:740] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.658094 24287 consensus_queue.cc:260] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.660663 24287 ts_tablet_manager.cc:1434] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.002s
I20260709 13:12:48.660854 24290 raft_consensus.cc:359] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.661840 24290 raft_consensus.cc:385] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.661840 24287 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:48.662369 24290 raft_consensus.cc:740] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.663403 24290 consensus_queue.cc:260] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.664721 24560 raft_consensus.cc:2804] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.665288 24560 raft_consensus.cc:493] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.665776 24560 raft_consensus.cc:3060] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.666734 24290 ts_tablet_manager.cc:1434] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:48.670212 24287 tablet_bootstrap.cc:654] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.675962 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb615a7452f542cebc700c8750746552" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:48.676864 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:48.677215 24019 raft_consensus.cc:2468] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:48.678771 24288 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:48.679402 24288 ts_tablet_manager.cc:1403] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.021s
W20260709 13:12:48.679620 23984 leader_election.cc:343] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.680830 24425 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.681632 24425 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.682624 24288 raft_consensus.cc:359] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.683449 24288 raft_consensus.cc:385] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.683748 24288 raft_consensus.cc:740] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.687043 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:48.689265 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:48.690627 24240 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:48.692241 23984 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:48.693944 24540 raft_consensus.cc:2804] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.692153 24288 consensus_queue.cc:260] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.692901 24290 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:48.694531 24540 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.695089 24540 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.692502 24425 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:48.696197 24287 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:48.696843 24287 ts_tablet_manager.cc:1403] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.016s
W20260709 13:12:48.699147 24205 leader_election.cc:343] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.700168 24287 raft_consensus.cc:359] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.701035 24287 raft_consensus.cc:385] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.701309 24287 raft_consensus.cc:740] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.702049 24287 consensus_queue.cc:260] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.709805 24288 ts_tablet_manager.cc:1434] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:12:48.711352 24288 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:48.718330 24540 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.722193 24290 tablet_bootstrap.cc:654] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.727680 24288 tablet_bootstrap.cc:654] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.729146 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:48.730122 24241 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.739535 24540 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:48.749655 24241 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:48.753877 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:48.756132 24092 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:48.758831 23984 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:48.760658 24540 raft_consensus.cc:2804] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:48.761876 24540 raft_consensus.cc:697] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:48.763479 24540 consensus_queue.cc:237] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.766985 24612 consensus_queue.cc:1048] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:48.771028 24290 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:48.772090 24290 ts_tablet_manager.cc:1403] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.006s
I20260709 13:12:48.768703 24289 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:48.777046 24289 ts_tablet_manager.cc:1403] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.334s	user 0.056s	sys 0.064s
I20260709 13:12:48.778910 24290 raft_consensus.cc:359] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.780277 24290 raft_consensus.cc:385] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.780472 24427 raft_consensus.cc:493] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.781665 24427 raft_consensus.cc:515] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.784198 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:48.785398 24427 leader_election.cc:290] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:48.786486 24290 raft_consensus.cc:740] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.780628 24289 raft_consensus.cc:359] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.788817 24289 raft_consensus.cc:385] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.789147 24289 raft_consensus.cc:740] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:48.789927 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:48.788250 24290 consensus_queue.cc:260] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.790753 24019 raft_consensus.cc:2468] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:48.792428 24057 leader_election.cc:304] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:48.789894 24289 consensus_queue.cc:260] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.794978 24428 raft_consensus.cc:2804] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.797120 24428 raft_consensus.cc:493] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.797534 24428 raft_consensus.cc:3060] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.794524 24290 ts_tablet_manager.cc:1434] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:12:48.816901 24427 raft_consensus.cc:493] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.819088 24427 raft_consensus.cc:515] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.821353 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:48.822928 24091 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.826381 24427 leader_election.cc:290] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:48.830674 24428 raft_consensus.cc:515] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:48.840277 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:48.840932 24428 leader_election.cc:290] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:48.832530 24295 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.841362 24019 raft_consensus.cc:3060] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.834728 24290 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:48.851346 24295 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:48.851228 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:48.854053 24241 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.855839 24290 tablet_bootstrap.cc:654] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.859261 24602 raft_consensus.cc:493] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.860105 24602 raft_consensus.cc:515] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.865721 24289 ts_tablet_manager.cc:1434] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.088s	user 0.020s	sys 0.018s
I20260709 13:12:48.871613 24289 tablet_bootstrap.cc:492] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:48.879284 24602 leader_election.cc:290] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:48.881361 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:48.882239 24018 raft_consensus.cc:2468] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:48.884605 24205 leader_election.cc:304] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:48.889205 24602 raft_consensus.cc:2804] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:48.890054 24602 raft_consensus.cc:493] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.890519 24602 raft_consensus.cc:3060] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.892475 24289 tablet_bootstrap.cc:654] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.898933 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:48.899896 24164 raft_consensus.cc:2468] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:48.901978 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0f4ea311bb4330ba8fc5081e593dc2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:48.909184 24560 raft_consensus.cc:515] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:48.912604 23982 leader_election.cc:343] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:48.913137 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:48.914103 24018 raft_consensus.cc:3060] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.916747 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0f4ea311bb4330ba8fc5081e593dc2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:48.917614 24240 raft_consensus.cc:2468] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:48.919224 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:48.920157 24094 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.924254 24427 consensus_queue.cc:1048] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:48.913151 23982 leader_election.cc:304] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:48.928155 24295 raft_consensus.cc:2749] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:48.930404 24612 consensus_queue.cc:1048] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:48.932466 24354 raft_consensus.cc:515] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:48.942961 24094 raft_consensus.cc:2468] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:48.975884 24618 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.944772 24287 ts_tablet_manager.cc:1434] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.248s	user 0.040s	sys 0.047s
I20260709 13:12:48.949359 24289 tablet_bootstrap.cc:492] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:48.977861 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb615a7452f542cebc700c8750746552" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:48.955780 24427 raft_consensus.cc:493] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.978746 24240 raft_consensus.cc:3060] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.978816 24427 raft_consensus.cc:515] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:48.979802 24287 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:48.958328 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:48.982530 24427 leader_election.cc:290] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:48.989857 24287 tablet_bootstrap.cc:654] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:48.993274 24354 leader_election.cc:290] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:48.961248 24018 raft_consensus.cc:2468] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:49.007958 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb615a7452f542cebc700c8750746552" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:49.008805 24016 raft_consensus.cc:3060] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:48.962328 24560 leader_election.cc:290] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:48.966507 24428 consensus_queue.cc:1048] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:49.010216 24091 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:48.938134 24019 raft_consensus.cc:2468] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:48.976492 24288 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:49.011659 24288 ts_tablet_manager.cc:1403] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.301s	user 0.052s	sys 0.069s
I20260709 13:12:48.976500 24618 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:49.014915 24288 raft_consensus.cc:359] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:48.978195 24289 ts_tablet_manager.cc:1403] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.019s
I20260709 13:12:49.015763 24288 raft_consensus.cc:385] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:48.952543 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:49.016693 24167 raft_consensus.cc:3060] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.016985 24290 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:49.017551 24290 ts_tablet_manager.cc:1403] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.183s	user 0.026s	sys 0.028s
I20260709 13:12:49.016199 24288 raft_consensus.cc:740] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.019213 24288 consensus_queue.cc:260] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:49.020882 24290 raft_consensus.cc:359] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:49.021591 24290 raft_consensus.cc:385] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.021862 24290 raft_consensus.cc:740] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.022563 24290 consensus_queue.cc:260] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:48.970880 24205 consensus_peers.cc:597] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.028707 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 58039.4us
I20260709 13:12:48.960883 24602 raft_consensus.cc:515] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.031802 24602 leader_election.cc:290] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:48.998358 24059 leader_election.cc:304] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:49.032713 24205 leader_election.cc:304] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:49.033883 24560 raft_consensus.cc:2804] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.034415 24560 raft_consensus.cc:697] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:49.035308 24560 consensus_queue.cc:237] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:49.035753 24057 leader_election.cc:343] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.036489 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:49.038092 24428 raft_consensus.cc:2804] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.038761 24428 raft_consensus.cc:493] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.039242 24428 raft_consensus.cc:3060] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.041489 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:49.042533 24242 raft_consensus.cc:2468] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:49.000778 24240 raft_consensus.cc:2468] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:49.003151 24241 raft_consensus.cc:2468] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:49.048046 24133 leader_election.cc:304] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:49.048890 23984 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:49.050727 24612 raft_consensus.cc:2804] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.051981 24612 raft_consensus.cc:697] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:49.054641 24612 consensus_queue.cc:237] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:49.015626 24618 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:49.025918 24016 raft_consensus.cc:2468] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:49.027182 24288 ts_tablet_manager.cc:1434] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:49.027316 24290 ts_tablet_manager.cc:1434] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
W20260709 13:12:49.050561 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 48357us
I20260709 13:12:49.023743 24289 raft_consensus.cc:359] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:49.064847 24289 raft_consensus.cc:385] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:49.056530 24205 leader_election.cc:343] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.065413 24289 raft_consensus.cc:740] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.057296 24059 leader_election.cc:304] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:49.058059 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:49.070416 24288 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:49.071027 24057 leader_election.cc:304] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:49.066676 24092 raft_consensus.cc:3060] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.061391 24354 raft_consensus.cc:2804] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.092674 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:49.099244 24427 raft_consensus.cc:2804] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.104001 24290 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:49.103825 24289 consensus_queue.cc:260] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:49.120095 24057 leader_election.cc:343] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.097811 24618 raft_consensus.cc:2804] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:49.136117 24167 raft_consensus.cc:2468] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:49.139969 24288 tablet_bootstrap.cc:654] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.106320 24354 raft_consensus.cc:697] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
W20260709 13:12:49.154260 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 86234us
I20260709 13:12:49.160550 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:49.161429 24016 raft_consensus.cc:3060] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.127200 24618 raft_consensus.cc:493] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.157066 24427 raft_consensus.cc:697] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:49.170519 24618 raft_consensus.cc:3060] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.178308 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:49.203089 24354 consensus_queue.cc:237] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:49.220764 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 77845.1us
I20260709 13:12:49.230283 24289 ts_tablet_manager.cc:1434] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.214s	user 0.028s	sys 0.013s
I20260709 13:12:49.228792 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:49.253870 24287 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:49.262413 24287 ts_tablet_manager.cc:1403] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.283s	user 0.045s	sys 0.059s
I20260709 13:12:49.224509 24428 raft_consensus.cc:515] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:49.257315 24289 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:49.224509 24602 consensus_queue.cc:1048] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
W20260709 13:12:49.271124 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 106989us
I20260709 13:12:49.246044 24427 consensus_queue.cc:237] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:49.302994 24633 log.cc:927] Time spent T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:12:49.356663 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0f4ea311bb4330ba8fc5081e593dc2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:49.357820 24644 raft_consensus.cc:493] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:49.357995 24205 leader_election.cc:343] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.358439 24644 raft_consensus.cc:515] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:49.360846 24644 leader_election.cc:290] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:12:49.364615 24057 leader_election.cc:343] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.371194 24057 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:49.373078 24638 raft_consensus.cc:2749] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.373075 24016 raft_consensus.cc:2468] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:49.373406 24287 raft_consensus.cc:359] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.374647 24287 raft_consensus.cc:385] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.374981 24287 raft_consensus.cc:740] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.380249 24290 tablet_bootstrap.cc:654] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.375712 24287 consensus_queue.cc:260] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.378376 24428 leader_election.cc:290] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:49.403012 24288 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:49.403748 24288 ts_tablet_manager.cc:1403] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.334s	user 0.014s	sys 0.007s
I20260709 13:12:49.417230 24205 leader_election.cc:304] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:49.428589 24632 raft_consensus.cc:2804] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.429430 24632 raft_consensus.cc:697] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:49.430466 23914 catalog_manager.cc:5697] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.437040 24289 tablet_bootstrap.cc:654] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.385933 24167 raft_consensus.cc:3060] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.444553 24287 ts_tablet_manager.cc:1434] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.182s	user 0.008s	sys 0.010s
I20260709 13:12:49.454322 23915 catalog_manager.cc:5697] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.460328 24287 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:49.449597 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf86c23dc92446f955db3e85bb4b3df" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:49.464294 24290 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:49.473258 24290 ts_tablet_manager.cc:1403] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.394s	user 0.024s	sys 0.016s
I20260709 13:12:49.423331 23913 catalog_manager.cc:5697] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.430488 24632 consensus_queue.cc:237] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:49.489612 24205 leader_election.cc:343] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.487953 24288 raft_consensus.cc:359] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.491864 24288 raft_consensus.cc:385] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.492244 24288 raft_consensus.cc:740] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.464219 24092 raft_consensus.cc:2468] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:49.498502 24288 consensus_queue.cc:260] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.505932 24290 raft_consensus.cc:359] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:49.507236 24290 raft_consensus.cc:385] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.507620 24290 raft_consensus.cc:740] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.509011 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0f4ea311bb4330ba8fc5081e593dc2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:49.510062 24237 raft_consensus.cc:3060] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:49.519696 24290 consensus_queue.cc:260] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:49.527596 24288 ts_tablet_manager.cc:1434] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.123s	user 0.009s	sys 0.000s
I20260709 13:12:49.529181 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf86c23dc92446f955db3e85bb4b3df" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:49.529763 24288 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:49.527405 24618 raft_consensus.cc:515] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:49.562544 24646 raft_consensus.cc:493] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.563280 24646 raft_consensus.cc:515] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:49.565249 24290 ts_tablet_manager.cc:1434] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.004s
I20260709 13:12:49.573371 24237 raft_consensus.cc:2468] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:49.589933 24290 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
W20260709 13:12:49.593045 24205 leader_election.cc:343] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.593696 24205 leader_election.cc:304] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:49.603500 24059 leader_election.cc:304] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:49.605243 24623 raft_consensus.cc:2804] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.605825 24623 raft_consensus.cc:697] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:49.606344 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:49.606767 24623 consensus_queue.cc:237] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:49.609627 24646 leader_election.cc:290] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:49.596807 24602 raft_consensus.cc:2749] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.615327 24618 leader_election.cc:290] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:49.616974 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
W20260709 13:12:49.618880 24057 leader_election.cc:343] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.622442 24288 tablet_bootstrap.cc:654] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.631031 24443 consensus_queue.cc:1048] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:49.635231 24057 leader_election.cc:343] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.572956 24560 consensus_queue.cc:1048] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:12:49.646840 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:49.650441 24287 tablet_bootstrap.cc:654] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.651110 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:49.654592 24241 raft_consensus.cc:3060] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:49.663471 24057 leader_election.cc:343] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.664162 24057 leader_election.cc:304] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:49.666023 24289 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:49.666990 24289 ts_tablet_manager.cc:1403] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.410s	user 0.027s	sys 0.019s
I20260709 13:12:49.670529 24241 raft_consensus.cc:2468] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:49.676857 24059 leader_election.cc:304] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:49.673096 24425 consensus_queue.cc:1048] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:49.698998 24626 raft_consensus.cc:2804] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:49.699942 24626 raft_consensus.cc:697] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:49.709860 24645 raft_consensus.cc:2749] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:49.712030 24288 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:49.712772 24288 ts_tablet_manager.cc:1403] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.183s	user 0.026s	sys 0.000s
W20260709 13:12:49.718093 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:49.705945 24354 raft_consensus.cc:493] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34a8f98cd2994376ac09a9ce8fcbc487)
I20260709 13:12:49.730772 24354 raft_consensus.cc:515] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:49.753505 24649 consensus_queue.cc:1048] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:49.754385 24425 consensus_queue.cc:1048] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:49.733855 24289 raft_consensus.cc:359] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.762581 24289 raft_consensus.cc:385] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.768790 24354 leader_election.cc:290] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:49.771683 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9fdacd398142bb98d711e9a9a13697" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:49.773320 24288 raft_consensus.cc:359] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:49.773344 24290 tablet_bootstrap.cc:654] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.774596 24289 raft_consensus.cc:740] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.778126 24289 consensus_queue.cc:260] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:49.778258 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 45525.1us
I20260709 13:12:49.780220 24288 raft_consensus.cc:385] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.780818 24288 raft_consensus.cc:740] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.785256 24288 consensus_queue.cc:260] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:49.820626 24288 ts_tablet_manager.cc:1434] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.006s
I20260709 13:12:49.828135 24644 raft_consensus.cc:493] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.829005 24644 raft_consensus.cc:515] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.829651 24287 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:49.831035 24287 ts_tablet_manager.cc:1403] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.382s	user 0.020s	sys 0.017s
I20260709 13:12:49.835332 24287 raft_consensus.cc:359] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:49.836270 24287 raft_consensus.cc:385] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:49.836802 24287 raft_consensus.cc:740] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.838804 24289 ts_tablet_manager.cc:1434] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.171s	user 0.015s	sys 0.001s
I20260709 13:12:49.847612 24288 tablet_bootstrap.cc:492] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:49.850086 24287 consensus_queue.cc:260] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:49.785554 24626 consensus_queue.cc:237] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:49.858645 24295 raft_consensus.cc:493] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.859676 24289 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:49.859540 24295 raft_consensus.cc:515] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:49.867483 24617 consensus_queue.cc:1048] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:12:49.864866 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:49.872689 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9fdacd398142bb98d711e9a9a13697" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:49.873301 24287 ts_tablet_manager.cc:1434] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:12:49.874579 24287 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:49.881559 24131 leader_election.cc:304] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
W20260709 13:12:49.880264 24205 leader_election.cc:343] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:49.934312 24019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:49.935262 24019 raft_consensus.cc:2468] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:49.935845 24288 tablet_bootstrap.cc:654] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.908038 24632 raft_consensus.cc:493] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.900218 24644 leader_election.cc:290] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:49.941057 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:49.944691 24290 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:49.945302 24290 ts_tablet_manager.cc:1403] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.356s	user 0.022s	sys 0.020s
I20260709 13:12:49.912261 24602 consensus_queue.cc:1048] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:12:49.940394 24638 consensus_queue.cc:1048] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:12:49.968317 24289 tablet_bootstrap.cc:654] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.944535 24640 raft_consensus.cc:2749] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.976732 24295 leader_election.cc:290] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:49.988565 24287 tablet_bootstrap.cc:654] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:49.946300 24632 raft_consensus.cc:515] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:50.011178 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 65636.8us
W20260709 13:12:50.016309 23982 leader_election.cc:343] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.026116 24205 leader_election.cc:304] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:50.027312 24167 raft_consensus.cc:3060] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.027477 24648 raft_consensus.cc:2804] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.028013 24648 raft_consensus.cc:493] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.028386 24648 raft_consensus.cc:3060] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.031260 24632 leader_election.cc:290] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:50.036630 24635 consensus_queue.cc:1048] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.042083 24290 raft_consensus.cc:359] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.042995 24290 raft_consensus.cc:385] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.045300 24649 raft_consensus.cc:493] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.046039 24649 raft_consensus.cc:515] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:50.046811 24288 tablet_bootstrap.cc:492] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:50.047457 24288 ts_tablet_manager.cc:1403] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.025s
I20260709 13:12:50.049623 24648 raft_consensus.cc:515] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:50.051709 24057 consensus_peers.cc:597] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.043359 24290 raft_consensus.cc:740] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.063016 24288 raft_consensus.cc:359] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.064219 24288 raft_consensus.cc:385] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.064715 24288 raft_consensus.cc:740] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.068001 24288 consensus_queue.cc:260] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.052205 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:50.092387 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:50.096680 24290 consensus_queue.cc:260] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.101750 24288 ts_tablet_manager.cc:1434] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:12:50.119352 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:50.120437 24091 raft_consensus.cc:2468] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:50.121075 24242 raft_consensus.cc:2393] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in this term.
I20260709 13:12:50.119451 24288 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:50.126864 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:50.128931 24290 ts_tablet_manager.cc:1434] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.183s	user 0.009s	sys 0.001s
I20260709 13:12:50.096549 24644 consensus_queue.cc:1048] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:50.105330 24649 leader_election.cc:290] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
W20260709 13:12:50.141769 23982 leader_election.cc:343] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.136714 24369 raft_consensus.cc:493] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.139573 23914 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44898 (request call id 45) took 1093 ms. Trace:
I20260709 13:12:50.155455 23982 leader_election.cc:304] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:50.165614 23984 leader_election.cc:304] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:50.166944 24612 raft_consensus.cc:3060] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.121459 24681 consensus_queue.cc:1048] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 13:12:50.169926 24290 tablet_bootstrap.cc:492] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:50.177105 24648 leader_election.cc:290] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:50.159129 23914 rpcz_store.cc:276] 0709 13:12:49.037276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.061641 (+ 24365us) service_pool.cc:224] Handling call
0709 13:12:50.127858 (+1066217us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:49.724198 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:49.822980 (+ 98782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:49.829516 (+  6536us) write_op.cc:435] Acquired schema lock
0709 13:12:49.829536 (+    20us) tablet.cc:662] Decoding operations
0709 13:12:49.830102 (+   566us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:49.830153 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:49.830188 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:49.830526 (+   338us) tablet.cc:701] Row locks acquired
0709 13:12:49.830547 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:49.830703 (+   156us) write_op.cc:270] Start()
0709 13:12:49.830846 (+   143us) write_op.cc:276] Timestamp: P: 1783602769830652 usec, L: 0
0709 13:12:49.830871 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:49.831835 (+   964us) log.cc:844] Serialized 540 byte log entry
0709 13:12:50.041291 (+209456us) op_driver.cc:464] REPLICATION: finished
0709 13:12:50.042218 (+   927us) write_op.cc:301] APPLY: starting
0709 13:12:50.042311 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:50.042439 (+   128us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:50.042560 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:50.042846 (+   286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:50.043049 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:50.043101 (+    52us) write_op.cc:312] APPLY: finished
0709 13:12:50.043725 (+   624us) log.cc:844] Serialized 22 byte log entry
0709 13:12:50.058559 (+ 14834us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:50.059651 (+  1092us) write_op.cc:454] Released schema lock
0709 13:12:50.059699 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:50.100656 (+ 40957us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:50.102549 (+  1893us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":695,"apply.run_cpu_time_us":2121,"apply.run_wall_time_us":49469,"num_ops":1,"prepare.queue_time_us":231559,"prepare.run_cpu_time_us":9600,"prepare.run_wall_time_us":110806,"replication_time_us":210271}]]}
W20260709 13:12:50.201911 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 111058us
I20260709 13:12:50.206355 24289 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
W20260709 13:12:50.206951 24205 leader_election.cc:343] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.207487 24289 ts_tablet_manager.cc:1403] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.356s	user 0.027s	sys 0.016s
I20260709 13:12:50.161545 24369 raft_consensus.cc:515] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.217037 24369 leader_election.cc:290] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:50.169217 24540 raft_consensus.cc:2804] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.217767 24540 raft_consensus.cc:493] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.218219 24540 raft_consensus.cc:3060] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.218067 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:50.222635 23917 catalog_manager.cc:5697] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.229130 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
W20260709 13:12:50.220647 24205 leader_election.cc:343] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.239625 24289 raft_consensus.cc:359] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.240490 24289 raft_consensus.cc:385] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.240933 24289 raft_consensus.cc:740] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.247573 24287 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:50.248277 24287 ts_tablet_manager.cc:1403] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.374s	user 0.028s	sys 0.005s
I20260709 13:12:50.244626 24289 consensus_queue.cc:260] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.239555 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:50.234778 24694 consensus_queue.cc:1048] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 13:12:50.255579 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:50.239123 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:50.270555 24288 tablet_bootstrap.cc:654] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:50.276947 24205 leader_election.cc:343] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.277551 24205 leader_election.cc:304] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:50.290928 24290 tablet_bootstrap.cc:654] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.296144 24540 raft_consensus.cc:515] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:12:50.299515 24205 leader_election.cc:343] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.300216 24205 leader_election.cc:304] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:50.304797 24694 raft_consensus.cc:2749] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.306402 24644 raft_consensus.cc:2749] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.322469 24289 ts_tablet_manager.cc:1434] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.115s	user 0.009s	sys 0.000s
I20260709 13:12:50.316123 24612 raft_consensus.cc:2749] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.360613 24626 consensus_queue.cc:1048] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:50.366496 24289 tablet_bootstrap.cc:492] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:50.366505 23917 catalog_manager.cc:5697] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.367304 24626 consensus_queue.cc:1048] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:12:50.387110 24540 leader_election.cc:290] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:50.387763 23917 catalog_manager.cc:5697] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } }
I20260709 13:12:50.395440 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:50.396387 24094 raft_consensus.cc:3060] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.417114 24288 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:50.418081 24288 ts_tablet_manager.cc:1403] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.299s	user 0.072s	sys 0.026s
I20260709 13:12:50.418047 24443 raft_consensus.cc:493] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.411587 24015 raft_consensus.cc:2468] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:50.425113 24443 raft_consensus.cc:515] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.427874 24443 leader_election.cc:290] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:50.448493 24205 leader_election.cc:304] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:50.432806 24640 raft_consensus.cc:493] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34a8f98cd2994376ac09a9ce8fcbc487)
I20260709 13:12:50.460072 24287 raft_consensus.cc:359] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.463341 24287 raft_consensus.cc:385] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.463568 24287 raft_consensus.cc:740] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.455699 24644 raft_consensus.cc:2804] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:50.468458 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 102522us
I20260709 13:12:50.471686 24094 raft_consensus.cc:2468] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:50.483392 24290 tablet_bootstrap.cc:492] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:50.484012 24290 ts_tablet_manager.cc:1403] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.334s	user 0.011s	sys 0.027s
I20260709 13:12:50.462811 24640 raft_consensus.cc:515] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.491798 23982 leader_election.cc:304] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:50.479185 24560 raft_consensus.cc:493] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.482882 24644 raft_consensus.cc:697] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:50.493191 24289 tablet_bootstrap.cc:654] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.476895 24626 raft_consensus.cc:493] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.505491 24287 consensus_queue.cc:260] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.508160 24626 raft_consensus.cc:515] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.514968 24626 leader_election.cc:290] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:50.511873 24288 raft_consensus.cc:359] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.517081 24288 raft_consensus.cc:385] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.517561 24288 raft_consensus.cc:740] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.497383 24612 raft_consensus.cc:2804] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.519824 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:50.505153 24560 raft_consensus.cc:515] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.522614 24560 leader_election.cc:290] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:50.524803 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf86c23dc92446f955db3e85bb4b3df" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:50.525914 24237 raft_consensus.cc:2468] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:50.527508 24287 ts_tablet_manager.cc:1434] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.279s	user 0.009s	sys 0.000s
I20260709 13:12:50.530145 24288 consensus_queue.cc:260] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.533180 24287 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:50.529918 24059 leader_election.cc:304] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:50.540423 24612 raft_consensus.cc:697] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:50.540863 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:50.541712 24612 consensus_queue.cc:237] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:50.543735 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf86c23dc92446f955db3e85bb4b3df" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:50.545002 24013 raft_consensus.cc:2468] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:50.551422 24288 ts_tablet_manager.cc:1434] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.002s
I20260709 13:12:50.551838 24644 consensus_queue.cc:237] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.552738 24288 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
W20260709 13:12:50.557936 23982 leader_election.cc:343] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.560312 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:50.565174 24290 raft_consensus.cc:359] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.566176 24290 raft_consensus.cc:385] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.566519 24290 raft_consensus.cc:740] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.570640 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccea2ecf3fb4019be0a669b6c1b6d2b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:50.570806 24205 leader_election.cc:343] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.569087 24290 consensus_queue.cc:260] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.572877 24090 raft_consensus.cc:2468] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:50.550053 24626 raft_consensus.cc:2804] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.577193 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:50.577304 24626 raft_consensus.cc:493] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.584764 24290 ts_tablet_manager.cc:1434] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 13:12:50.585217 24626 raft_consensus.cc:3060] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.565832 24013 raft_consensus.cc:2393] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in this term.
I20260709 13:12:50.592417 24290 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:50.595201 24289 tablet_bootstrap.cc:492] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:50.595898 24289 ts_tablet_manager.cc:1403] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.245s	user 0.025s	sys 0.020s
I20260709 13:12:50.586491 24640 leader_election.cc:290] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:50.614341 24289 raft_consensus.cc:359] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.615626 24289 raft_consensus.cc:385] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:50.615875 24057 consensus_peers.cc:597] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.621722 24288 tablet_bootstrap.cc:654] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.624089 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccea2ecf3fb4019be0a669b6c1b6d2b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:50.626282 23915 catalog_manager.cc:5697] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.621701 24287 tablet_bootstrap.cc:654] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.615978 24289 raft_consensus.cc:740] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.633523 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:50.621707 24290 tablet_bootstrap.cc:654] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.634783 24289 consensus_queue.cc:260] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.631801 24205 leader_election.cc:304] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:50.645247 24644 raft_consensus.cc:2804] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:50.637522 24289 ts_tablet_manager.cc:1434] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:12:50.650581 24289 tablet_bootstrap.cc:492] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:50.645807 24644 raft_consensus.cc:493] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.645740 24626 raft_consensus.cc:515] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.659477 24644 raft_consensus.cc:3060] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.649371 24131 leader_election.cc:304] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:50.661396 24626 leader_election.cc:290] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:50.662544 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf86c23dc92446f955db3e85bb4b3df" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:50.663228 24640 raft_consensus.cc:3060] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.663492 24234 raft_consensus.cc:3060] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.663412 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf86c23dc92446f955db3e85bb4b3df" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:50.664785 24013 raft_consensus.cc:3060] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.668503 24289 tablet_bootstrap.cc:654] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.655818 24287 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:50.674485 24287 ts_tablet_manager.cc:1403] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.004s
I20260709 13:12:50.652134 23915 catalog_manager.cc:5697] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:50.656643 24205 leader_election.cc:343] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.682622 24013 raft_consensus.cc:2468] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:50.686868 24131 leader_election.cc:304] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:50.691062 24057 leader_election.cc:304] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:50.691979 24704 raft_consensus.cc:2749] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:50.692840 24626 raft_consensus.cc:2804] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.693694 24626 raft_consensus.cc:697] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:50.694684 24626 consensus_queue.cc:237] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.695031 24288 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:50.696327 24288 ts_tablet_manager.cc:1403] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.002s
I20260709 13:12:50.699666 24640 raft_consensus.cc:2749] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.707858 24290 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:50.708802 24290 ts_tablet_manager.cc:1403] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.000s
I20260709 13:12:50.710314 24644 raft_consensus.cc:515] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.727288 24644 leader_election.cc:290] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:50.728904 24234 raft_consensus.cc:2468] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:50.731076 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccea2ecf3fb4019be0a669b6c1b6d2b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:50.732658 24090 raft_consensus.cc:3060] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:50.731997 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccea2ecf3fb4019be0a669b6c1b6d2b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
W20260709 13:12:50.737980 24205 leader_election.cc:343] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.747020 24090 raft_consensus.cc:2468] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:50.748941 24289 tablet_bootstrap.cc:492] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:50.749625 24289 ts_tablet_manager.cc:1403] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.010s
I20260709 13:12:50.749897 24205 leader_election.cc:304] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:50.750496 24288 raft_consensus.cc:359] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.751269 24288 raft_consensus.cc:385] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.751569 24288 raft_consensus.cc:740] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.752578 24288 consensus_queue.cc:260] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.753332 24290 raft_consensus.cc:359] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.754206 24290 raft_consensus.cc:385] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.753952 24289 raft_consensus.cc:359] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.754522 24290 raft_consensus.cc:740] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.754761 24289 raft_consensus.cc:385] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.755120 24289 raft_consensus.cc:740] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.755904 24289 consensus_queue.cc:260] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.755407 24290 consensus_queue.cc:260] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.761039 24288 ts_tablet_manager.cc:1434] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:12:50.762590 24288 tablet_bootstrap.cc:492] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:50.751418 24287 raft_consensus.cc:359] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.766347 24287 raft_consensus.cc:385] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.766707 24287 raft_consensus.cc:740] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.760860 24683 raft_consensus.cc:2804] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:50.767779 24289 ts_tablet_manager.cc:1434] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:12:50.767503 24287 consensus_queue.cc:260] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.765825 24290 ts_tablet_manager.cc:1434] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:12:50.768523 24683 raft_consensus.cc:697] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:50.769150 24289 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:50.769613 24290 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:50.769716 24683 consensus_queue.cc:237] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.770908 24288 tablet_bootstrap.cc:654] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.774118 24287 ts_tablet_manager.cc:1434] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 13:12:50.775430 24287 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:50.782773 24704 raft_consensus.cc:493] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.783558 24704 raft_consensus.cc:515] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.786428 24704 leader_election.cc:290] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:50.787276 24289 tablet_bootstrap.cc:654] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.787680 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0f4ea311bb4330ba8fc5081e593dc2" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:50.793301 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0f4ea311bb4330ba8fc5081e593dc2" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:50.796075 24133 leader_election.cc:304] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:50.799510 24704 raft_consensus.cc:2749] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.811036 24290 tablet_bootstrap.cc:654] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.815444 24287 tablet_bootstrap.cc:654] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.815567 24288 tablet_bootstrap.cc:492] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:50.816274 24288 ts_tablet_manager.cc:1403] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.016s
I20260709 13:12:50.821393 23917 catalog_manager.cc:5697] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.819844 24288 raft_consensus.cc:359] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.826263 24288 raft_consensus.cc:385] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:50.826828 24288 raft_consensus.cc:740] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:50.835322 24288 consensus_queue.cc:260] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.835791 24704 raft_consensus.cc:493] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.836839 24704 raft_consensus.cc:515] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:50.838274 24288 ts_tablet_manager.cc:1434] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:12:50.839749 24288 tablet_bootstrap.cc:492] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:50.843106 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:50.847859 24288 tablet_bootstrap.cc:654] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:50.848210 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068410948a164d408611c73e52af845e" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:50.857826 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:50.863649 24133 leader_election.cc:304] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:50.865872 24640 raft_consensus.cc:2749] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:50.856691 24704 leader_election.cc:290] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:50.900087 23915 catalog_manager.cc:5697] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.905637 24644 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.906644 24644 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:50.915205 24644 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:50.932651 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:50.933751 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:50.939014 24560 raft_consensus.cc:493] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.939761 24560 raft_consensus.cc:515] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:50.982426 23917 catalog_manager.cc:5697] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:50.985109 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 44201.1us
W20260709 13:12:50.986829 24205 leader_election.cc:343] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.989607 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:50.957100 24560 leader_election.cc:290] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:12:50.995605 24205 leader_election.cc:343] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:50.996626 24205 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:50.998136 24295 raft_consensus.cc:493] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.999871 24205 leader_election.cc:343] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.000206 24295 raft_consensus.cc:515] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.002619 24560 raft_consensus.cc:2749] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.018549 24289 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:51.021767 24289 ts_tablet_manager.cc:1403] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.253s	user 0.026s	sys 0.016s
I20260709 13:12:51.029163 24290 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:51.029907 24290 ts_tablet_manager.cc:1403] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.261s	user 0.046s	sys 0.043s
I20260709 13:12:51.019582 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:51.033358 23915 catalog_manager.cc:5697] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.035768 24290 raft_consensus.cc:359] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.036778 24290 raft_consensus.cc:385] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.037065 24290 raft_consensus.cc:740] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.039721 24290 consensus_queue.cc:260] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.040611 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:51.041602 24288 tablet_bootstrap.cc:492] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:51.042209 24288 ts_tablet_manager.cc:1403] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.203s	user 0.062s	sys 0.064s
I20260709 13:12:51.058619 24295 leader_election.cc:290] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:51.075927 24290 ts_tablet_manager.cc:1434] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.008s
I20260709 13:12:51.087198 24290 tablet_bootstrap.cc:492] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
W20260709 13:12:51.090795 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 50272.5us
W20260709 13:12:51.092288 23982 leader_election.cc:343] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:51.039441 24205 leader_election.cc:343] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.097373 24288 raft_consensus.cc:359] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.097770 24205 leader_election.cc:304] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:51.098316 24288 raft_consensus.cc:385] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:51.098332 23982 consensus_peers.cc:597] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:51.098783 24288 raft_consensus.cc:740] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.102102 24288 consensus_queue.cc:260] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:51.109891 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 70827.1us
I20260709 13:12:51.115746 24167 raft_consensus.cc:3060] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.125954 24289 raft_consensus.cc:359] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.127405 24289 raft_consensus.cc:385] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.127825 24289 raft_consensus.cc:740] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.134439 24644 raft_consensus.cc:2749] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.135841 24613 consensus_queue.cc:1048] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.144027 24635 consensus_queue.cc:1048] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.188953 24288 ts_tablet_manager.cc:1434] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.146s	user 0.014s	sys 0.016s
I20260709 13:12:51.188380 24165 raft_consensus.cc:3060] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.186573 24289 consensus_queue.cc:260] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.203835 24290 tablet_bootstrap.cc:654] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.211784 24288 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
W20260709 13:12:51.226254 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 108236us
I20260709 13:12:51.228082 24289 ts_tablet_manager.cc:1434] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.206s	user 0.008s	sys 0.005s
I20260709 13:12:51.229311 24652 raft_consensus.cc:493] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.262844 24287 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:51.263585 24287 ts_tablet_manager.cc:1403] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.488s	user 0.020s	sys 0.007s
I20260709 13:12:51.281891 24719 consensus_queue.cc:1048] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:51.292838 24289 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:51.295272 24287 raft_consensus.cc:359] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.298722 24287 raft_consensus.cc:385] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.299081 24287 raft_consensus.cc:740] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.282186 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:51.267647 24652 raft_consensus.cc:515] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.306025 24287 consensus_queue.cc:260] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.327414 24287 ts_tablet_manager.cc:1434] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.006s
I20260709 13:12:51.323359 24635 raft_consensus.cc:493] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.313851 24234 raft_consensus.cc:2468] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:51.340117 24635 raft_consensus.cc:515] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.345875 24683 raft_consensus.cc:493] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.346099 24635 leader_election.cc:290] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:51.346678 24683 raft_consensus.cc:515] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.359385 24694 consensus_queue.cc:1048] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.362797 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:51.363279 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:51.364027 24016 raft_consensus.cc:2468] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:51.365549 24057 leader_election.cc:304] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:51.377658 24652 leader_election.cc:290] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:51.379588 24722 raft_consensus.cc:493] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.380260 24722 raft_consensus.cc:515] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.381896 24288 tablet_bootstrap.cc:654] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.383086 24722 leader_election.cc:290] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:51.382817 24287 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:51.384110 23984 leader_election.cc:304] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:51.389051 24683 leader_election.cc:290] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:51.386153 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58db1c790ab94c0ba5756b94b1280302" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:51.386569 24635 consensus_queue.cc:1048] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:51.393426 24295 raft_consensus.cc:2804] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.397610 24626 raft_consensus.cc:2804] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.398168 24626 raft_consensus.cc:493] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.398566 24626 raft_consensus.cc:3060] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.396885 24295 raft_consensus.cc:493] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.401911 24295 raft_consensus.cc:3060] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:51.402580 24205 leader_election.cc:343] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.397480 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
W20260709 13:12:51.404742 24057 leader_election.cc:343] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:51.439273 24057 leader_election.cc:343] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.450361 24289 tablet_bootstrap.cc:654] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.412786 24626 raft_consensus.cc:515] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.462482 24288 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:51.469128 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:51.479624 24626 leader_election.cc:290] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
W20260709 13:12:51.482728 24205 consensus_peers.cc:597] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:51.483852 24205 leader_election.cc:343] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.492282 24288 ts_tablet_manager.cc:1403] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.281s	user 0.014s	sys 0.003s
I20260709 13:12:51.494204 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:51.495137 24234 raft_consensus.cc:2468] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:51.496843 24288 raft_consensus.cc:359] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.497864 24288 raft_consensus.cc:385] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.498214 24288 raft_consensus.cc:740] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.499265 24288 consensus_queue.cc:260] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.501183 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:51.501991 24017 raft_consensus.cc:3060] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.509783 24290 tablet_bootstrap.cc:492] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:51.510728 24290 ts_tablet_manager.cc:1403] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.424s	user 0.023s	sys 0.001s
I20260709 13:12:51.514833 24290 raft_consensus.cc:359] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.515704 24290 raft_consensus.cc:385] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.516001 24290 raft_consensus.cc:740] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.520210 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58db1c790ab94c0ba5756b94b1280302" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:51.522255 24288 ts_tablet_manager.cc:1434] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:12:51.523214 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:51.525180 24287 tablet_bootstrap.cc:654] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.529356 24288 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:51.535419 24290 consensus_queue.cc:260] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.548833 24636 raft_consensus.cc:493] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.550073 24636 raft_consensus.cc:515] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.553239 24636 leader_election.cc:290] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:51.561334 24059 leader_election.cc:304] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:51.589099 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:51.589485 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:51.592511 24017 raft_consensus.cc:2468] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:51.592633 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:51.597807 24652 raft_consensus.cc:2804] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:51.597968 24287 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:51.598351 24652 raft_consensus.cc:493] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.598734 24287 ts_tablet_manager.cc:1403] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.216s	user 0.022s	sys 0.005s
I20260709 13:12:51.598917 24652 raft_consensus.cc:3060] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.599936 24288 tablet_bootstrap.cc:654] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.613711 24131 leader_election.cc:304] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:51.618191 24443 raft_consensus.cc:2749] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:51.621273 24057 leader_election.cc:343] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.625877 24091 raft_consensus.cc:2468] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:51.646190 24287 raft_consensus.cc:359] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.647156 24287 raft_consensus.cc:385] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.647445 24287 raft_consensus.cc:740] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.648159 24287 consensus_queue.cc:260] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.651454 24287 ts_tablet_manager.cc:1434] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.000s
I20260709 13:12:51.652740 24287 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:51.671803 24290 ts_tablet_manager.cc:1434] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.161s	user 0.013s	sys 0.000s
I20260709 13:12:51.673116 24289 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:51.673559 24165 raft_consensus.cc:3060] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.673749 24289 ts_tablet_manager.cc:1403] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.381s	user 0.014s	sys 0.002s
W20260709 13:12:51.674115 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 51206.7us
I20260709 13:12:51.675187 24057 leader_election.cc:304] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:51.677198 24289 raft_consensus.cc:359] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.678062 24289 raft_consensus.cc:385] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.678320 24289 raft_consensus.cc:740] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.679080 24289 consensus_queue.cc:260] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.681418 24289 ts_tablet_manager.cc:1434] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:51.682514 24289 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
W20260709 13:12:51.673152 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 75643.8us
I20260709 13:12:51.699056 24683 consensus_queue.cc:1048] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:51.702071 24205 leader_election.cc:343] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.702643 24205 leader_election.cc:304] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:12:51.703441 24722 raft_consensus.cc:2749] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.704010 24290 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:51.709185 24722 raft_consensus.cc:493] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.709903 24722 raft_consensus.cc:515] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.670189 24652 raft_consensus.cc:515] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.716482 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:51.718119 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:51.728601 24652 leader_election.cc:290] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:51.712299 24722 leader_election.cc:290] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:51.735821 24290 tablet_bootstrap.cc:654] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:51.738314 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 63250.2us
I20260709 13:12:51.520277 24295 raft_consensus.cc:515] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:51.719004 24205 leader_election.cc:304] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:51.739732 24287 tablet_bootstrap.cc:654] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:51.740252 24205 leader_election.cc:343] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.741259 24683 raft_consensus.cc:2804] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:51.741355 24205 leader_election.cc:343] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.741753 24683 raft_consensus.cc:493] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.741910 24205 leader_election.cc:304] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:51.742195 24683 raft_consensus.cc:3060] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.746539 24560 raft_consensus.cc:2749] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:51.739764 24741 raft_consensus.cc:2804] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.749127 24741 raft_consensus.cc:697] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:51.750193 24741 consensus_queue.cc:237] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.754756 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:51.755553 24165 raft_consensus.cc:3060] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.760391 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:51.761257 24234 raft_consensus.cc:3060] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.775694 24165 raft_consensus.cc:2468] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:51.781796 23982 leader_election.cc:304] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:51.782971 24612 raft_consensus.cc:2804] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.783565 24612 raft_consensus.cc:697] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:51.788404 24295 leader_election.cc:290] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:51.718744 24289 tablet_bootstrap.cc:654] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.789712 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:51.790586 24241 raft_consensus.cc:3060] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.784512 24612 consensus_queue.cc:237] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:51.798677 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 59265.1us
I20260709 13:12:51.806687 24683 raft_consensus.cc:515] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.809597 24683 leader_election.cc:290] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:51.808194 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
W20260709 13:12:51.817492 24057 leader_election.cc:343] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.822394 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58db1c790ab94c0ba5756b94b1280302" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:51.825031 24288 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:51.825796 24288 ts_tablet_manager.cc:1403] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.297s	user 0.039s	sys 0.054s
I20260709 13:12:51.830302 24288 raft_consensus.cc:359] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.831280 24288 raft_consensus.cc:385] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.831677 24288 raft_consensus.cc:740] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.832796 24290 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
W20260709 13:12:51.830615 24205 leader_election.cc:343] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:51.833581 24290 ts_tablet_manager.cc:1403] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.004s
I20260709 13:12:51.834879 24287 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:51.835495 24287 ts_tablet_manager.cc:1403] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.001s
I20260709 13:12:51.835685 24289 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:51.836261 24289 ts_tablet_manager.cc:1403] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.001s
I20260709 13:12:51.842047 24290 raft_consensus.cc:359] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.844449 24287 raft_consensus.cc:359] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.847767 24287 raft_consensus.cc:385] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.849570 24287 raft_consensus.cc:740] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.850517 24287 consensus_queue.cc:260] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.854527 24287 ts_tablet_manager.cc:1434] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:51.856186 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58db1c790ab94c0ba5756b94b1280302" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:51.857117 24091 raft_consensus.cc:3060] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.857671 24287 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:51.832858 24288 consensus_queue.cc:260] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.861472 24288 ts_tablet_manager.cc:1434] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.004s
I20260709 13:12:51.862890 24288 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487: Bootstrap starting.
I20260709 13:12:51.839990 24241 raft_consensus.cc:2468] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:51.845779 24289 raft_consensus.cc:359] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.865410 24289 raft_consensus.cc:385] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.865790 24289 raft_consensus.cc:740] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.866570 24289 consensus_queue.cc:260] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.867591 24290 raft_consensus.cc:385] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.867925 24290 raft_consensus.cc:740] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.870584 24290 consensus_queue.cc:260] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.872821 24234 raft_consensus.cc:2468] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:51.874683 24059 leader_election.cc:304] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:51.876603 24733 raft_consensus.cc:2804] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.877254 24733 raft_consensus.cc:697] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:51.878328 24733 consensus_queue.cc:237] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.879375 24289 ts_tablet_manager.cc:1434] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 13:12:51.883056 24290 ts_tablet_manager.cc:1434] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:12:51.884651 24290 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:51.894098 24287 tablet_bootstrap.cc:654] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.894167 24288 tablet_bootstrap.cc:654] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.894673 23917 catalog_manager.cc:5697] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.897535 24290 tablet_bootstrap.cc:654] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.898308 24289 tablet_bootstrap.cc:492] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:51.906737 24289 tablet_bootstrap.cc:654] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.915796 24289 tablet_bootstrap.cc:492] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:51.922228 24287 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:51.925032 24287 ts_tablet_manager.cc:1403] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.005s
I20260709 13:12:51.933655 24289 ts_tablet_manager.cc:1403] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.000s
I20260709 13:12:51.947898 24287 raft_consensus.cc:359] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.949651 24287 raft_consensus.cc:385] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.949986 24287 raft_consensus.cc:740] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.952839 24290 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:51.953461 24290 ts_tablet_manager.cc:1403] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.069s	user 0.037s	sys 0.019s
I20260709 13:12:51.957345 24287 consensus_queue.cc:260] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:51.960266 24287 ts_tablet_manager.cc:1434] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:12:51.961580 24287 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:51.966459 24289 raft_consensus.cc:359] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.967564 24289 raft_consensus.cc:385] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.968116 24289 raft_consensus.cc:740] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.969291 24289 consensus_queue.cc:260] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:51.972602 24290 raft_consensus.cc:359] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.973551 24290 raft_consensus.cc:385] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.973825 24290 raft_consensus.cc:740] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.974555 24290 consensus_queue.cc:260] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:51.976671 24290 ts_tablet_manager.cc:1434] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:51.977748 24290 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:51.972288 24289 ts_tablet_manager.cc:1434] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 13:12:51.985680 24289 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:51.999045 24290 tablet_bootstrap.cc:654] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.000763 24289 tablet_bootstrap.cc:654] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.001858 24612 raft_consensus.cc:493] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.999277 24091 raft_consensus.cc:2468] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:52.002771 24612 raft_consensus.cc:515] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.000079 24287 tablet_bootstrap.cc:654] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.017470 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:52.018819 24241 raft_consensus.cc:2393] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:52.000819 24560 raft_consensus.cc:493] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.020475 24560 raft_consensus.cc:515] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.023772 24560 leader_election.cc:290] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:52.042110 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a961e0b83f93496e8888d704a2d82065" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:52.046017 24612 leader_election.cc:290] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:52.054044 24205 leader_election.cc:304] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:52.055392 23915 catalog_manager.cc:5697] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.056695 24694 raft_consensus.cc:2804] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.071162 24694 raft_consensus.cc:697] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:52.072889 24287 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:52.072669 24694 consensus_queue.cc:237] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:52.073566 24287 ts_tablet_manager.cc:1403] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.022s
I20260709 13:12:52.070962 24649 raft_consensus.cc:493] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.104286 24289 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:52.105064 24289 ts_tablet_manager.cc:1403] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.120s	user 0.027s	sys 0.020s
I20260709 13:12:52.110037 24289 raft_consensus.cc:359] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.110992 24289 raft_consensus.cc:385] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.110734 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:52.111418 24289 raft_consensus.cc:740] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.115931 24289 consensus_queue.cc:260] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.118392 24287 raft_consensus.cc:359] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.120266 24287 raft_consensus.cc:385] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.120680 24287 raft_consensus.cc:740] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.096992 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a961e0b83f93496e8888d704a2d82065" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:52.154326 24288 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487: No bootstrap required, opened a new log
I20260709 13:12:52.150740 24290 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:52.160495 24288 ts_tablet_manager.cc:1403] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent bootstrapping tablet: real 0.298s	user 0.076s	sys 0.117s
I20260709 13:12:52.122087 24287 consensus_queue.cc:260] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.161005 24290 ts_tablet_manager.cc:1403] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.183s	user 0.031s	sys 0.013s
I20260709 13:12:52.164373 24289 ts_tablet_manager.cc:1434] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
W20260709 13:12:52.148597 24205 leader_election.cc:343] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.167182 23982 leader_election.cc:304] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:52.170455 24295 raft_consensus.cc:3060] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.169392 24091 raft_consensus.cc:2468] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 0.
I20260709 13:12:52.166719 24704 raft_consensus.cc:493] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.194972 24290 raft_consensus.cc:359] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.196122 24290 raft_consensus.cc:385] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.196636 24290 raft_consensus.cc:740] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.197731 24290 consensus_queue.cc:260] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.105499 24649 raft_consensus.cc:515] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.203469 24288 raft_consensus.cc:359] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.206910 24288 raft_consensus.cc:385] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.217469 24289 tablet_bootstrap.cc:492] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:52.226891 24290 ts_tablet_manager.cc:1434] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.002s
I20260709 13:12:52.207314 24288 raft_consensus.cc:740] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.241468 24288 consensus_queue.cc:260] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.203610 24681 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.254323 24295 raft_consensus.cc:2749] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:52.256906 24205 leader_election.cc:304] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:52.202540 24704 raft_consensus.cc:515] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:52.278573 24290 tablet_bootstrap.cc:492] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:52.280784 24287 ts_tablet_manager.cc:1434] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.207s	user 0.018s	sys 0.008s
W20260709 13:12:52.289256 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 88084.1us
I20260709 13:12:52.290541 23917 catalog_manager.cc:5697] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.297901 24649 leader_election.cc:290] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:52.298408 24636 raft_consensus.cc:493] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.299049 24636 raft_consensus.cc:515] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:52.315932 24287 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:52.260468 24681 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.336359 24290 tablet_bootstrap.cc:654] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.313947 24369 raft_consensus.cc:2804] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.344604 24288 ts_tablet_manager.cc:1434] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487: Time spent starting tablet: real 0.184s	user 0.014s	sys 0.010s
I20260709 13:12:52.342106 24369 raft_consensus.cc:493] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.353139 24369 raft_consensus.cc:3060] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.354347 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:52.355177 24167 raft_consensus.cc:2468] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:52.355509 23916 catalog_manager.cc:5697] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:52.364245 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 76223.6us
I20260709 13:12:52.362932 24741 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.365443 24741 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.377246 24741 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:52.357889 24733 raft_consensus.cc:493] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.396955 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:52.398417 24241 raft_consensus.cc:2468] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:52.400216 24059 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:52.404455 24167 raft_consensus.cc:3060] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.410732 24704 leader_election.cc:290] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:52.411583 24636 leader_election.cc:290] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:52.413750 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccea2ecf3fb4019be0a669b6c1b6d2b" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:52.415787 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:52.425391 24649 raft_consensus.cc:493] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.426100 24649 raft_consensus.cc:515] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:52.431190 24681 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:52.439534 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:52.441572 24289 tablet_bootstrap.cc:654] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:52.458257 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:52.432626 24773 consensus_queue.cc:1048] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:52.398883 24733 raft_consensus.cc:515] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:52.452492 24741 raft_consensus.cc:2804] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.450750 24242 raft_consensus.cc:2468] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:52.479426 24287 tablet_bootstrap.cc:654] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.480404 24090 raft_consensus.cc:2468] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:52.481282 24733 leader_election.cc:290] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:52.492803 23982 leader_election.cc:304] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:52.469247 24649 leader_election.cc:290] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:52.473631 24741 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.502635 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:52.506726 24652 consensus_queue.cc:1048] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.502841 24741 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.513244 24369 raft_consensus.cc:515] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.497179 24613 raft_consensus.cc:2804] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.514680 24613 raft_consensus.cc:493] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.515098 24613 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.515941 24369 leader_election.cc:290] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:52.517362 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:52.519464 24290 tablet_bootstrap.cc:492] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:52.519616 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:52.520195 24290 ts_tablet_manager.cc:1403] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.242s	user 0.030s	sys 0.017s
I20260709 13:12:52.520489 24235 raft_consensus.cc:2468] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
I20260709 13:12:52.521847 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a961e0b83f93496e8888d704a2d82065" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:52.529950 23982 leader_election.cc:304] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
W20260709 13:12:52.531329 24205 leader_election.cc:343] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:52.539229 24012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:52.540428 24012 raft_consensus.cc:2393] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:52.565244 24167 raft_consensus.cc:3060] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.572441 24290 raft_consensus.cc:359] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:52.593364 24290 raft_consensus.cc:385] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.593874 24290 raft_consensus.cc:740] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.574177 24626 consensus_queue.cc:1048] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:12:52.617072 24290 consensus_queue.cc:260] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:52.550280 24773 raft_consensus.cc:2804] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.620596 23984 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:52.629786 24295 raft_consensus.cc:2804] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.632869 24295 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.633816 24295 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.646109 24290 ts_tablet_manager.cc:1434] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.002s
I20260709 13:12:52.624189 24773 raft_consensus.cc:493] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.633452 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:52.669672 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:52.675606 23982 leader_election.cc:343] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:52.685599 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 63217.4us
I20260709 13:12:52.630432 24764 consensus_queue.cc:1048] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:12:52.665876 24773 raft_consensus.cc:3060] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.692737 24295 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.679715 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
W20260709 13:12:52.697953 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 125127us
I20260709 13:12:52.635789 24777 consensus_queue.cc:1048] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.076s
I20260709 13:12:52.720305 24295 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:52.753618 24287 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:52.754529 24287 ts_tablet_manager.cc:1403] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.449s	user 0.022s	sys 0.033s
I20260709 13:12:52.746929 24013 raft_consensus.cc:2393] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:52.756138 24618 consensus_queue.cc:1048] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 13:12:52.785713 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 73466.8us
W20260709 13:12:52.790052 23984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 78092.8us
I20260709 13:12:52.797055 24287 raft_consensus.cc:359] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.798499 24287 raft_consensus.cc:385] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.798931 24287 raft_consensus.cc:740] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.801013 24287 consensus_queue.cc:260] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:52.805253 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 77056.6us
I20260709 13:12:52.779835 24613 raft_consensus.cc:515] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:52.850842 24290 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad: Bootstrap starting.
I20260709 13:12:52.854885 24287 ts_tablet_manager.cc:1434] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.010s
I20260709 13:12:52.850638 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:52.865195 24772 raft_consensus.cc:493] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.866070 24772 raft_consensus.cc:515] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.889106 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a961e0b83f93496e8888d704a2d82065" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:52.890266 24087 raft_consensus.cc:3060] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.890735 24794 raft_consensus.cc:493] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.891342 24794 raft_consensus.cc:515] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:52.892742 24014 raft_consensus.cc:2393] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:52.894052 24794 leader_election.cc:290] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:52.904812 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:52.905874 24235 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.906237 24741 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:52.907670 24094 raft_consensus.cc:2393] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:52.920768 24613 leader_election.cc:290] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:52.925284 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:52.934589 24131 leader_election.cc:304] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:53.092813 24289 tablet_bootstrap.cc:492] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:53.093564 24289 ts_tablet_manager.cc:1403] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.897s	user 0.015s	sys 0.024s
I20260709 13:12:53.097754 24290 tablet_bootstrap.cc:700] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad: Time spent opening tablet: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:12:53.103614 24290 tablet_bootstrap.cc:654] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.121419 24741 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:53.149345 24289 raft_consensus.cc:359] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:53.150810 24289 raft_consensus.cc:385] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.151211 24289 raft_consensus.cc:740] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.152762 24289 consensus_queue.cc:260] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:53.175685 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 242258us
I20260709 13:12:53.177479 24289 ts_tablet_manager.cc:1434] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.084s	user 0.011s	sys 0.000s
W20260709 13:12:53.184769 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 95011.8us
I20260709 13:12:53.185328 24289 tablet_bootstrap.cc:492] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
W20260709 13:12:53.185753 24057 leader_election.cc:343] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.187978 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fccea2ecf3fb4019be0a669b6c1b6d2b" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:53.187076 24057 leader_election.cc:304] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:53.196496 24635 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.230305 24704 raft_consensus.cc:493] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.230701 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:53.195470 24765 raft_consensus.cc:2749] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.237924 24704 raft_consensus.cc:515] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:53.245447 24087 raft_consensus.cc:2468] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:53.242816 24234 raft_consensus.cc:2468] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 0.
W20260709 13:12:53.317451 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 375423us
I20260709 13:12:53.317696 24235 raft_consensus.cc:2468] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:53.323550 24290 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad: No bootstrap required, opened a new log
I20260709 13:12:53.333799 24015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:53.335044 24015 raft_consensus.cc:2393] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:53.324285 24290 ts_tablet_manager.cc:1403] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad: Time spent bootstrapping tablet: real 0.485s	user 0.020s	sys 0.010s
I20260709 13:12:53.339069 24704 leader_election.cc:290] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:53.347477 24289 tablet_bootstrap.cc:654] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.343673 23984 leader_election.cc:304] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:53.354028 24798 raft_consensus.cc:2804] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.356001 24798 raft_consensus.cc:493] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.356508 24798 raft_consensus.cc:3060] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.359205 24772 leader_election.cc:290] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:53.360592 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:53.361444 24234 raft_consensus.cc:2468] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:53.363023 24133 leader_election.cc:304] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:53.370852 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:53.371953 24237 raft_consensus.cc:2393] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:53.374598 24290 raft_consensus.cc:359] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.375532 24290 raft_consensus.cc:385] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.375861 24290 raft_consensus.cc:740] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.375995 24704 raft_consensus.cc:2804] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.376586 24704 raft_consensus.cc:493] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.377032 24704 raft_consensus.cc:3060] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.378062 24290 consensus_queue.cc:260] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.380539 24290 ts_tablet_manager.cc:1434] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
W20260709 13:12:53.339874 24773 consensus_meta.cc:287] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent flushing consensus metadata: real 0.632s	user 0.016s	sys 0.000s
I20260709 13:12:53.385546 23984 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad
I20260709 13:12:53.403752 24635 raft_consensus.cc:2749] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.405735 24785 raft_consensus.cc:2804] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.407307 24785 raft_consensus.cc:697] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:53.408318 24785 consensus_queue.cc:237] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:53.415293 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 46563.9us
I20260709 13:12:53.390403 24773 raft_consensus.cc:515] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:53.427976 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:53.422077 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:53.421640 24635 raft_consensus.cc:493] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.456996 24091 raft_consensus.cc:2468] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:53.425590 24131 leader_election.cc:304] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
W20260709 13:12:53.472105 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 46662.1us
I20260709 13:12:53.479790 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:53.502091 24785 raft_consensus.cc:493] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34a8f98cd2994376ac09a9ce8fcbc487)
I20260709 13:12:53.502884 24785 raft_consensus.cc:515] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:53.503238 24773 leader_election.cc:290] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:53.506843 24289 tablet_bootstrap.cc:492] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:53.485714 24765 raft_consensus.cc:2749] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.507684 24289 ts_tablet_manager.cc:1403] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.323s	user 0.015s	sys 0.009s
I20260709 13:12:53.507517 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:53.474009 24635 raft_consensus.cc:515] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
W20260709 13:12:53.508850 24806 log.cc:927] Time spent T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:12:53.509007 24235 raft_consensus.cc:3060] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.510591 24635 leader_election.cc:290] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:53.511409 24289 raft_consensus.cc:359] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:53.511925 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:53.513608 24785 leader_election.cc:290] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:53.512225 24289 raft_consensus.cc:385] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.520255 24089 raft_consensus.cc:2468] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:53.520548 24289 raft_consensus.cc:740] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.521335 24289 consensus_queue.cc:260] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:53.522964 24704 raft_consensus.cc:515] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:53.523943 24289 ts_tablet_manager.cc:1434] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:12:53.525260 24289 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:53.533753 24704 leader_election.cc:290] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:53.534907 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:53.535981 24234 raft_consensus.cc:2468] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
I20260709 13:12:53.537434 24059 leader_election.cc:304] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:53.540719 24289 tablet_bootstrap.cc:654] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.541253 24287 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:53.518436 23982 leader_election.cc:304] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
W20260709 13:12:53.576896 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 58569us
I20260709 13:12:53.581668 24635 raft_consensus.cc:2804] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:53.582283 24635 raft_consensus.cc:493] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.582698 24635 raft_consensus.cc:3060] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.582922 24235 raft_consensus.cc:2468] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:53.583187 24681 raft_consensus.cc:2804] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.583746 24681 raft_consensus.cc:697] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
W20260709 13:12:53.604532 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 107840us
W20260709 13:12:53.615361 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:12:53.615449 24205 consensus_peers.cc:597] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:53.616554 23984 leader_election.cc:304] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:12:53.617616 24295 raft_consensus.cc:2804] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.618106 24295 raft_consensus.cc:697] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
W20260709 13:12:53.619683 23982 leader_election.cc:343] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.624195 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:53.632095 24235 raft_consensus.cc:3060] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.621455 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:53.618933 24295 consensus_queue.cc:237] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:53.637550 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:53.553395 24798 raft_consensus.cc:515] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:53.672084 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 46091.1us
I20260709 13:12:53.671283 24289 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:53.674680 24289 ts_tablet_manager.cc:1403] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.150s	user 0.013s	sys 0.016s
W20260709 13:12:53.676184 23982 leader_election.cc:343] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.670468 24057 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:53.682060 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:53.683173 24163 raft_consensus.cc:2393] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:53.685681 24287 tablet_bootstrap.cc:654] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.689301 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:53.695700 24782 raft_consensus.cc:2749] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:53.670234 24681 consensus_queue.cc:237] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.709028 24018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:53.742126 24369 raft_consensus.cc:493] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.742923 24369 raft_consensus.cc:515] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:53.745373 24369 leader_election.cc:290] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:53.746199 24018 raft_consensus.cc:2393] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 1: Already voted for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in this term.
I20260709 13:12:53.738512 24205 leader_election.cc:304] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:53.753032 24289 raft_consensus.cc:359] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.753278 24772 consensus_queue.cc:1048] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:53.753968 24289 raft_consensus.cc:385] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:53.754312 24289 raft_consensus.cc:740] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:53.755079 24289 consensus_queue.cc:260] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.757493 24289 ts_tablet_manager.cc:1434] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:12:53.760478 24720 raft_consensus.cc:2804] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:53.761114 24289 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:53.769280 24289 tablet_bootstrap.cc:654] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:53.761165 24720 raft_consensus.cc:697] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:53.788018 24795 raft_consensus.cc:493] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.813476 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:53.877084 24720 consensus_queue.cc:237] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:53.858774 24765 raft_consensus.cc:493] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.882207 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:53.884377 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b5f299f0dd64ce2a6147e78c234d2b2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:53.842099 24795 raft_consensus.cc:515] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.854310 24160 raft_consensus.cc:3060] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:53.816910 24235 raft_consensus.cc:2468] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
W20260709 13:12:53.908739 24205 leader_election.cc:343] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:53.916615 24768 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:53.937866 24635 raft_consensus.cc:515] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:53.951077 24795 leader_election.cc:290] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:53.952112 24091 raft_consensus.cc:2393] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:53.952451 24798 leader_election.cc:290] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:53.903544 24765 raft_consensus.cc:515] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.961037 24765 leader_election.cc:290] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:53.963070 24768 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:53.966399 24768 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:53.955971 24635 leader_election.cc:290] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:54.068100 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:54.072881 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:54.073740 23917 catalog_manager.cc:5697] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 1 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:54.080183 24205 leader_election.cc:343] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.080847 24205 leader_election.cc:304] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:54.081578 24160 raft_consensus.cc:2468] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:54.084941 24287 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:54.085619 24287 ts_tablet_manager.cc:1403] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.545s	user 0.022s	sys 0.022s
I20260709 13:12:54.088254 24133 leader_election.cc:304] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:54.089943 24287 raft_consensus.cc:359] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:54.091040 24287 raft_consensus.cc:385] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.090481 24768 raft_consensus.cc:2804] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.091696 24287 raft_consensus.cc:740] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.092206 24768 raft_consensus.cc:697] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:54.092811 24287 consensus_queue.cc:260] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:54.094890 24289 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:54.100730 24289 ts_tablet_manager.cc:1403] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.340s	user 0.022s	sys 0.017s
I20260709 13:12:54.096375 24775 raft_consensus.cc:3060] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.102316 24814 raft_consensus.cc:493] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34a8f98cd2994376ac09a9ce8fcbc487)
I20260709 13:12:54.103034 24814 raft_consensus.cc:515] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.103807 24287 ts_tablet_manager.cc:1434] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:12:54.113307 24287 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:54.115963 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:54.129230 24091 raft_consensus.cc:2468] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:54.126868 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:54.127429 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:54.132642 24234 raft_consensus.cc:2393] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:54.128504 24765 raft_consensus.cc:493] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.133328 24765 raft_consensus.cc:515] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:54.131392 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:54.135681 24765 leader_election.cc:290] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:54.117460 24775 raft_consensus.cc:2749] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.105587 24814 leader_election.cc:290] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:54.093350 24768 consensus_queue.cc:237] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:12:54.108122 23982 leader_election.cc:304] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
W20260709 13:12:54.111111 24057 leader_election.cc:343] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.104084 24289 raft_consensus.cc:359] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:54.143581 24289 raft_consensus.cc:385] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.143844 24289 raft_consensus.cc:740] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.144730 24289 consensus_queue.cc:260] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:54.147363 24793 raft_consensus.cc:2749] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:54.152000 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:54.152976 24013 raft_consensus.cc:2468] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:54.110224 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:54.154176 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58db1c790ab94c0ba5756b94b1280302" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:54.156049 24014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:54.163542 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:54.163832 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:54.164378 24163 raft_consensus.cc:2468] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 0.
W20260709 13:12:54.171159 23982 leader_election.cc:343] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.171494 24233 raft_consensus.cc:2468] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 1.
I20260709 13:12:54.177825 24161 raft_consensus.cc:3060] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.183688 24057 leader_election.cc:304] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:12:54.184175 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:54.181890 24793 consensus_queue.cc:1048] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:54.185238 24057 leader_election.cc:304] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:54.190564 24801 raft_consensus.cc:2749] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.191627 24801 raft_consensus.cc:2804] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.193480 24287 tablet_bootstrap.cc:654] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.191978 24801 raft_consensus.cc:493] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.194216 24801 raft_consensus.cc:3060] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.194355 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58db1c790ab94c0ba5756b94b1280302" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:54.197381 24131 leader_election.cc:304] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:54.199373 23984 leader_election.cc:304] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:54.200762 24289 ts_tablet_manager.cc:1434] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.100s	user 0.004s	sys 0.005s
I20260709 13:12:54.209812 24013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff3617135ac4b94a68ffb136a68c4b8" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:54.209868 24131 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:54.211902 24768 raft_consensus.cc:2749] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:54.204586 24793 consensus_queue.cc:1048] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:54.204144 24794 consensus_queue.cc:1048] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:12:54.202065 24765 raft_consensus.cc:2804] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.215083 24164 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.215590 24765 raft_consensus.cc:493] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.216045 24765 raft_consensus.cc:3060] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:54.218233 24205 leader_election.cc:343] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:54.218894 24205 leader_election.cc:304] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:54.220113 24131 leader_election.cc:304] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:54.205255 24798 raft_consensus.cc:2804] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.221545 24798 raft_consensus.cc:697] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:12:54.221740 24774 raft_consensus.cc:2749] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.222627 24798 consensus_queue.cc:237] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.232981 24289 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:54.247962 24131 leader_election.cc:304] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:54.248257 24289 tablet_bootstrap.cc:654] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.256007 24814 raft_consensus.cc:2749] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:54.261171 24764 consensus_queue.cc:1048] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.281777 24287 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:54.282379 24287 ts_tablet_manager.cc:1403] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.006s
I20260709 13:12:54.323215 24793 consensus_queue.cc:1048] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.333086 24794 consensus_queue.cc:1048] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:54.350302 24801 raft_consensus.cc:515] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:54.353484 24801 leader_election.cc:290] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
W20260709 13:12:54.361624 24830 log.cc:927] Time spent T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:12:54.363375 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:54.367525 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:54.368254 24016 raft_consensus.cc:3060] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.355962 23914 catalog_manager.cc:5697] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } }
I20260709 13:12:54.367141 24287 raft_consensus.cc:359] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.375523 24287 raft_consensus.cc:385] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.375890 24287 raft_consensus.cc:740] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.368832 24768 raft_consensus.cc:2749] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.382781 24287 consensus_queue.cc:260] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.395891 24765 raft_consensus.cc:515] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:54.400195 24162 raft_consensus.cc:2393] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 1: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:54.401505 24287 ts_tablet_manager.cc:1434] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.001s
I20260709 13:12:54.406639 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:54.419507 24287 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:54.426124 24765 leader_election.cc:290] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:54.436997 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abdb73a1fad747ee8b290ec26121bac5" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:54.438285 24091 raft_consensus.cc:2393] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 1: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:54.439939 24131 leader_election.cc:304] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:54.442454 24768 raft_consensus.cc:2749] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:54.453315 24774 consensus_queue.cc:1048] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:54.469735 24289 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:54.473604 24289 ts_tablet_manager.cc:1403] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.010s
I20260709 13:12:54.477792 24287 tablet_bootstrap.cc:654] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.486313 24016 raft_consensus.cc:2468] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
W20260709 13:12:54.490658 24205 consensus_peers.cc:597] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:54.490756 24289 raft_consensus.cc:359] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.497807 24057 leader_election.cc:304] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 411dcd784dc842ecb490506483244223
I20260709 13:12:54.498385 24289 raft_consensus.cc:385] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.498776 24289 raft_consensus.cc:740] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.499740 24289 consensus_queue.cc:260] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.508898 24289 ts_tablet_manager.cc:1434] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.003s
I20260709 13:12:54.535719 24768 raft_consensus.cc:493] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.539012 24768 raft_consensus.cc:515] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.541779 24768 leader_election.cc:290] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:54.515758 24784 raft_consensus.cc:2804] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.546300 24784 raft_consensus.cc:697] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:54.547443 24784 consensus_queue.cc:237] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:54.549204 24289 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223: Bootstrap starting.
I20260709 13:12:54.555218 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:54.556149 24233 raft_consensus.cc:2468] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:54.557731 24133 leader_election.cc:304] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:54.558826 24768 raft_consensus.cc:2804] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:54.559365 24768 raft_consensus.cc:493] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.559815 24768 raft_consensus.cc:3060] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.561882 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:54.563066 24016 raft_consensus.cc:2468] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 0.
I20260709 13:12:54.567134 24287 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: No bootstrap required, opened a new log
I20260709 13:12:54.567886 24287 ts_tablet_manager.cc:1403] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.016s
I20260709 13:12:54.570308 24289 tablet_bootstrap.cc:654] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.571269 24768 raft_consensus.cc:515] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.573844 24768 leader_election.cc:290] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:54.573669 24765 consensus_queue.cc:1048] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:54.573295 24287 raft_consensus.cc:359] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:54.575573 24287 raft_consensus.cc:385] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.574733 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:54.575781 24287 raft_consensus.cc:740] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.577374 24017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:12:54.577844 24234 raft_consensus.cc:3060] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.578253 24287 consensus_queue.cc:260] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:54.578099 24017 raft_consensus.cc:3060] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.582230 24765 consensus_queue.cc:1048] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.596844 24287 ts_tablet_manager.cc:1434] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 13:12:54.653055 23913 catalog_manager.cc:5697] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.657917 23913 catalog_manager.cc:5697] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:54.695925 23982 consensus_peers.cc:597] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:54.698781 24289 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223: No bootstrap required, opened a new log
I20260709 13:12:54.699510 24289 ts_tablet_manager.cc:1403] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.018s
I20260709 13:12:54.704003 24289 raft_consensus.cc:359] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.704838 24289 raft_consensus.cc:385] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.705130 24289 raft_consensus.cc:740] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.689885 24234 raft_consensus.cc:2468] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:54.705921 24289 consensus_queue.cc:260] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.708361 24133 leader_election.cc:304] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:54.708732 24289 ts_tablet_manager.cc:1434] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:12:54.709399 24765 raft_consensus.cc:2804] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.709964 24765 raft_consensus.cc:697] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:54.770860 24765 consensus_queue.cc:237] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.780967 24017 raft_consensus.cc:2468] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:54.783643 23914 catalog_manager.cc:5697] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } }
I20260709 13:12:54.831300 24773 consensus_queue.cc:1048] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:54.849529 24765 raft_consensus.cc:493] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.850363 24765 raft_consensus.cc:515] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:54.852701 24765 leader_election.cc:290] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:54.854872 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:54.855604 23913 catalog_manager.cc:5697] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 1 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.858480 24773 raft_consensus.cc:493] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.864765 24773 raft_consensus.cc:515] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:54.867568 24773 leader_election.cc:290] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:54.870425 24016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:12:54.874894 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a961e0b83f93496e8888d704a2d82065" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:54.888021 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a961e0b83f93496e8888d704a2d82065" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
W20260709 13:12:54.979260 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 63542.8us
I20260709 13:12:54.990808 23917 catalog_manager.cc:5697] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 0 to 1, leader changed from <none> to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 1 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.006263 24131 leader_election.cc:304] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:55.013886 24765 raft_consensus.cc:2749] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:55.015244 23982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 110228us
I20260709 13:12:55.038239 23984 leader_election.cc:304] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:12:55.056154 24773 raft_consensus.cc:2749] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:55.043654 23964 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:55.092499 24016 raft_consensus.cc:3060] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:55.092515 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 67293.5us
W20260709 13:12:55.194027 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 48100.7us
I20260709 13:12:55.209218 24801 consensus_queue.cc:1048] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.223912 24855 consensus_queue.cc:1048] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.362201 23915 catalog_manager.cc:5697] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 0 to 1, leader changed from <none> to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.417168 24162 raft_consensus.cc:3060] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.444223 24782 consensus_queue.cc:1048] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:55.475390 24765 consensus_queue.cc:1048] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.693217 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
W20260709 13:12:56.713521 24131 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:12:56.758054 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 44594.2us
W20260709 13:12:56.761266 24057 consensus_peers.cc:597] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.762959 24057 consensus_peers.cc:597] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.767376 24057 consensus_peers.cc:597] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.768643 24057 consensus_peers.cc:597] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.783998 24131 consensus_peers.cc:597] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.785153 24131 consensus_peers.cc:597] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.799325 24205 consensus_peers.cc:597] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.812186 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:56.814060 14097 tablet_replica.cc:333] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.815896 14097 raft_consensus.cc:2243] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.816787 14097 raft_consensus.cc:2272] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.820845 14097 tablet_replica.cc:333] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.822191 14097 raft_consensus.cc:2243] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.823607 14097 raft_consensus.cc:2272] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.830324 24057 consensus_peers.cc:597] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.833381 14097 tablet_replica.cc:333] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.834721 14097 raft_consensus.cc:2243] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.836028 14097 raft_consensus.cc:2272] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.839936 14097 tablet_replica.cc:333] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.841257 14097 raft_consensus.cc:2243] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.843484 14097 raft_consensus.cc:2272] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.851265 24131 consensus_peers.cc:597] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.851970 14097 tablet_replica.cc:333] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.853796 14097 raft_consensus.cc:2243] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.855635 14097 raft_consensus.cc:2272] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.860291 14097 tablet_replica.cc:333] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.861654 14097 raft_consensus.cc:2243] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.862438 14097 raft_consensus.cc:2272] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.865123 24131 consensus_peers.cc:597] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.867129 14097 tablet_replica.cc:333] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
W20260709 13:12:56.868285 24131 consensus_peers.cc:597] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.869009 14097 raft_consensus.cc:2243] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:56.872054 24057 consensus_peers.cc:597] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.873972 14097 raft_consensus.cc:2272] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.879774 14097 tablet_replica.cc:333] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.881101 14097 raft_consensus.cc:2243] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.881884 14097 raft_consensus.cc:2272] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.894841 14097 tablet_replica.cc:333] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
W20260709 13:12:56.894095 24205 consensus_peers.cc:597] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.896261 14097 raft_consensus.cc:2243] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.901561 14097 raft_consensus.cc:2272] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.902812 24205 consensus_peers.cc:597] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:56.906376 24131 consensus_peers.cc:597] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.906840 14097 tablet_replica.cc:333] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.907864 14097 raft_consensus.cc:2243] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.908695 14097 raft_consensus.cc:2272] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.912168 24057 consensus_peers.cc:597] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.912221 14097 tablet_replica.cc:333] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.913993 14097 raft_consensus.cc:2243] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.915136 14097 raft_consensus.cc:2272] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.919373 14097 tablet_replica.cc:333] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.920766 14097 raft_consensus.cc:2243] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.921407 14097 raft_consensus.cc:2272] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.926932 14097 tablet_replica.cc:333] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.927963 14097 raft_consensus.cc:2243] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.928993 14097 raft_consensus.cc:2272] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.933051 14097 tablet_replica.cc:333] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.934430 14097 raft_consensus.cc:2243] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.935253 14097 raft_consensus.cc:2272] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.940819 14097 tablet_replica.cc:333] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.941645 14097 raft_consensus.cc:2243] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.942963 14097 raft_consensus.cc:2272] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.946430 14097 tablet_replica.cc:333] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.947290 14097 raft_consensus.cc:2243] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.948088 14097 raft_consensus.cc:2272] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.951074 14097 tablet_replica.cc:333] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.951876 14097 raft_consensus.cc:2243] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.952610 14097 raft_consensus.cc:2272] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.955755 14097 tablet_replica.cc:333] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.956588 14097 raft_consensus.cc:2243] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.957183 14097 raft_consensus.cc:2272] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.958943 24131 consensus_peers.cc:597] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.960139 14097 tablet_replica.cc:333] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.961001 14097 raft_consensus.cc:2243] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.961558 14097 raft_consensus.cc:2272] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.964363 14097 tablet_replica.cc:333] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.965123 14097 raft_consensus.cc:2243] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.965696 14097 raft_consensus.cc:2272] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.968393 14097 tablet_replica.cc:333] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.969161 14097 raft_consensus.cc:2243] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.970373 14097 raft_consensus.cc:2272] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.974385 14097 tablet_replica.cc:333] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.975406 14097 raft_consensus.cc:2243] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.976279 14097 raft_consensus.cc:2272] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:56.977073 24131 consensus_peers.cc:597] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:56.980039 14097 tablet_replica.cc:333] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.981163 14097 raft_consensus.cc:2243] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:56.982547 14097 raft_consensus.cc:2272] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.987174 14097 tablet_replica.cc:333] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.988018 14097 raft_consensus.cc:2243] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.988684 14097 raft_consensus.cc:2272] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.993558 14097 tablet_replica.cc:333] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:56.994670 14097 raft_consensus.cc:2243] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:56.995690 14097 raft_consensus.cc:2272] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:56.999675 14097 tablet_replica.cc:333] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.000847 14097 raft_consensus.cc:2243] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.002455 14097 raft_consensus.cc:2272] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.005920 14097 tablet_replica.cc:333] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.006717 14097 raft_consensus.cc:2243] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.007364 14097 raft_consensus.cc:2272] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.010313 14097 tablet_replica.cc:333] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.011047 14097 raft_consensus.cc:2243] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.012115 14097 raft_consensus.cc:2272] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.014834 14097 tablet_replica.cc:333] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.015707 14097 raft_consensus.cc:2243] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.016430 14097 raft_consensus.cc:2272] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.018967 14097 tablet_replica.cc:333] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.019657 14097 raft_consensus.cc:2243] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.020239 14097 raft_consensus.cc:2272] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.022914 14097 tablet_replica.cc:333] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.023600 14097 raft_consensus.cc:2243] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.024158 14097 raft_consensus.cc:2272] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.027189 14097 tablet_replica.cc:333] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.027921 14097 raft_consensus.cc:2243] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.028790 14097 raft_consensus.cc:2272] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.032663 14097 tablet_replica.cc:333] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.033522 14097 raft_consensus.cc:2243] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.034854 14097 raft_consensus.cc:2272] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.038018 14097 tablet_replica.cc:333] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.038916 14097 raft_consensus.cc:2243] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.040230 14097 raft_consensus.cc:2272] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.044552 14097 tablet_replica.cc:333] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.045312 14097 raft_consensus.cc:2243] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.046947 14097 raft_consensus.cc:2272] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.051746 14097 tablet_replica.cc:333] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.052681 14097 raft_consensus.cc:2243] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.053330 14097 raft_consensus.cc:2272] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:57.054998 24057 consensus_peers.cc:597] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.056476 14097 tablet_replica.cc:333] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.057474 14097 raft_consensus.cc:2243] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.058741 14097 raft_consensus.cc:2272] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.062168 14097 tablet_replica.cc:333] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.063208 14097 raft_consensus.cc:2243] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.065054 14097 raft_consensus.cc:2272] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.069046 14097 tablet_replica.cc:333] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.069744 14097 raft_consensus.cc:2243] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.070304 14097 raft_consensus.cc:2272] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.074584 14097 tablet_replica.cc:333] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.075861 14097 raft_consensus.cc:2243] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.077739 14097 raft_consensus.cc:2272] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:57.078316 24131 consensus_peers.cc:597] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.082828 14097 tablet_replica.cc:333] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.084991 14097 raft_consensus.cc:2243] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.085836 14097 raft_consensus.cc:2272] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.089733 14097 tablet_replica.cc:333] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.091499 14097 raft_consensus.cc:2243] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.092501 14097 raft_consensus.cc:2272] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.095948 14097 tablet_replica.cc:333] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
W20260709 13:12:57.096278 24057 consensus_peers.cc:597] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.096920 14097 raft_consensus.cc:2243] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.098274 14097 raft_consensus.cc:2272] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.102363 14097 tablet_replica.cc:333] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.103157 14097 raft_consensus.cc:2243] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.103932 14097 raft_consensus.cc:2272] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.108090 14097 tablet_replica.cc:333] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: stopping tablet replica
I20260709 13:12:57.109395 14097 raft_consensus.cc:2243] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.111166 14097 raft_consensus.cc:2272] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:57.113883 24205 consensus_peers.cc:597] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:57.120936 24057 consensus_peers.cc:597] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:57.122143 24205 consensus_peers.cc:597] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:57.190133 24057 consensus_peers.cc:597] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:57.218554 24205 consensus_peers.cc:597] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.249946 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
W20260709 13:12:57.353401 24205 consensus_peers.cc:597] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.420791 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:57.439198 24885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:57.439225 24884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:57.442042 24887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:57.444271 14097 server_base.cc:1061] running on GCE node
I20260709 13:12:57.447369 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:57.447654 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:57.447825 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602777447812 us; error 0 us; skew 500 ppm
I20260709 13:12:57.448514 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:57.469062 14097 webserver.cc:533] Webserver started at http://127.13.196.65:38811/ using document root <none> and password file <none>
I20260709 13:12:57.470409 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:57.470744 14097 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:57.478636 14097 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:57.490342 24892 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:57.491906 14097 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:12:57.492728 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
format_stamp: "Formatted at 2026-07-09 13:12:39 on dist-test-slave-ftjc"
I20260709 13:12:57.493285 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:57.519378 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:57.521065 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:57.523228 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:57.529547 24899 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:12:57.930382 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:12:57.930763 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.403s	user 0.005s	sys 0.008s
I20260709 13:12:57.931167 14097 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:12:57.938169 24899 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:57.940984 24775 raft_consensus.cc:493] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:57.941731 24775 raft_consensus.cc:515] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:57.944460 24775 leader_election.cc:290] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:57.951237 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
W20260709 13:12:57.954245 24205 leader_election.cc:336] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:57.955600 24205 leader_election.cc:304] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:57.956655 24775 raft_consensus.cc:2749] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:57.960520 24899 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:57.961804 24899 tablet_bootstrap.cc:492] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:57.962602 24899 ts_tablet_manager.cc:1403] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:12:57.965904 24899 raft_consensus.cc:359] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:57.966744 24899 raft_consensus.cc:740] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.967571 24899 consensus_queue.cc:260] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:57.971096 24899 ts_tablet_manager.cc:1434] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:12:57.972018 24899 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:57.987046 24877 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:57.987720 24877 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:57.989705 24899 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:57.990841 24899 tablet_bootstrap.cc:492] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:57.991617 24899 ts_tablet_manager.cc:1403] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:12:57.991843 24877 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:57.992035 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:57.994648 24899 raft_consensus.cc:359] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:57.995560 24899 raft_consensus.cc:740] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
W20260709 13:12:57.996490 24131 leader_election.cc:336] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:57.996433 24899 consensus_queue.cc:260] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:57.997032 24131 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:57.997825 24877 raft_consensus.cc:2749] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:57.998641 24899 ts_tablet_manager.cc:1434] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:12:57.999683 24899 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:58.030236 24899 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.031128 24899 tablet_bootstrap.cc:492] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:58.032078 24899 ts_tablet_manager.cc:1403] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.012s
I20260709 13:12:58.031639 24775 raft_consensus.cc:493] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.032810 24775 raft_consensus.cc:515] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.035467 24899 raft_consensus.cc:359] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.036365 24899 raft_consensus.cc:740] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.037142 24775 leader_election.cc:290] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.038059 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.037185 24899 consensus_queue.cc:260] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.041951 24899 ts_tablet_manager.cc:1434] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 13:12:58.042294 24205 leader_election.cc:336] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.043030 24899 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:58.042891 24205 leader_election.cc:304] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.044170 24775 raft_consensus.cc:2749] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.058971 24877 raft_consensus.cc:493] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.059670 24877 raft_consensus.cc:515] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.062440 24899 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.062605 24877 leader_election.cc:290] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.063731 24899 tablet_bootstrap.cc:492] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:58.064783 24899 ts_tablet_manager.cc:1403] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:12:58.067303 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.069574 24899 raft_consensus.cc:359] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.071383 24899 raft_consensus.cc:740] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
W20260709 13:12:58.072149 24131 leader_election.cc:336] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.072209 24899 consensus_queue.cc:260] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.072901 24131 leader_election.cc:304] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.073799 24877 raft_consensus.cc:2749] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.077075 24899 ts_tablet_manager.cc:1434] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:58.078231 24899 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:58.081003 24872 raft_consensus.cc:493] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.081728 24872 raft_consensus.cc:515] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.087414 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.088316 24233 raft_consensus.cc:2468] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:58.091048 24133 leader_election.cc:304] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.093325 24877 raft_consensus.cc:2804] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.093802 24877 raft_consensus.cc:493] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.094209 24877 raft_consensus.cc:3060] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.084178 24872 leader_election.cc:290] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.110785 24877 raft_consensus.cc:515] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.114046 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fbedd20384f379daf18894c847ae3" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:58.114863 24233 raft_consensus.cc:3060] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.115299 24899 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.116698 24899 tablet_bootstrap.cc:492] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:58.117635 24899 ts_tablet_manager.cc:1403] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.040s	user 0.027s	sys 0.007s
I20260709 13:12:58.120743 24899 raft_consensus.cc:359] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.131235 24899 raft_consensus.cc:740] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.133250 24877 leader_election.cc:290] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.135828 24899 consensus_queue.cc:260] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.136720 24869 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.139671 24869 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.140895 24899 ts_tablet_manager.cc:1434] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:12:58.141942 24899 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:58.142668 24869 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.145035 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:58.148200 24205 leader_election.cc:336] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.149025 24205 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.149446 24233 raft_consensus.cc:2468] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:12:58.150812 24775 raft_consensus.cc:2749] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:58.150244 24131 leader_election.cc:336] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.151932 24782 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.152544 24782 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.156667 24133 leader_election.cc:304] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.157577 24877 raft_consensus.cc:2804] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:58.158103 24877 raft_consensus.cc:697] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:58.161744 24877 consensus_queue.cc:237] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:58.166952 24057 leader_election.cc:336] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:58.158075 24131 leader_election.cc:336] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.168579 24775 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.169322 24775 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.172276 24775 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.172981 24883 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.173671 24883 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.178972 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.179562 24087 raft_consensus.cc:2468] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:58.181494 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.159432 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.182337 24235 raft_consensus.cc:2468] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.158176 24782 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.183981 24782 raft_consensus.cc:493] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.184187 24899 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.184592 24782 raft_consensus.cc:515] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.185374 24899 tablet_bootstrap.cc:492] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:58.185578 24059 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.186230 24899 ts_tablet_manager.cc:1403] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.004s
I20260709 13:12:58.187287 24059 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:58.188890 24876 raft_consensus.cc:2749] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.188647 24883 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.189460 24899 raft_consensus.cc:359] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.189966 24876 raft_consensus.cc:2804] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.190371 24899 raft_consensus.cc:740] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.190478 24876 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.190958 24876 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.191330 24899 consensus_queue.cc:260] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.193908 24899 ts_tablet_manager.cc:1434] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:58.195948 24869 raft_consensus.cc:493] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.196624 24869 raft_consensus.cc:515] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.198901 24869 leader_election.cc:290] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:12:58.199798 24057 leader_election.cc:336] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:58.204463 24057 leader_election.cc:336] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.205302 24899 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:58.205539 24782 leader_election.cc:290] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:58.208832 24205 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:58.212085 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.214759 23915 catalog_manager.cc:5697] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.215819 24057 leader_election.cc:304] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.217949 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.217949 24775 raft_consensus.cc:2804] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.228883 24775 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.229413 24775 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.244160 24910 raft_consensus.cc:2749] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.249532 24910 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.250921 24910 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.255206 24910 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
W20260709 13:12:58.257083 24907 log.cc:927] Time spent T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:12:58.257416 24869 raft_consensus.cc:493] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.258323 24869 raft_consensus.cc:515] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:58.260596 24205 leader_election.cc:336] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.260975 24869 leader_election.cc:290] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.265507 24872 raft_consensus.cc:493] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.266542 24872 raft_consensus.cc:515] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.267740 24906 raft_consensus.cc:493] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.268491 24906 raft_consensus.cc:515] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.272084 24872 leader_election.cc:290] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.273901 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.275103 24235 raft_consensus.cc:2468] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:58.277621 24872 raft_consensus.cc:493] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.278594 24872 raft_consensus.cc:515] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.279882 24775 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.281764 24906 leader_election.cc:290] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.282275 24775 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.294930 24877 raft_consensus.cc:493] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.297703 24872 leader_election.cc:290] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.296031 24877 raft_consensus.cc:515] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.301177 24869 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.319459 24869 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.319705 24876 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.328473 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:58.329797 24235 raft_consensus.cc:2393] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 2: Already voted for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in this term.
I20260709 13:12:58.329901 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.331782 24910 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.332501 24910 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.335004 24910 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:58.321843 24869 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.336064 24775 raft_consensus.cc:493] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.336925 24775 raft_consensus.cc:515] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.338338 24133 leader_election.cc:304] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.339872 24775 leader_election.cc:290] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.343011 24872 raft_consensus.cc:2804] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.343590 24872 raft_consensus.cc:493] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.344012 24872 raft_consensus.cc:3060] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:58.345326 24131 leader_election.cc:336] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:58.347594 24131 leader_election.cc:336] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.350947 14097 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:12:58.351500 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.420s	user 0.365s	sys 0.005s
I20260709 13:12:58.358711 24910 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.359671 24910 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.363188 24910 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.363901 24906 raft_consensus.cc:493] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.364914 24906 raft_consensus.cc:515] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.367779 24913 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.368608 24913 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.369194 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.370787 24235 raft_consensus.cc:2468] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.375154 24059 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:58.379930 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.380748 24782 raft_consensus.cc:2804] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.380769 24164 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.381347 24782 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.381938 24782 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.384621 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.385733 24168 raft_consensus.cc:2468] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:58.385869 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.387017 24087 raft_consensus.cc:2468] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:58.377871 24906 leader_election.cc:290] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:12:58.394747 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 82926.9us
I20260709 13:12:58.409045 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:58.410495 24087 raft_consensus.cc:2393] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
W20260709 13:12:58.412585 24205 leader_election.cc:336] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.413446 24205 leader_election.cc:304] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.332757 24877 leader_election.cc:290] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.398898 24782 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.400473 24906 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.403841 24869 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.491839 24869 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.494350 24869 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:12:58.405599 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 81585.5us
I20260709 13:12:58.414994 24916 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.495376 24916 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.497853 24916 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.498342 24916 raft_consensus.cc:493] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.498873 24916 raft_consensus.cc:515] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.499694 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.500939 24087 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:58.371331 24913 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.473389 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.478644 24881 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.429801 24233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.481731 24876 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.480780 24782 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.479616 24899 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.504112 24233 raft_consensus.cc:2468] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:58.505501 24899 tablet_bootstrap.cc:492] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:58.506403 24899 ts_tablet_manager.cc:1403] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.302s	user 0.081s	sys 0.127s
I20260709 13:12:58.506148 24881 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.510022 24881 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.503487 24883 raft_consensus.cc:493] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.503501 24235 raft_consensus.cc:2468] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:58.511180 24883 raft_consensus.cc:515] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.512195 24923 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.512856 24782 raft_consensus.cc:493] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.513417 24782 raft_consensus.cc:515] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.513792 24883 leader_election.cc:290] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:58.514433 24883 raft_consensus.cc:493] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.514962 24883 raft_consensus.cc:515] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.515399 24782 leader_election.cc:290] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:58.516053 24877 raft_consensus.cc:493] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.516705 24877 raft_consensus.cc:515] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.517164 24883 leader_election.cc:290] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:58.478799 24775 raft_consensus.cc:2749] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.512831 24923 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:12:58.463904 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 51345.9us
I20260709 13:12:58.488847 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:58.518671 24237 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.519011 24877 leader_election.cc:290] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.519920 24923 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.477643 24910 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.503163 24916 leader_election.cc:290] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.522737 24133 leader_election.cc:304] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.523633 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.524313 24899 raft_consensus.cc:359] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.525146 24906 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.528553 24133 leader_election.cc:304] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.532091 24131 leader_election.cc:304] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.534997 24235 raft_consensus.cc:2468] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
I20260709 13:12:58.535223 24919 raft_consensus.cc:2804] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.535742 24919 raft_consensus.cc:493] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.536130 24919 raft_consensus.cc:3060] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.536767 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.538321 24238 raft_consensus.cc:2468] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.536870 24877 raft_consensus.cc:2804] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.539436 24877 raft_consensus.cc:493] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.539817 24877 raft_consensus.cc:3060] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.539824 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.541092 24234 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.542595 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.544045 24087 raft_consensus.cc:2393] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:58.526086 24910 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.546725 24910 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:58.548237 24057 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.549574 24782 raft_consensus.cc:2804] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.549986 24782 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.550475 24782 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.529294 24899 raft_consensus.cc:740] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.552573 24906 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.553031 24899 consensus_queue.cc:260] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.555344 24131 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
W20260709 13:12:58.549886 24057 leader_election.cc:336] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.548058 24923 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.555716 24899 ts_tablet_manager.cc:1434] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:12:58.560675 24899 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:58.561224 24059 leader_election.cc:304] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:58.547698 24872 raft_consensus.cc:515] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:58.569691 24131 leader_election.cc:336] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.589577 24131 leader_election.cc:304] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.591898 24782 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.594502 24926 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.594765 24133 leader_election.cc:304] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.560150 24906 raft_consensus.cc:2804] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.559810 24923 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.596519 24913 raft_consensus.cc:2804] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.600549 24926 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.598842 24906 raft_consensus.cc:493] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
W20260709 13:12:58.611943 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 50824us
I20260709 13:12:58.611989 24782 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:58.614091 24059 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:58.612267 24919 raft_consensus.cc:515] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.619098 24876 raft_consensus.cc:2804] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.619556 24876 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.619941 24876 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.621363 24919 leader_election.cc:290] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.611435 24913 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.622682 24909 raft_consensus.cc:2804] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.623987 24872 leader_election.cc:290] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.624274 24909 raft_consensus.cc:493] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.624886 24872 raft_consensus.cc:2749] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.613979 24906 raft_consensus.cc:3060] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.629415 24877 raft_consensus.cc:515] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.626153 24919 raft_consensus.cc:2804] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.631615 24919 raft_consensus.cc:493] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.632699 24919 raft_consensus.cc:3060] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.624001 24913 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.641321 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.641784 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.642195 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:12:58.642567 24094 raft_consensus.cc:2468] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:58.642781 24877 leader_election.cc:290] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.643181 24235 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.643873 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.624946 24909 raft_consensus.cc:3060] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.630716 24923 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:12:58.614086 24205 leader_election.cc:336] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:58.671429 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 57353.5us
W20260709 13:12:58.672574 24205 leader_election.cc:336] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.651360 24059 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
W20260709 13:12:58.704265 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 53035.6us
W20260709 13:12:58.693502 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 123827us
I20260709 13:12:58.706162 24923 raft_consensus.cc:2804] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.706652 24923 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.707261 24923 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:58.706679 24131 leader_election.cc:336] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.611559 24237 raft_consensus.cc:2468] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:12:58.715361 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.716159 24162 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:12:58.733279 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.734289 24087 raft_consensus.cc:2468] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 1.
W20260709 13:12:58.737210 24057 leader_election.cc:336] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:58.738016 24057 leader_election.cc:336] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.738372 24926 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:58.744124 24059 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.745766 24910 raft_consensus.cc:2804] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:58.746371 24910 raft_consensus.cc:697] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:58.747427 24910 consensus_queue.cc:237] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.752905 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.753420 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:58.754122 24163 raft_consensus.cc:2468] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.738462 24057 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.767963 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.770201 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.770561 24160 raft_consensus.cc:2468] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.771080 24164 raft_consensus.cc:2468] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 1.
I20260709 13:12:58.776158 24876 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:58.790807 24092 raft_consensus.cc:2393] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:58.793671 24205 leader_election.cc:304] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
W20260709 13:12:58.791975 24131 leader_election.cc:336] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.776320 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
W20260709 13:12:58.802300 24131 leader_election.cc:336] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.788166 24883 raft_consensus.cc:2749] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:58.823577 24133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 228924us
I20260709 13:12:58.831889 24131 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.835897 24877 raft_consensus.cc:2804] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.829852 24057 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.836697 24919 raft_consensus.cc:515] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:58.852696 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "feaea0cd237f463b89076aecb1d55c32" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:58.853603 24234 raft_consensus.cc:3060] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.855643 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:58.855985 24235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dfb395be48d4df5895b77cd94ea1512" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:58.856477 24162 raft_consensus.cc:2468] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:12:58.856732 24168 raft_consensus.cc:2393] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 2: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:58.829491 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:58.865202 24087 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:12:58.851976 24919 leader_election.cc:290] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.880506 24057 leader_election.cc:304] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.905573 24057 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.910260 24938 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:58.910959 24938 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.911605 24938 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:58.910274 24932 raft_consensus.cc:2804] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.913575 24932 raft_consensus.cc:493] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.913990 24932 raft_consensus.cc:3060] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.914650 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:58.915499 24240 raft_consensus.cc:3060] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.856796 24235 raft_consensus.cc:3060] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.839567 24877 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
W20260709 13:12:58.957770 24131 leader_election.cc:336] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:58.932969 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fd3c07e7b741e0a01e60ebf1092778" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
W20260709 13:12:58.963709 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 58211.6us
I20260709 13:12:58.949913 24877 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:58.970139 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 176514us
I20260709 13:12:58.972191 24205 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:58.969456 24057 leader_election.cc:304] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:58.981281 24930 raft_consensus.cc:2804] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:58.981912 24930 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:58.982362 24930 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.985292 24913 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:58.987488 24916 raft_consensus.cc:2749] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.969226 24876 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:58.977149 24238 raft_consensus.cc:3060] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:58.988930 24159 raft_consensus.cc:2393] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 2: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:58.989848 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:58.990612 24241 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.000448 24899 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.002565 24782 raft_consensus.cc:2804] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.003140 24782 raft_consensus.cc:493] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:59.003443 24782 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:58.963478 24131 leader_election.cc:336] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.006587 24131 leader_election.cc:336] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.007071 24131 leader_election.cc:336] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.007485 24131 consensus_peers.cc:597] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:59.007897 24131 leader_election.cc:336] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.011238 24057 leader_election.cc:336] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.013135 24057 leader_election.cc:336] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.016901 24131 leader_election.cc:336] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.018662 24057 leader_election.cc:336] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.022012 24057 leader_election.cc:336] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.022660 24899 tablet_bootstrap.cc:492] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:59.023586 24899 ts_tablet_manager.cc:1403] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.464s	user 0.033s	sys 0.026s
I20260709 13:12:58.988008 24913 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:59.030225 24238 raft_consensus.cc:2468] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:12:59.031555 24923 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.034902 24234 raft_consensus.cc:2468] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:12:59.042080 24915 raft_consensus.cc:2764] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:12:59.023288 24205 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:59.027801 24906 raft_consensus.cc:515] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.046409 24906 leader_election.cc:290] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:59.043879 24923 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:12:59.056763 24205 leader_election.cc:336] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.062318 24205 leader_election.cc:336] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.063967 24205 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
W20260709 13:12:59.064651 24057 leader_election.cc:336] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.065121 24205 leader_election.cc:336] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.049527 24881 raft_consensus.cc:2804] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:59.066910 24205 leader_election.cc:336] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.073993 24057 leader_election.cc:336] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.075804 24057 leader_election.cc:336] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.068979 24881 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:59.081545 24881 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:59.084822 24133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 129744us
W20260709 13:12:59.087595 24057 leader_election.cc:336] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.069998 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:59.089715 24092 raft_consensus.cc:2393] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
W20260709 13:12:59.088989 24057 leader_election.cc:336] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.102844 24238 raft_consensus.cc:1275] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.104147 23915 catalog_manager.cc:5697] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.105233 24909 raft_consensus.cc:515] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.105744 24899 raft_consensus.cc:359] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.106544 24899 raft_consensus.cc:740] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.107005 24090 raft_consensus.cc:2393] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34a8f98cd2994376ac09a9ce8fcbc487 in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:59.107424 24899 consensus_queue.cc:260] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.108498 24930 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.110249 24240 raft_consensus.cc:2468] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:12:59.111065 24930 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:59.111439 24909 leader_election.cc:290] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:12:59.114794 24938 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.117255 24877 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.120280 24241 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:12:59.083776 24932 raft_consensus.cc:515] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.094343 24782 raft_consensus.cc:515] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.126019 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:59.126776 24240 raft_consensus.cc:3060] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.127285 24932 leader_election.cc:290] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:59.123831 24916 raft_consensus.cc:2749] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.129130 24938 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:59.131278 24234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:12:59.132032 24234 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.119647 24877 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:59.132792 24235 raft_consensus.cc:2468] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:12:59.132592 24881 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.138662 24133 leader_election.cc:304] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.140192 24131 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.147074 24133 leader_election.cc:304] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.149911 24919 raft_consensus.cc:2804] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.150151 24927 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:59.150704 24927 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:59.150736 24919 raft_consensus.cc:697] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:59.151244 24927 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:59.152576 24872 raft_consensus.cc:2804] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.153194 24872 raft_consensus.cc:697] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:59.154210 24881 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:59.158275 24782 leader_election.cc:290] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:59.154241 24872 consensus_queue.cc:237] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:59.142381 24205 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.124359 24059 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
W20260709 13:12:59.163033 24205 leader_election.cc:336] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.164381 24928 consensus_queue.cc:1048] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:59.164955 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3101771b367478999c4973ad7df868f" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:59.165764 24090 raft_consensus.cc:3060] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.166049 24133 leader_election.cc:304] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:12:59.166882 24947 raft_consensus.cc:2804] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.167485 24947 raft_consensus.cc:697] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:59.168473 24947 consensus_queue.cc:237] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.174213 24234 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:12:59.181954 24944 raft_consensus.cc:2804] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.182741 24944 raft_consensus.cc:697] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:59.183352 24899 ts_tablet_manager.cc:1434] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.159s	user 0.006s	sys 0.011s
I20260709 13:12:59.184185 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:59.172710 24133 leader_election.cc:304] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.151901 24240 raft_consensus.cc:2468] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
W20260709 13:12:59.175904 24057 leader_election.cc:336] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.151976 24919 consensus_queue.cc:237] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:59.177976 24131 leader_election.cc:336] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.185889 24899 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:12:59.178532 24205 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.178473 24881 raft_consensus.cc:2804] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.184996 24087 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.188625 24926 raft_consensus.cc:2804] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.193195 24926 raft_consensus.cc:697] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
W20260709 13:12:59.194334 24205 leader_election.cc:336] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.195024 24205 leader_election.cc:304] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.194216 24059 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:59.196372 24782 raft_consensus.cc:2804] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.199534 24059 leader_election.cc:304] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:12:59.183794 24944 consensus_queue.cc:237] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:59.204613 24941 raft_consensus.cc:2804] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.205278 24941 raft_consensus.cc:697] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:59.203719 24939 raft_consensus.cc:2749] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.209573 24782 raft_consensus.cc:697] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:59.210529 24057 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.213405 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:59.196254 24916 raft_consensus.cc:2749] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.216310 24094 raft_consensus.cc:2393] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:59.196802 24881 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:12:59.217562 24926 consensus_queue.cc:237] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:59.218722 24782 consensus_queue.cc:237] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.215761 24876 raft_consensus.cc:2749] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:59.223896 24057 leader_election.cc:336] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.226579 24131 leader_election.cc:336] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.230532 24131 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.206332 24941 consensus_queue.cc:237] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.221395 24881 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:59.232887 24131 leader_election.cc:336] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.233227 24057 leader_election.cc:336] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.233266 24877 raft_consensus.cc:2749] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:59.242537 24057 leader_election.cc:336] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.243536 24057 leader_election.cc:336] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.244161 24057 leader_election.cc:336] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.244915 24057 leader_election.cc:336] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.253011 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:59.254616 24168 raft_consensus.cc:2393] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 2: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:12:59.263502 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:59.267383 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:59.268229 24164 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.247644 24090 raft_consensus.cc:2468] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:12:59.280843 24131 leader_election.cc:304] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.322649 24164 raft_consensus.cc:2468] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:12:59.342984 24950 raft_consensus.cc:493] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.302328 24877 raft_consensus.cc:2804] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:59.346838 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:36367, user_credentials={real_user=slave}} blocked reactor thread for 140144us
W20260709 13:12:59.350113 24131 leader_election.cc:336] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.351166 24131 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.345050 24950 raft_consensus.cc:515] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.352712 24205 leader_election.cc:304] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.341007 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:59.362275 24168 raft_consensus.cc:3060] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.370359 24957 raft_consensus.cc:2749] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.360986 24926 raft_consensus.cc:2749] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.359213 24877 raft_consensus.cc:697] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:12:59.377766 24087 raft_consensus.cc:2468] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 2.
I20260709 13:12:59.378469 24877 consensus_queue.cc:237] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.381649 24168 raft_consensus.cc:2468] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:12:59.345520 24927 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.391456 24159 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22ba00a563f342be8b8432bb050f9cad in current term 3: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
W20260709 13:12:59.398887 24205 leader_election.cc:336] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.401479 24956 log.cc:927] Time spent T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:12:59.404258 24950 leader_election.cc:290] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:12:59.406991 24205 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
W20260709 13:12:59.407604 24131 consensus_peers.cc:597] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.427340 24775 raft_consensus.cc:2804] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.427961 24775 raft_consensus.cc:697] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:59.431010 24775 consensus_queue.cc:237] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.441452 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:12:59.442493 24094 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 411dcd784dc842ecb490506483244223 in current term 3: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:12:59.450717 24240 raft_consensus.cc:1275] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.451494 24881 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:59.454632 24881 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:12:59.455075 24782 consensus_queue.cc:1048] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:59.435412 24927 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:12:59.524317 24205 leader_election.cc:336] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:12:59.526660 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 52756.1us
W20260709 13:12:59.527348 24131 consensus_peers.cc:597] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.527740 24131 leader_election.cc:336] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:12:59.528090 24131 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.547302 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:12:59.548139 24160 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.558849 24945 raft_consensus.cc:2749] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.572779 23913 catalog_manager.cc:5697] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.575462 23913 catalog_manager.cc:5697] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:59.587611 24969 log.cc:927] Time spent T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
W20260709 13:12:59.605162 24205 consensus_peers.cc:597] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.629606 24950 raft_consensus.cc:493] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.631239 24131 consensus_peers.cc:597] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.630903 24950 raft_consensus.cc:515] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.633067 24899 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.599489 23915 catalog_manager.cc:5697] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.633044 24057 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.634512 23915 catalog_manager.cc:5697] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.636615 23915 catalog_manager.cc:5697] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.611040 23914 catalog_manager.cc:5697] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 2 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.640525 24876 raft_consensus.cc:2749] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.665494 24899 tablet_bootstrap.cc:492] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:12:59.671314 24899 ts_tablet_manager.cc:1403] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.486s	user 0.027s	sys 0.017s
I20260709 13:12:59.665181 24057 leader_election.cc:304] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.672915 24782 raft_consensus.cc:2804] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.673520 24782 raft_consensus.cc:697] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:59.675992 24057 leader_election.cc:304] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.680156 24057 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.686956 24950 leader_election.cc:290] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:59.687726 24925 raft_consensus.cc:2804] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.688434 24925 raft_consensus.cc:697] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:12:59.689944 24241 raft_consensus.cc:1275] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.689571 24925 consensus_queue.cc:237] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.714871 24242 raft_consensus.cc:1275] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.714946 24877 consensus_queue.cc:1048] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:12:59.718791 24877 consensus_queue.cc:1048] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:59.693547 24950 raft_consensus.cc:493] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.734257 24782 consensus_queue.cc:237] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:12:59.705425 24923 raft_consensus.cc:2749] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:59.746538 24160 raft_consensus.cc:2468] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 2.
I20260709 13:12:59.780373 24981 raft_consensus.cc:493] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.780665 24899 raft_consensus.cc:359] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:59.781515 24899 raft_consensus.cc:740] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.781183 24981 raft_consensus.cc:515] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.782269 24899 consensus_queue.cc:260] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:59.740541 24950 raft_consensus.cc:515] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.799708 24899 ts_tablet_manager.cc:1434] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.000s
I20260709 13:12:59.801180 24899 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:12:59.815128 24131 consensus_peers.cc:597] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.817965 24057 consensus_peers.cc:597] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.818558 24057 consensus_peers.cc:597] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.830209 24205 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:12:59.861409 24242 raft_consensus.cc:1275] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.861755 24981 leader_election.cc:290] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:59.862416 24981 raft_consensus.cc:493] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.862967 24981 raft_consensus.cc:515] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:12:59.859031 24881 raft_consensus.cc:2804] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.817003 24950 leader_election.cc:290] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:12:59.864256 24881 raft_consensus.cc:697] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:12:59.864717 24950 raft_consensus.cc:493] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.865340 24950 raft_consensus.cc:515] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:12:59.865422 24881 consensus_queue.cc:237] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:12:59.875042 24057 consensus_peers.cc:597] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.875874 24057 consensus_peers.cc:597] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.883576 24057 consensus_peers.cc:597] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.884364 24057 consensus_peers.cc:597] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.886325 24239 raft_consensus.cc:1275] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:59.886716 24057 consensus_peers.cc:597] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:59.887354 24057 consensus_peers.cc:597] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.887822 24057 consensus_peers.cc:597] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:59.888257 24057 consensus_peers.cc:597] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:59.888890 24057 consensus_peers.cc:597] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:59.901832 24205 consensus_peers.cc:597] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.905753 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:59.917197 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:59.918582 24239 raft_consensus.cc:1275] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:59.928522 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:12:59.924032 24925 consensus_queue.cc:1048] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:12:59.913046 24983 consensus_queue.cc:1048] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:12:59.950914 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:12:59.953511 24205 consensus_peers.cc:597] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.958531 24238 raft_consensus.cc:1275] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:59.961820 24131 consensus_peers.cc:597] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.964373 24241 raft_consensus.cc:1275] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:59.964416 24057 consensus_peers.cc:597] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:59.925710 24950 leader_election.cc:290] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:12:59.972781 24057 consensus_peers.cc:597] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:59.991310 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619297e96cc440a391ca25a2d881345e" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:59.996855 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:12:59.994884 24168 raft_consensus.cc:2393] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:13:00.002285 24893 leader_election.cc:304] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
W20260709 13:12:59.996641 24131 consensus_peers.cc:597] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.005004 24131 consensus_peers.cc:597] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:00.005815 24950 raft_consensus.cc:3060] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:00.006114 24131 consensus_peers.cc:597] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.011847 24131 consensus_peers.cc:597] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.014508 24877 consensus_queue.cc:1048] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:00.016076 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:00.016904 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:00.006820 24981 leader_election.cc:290] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
W20260709 13:13:00.003892 24997 log.cc:927] Time spent T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:13:00.009964 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:00.010442 24872 consensus_queue.cc:1048] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:00.006292 24998 log.cc:927] Time spent T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad: Append to log took a long time: real 0.072s	user 0.000s	sys 0.004s
I20260709 13:13:00.031222 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525d514eaa5240e593495ab5fcc122aa" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:00.008798 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc852f89c8f4fafbb28f064daeebdb2" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:00.048293 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:13:00.086055 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 58085.7us
I20260709 13:13:00.074585 24239 raft_consensus.cc:2393] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 2: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:13:00.054857 24876 consensus_queue.cc:1048] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:13:00.103374 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 52542.5us
I20260709 13:13:00.083930 24087 raft_consensus.cc:1275] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.105942 24895 leader_election.cc:304] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:00.108574 24981 raft_consensus.cc:2749] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.109673 24895 leader_election.cc:304] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:13:00.112514 24981 raft_consensus.cc:2749] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.115295 24895 leader_election.cc:304] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:00.116431 24981 raft_consensus.cc:2749] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.121249 24945 consensus_queue.cc:1048] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:00.136089 24094 raft_consensus.cc:1275] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 34a8f98cd2994376ac09a9ce8fcbc487: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:00.145464 24131 consensus_peers.cc:597] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:00.146199 24131 consensus_peers.cc:597] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.145815 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 94683.5us
I20260709 13:13:00.174015 24893 leader_election.cc:304] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:00.175562 24981 raft_consensus.cc:2749] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.152254 24895 leader_election.cc:304] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:00.189057 24981 raft_consensus.cc:3060] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.218724 24899 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.231281 24775 consensus_queue.cc:1048] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:13:00.233562 24899 tablet_bootstrap.cc:492] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:00.235098 24899 ts_tablet_manager.cc:1403] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.434s	user 0.029s	sys 0.008s
W20260709 13:13:00.220870 24895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 87308.7us
W20260709 13:13:00.274120 24131 consensus_peers.cc:597] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:00.274883 24131 consensus_peers.cc:597] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:00.275384 24131 consensus_peers.cc:597] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:00.290418 25018 log.cc:927] Time spent T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:00.305622 24899 raft_consensus.cc:359] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:00.306596 24899 raft_consensus.cc:740] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.298727 24159 raft_consensus.cc:1275] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.309361 24899 consensus_queue.cc:260] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:00.314014 24899 ts_tablet_manager.cc:1434] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:13:00.315182 24899 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:00.356504 24057 consensus_peers.cc:597] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.361714 24981 raft_consensus.cc:2749] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.367689 24950 raft_consensus.cc:2749] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:00.369541 24059 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 46779.3us
I20260709 13:13:00.365360 23915 catalog_manager.cc:5697] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.387912 23915 catalog_manager.cc:5697] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.382834 23914 catalog_manager.cc:5697] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.403251 24925 consensus_queue.cc:1048] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:00.382336 24205 consensus_peers.cc:597] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.415817 23914 catalog_manager.cc:5697] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.425861 23914 catalog_manager.cc:5697] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:00.437619 24205 consensus_peers.cc:597] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:00.438510 24205 consensus_peers.cc:597] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:00.457959 24057 consensus_peers.cc:597] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:00.453467 24950 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.506707 24160 raft_consensus.cc:1275] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:00.507424 24205 consensus_peers.cc:597] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:00.485306 24950 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:00.549327 24950 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:00.552302 24160 raft_consensus.cc:1275] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 34a8f98cd2994376ac09a9ce8fcbc487: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.557546 25009 consensus_queue.cc:1048] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:00.580677 24057 consensus_peers.cc:597] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.582043 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:13:00.588619 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 77777.6us
W20260709 13:13:00.590713 24205 consensus_peers.cc:597] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:00.604401 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:00.615487 24899 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.641155 24973 consensus_queue.cc:1048] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:13:00.646515 24899 tablet_bootstrap.cc:492] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:00.647682 24899 ts_tablet_manager.cc:1403] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.333s	user 0.023s	sys 0.013s
I20260709 13:13:00.632565 24895 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
W20260709 13:13:00.661923 24057 consensus_peers.cc:597] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:00.663280 24205 consensus_peers.cc:597] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:00.663947 24950 raft_consensus.cc:2749] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:00.676414 23913 catalog_manager.cc:5697] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 1 to 2, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 2 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.720969 24899 raft_consensus.cc:359] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:00.721976 24899 raft_consensus.cc:740] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.723331 24899 consensus_queue.cc:260] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:00.725943 24899 ts_tablet_manager.cc:1434] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.001s
I20260709 13:13:00.726941 24899 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:00.775735 24950 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.776620 24950 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:00.809783 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:13:00.814152 24087 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 3: Already voted for candidate 22ba00a563f342be8b8432bb050f9cad in this term.
I20260709 13:13:00.826195 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:13:00.826953 24869 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.827378 24159 raft_consensus.cc:2393] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 719fbcf5b03f4c428371a3bcd9bbb15d in current term 3: Already voted for candidate 411dcd784dc842ecb490506483244223 in this term.
I20260709 13:13:00.827708 24869 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:00.830144 24869 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:00.822778 24950 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:00.842945 24893 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223
I20260709 13:13:00.844174 24950 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.849582 24899 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.850832 24899 tablet_bootstrap.cc:492] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:00.850454 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:13:00.851704 24899 ts_tablet_manager.cc:1403] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.008s
I20260709 13:13:00.851558 24087 raft_consensus.cc:2468] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 2.
I20260709 13:13:00.856756 24899 raft_consensus.cc:359] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:00.857697 24899 raft_consensus.cc:740] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.858601 24899 consensus_queue.cc:260] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:00.890998 24899 ts_tablet_manager.cc:1434] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.039s	user 0.016s	sys 0.000s
I20260709 13:13:00.891894 24205 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:13:00.892418 24899 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:00.893005 25008 raft_consensus.cc:2804] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:00.893487 25008 raft_consensus.cc:493] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.893936 25008 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.919881 24950 raft_consensus.cc:2749] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:00.929905 24205 leader_election.cc:336] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:13:00.904232 25008 raft_consensus.cc:515] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:00.959997 25008 leader_election.cc:290] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:00.964268 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566862ace4e445a998adbca005d9316b" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:00.967165 24090 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:00.977558 24090 raft_consensus.cc:2468] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 3.
I20260709 13:13:00.980573 24899 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.985641 24205 leader_election.cc:304] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 
I20260709 13:13:00.986640 25017 raft_consensus.cc:2804] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:00.987142 24899 tablet_bootstrap.cc:492] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:00.987239 25017 raft_consensus.cc:697] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:13:00.988197 24899 ts_tablet_manager.cc:1403] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.096s	user 0.025s	sys 0.002s
I20260709 13:13:00.988498 25017 consensus_queue.cc:237] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:00.991699 24899 raft_consensus.cc:359] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:00.992611 24899 raft_consensus.cc:740] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.993562 24899 consensus_queue.cc:260] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
W20260709 13:13:00.994030 24205 leader_election.cc:336] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:13:00.996446 24899 ts_tablet_manager.cc:1434] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:00.997716 24899 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:01.036247 24950 raft_consensus.cc:493] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.037909 24950 raft_consensus.cc:515] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:01.045264 24950 leader_election.cc:290] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:13:01.046581 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:01.042750 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a7e71c709e4b1096bce054322ed8dd" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:13:01.063910 24895 leader_election.cc:304] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223
I20260709 13:13:01.067402 24950 raft_consensus.cc:2749] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.072088 24899 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.077946 24899 tablet_bootstrap.cc:492] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:01.078909 24899 ts_tablet_manager.cc:1403] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.082s	user 0.041s	sys 0.011s
I20260709 13:13:01.090159 24899 raft_consensus.cc:359] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.093865 24899 raft_consensus.cc:740] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.101713 24899 consensus_queue.cc:260] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.095243 23915 catalog_manager.cc:5697] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 1 to 3, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 3 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.104622 24899 ts_tablet_manager.cc:1434] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:13:01.106269 24899 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:01.152886 24899 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.154187 24899 tablet_bootstrap.cc:492] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:01.155016 24899 ts_tablet_manager.cc:1403] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.012s
I20260709 13:13:01.158214 24899 raft_consensus.cc:359] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:01.159032 24899 raft_consensus.cc:740] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.180783 24899 consensus_queue.cc:260] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:01.183555 24899 ts_tablet_manager.cc:1434] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:13:01.184887 24899 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:01.195468 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:35647
I20260709 13:13:01.195602 25070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:35647 every 8 connection(s)
I20260709 13:13:01.249264 24899 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.262650 24899 tablet_bootstrap.cc:492] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:01.263634 24899 ts_tablet_manager.cc:1403] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.003s
I20260709 13:13:01.281294 24923 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.282013 24923 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.283530 24899 raft_consensus.cc:359] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.284441 24899 raft_consensus.cc:740] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.284533 24923 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:01.286952 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:13:01.287809 24159 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 3.
I20260709 13:13:01.292683 24057 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:01.294011 24923 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:01.294649 24923 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.285286 24899 consensus_queue.cc:260] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.295032 24923 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.297698 24899 ts_tablet_manager.cc:1434] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:13:01.299117 24899 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:01.339135 25039 raft_consensus.cc:3060] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.353116 24899 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.354827 24899 tablet_bootstrap.cc:492] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:01.355638 24899 ts_tablet_manager.cc:1403] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.008s
I20260709 13:13:01.371079 25030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:13:01.372000 25030 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 3.
I20260709 13:13:01.374814 25030 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.382349 24923 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.396060 24941 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.397322 24941 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.400012 25025 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.402411 25019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
I20260709 13:13:01.402455 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223" is_pre_election: true
I20260709 13:13:01.403568 25019 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 1.
I20260709 13:13:01.403654 24161 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:13:01.400045 24941 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:01.409168 24057 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:01.410704 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:01.411473 24159 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.415827 25019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:13:01.416133 24876 raft_consensus.cc:2804] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:01.416764 24876 raft_consensus.cc:493] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.416826 25019 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:01.417261 24876 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.407730 24923 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 4 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:01.427559 24899 raft_consensus.cc:359] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.428619 24899 raft_consensus.cc:740] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.429512 24899 consensus_queue.cc:260] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.431952 25072 heartbeater.cc:344] Connected to a master server at 127.13.196.126:42321
I20260709 13:13:01.432623 25072 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:01.433807 25072 heartbeater.cc:507] Master 127.13.196.126:42321 requested a full tablet report, sending...
I20260709 13:13:01.433697 24159 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 4.
I20260709 13:13:01.432221 24899 ts_tablet_manager.cc:1434] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:13:01.439941 24899 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:01.455063 25019 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 4.
I20260709 13:13:01.447808 24876 raft_consensus.cc:515] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.457548 24057 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:01.459504 24876 leader_election.cc:290] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:01.459115 24923 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:01.460453 24923 raft_consensus.cc:697] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:01.461714 24923 consensus_queue.cc:237] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.469935 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:01.472681 24159 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.474188 25014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7813bb792671456d923416caa83dba55" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:13:01.475127 25014 raft_consensus.cc:3060] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.490065 24159 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 3.
I20260709 13:13:01.508080 24091 raft_consensus.cc:1275] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Refusing update from remote peer 34a8f98cd2994376ac09a9ce8fcbc487: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:01.510007 25008 consensus_queue.cc:1048] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:01.511946 25014 raft_consensus.cc:2468] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 3.
I20260709 13:13:01.517500 24057 leader_election.cc:304] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:01.520828 24923 raft_consensus.cc:2804] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:01.521811 24923 raft_consensus.cc:697] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 3 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:01.522887 24923 consensus_queue.cc:237] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.519735 24944 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.526254 24944 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:01.526021 23915 catalog_manager.cc:5697] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 2 to 4, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 4 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.529286 24944 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:01.534854 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:13:01.535804 24090 raft_consensus.cc:2468] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:13:01.539296 24131 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:01.540395 25080 raft_consensus.cc:2804] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:01.540881 25080 raft_consensus.cc:493] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.541244 25080 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:01.542131 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" is_pre_election: true
W20260709 13:13:01.550033 24131 leader_election.cc:343] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:01.608614 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 48663.8us
I20260709 13:13:01.629354 25039 raft_consensus.cc:3060] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.612543 25080 raft_consensus.cc:515] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:13:01.701989 24133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 65258.7us
W20260709 13:13:01.752310 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 109847us
W20260709 13:13:01.792579 25094 log.cc:927] Time spent T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:13:01.815949 24950 raft_consensus.cc:493] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.856067 24899 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.895571 24899 tablet_bootstrap.cc:492] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:01.896865 24899 ts_tablet_manager.cc:1403] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.457s	user 0.031s	sys 0.015s
I20260709 13:13:01.874284 24950 raft_consensus.cc:515] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:01.912369 24899 raft_consensus.cc:359] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:01.913736 24899 raft_consensus.cc:740] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
W20260709 13:13:01.904757 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:35647, user_credentials={real_user=slave}} blocked reactor thread for 145982us
I20260709 13:13:01.903151 25080 leader_election.cc:290] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 election: Requested vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:01.923610 24899 consensus_queue.cc:260] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:01.927171 24899 ts_tablet_manager.cc:1434] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:13:01.928328 24899 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:01.973625 24205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:33929, user_credentials={real_user=slave}} blocked reactor thread for 47782.9us
I20260709 13:13:01.973809 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:02.034183 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:02.011166 24090 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.039067 24950 leader_election.cc:290] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:02.047407 25114 raft_consensus.cc:493] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.072773 24205 consensus_peers.cc:597] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.090113 25034 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.073838 25114 raft_consensus.cc:515] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:02.110196 25114 leader_election.cc:290] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:02.113106 24090 raft_consensus.cc:2468] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 3.
I20260709 13:13:02.117450 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:02.116060 25114 raft_consensus.cc:493] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.129056 25114 raft_consensus.cc:515] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:02.131587 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b526e669ce164ea79b4d5b5132eac617" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
I20260709 13:13:02.135419 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:02.140131 25114 leader_election.cc:290] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:02.142251 25014 raft_consensus.cc:1275] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 4 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:13:02.150327 24133 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.68:40339, user_credentials={real_user=slave}} blocked reactor thread for 411905us
I20260709 13:13:02.168246 25012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77236aeb1698485ebbe657a40d6f6d72" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
I20260709 13:13:02.201120 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f402838ece44ca68fc177563a3827af" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:13:02.202353 24057 consensus_peers.cc:597] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:02.203187 24057 consensus_peers.cc:597] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.203770 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437f3547914b45e2a61c419bdd3fe09f" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22ba00a563f342be8b8432bb050f9cad" is_pre_election: true
W20260709 13:13:02.207242 24057 consensus_peers.cc:597] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.208251 24923 consensus_queue.cc:1048] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.211133 24893 leader_election.cc:304] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:02.212146 25114 raft_consensus.cc:2749] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.215579 24131 leader_election.cc:304] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:02.219836 24893 leader_election.cc:304] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:02.221572 24893 leader_election.cc:304] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 22ba00a563f342be8b8432bb050f9cad, 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:02.222468 25125 raft_consensus.cc:2749] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.223272 25125 raft_consensus.cc:2749] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:02.243108 24057 consensus_peers.cc:597] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:02.247431 25097 raft_consensus.cc:2804] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:02.248212 25097 raft_consensus.cc:697] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 3 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:13:02.249060 25004 raft_consensus.cc:1275] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:02.249212 25097 consensus_queue.cc:237] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:02.250674 23915 catalog_manager.cc:5697] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 3, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 3 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.255139 25083 consensus_queue.cc:1048] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.276563 23914 ts_manager.cc:194] Re-registered known tserver with Master: 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:13:02.296211 24160 raft_consensus.cc:1275] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:02.307137 24899 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.308424 24899 tablet_bootstrap.cc:492] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.310209 24160 raft_consensus.cc:1275] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 4 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:13:02.309237 24899 ts_tablet_manager.cc:1403] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.381s	user 0.009s	sys 0.017s
I20260709 13:13:02.315753 24899 raft_consensus.cc:359] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:02.316716 24899 raft_consensus.cc:740] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.317617 24899 consensus_queue.cc:260] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:02.320282 24899 ts_tablet_manager.cc:1434] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:02.319782 23913 catalog_manager.cc:5697] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 3, leader changed from 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 3 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:02.321376 24899 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:02.393584 24131 consensus_peers.cc:597] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:02.393721 24899 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.395018 24899 tablet_bootstrap.cc:492] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.396116 24899 ts_tablet_manager.cc:1403] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.031s
W20260709 13:13:02.402062 24131 leader_election.cc:343] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.402267 24899 raft_consensus.cc:359] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:02.403088 24899 raft_consensus.cc:740] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.404009 24899 consensus_queue.cc:260] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:13:02.405645 24131 consensus_peers.cc:597] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.406391 24899 ts_tablet_manager.cc:1434] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:02.407366 24899 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:02.409482 24131 consensus_peers.cc:597] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:02.434005 24205 consensus_peers.cc:597] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.435282 25111 consensus_queue.cc:1048] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.440557 25111 consensus_queue.cc:1048] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.441740 24899 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.443020 24899 tablet_bootstrap.cc:492] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.443861 24899 ts_tablet_manager.cc:1403] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.003s
I20260709 13:13:02.447602 24899 raft_consensus.cc:359] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:02.448503 24899 raft_consensus.cc:740] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.455132 24899 consensus_queue.cc:260] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:02.457841 24899 ts_tablet_manager.cc:1434] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:13:02.458948 24899 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:02.466023 23914 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39392
I20260709 13:13:02.475657 25072 heartbeater.cc:499] Master 127.13.196.126:42321 was elected leader, sending a full tablet report...
I20260709 13:13:02.510526 25034 raft_consensus.cc:3060] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:02.518095 24131 consensus_peers.cc:597] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:02.521600 24131 consensus_peers.cc:597] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:02.534901 24131 consensus_peers.cc:597] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:02.579411 24057 consensus_peers.cc:597] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.599212 24899 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.600386 24899 tablet_bootstrap.cc:492] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.601121 24899 ts_tablet_manager.cc:1403] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.142s	user 0.032s	sys 0.028s
I20260709 13:13:02.609251 24899 raft_consensus.cc:359] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:02.610215 24899 raft_consensus.cc:740] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.611109 24899 consensus_queue.cc:260] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
W20260709 13:13:02.611470 24205 consensus_peers.cc:597] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.637729 24899 ts_tablet_manager.cc:1434] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:13:02.641670 24899 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:02.647482 24057 consensus_peers.cc:597] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:02.693009 24131 consensus_peers.cc:597] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.721318 24899 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.722637 24899 tablet_bootstrap.cc:492] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.723484 24899 ts_tablet_manager.cc:1403] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.082s	user 0.031s	sys 0.013s
I20260709 13:13:02.726557 24899 raft_consensus.cc:359] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:02.727344 24899 raft_consensus.cc:740] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.728168 24899 consensus_queue.cc:260] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:02.737854 24899 ts_tablet_manager.cc:1434] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:13:02.738963 24899 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:02.769893 24899 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.770826 24899 tablet_bootstrap.cc:492] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.771492 24899 ts_tablet_manager.cc:1403] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.016s
I20260709 13:13:02.774524 24899 raft_consensus.cc:359] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:02.775413 24899 raft_consensus.cc:740] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.776131 24899 consensus_queue.cc:260] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:02.778822 24899 ts_tablet_manager.cc:1434] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:02.779794 24899 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:02.794929 24091 raft_consensus.cc:1275] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:02.798012 25113 consensus_queue.cc:1048] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.819105 24899 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.821449 24899 tablet_bootstrap.cc:492] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.822286 24899 ts_tablet_manager.cc:1403] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.005s
I20260709 13:13:02.827674 24899 raft_consensus.cc:359] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:02.828548 24899 raft_consensus.cc:740] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.829535 24899 consensus_queue.cc:260] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
W20260709 13:13:02.831044 24131 consensus_peers.cc:597] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:02.847416 24205 consensus_peers.cc:597] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.832211 24899 ts_tablet_manager.cc:1434] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:13:02.849216 24899 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:02.877916 24057 consensus_peers.cc:597] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:02.946605 24899 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:02.947861 24899 tablet_bootstrap.cc:492] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:02.948717 24899 ts_tablet_manager.cc:1403] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.010s
I20260709 13:13:02.951696 24899 raft_consensus.cc:359] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:02.952495 24899 raft_consensus.cc:740] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.953310 24899 consensus_queue.cc:260] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:02.956599 24899 ts_tablet_manager.cc:1434] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:02.961952 24899 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.026005 24899 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.027243 24899 tablet_bootstrap.cc:492] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.028112 24899 ts_tablet_manager.cc:1403] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.008s
I20260709 13:13:03.031430 24899 raft_consensus.cc:359] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.032217 24899 raft_consensus.cc:740] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.033041 24899 consensus_queue.cc:260] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.035601 24899 ts_tablet_manager.cc:1434] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:03.036639 24899 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.081928 24899 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.083228 24899 tablet_bootstrap.cc:492] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.084199 24899 ts_tablet_manager.cc:1403] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.016s
I20260709 13:13:03.087170 24899 raft_consensus.cc:359] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.087762 24899 raft_consensus.cc:740] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.088327 24899 consensus_queue.cc:260] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.090987 24899 ts_tablet_manager.cc:1434] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:03.092410 24899 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.113903 24899 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.115178 24899 tablet_bootstrap.cc:492] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.115918 24899 ts_tablet_manager.cc:1403] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:13:03.118593 24899 raft_consensus.cc:359] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.119215 24899 raft_consensus.cc:740] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.120131 24899 consensus_queue.cc:260] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.122365 24899 ts_tablet_manager.cc:1434] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:03.123914 24899 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.134302 25014 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.147431 24899 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.148845 24899 tablet_bootstrap.cc:492] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.149788 24899 ts_tablet_manager.cc:1403] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 13:13:03.155750 24899 raft_consensus.cc:359] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.156642 24899 raft_consensus.cc:740] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.157553 24899 consensus_queue.cc:260] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.163609 24899 ts_tablet_manager.cc:1434] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:03.164727 24899 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:03.190325 24205 consensus_peers.cc:597] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:03.190778 24899 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.191728 25014 raft_consensus.cc:3060] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.192471 24899 tablet_bootstrap.cc:492] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.193378 24899 ts_tablet_manager.cc:1403] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.007s
I20260709 13:13:03.196498 24899 raft_consensus.cc:359] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.197270 24899 raft_consensus.cc:740] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.198167 24899 consensus_queue.cc:260] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.201491 24899 ts_tablet_manager.cc:1434] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:03.202525 24899 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
W20260709 13:13:03.231652 24131 consensus_peers.cc:597] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:03.242429 24899 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.243711 24899 tablet_bootstrap.cc:492] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.244616 24899 ts_tablet_manager.cc:1403] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.015s
I20260709 13:13:03.249305 24899 raft_consensus.cc:359] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.250133 24899 raft_consensus.cc:740] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.251029 24899 consensus_queue.cc:260] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.253335 24899 ts_tablet_manager.cc:1434] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:03.254285 24899 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.277714 24899 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.280095 24899 tablet_bootstrap.cc:492] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.281052 24899 ts_tablet_manager.cc:1403] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 13:13:03.285044 24899 raft_consensus.cc:359] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.285832 24899 raft_consensus.cc:740] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.286841 24899 consensus_queue.cc:260] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.291986 25014 raft_consensus.cc:3060] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.293736 24899 ts_tablet_manager.cc:1434] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:03.294879 24899 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.325863 24899 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.326947 24899 tablet_bootstrap.cc:492] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.327756 24899 ts_tablet_manager.cc:1403] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.005s
I20260709 13:13:03.330788 24899 raft_consensus.cc:359] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.331429 24899 raft_consensus.cc:740] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.332054 24899 consensus_queue.cc:260] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.334797 24899 ts_tablet_manager.cc:1434] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:13:03.335727 24899 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.353907 24899 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.354914 24899 tablet_bootstrap.cc:492] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.355587 24899 ts_tablet_manager.cc:1403] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:13:03.358078 24899 raft_consensus.cc:359] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.358834 24899 raft_consensus.cc:740] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.359529 24899 consensus_queue.cc:260] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.361816 24899 ts_tablet_manager.cc:1434] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:13:03.363066 24899 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.375765 25014 raft_consensus.cc:3060] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.375764 25039 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.386902 24899 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.387923 24899 tablet_bootstrap.cc:492] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.388749 24899 ts_tablet_manager.cc:1403] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.003s
I20260709 13:13:03.391739 24899 raft_consensus.cc:359] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.392541 24899 raft_consensus.cc:740] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.393253 24899 consensus_queue.cc:260] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.395538 24899 ts_tablet_manager.cc:1434] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:03.402208 24899 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.431252 25039 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.432472 24899 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.433663 24899 tablet_bootstrap.cc:492] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.434458 24899 ts_tablet_manager.cc:1403] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 13:13:03.437500 24899 raft_consensus.cc:359] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.438258 24899 raft_consensus.cc:740] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.439000 24899 consensus_queue.cc:260] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.441411 24899 ts_tablet_manager.cc:1434] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:03.442507 24899 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.465996 24899 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.467193 24899 tablet_bootstrap.cc:492] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.468019 24899 ts_tablet_manager.cc:1403] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.001s
I20260709 13:13:03.470984 24899 raft_consensus.cc:359] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.471745 24899 raft_consensus.cc:740] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.472894 24899 consensus_queue.cc:260] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.474783 24899 ts_tablet_manager.cc:1434] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:03.478360 24899 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.499990 24899 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.501071 24899 tablet_bootstrap.cc:492] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.501858 24899 ts_tablet_manager.cc:1403] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:13:03.504709 24899 raft_consensus.cc:359] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.505535 24899 raft_consensus.cc:740] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.506211 24899 consensus_queue.cc:260] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.508008 24899 ts_tablet_manager.cc:1434] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:03.509826 24899 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.537673 24899 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.538894 24899 tablet_bootstrap.cc:492] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.539758 24899 ts_tablet_manager.cc:1403] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.006s
I20260709 13:13:03.542800 24899 raft_consensus.cc:359] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.543658 24899 raft_consensus.cc:740] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.544930 24899 consensus_queue.cc:260] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.547434 24899 ts_tablet_manager.cc:1434] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:13:03.549137 24899 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.596299 24899 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.597012 25004 raft_consensus.cc:3060] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.597417 24899 tablet_bootstrap.cc:492] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.598281 24899 ts_tablet_manager.cc:1403] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.026s
I20260709 13:13:03.602173 24899 raft_consensus.cc:359] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.604594 24899 raft_consensus.cc:740] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.605417 24899 consensus_queue.cc:260] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.607713 24899 ts_tablet_manager.cc:1434] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:03.609951 24899 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.635438 24899 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.636427 24899 tablet_bootstrap.cc:492] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.637193 24899 ts_tablet_manager.cc:1403] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:13:03.639799 24899 raft_consensus.cc:359] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.640442 24899 raft_consensus.cc:740] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.641213 24899 consensus_queue.cc:260] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:03.643239 24899 ts_tablet_manager.cc:1434] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:03.644085 24899 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.659919 25004 raft_consensus.cc:3060] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:03.678416 24899 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.679570 24899 tablet_bootstrap.cc:492] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.680243 24899 ts_tablet_manager.cc:1403] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.008s
I20260709 13:13:03.683492 24899 raft_consensus.cc:359] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.684262 24899 raft_consensus.cc:740] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.685166 24899 consensus_queue.cc:260] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.690205 24899 ts_tablet_manager.cc:1434] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:03.691228 24899 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.713613 24899 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.714717 24899 tablet_bootstrap.cc:492] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.715508 24899 ts_tablet_manager.cc:1403] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:13:03.718401 24899 raft_consensus.cc:359] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.719156 24899 raft_consensus.cc:740] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.719832 24899 consensus_queue.cc:260] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:03.722074 24899 ts_tablet_manager.cc:1434] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:03.723443 24899 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap starting.
I20260709 13:13:03.757768 24899 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:03.758978 24899 tablet_bootstrap.cc:492] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Bootstrap complete.
I20260709 13:13:03.759799 24899 ts_tablet_manager.cc:1403] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.004s
I20260709 13:13:03.762801 24899 raft_consensus.cc:359] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.763537 24899 raft_consensus.cc:740] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.764452 24899 consensus_queue.cc:260] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:03.766233 24899 ts_tablet_manager.cc:1434] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:13:11.269320 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:11.353875 24090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20a307a7186f4c828e6851401a78c276"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "411dcd784dc842ecb490506483244223"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:11.354848 24090 raft_consensus.cc:606] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Received request to transfer leadership to TS 411dcd784dc842ecb490506483244223
I20260709 13:13:11.359560 24090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:11.360291 24090 raft_consensus.cc:606] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Received request to transfer leadership to TS 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:11.382828 24239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "998f8cd3c00740049cb50291b59df964"
dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:53828
I20260709 13:13:11.383585 24239 raft_consensus.cc:606] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:11.401259 24168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b"
dest_uuid: "411dcd784dc842ecb490506483244223"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:44614
I20260709 13:13:11.402027 24168 raft_consensus.cc:606] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:11.407488 24087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:11.408119 24087 raft_consensus.cc:606] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:11.411273 24087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:11.412003 24087 raft_consensus.cc:606] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:11.414958 24087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:11.415570 24087 raft_consensus.cc:606] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:11.417110 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:13:11.419278 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:11.498442 25206 raft_consensus.cc:993] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.499210 25215 raft_consensus.cc:1081] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.501406 25014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "998f8cd3c00740049cb50291b59df964"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41436
I20260709 13:13:11.502063 25014 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.502458 25014 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.510807 25014 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:11.513379 25014 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:13:11.515062 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:11.515067 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:11.516254 24239 raft_consensus.cc:3055] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.516667 24239 raft_consensus.cc:740] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:13:11.516744 24160 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.517663 24239 consensus_queue.cc:260] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:11.519451 24239 raft_consensus.cc:3060] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.526464 24160 raft_consensus.cc:2468] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:11.529560 24893 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:11.530614 24239 raft_consensus.cc:2468] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:11.534200 25216 raft_consensus.cc:2804] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.537181 25216 raft_consensus.cc:697] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:11.538359 25216 consensus_queue.cc:237] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:11.559168 23913 catalog_manager.cc:5697] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 2 to 3, leader changed from 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 3 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.630446 25127 raft_consensus.cc:993] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 34a8f98cd2994376ac09a9ce8fcbc487 to start an election
I20260709 13:13:11.631017 25127 raft_consensus.cc:1081] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Signalling peer 34a8f98cd2994376ac09a9ce8fcbc487 to start an election
I20260709 13:13:11.632972 24242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72"
dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
 from {username='slave'} at 127.0.0.1:56334
I20260709 13:13:11.633648 24242 raft_consensus.cc:493] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.634006 24242 raft_consensus.cc:3060] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.643707 24242 raft_consensus.cc:515] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:11.646026 24242 leader_election.cc:290] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:11.646939 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:11.647329 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c5d2e9bae44e1cbc8eb9673d4e7b72" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:11.647751 24087 raft_consensus.cc:3055] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.647974 24168 raft_consensus.cc:3060] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.648130 24087 raft_consensus.cc:740] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:11.649139 24087 consensus_queue.cc:260] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:11.650719 24087 raft_consensus.cc:3060] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.658526 24168 raft_consensus.cc:2468] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 2.
I20260709 13:13:11.660115 24205 leader_election.cc:304] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:11.660952 24087 raft_consensus.cc:2468] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 2.
I20260709 13:13:11.661085 25215 raft_consensus.cc:2804] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.661818 25215 raft_consensus.cc:697] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:13:11.662882 25215 consensus_queue.cc:237] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:11.672710 25127 raft_consensus.cc:993] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.673471 25127 raft_consensus.cc:1081] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.675885 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:11.676636 25039 raft_consensus.cc:493] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.677026 25039 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.678748 25213 raft_consensus.cc:993] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.679314 25213 raft_consensus.cc:1081] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.679507 23913 catalog_manager.cc:5697] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 1 to 2, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 2 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.684685 25014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:11.685711 25014 raft_consensus.cc:493] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.686133 25014 raft_consensus.cc:3060] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.686450 25039 raft_consensus.cc:515] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.688560 25039 leader_election.cc:290] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:11.689975 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:11.690686 24160 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.702847 24160 raft_consensus.cc:2468] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:11.703698 25014 raft_consensus.cc:515] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.704669 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f7273b2a634d919bc68a4cad26f668" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:11.705415 24087 raft_consensus.cc:3055] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.705427 24893 leader_election.cc:304] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:11.705858 24087 raft_consensus.cc:740] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:11.706050 25014 leader_election.cc:290] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:11.707222 25216 raft_consensus.cc:2804] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.707015 24087 consensus_queue.cc:260] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.707743 25216 raft_consensus.cc:697] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:11.708869 25216 consensus_queue.cc:237] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.712842 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:11.713559 24168 raft_consensus.cc:3060] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.708602 24087 raft_consensus.cc:3060] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.723182 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20bd0670e6e43e3a412db4836eacf00" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:11.723971 24090 raft_consensus.cc:3055] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.724130 24168 raft_consensus.cc:2468] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:11.724309 24090 raft_consensus.cc:740] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:11.725553 24090 consensus_queue.cc:260] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.725821 24893 leader_election.cc:304] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:11.726375 24087 raft_consensus.cc:2468] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:11.727167 24090 raft_consensus.cc:3060] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.727221 25216 raft_consensus.cc:2804] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.727962 25216 raft_consensus.cc:697] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:11.729040 25216 consensus_queue.cc:237] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.738765 24090 raft_consensus.cc:2468] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:11.742856 23915 catalog_manager.cc:5697] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 2 to 3, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 3 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.766780 23915 catalog_manager.cc:5697] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 1 to 2, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.784371 25213 raft_consensus.cc:993] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 411dcd784dc842ecb490506483244223 to start an election
I20260709 13:13:11.785168 25207 raft_consensus.cc:1081] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Signalling peer 411dcd784dc842ecb490506483244223 to start an election
I20260709 13:13:11.787138 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20a307a7186f4c828e6851401a78c276"
dest_uuid: "411dcd784dc842ecb490506483244223"
 from {username='slave'} at 127.0.0.1:44010
I20260709 13:13:11.787806 24168 raft_consensus.cc:493] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.788779 24168 raft_consensus.cc:3060] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.795962 24168 raft_consensus.cc:515] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:11.799388 24168 leader_election.cc:290] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:13:11.801604 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:11.802277 24090 raft_consensus.cc:3055] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.802618 24090 raft_consensus.cc:740] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:11.802875 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a307a7186f4c828e6851401a78c276" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:11.803634 24239 raft_consensus.cc:3060] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.803540 24090 consensus_queue.cc:260] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:11.805364 24090 raft_consensus.cc:3060] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.819408 24090 raft_consensus.cc:2468] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:13:11.821331 24131 leader_election.cc:304] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:11.822528 25208 raft_consensus.cc:2804] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.823092 25208 raft_consensus.cc:697] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Becoming Leader. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:13:11.824075 25208 consensus_queue.cc:237] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:11.831664 24239 raft_consensus.cc:2468] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 411dcd784dc842ecb490506483244223 in term 2.
I20260709 13:13:11.843458 23915 catalog_manager.cc:5697] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 reported cstate change: term changed from 1 to 2, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 411dcd784dc842ecb490506483244223 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "411dcd784dc842ecb490506483244223" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.874910 25227 raft_consensus.cc:993] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.875787 25227 raft_consensus.cc:1081] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.879185 25034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41426
I20260709 13:13:11.880100 25034 raft_consensus.cc:493] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.880579 25034 raft_consensus.cc:3060] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.911675 25034 raft_consensus.cc:515] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:11.914358 25034 leader_election.cc:290] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:11.915246 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:11.915983 24168 raft_consensus.cc:3055] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.916306 24168 raft_consensus.cc:740] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:13:11.917411 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4fbad4af3f44d4fb97dfaca23e0e07b" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:11.917335 24168 consensus_queue.cc:260] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:11.918063 24087 raft_consensus.cc:3060] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.918586 24168 raft_consensus.cc:3060] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.930190 24168 raft_consensus.cc:2468] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:11.934413 24087 raft_consensus.cc:2468] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:11.935408 24893 leader_election.cc:304] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:11.938603 25216 raft_consensus.cc:2804] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.939200 25216 raft_consensus.cc:697] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:11.940513 25216 consensus_queue.cc:237] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:11.950276 24160 raft_consensus.cc:1275] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:11.953065 25217 consensus_queue.cc:1048] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:11.953855 25127 raft_consensus.cc:993] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.954659 25127 raft_consensus.cc:1081] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:11.957554 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:11.958329 25039 raft_consensus.cc:493] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.959385 25039 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.969982 25039 raft_consensus.cc:515] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.972633 25039 leader_election.cc:290] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 5 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:11.977926 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:11.978921 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fde7706e764fa8bcd5109c6e23f970" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:11.979781 24168 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.978456 23915 catalog_manager.cc:5697] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 1 to 2, leader changed from 411dcd784dc842ecb490506483244223 (127.13.196.67) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.979827 24087 raft_consensus.cc:3055] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:11.980787 24087 raft_consensus.cc:740] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:11.986972 24242 raft_consensus.cc:1275] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:11.983078 24087 consensus_queue.cc:260] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:11.991721 24087 raft_consensus.cc:3060] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:11.993764 25216 consensus_queue.cc:1048] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:11.992864 24168 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 5.
I20260709 13:13:11.996726 24893 leader_election.cc:304] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:11.997622 25216 raft_consensus.cc:2804] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:11.998481 25216 raft_consensus.cc:697] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 5 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:11.999483 25216 consensus_queue.cc:237] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:12.002641 24087 raft_consensus.cc:2468] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 5.
I20260709 13:13:12.033725 23915 catalog_manager.cc:5697] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 4 to 5, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 5 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.108067 24160 raft_consensus.cc:1275] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.109905 25216 consensus_queue.cc:1048] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.130784 24087 raft_consensus.cc:1275] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.141088 25217 consensus_queue.cc:1048] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.173100 24160 raft_consensus.cc:1275] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 34a8f98cd2994376ac09a9ce8fcbc487: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.174628 25206 consensus_queue.cc:1048] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.177573 24087 raft_consensus.cc:1275] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 34a8f98cd2994376ac09a9ce8fcbc487: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.180972 25206 consensus_queue.cc:1048] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.268719 24242 raft_consensus.cc:1275] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.270519 25198 consensus_queue.cc:1048] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.286793 24090 raft_consensus.cc:1275] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 411dcd784dc842ecb490506483244223: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.288846 25228 consensus_queue.cc:1048] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.305780 24160 raft_consensus.cc:1275] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.308244 25234 consensus_queue.cc:1048] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.312758 24090 raft_consensus.cc:1275] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.316219 25234 consensus_queue.cc:1048] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.390044 24090 raft_consensus.cc:1275] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.391469 25234 consensus_queue.cc:1048] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.406196 24168 raft_consensus.cc:1275] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.410283 25216 consensus_queue.cc:1048] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.420459 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:12.486652 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:12.517478 24090 raft_consensus.cc:1275] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 5 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:12.519142 25216 consensus_queue.cc:1048] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.535418 24164 raft_consensus.cc:1275] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 5 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:13:12.543617 25217 consensus_queue.cc:1048] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:12.544927 24087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:12.545632 24087 raft_consensus.cc:606] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:12.573422 25213 raft_consensus.cc:993] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.574069 25213 raft_consensus.cc:1081] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.575992 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:12.576658 25039 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.577047 25039 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.584830 24168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cdc73b179344810934aee531a69b292"
dest_uuid: "411dcd784dc842ecb490506483244223"
mode: GRACEFUL
new_leader_uuid: "22ba00a563f342be8b8432bb050f9cad"
 from {username='slave'} at 127.0.0.1:44614
I20260709 13:13:12.585762 24168 raft_consensus.cc:606] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Received request to transfer leadership to TS 22ba00a563f342be8b8432bb050f9cad
I20260709 13:13:12.590971 25039 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.591903 24090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:12.592572 24090 raft_consensus.cc:606] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:12.593730 25039 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:12.594818 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:12.595590 24239 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.599285 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cd52e84d46949fd9d8789814378866c" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:12.599974 24242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660"
dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:53828
I20260709 13:13:12.600081 24090 raft_consensus.cc:3055] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.600710 24090 raft_consensus.cc:740] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:12.600777 24242 raft_consensus.cc:606] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:12.601799 24090 consensus_queue.cc:260] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.603257 24090 raft_consensus.cc:3060] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.603626 24239 raft_consensus.cc:2468] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:12.604497 24087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:12.605157 24087 raft_consensus.cc:606] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:12.605094 24895 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:12.606304 25217 raft_consensus.cc:2804] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.606998 25217 raft_consensus.cc:697] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:12.608108 25217 consensus_queue.cc:237] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.608982 24087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1a25f18b7864945a89a86966153a568"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:12.609615 24087 raft_consensus.cc:606] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:12.614454 24091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:12.615154 24091 raft_consensus.cc:606] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:12.618709 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:13:12.620011 25228 raft_consensus.cc:993] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223: : Instructing follower 22ba00a563f342be8b8432bb050f9cad to start an election
I20260709 13:13:12.620671 25228 raft_consensus.cc:1081] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Signalling peer 22ba00a563f342be8b8432bb050f9cad to start an election
I20260709 13:13:12.621212 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:12.621358 24090 raft_consensus.cc:2468] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:12.623072 24090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cdc73b179344810934aee531a69b292"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
 from {username='slave'} at 127.0.0.1:59954
I20260709 13:13:12.623870 24090 raft_consensus.cc:493] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.624372 24090 raft_consensus.cc:3060] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.630899 24090 raft_consensus.cc:515] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:12.633205 24090 leader_election.cc:290] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:13:12.634660 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:12.635429 24164 raft_consensus.cc:3055] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.635731 24164 raft_consensus.cc:740] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:13:12.636639 24164 consensus_queue.cc:260] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:12.637910 24164 raft_consensus.cc:3060] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.636706 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdc73b179344810934aee531a69b292" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:12.639361 24242 raft_consensus.cc:3060] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.641752 23914 catalog_manager.cc:5697] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 2 to 3, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 3 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.650991 24164 raft_consensus.cc:2468] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:13:12.652004 24242 raft_consensus.cc:2468] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:13:12.653602 24057 leader_election.cc:304] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:12.656607 25253 raft_consensus.cc:2804] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.657176 25253 raft_consensus.cc:697] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:12.658205 25253 consensus_queue.cc:237] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:12.684559 23914 catalog_manager.cc:5697] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 411dcd784dc842ecb490506483244223 (127.13.196.67) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.772796 25254 raft_consensus.cc:993] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.773411 25254 raft_consensus.cc:1081] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.776096 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:12.776816 25039 raft_consensus.cc:493] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.777427 25039 raft_consensus.cc:3060] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.790831 25039 raft_consensus.cc:515] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:12.793277 25039 leader_election.cc:290] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:12.793417 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:12.794157 24091 raft_consensus.cc:3055] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.794250 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6700a2c5fd44373aae4bf17748f91b0" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:12.794575 24091 raft_consensus.cc:740] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:12.794998 24164 raft_consensus.cc:3060] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.795586 24091 consensus_queue.cc:260] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:12.797389 24091 raft_consensus.cc:3060] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.803745 24164 raft_consensus.cc:2468] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:12.805601 24091 raft_consensus.cc:2468] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:12.806003 24893 leader_election.cc:304] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:12.806970 25217 raft_consensus.cc:2804] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.807504 25217 raft_consensus.cc:697] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:12.808549 25217 consensus_queue.cc:237] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:12.819289 23914 catalog_manager.cc:5697] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 1 to 2, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.877946 25254 raft_consensus.cc:993] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.878650 25254 raft_consensus.cc:1081] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.880471 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:12.881158 25039 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.881639 25039 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.899678 25039 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.902735 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:12.903509 24242 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.903627 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a5dbaa1db84031bb226476b1bfdccb" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:12.904261 24091 raft_consensus.cc:3055] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.904618 24091 raft_consensus.cc:740] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:12.905514 24091 consensus_queue.cc:260] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.906646 25215 raft_consensus.cc:993] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.902930 25039 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:12.907291 25215 raft_consensus.cc:1081] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:12.908565 24091 raft_consensus.cc:3060] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.911870 25034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41436
I20260709 13:13:12.912686 25034 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.913069 25034 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.913209 24242 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:12.914824 24895 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:12.915776 25217 raft_consensus.cc:2804] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.916570 25217 raft_consensus.cc:697] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:12.917541 25217 consensus_queue.cc:237] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.922235 25034 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.924643 25034 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:12.924747 24091 raft_consensus.cc:2468] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:12.926262 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:12.927110 24090 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.928095 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668e2b45abf747ec90001e857e9bd660" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:12.928789 24242 raft_consensus.cc:3055] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.929082 24242 raft_consensus.cc:740] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:13:12.929927 24242 consensus_queue.cc:260] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.935235 24242 raft_consensus.cc:3060] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.936888 24090 raft_consensus.cc:2468] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:12.938759 24893 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:12.941149 25217 raft_consensus.cc:2804] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.941983 25217 raft_consensus.cc:697] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:12.943027 25217 consensus_queue.cc:237] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:12.981060 23914 catalog_manager.cc:5697] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 2 to 3, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 3 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.983959 24242 raft_consensus.cc:2468] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:13.006202 25240 raft_consensus.cc:993] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:13.006862 25240 raft_consensus.cc:1081] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:13.009449 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1a25f18b7864945a89a86966153a568"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:13.010067 25039 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.009291 23914 catalog_manager.cc:5697] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 2 to 3, leader changed from 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 3 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.010380 25039 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.017428 25039 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:13.020566 25039 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:13.021227 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:13.021294 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1a25f18b7864945a89a86966153a568" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:13.022173 24090 raft_consensus.cc:3055] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.022713 24090 raft_consensus.cc:740] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:13.022266 24239 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.023743 24090 consensus_queue.cc:260] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:13.025002 24090 raft_consensus.cc:3060] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.032542 24239 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:13.036763 24895 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:13.038152 25217 raft_consensus.cc:2804] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.038743 25217 raft_consensus.cc:697] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:13.041424 24090 raft_consensus.cc:2468] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 3.
I20260709 13:13:13.039844 25217 consensus_queue.cc:237] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:13.052732 24168 raft_consensus.cc:1275] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.054345 25254 consensus_queue.cc:1048] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.057451 23914 catalog_manager.cc:5697] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 2 to 3, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 3 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.103121 25213 raft_consensus.cc:993] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:13.103701 25213 raft_consensus.cc:1081] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:13.106242 25034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:13.106927 25034 raft_consensus.cc:493] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.107353 25034 raft_consensus.cc:3060] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.112599 24090 raft_consensus.cc:1275] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.117365 25217 consensus_queue.cc:1048] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.130453 25034 raft_consensus.cc:515] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:13.137466 24239 raft_consensus.cc:1275] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.138051 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:13.138597 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d864e05a46b452780b1d6da88f05538" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:13.138351 25034 leader_election.cc:290] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:13.139326 24168 raft_consensus.cc:3060] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.140321 24090 raft_consensus.cc:3055] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.140769 24090 raft_consensus.cc:740] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:13.140395 25254 consensus_queue.cc:1048] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.141826 24090 consensus_queue.cc:260] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:13.143481 24090 raft_consensus.cc:3060] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.155968 24090 raft_consensus.cc:2468] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:13.155968 24168 raft_consensus.cc:2468] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:13.157977 24893 leader_election.cc:304] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:13.159858 25239 raft_consensus.cc:2804] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.160447 25239 raft_consensus.cc:697] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:13.161494 25239 consensus_queue.cc:237] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:13.172587 24239 raft_consensus.cc:1275] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.174485 25216 consensus_queue.cc:1048] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.191283 23913 catalog_manager.cc:5697] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 1 to 2, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.270943 24090 raft_consensus.cc:1275] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.272675 25239 consensus_queue.cc:1048] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.285604 24168 raft_consensus.cc:1275] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.289371 25234 consensus_queue.cc:1048] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.301863 24239 raft_consensus.cc:1275] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.303833 25217 consensus_queue.cc:1048] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.318315 24090 raft_consensus.cc:1275] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.320113 25234 consensus_queue.cc:1048] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.438499 24091 raft_consensus.cc:1275] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.440670 25216 consensus_queue.cc:1048] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.454272 24239 raft_consensus.cc:1275] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.456219 25239 consensus_queue.cc:1048] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.526247 24239 raft_consensus.cc:1275] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.527835 25239 consensus_queue.cc:1048] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.542629 24090 raft_consensus.cc:1275] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.545060 25217 consensus_queue.cc:1048] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:13.622917 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.677605 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.695607 24160 raft_consensus.cc:1275] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.697373 25216 consensus_queue.cc:1048] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.720146 24091 raft_consensus.cc:1275] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.722010 25216 consensus_queue.cc:1048] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.732558 24239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e"
dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
mode: GRACEFUL
new_leader_uuid: "22ba00a563f342be8b8432bb050f9cad"
 from {username='slave'} at 127.0.0.1:53828
I20260709 13:13:13.733314 24239 raft_consensus.cc:606] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Received request to transfer leadership to TS 22ba00a563f342be8b8432bb050f9cad
I20260709 13:13:13.738874 24168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "799e2a0152b140759a74a55581347755"
dest_uuid: "411dcd784dc842ecb490506483244223"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:44614
I20260709 13:13:13.754664 24168 raft_consensus.cc:606] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:13.800822 24091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:13.801795 24091 raft_consensus.cc:606] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:13.804417 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:13.806169 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:14.080168 25215 raft_consensus.cc:993] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: : Instructing follower 22ba00a563f342be8b8432bb050f9cad to start an election
I20260709 13:13:14.080847 25232 raft_consensus.cc:1081] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Signalling peer 22ba00a563f342be8b8432bb050f9cad to start an election
I20260709 13:13:14.082787 24090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
 from {username='slave'} at 127.0.0.1:59932
I20260709 13:13:14.083482 24090 raft_consensus.cc:493] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.083830 24090 raft_consensus.cc:3060] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.093127 24090 raft_consensus.cc:515] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:14.095721 24090 leader_election.cc:290] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:13:14.097054 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:14.097759 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a52f9f7e19642978555231fddcdc38e" candidate_uuid: "22ba00a563f342be8b8432bb050f9cad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:14.097977 24160 raft_consensus.cc:3060] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.098227 24242 raft_consensus.cc:3055] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.098542 24242 raft_consensus.cc:740] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:13:14.099332 24242 consensus_queue.cc:260] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:14.100945 24242 raft_consensus.cc:3060] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.106401 24160 raft_consensus.cc:2468] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:13:14.108003 24057 leader_election.cc:304] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ba00a563f342be8b8432bb050f9cad, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:14.109014 25213 raft_consensus.cc:2804] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.109652 25213 raft_consensus.cc:697] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Becoming Leader. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:14.115415 24242 raft_consensus.cc:2468] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ba00a563f342be8b8432bb050f9cad in term 2.
I20260709 13:13:14.119290 25213 consensus_queue.cc:237] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:14.131666 23917 catalog_manager.cc:5697] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad reported cstate change: term changed from 1 to 2, leader changed from 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68) to 22ba00a563f342be8b8432bb050f9cad (127.13.196.66). New cstate: current_term: 2 leader_uuid: "22ba00a563f342be8b8432bb050f9cad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.217952 25253 raft_consensus.cc:993] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:14.218570 25253 raft_consensus.cc:1081] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:14.221091 25014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41424
I20260709 13:13:14.221756 25014 raft_consensus.cc:493] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.222100 25014 raft_consensus.cc:3060] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.230908 25014 raft_consensus.cc:515] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:14.234184 25208 raft_consensus.cc:993] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:14.234858 25208 raft_consensus.cc:1081] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:14.236292 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:14.237200 24242 raft_consensus.cc:3060] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.237501 25034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "799e2a0152b140759a74a55581347755"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41426
I20260709 13:13:14.238127 25034 raft_consensus.cc:493] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:14.238473 25034 raft_consensus.cc:3060] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.239475 25014 leader_election.cc:290] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:14.242151 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d1b8f8cfaa4c65b287b5f68413022a" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:14.242857 24090 raft_consensus.cc:3055] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.243170 24090 raft_consensus.cc:740] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:14.244038 24090 consensus_queue.cc:260] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:14.245581 24090 raft_consensus.cc:3060] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.245532 24242 raft_consensus.cc:2468] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:14.247977 25034 raft_consensus.cc:515] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:14.248586 24895 leader_election.cc:304] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:14.250670 25217 raft_consensus.cc:2804] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.251325 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:14.251667 25217 raft_consensus.cc:697] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:14.252188 24168 raft_consensus.cc:3055] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:14.252619 24168 raft_consensus.cc:740] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 411dcd784dc842ecb490506483244223, State: Running, Role: LEADER
I20260709 13:13:14.252851 25217 consensus_queue.cc:237] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:14.254230 24090 raft_consensus.cc:2468] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:14.253700 24168 consensus_queue.cc:260] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:14.257215 24168 raft_consensus.cc:3060] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.265400 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "799e2a0152b140759a74a55581347755" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:14.266973 24168 raft_consensus.cc:2468] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:14.267386 24242 raft_consensus.cc:3060] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:14.270668 24893 leader_election.cc:304] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:14.270190 23917 catalog_manager.cc:5697] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 1 to 2, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.272492 25217 raft_consensus.cc:2804] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:14.273257 25217 raft_consensus.cc:697] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:14.276460 25034 leader_election.cc:290] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:13:14.274363 25217 consensus_queue.cc:237] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:14.276075 24242 raft_consensus.cc:2468] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:14.300118 23917 catalog_manager.cc:5697] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 1 to 2, leader changed from 411dcd784dc842ecb490506483244223 (127.13.196.67) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.550503 24168 raft_consensus.cc:1275] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.552134 25290 consensus_queue.cc:1048] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:14.567711 24242 raft_consensus.cc:1275] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 22ba00a563f342be8b8432bb050f9cad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.569629 25213 consensus_queue.cc:1048] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.783421 24091 raft_consensus.cc:1275] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.785178 25234 consensus_queue.cc:1048] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:14.807019 24242 raft_consensus.cc:1275] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.808452 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:14.808800 25234 consensus_queue.cc:1048] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:14.822885 24236 raft_consensus.cc:1275] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.824643 25234 consensus_queue.cc:1048] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:14.858067 24160 raft_consensus.cc:1275] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:14.861222 25217 consensus_queue.cc:1048] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:14.965199 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:15.039409 24091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa"
dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
mode: GRACEFUL
new_leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
 from {username='slave'} at 127.0.0.1:56690
I20260709 13:13:15.040164 24091 raft_consensus.cc:606] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Received request to transfer leadership to TS 34a8f98cd2994376ac09a9ce8fcbc487
I20260709 13:13:15.042141 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:15.044448 25290 raft_consensus.cc:993] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad: : Instructing follower 34a8f98cd2994376ac09a9ce8fcbc487 to start an election
I20260709 13:13:15.045073 25290 raft_consensus.cc:1081] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Signalling peer 34a8f98cd2994376ac09a9ce8fcbc487 to start an election
I20260709 13:13:15.044487 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:15.048729 24242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa"
dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
 from {username='slave'} at 127.0.0.1:56334
I20260709 13:13:15.049624 24242 raft_consensus.cc:493] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.050057 24242 raft_consensus.cc:3060] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.056524 24242 raft_consensus.cc:515] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:15.059317 24242 leader_election.cc:290] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Requested vote from peers 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367), 411dcd784dc842ecb490506483244223 (127.13.196.67:33929)
I20260709 13:13:15.060490 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:15.060798 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33cdb2ec12446faa2231acb16092baa" candidate_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ba00a563f342be8b8432bb050f9cad"
I20260709 13:13:15.061187 24160 raft_consensus.cc:3060] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.061561 24091 raft_consensus.cc:3055] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.061910 24091 raft_consensus.cc:740] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22ba00a563f342be8b8432bb050f9cad, State: Running, Role: LEADER
I20260709 13:13:15.063758 24091 consensus_queue.cc:260] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:15.065274 24091 raft_consensus.cc:3060] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.070328 24160 raft_consensus.cc:2468] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 2.
I20260709 13:13:15.071939 24205 leader_election.cc:304] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487, 411dcd784dc842ecb490506483244223; no voters: 
I20260709 13:13:15.073060 25305 raft_consensus.cc:2804] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.073988 25305 raft_consensus.cc:697] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Becoming Leader. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:13:15.074899 25305 consensus_queue.cc:237] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } }
I20260709 13:13:15.075067 24091 raft_consensus.cc:2468] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34a8f98cd2994376ac09a9ce8fcbc487 in term 2.
I20260709 13:13:15.094147 23913 catalog_manager.cc:5697] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 reported cstate change: term changed from 1 to 2, leader changed from 22ba00a563f342be8b8432bb050f9cad (127.13.196.66) to 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68). New cstate: current_term: 2 leader_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.482735 24091 raft_consensus.cc:1275] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Refusing update from remote peer 34a8f98cd2994376ac09a9ce8fcbc487: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.486562 25305 consensus_queue.cc:1048] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:15.540486 24160 raft_consensus.cc:1275] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 34a8f98cd2994376ac09a9ce8fcbc487: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.544986 25306 consensus_queue.cc:1048] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:16.048309 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.158015 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:16.217183 24236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538"
dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
mode: GRACEFUL
new_leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:53828
I20260709 13:13:16.218106 24236 raft_consensus.cc:606] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Received request to transfer leadership to TS 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:16.219784 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:16.221923 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:16.294636 25215 raft_consensus.cc:993] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487: : Instructing follower 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:16.295516 25323 raft_consensus.cc:1081] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Signalling peer 719fbcf5b03f4c428371a3bcd9bbb15d to start an election
I20260709 13:13:16.298161 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538"
dest_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d"
 from {username='slave'} at 127.0.0.1:41436
I20260709 13:13:16.298939 25039 raft_consensus.cc:493] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.299384 25039 raft_consensus.cc:3060] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.309609 25039 raft_consensus.cc:515] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:16.313450 25039 leader_election.cc:290] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Requested vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339)
I20260709 13:13:16.313894 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "411dcd784dc842ecb490506483244223"
I20260709 13:13:16.315390 24168 raft_consensus.cc:3060] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.317113 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfb89428db741ae9e1417e2ece21538" candidate_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487"
I20260709 13:13:16.317986 24236 raft_consensus.cc:3055] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.318396 24236 raft_consensus.cc:740] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34a8f98cd2994376ac09a9ce8fcbc487, State: Running, Role: LEADER
I20260709 13:13:16.322933 24236 consensus_queue.cc:260] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:16.325543 24236 raft_consensus.cc:3060] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.326210 24168 raft_consensus.cc:2468] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:16.328635 24893 leader_election.cc:304] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d; no voters: 
I20260709 13:13:16.329866 25217 raft_consensus.cc:2804] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.330523 25217 raft_consensus.cc:697] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Becoming Leader. State: Replica: 719fbcf5b03f4c428371a3bcd9bbb15d, State: Running, Role: LEADER
I20260709 13:13:16.331799 25217 consensus_queue.cc:237] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:16.338828 24236 raft_consensus.cc:2468] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 719fbcf5b03f4c428371a3bcd9bbb15d in term 2.
I20260709 13:13:16.353727 23913 catalog_manager.cc:5697] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d reported cstate change: term changed from 1 to 2, leader changed from 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68) to 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65). New cstate: current_term: 2 leader_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.778575 24239 raft_consensus.cc:1275] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.780452 25300 consensus_queue.cc:1048] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:16.800418 24168 raft_consensus.cc:1275] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Refusing update from remote peer 719fbcf5b03f4c428371a3bcd9bbb15d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.802884 25217 consensus_queue.cc:1048] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [LEADER]: Connected to new peer: Peer: permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:17.223107 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:17.285234 14097 tablet_server.cc:179] TabletServer@127.13.196.65:35647 shutting down...
W20260709 13:13:17.298401 24131 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 325 similar messages]
W20260709 13:13:17.319764 24131 consensus_peers.cc:597] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.339996 24205 consensus_peers.cc:597] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.341745 24131 consensus_peers.cc:597] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.363565 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.364907 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.366153 14097 raft_consensus.cc:2243] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.366804 14097 raft_consensus.cc:2272] T a961e0b83f93496e8888d704a2d82065 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.372987 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.375006 14097 raft_consensus.cc:2243] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.375957 14097 raft_consensus.cc:2272] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.376104 24131 consensus_peers.cc:597] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.380329 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.381726 14097 raft_consensus.cc:2243] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.382457 14097 raft_consensus.cc:2272] T 566862ace4e445a998adbca005d9316b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.385282 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.386646 14097 raft_consensus.cc:2243] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.387499 14097 raft_consensus.cc:2272] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.391819 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.393146 14097 raft_consensus.cc:2243] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.394299 14097 raft_consensus.cc:2272] T 3e9e1136d57e4ad0b7b229647d268d85 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.395619 24131 consensus_peers.cc:597] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.398486 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.399852 14097 raft_consensus.cc:2243] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.401463 14097 raft_consensus.cc:2272] T b5d1b8f8cfaa4c65b287b5f68413022a P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.404887 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.405786 14097 raft_consensus.cc:2243] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.406471 14097 raft_consensus.cc:2272] T 9ff3617135ac4b94a68ffb136a68c4b8 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.409729 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.410571 14097 raft_consensus.cc:2243] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.411463 14097 raft_consensus.cc:2272] T deeadb805a464c1bb34f499463f846e3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.415630 24205 consensus_peers.cc:597] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.415644 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.417141 14097 raft_consensus.cc:2243] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.418493 14097 raft_consensus.cc:2272] T 998f8cd3c00740049cb50291b59df964 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.422698 14097 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.423026 24131 consensus_peers.cc:597] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.424031 14097 raft_consensus.cc:2243] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.424965 14097 raft_consensus.cc:2272] T e6fd3c07e7b741e0a01e60ebf1092778 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.429504 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.430858 14097 raft_consensus.cc:2243] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.431793 14097 raft_consensus.cc:2272] T 9400c6e36c194339911221cf57386f55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.435930 24057 consensus_peers.cc:597] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.436271 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.437373 14097 raft_consensus.cc:2243] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.437906 14097 raft_consensus.cc:2272] T abdb73a1fad747ee8b290ec26121bac5 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.440665 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.441638 14097 raft_consensus.cc:2243] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.443018 14097 raft_consensus.cc:2272] T 0cd52e84d46949fd9d8789814378866c P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.445971 24057 consensus_peers.cc:597] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.446872 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.448035 14097 raft_consensus.cc:2243] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:17.448844 24057 consensus_peers.cc:597] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.449452 14097 raft_consensus.cc:2272] T c4fbad4af3f44d4fb97dfaca23e0e07b P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.453449 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.454710 14097 raft_consensus.cc:2243] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.456131 14097 raft_consensus.cc:2272] T e6f7273b2a634d919bc68a4cad26f668 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.460096 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.461117 14097 raft_consensus.cc:2243] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.461853 14097 raft_consensus.cc:2272] T cb615a7452f542cebc700c8750746552 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.465375 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.466445 14097 raft_consensus.cc:2243] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.467046 14097 raft_consensus.cc:2272] T 9df15e7ed7b64fc5a86f821e0330cef7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.469497 24057 consensus_peers.cc:597] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.470669 14097 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.471361 24131 consensus_peers.cc:597] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.471855 14097 raft_consensus.cc:2243] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:17.472406 24131 consensus_peers.cc:597] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.472718 14097 raft_consensus.cc:2272] T e12d688dc9954b58b54c3ef416ca0da6 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.473354 24131 consensus_peers.cc:597] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.477135 14097 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.478014 24131 consensus_peers.cc:597] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.478437 14097 raft_consensus.cc:2243] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.479919 14097 raft_consensus.cc:2272] T f5fde7706e764fa8bcd5109c6e23f970 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.483916 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.484969 14097 raft_consensus.cc:2243] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.486385 14097 raft_consensus.cc:2272] T f20bd0670e6e43e3a412db4836eacf00 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.489791 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.490547 14097 raft_consensus.cc:2243] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.491902 14097 raft_consensus.cc:2272] T e6700a2c5fd44373aae4bf17748f91b0 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.496224 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.497329 14097 raft_consensus.cc:2243] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:17.497383 24131 consensus_peers.cc:597] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.498068 14097 raft_consensus.cc:2272] T a5abba1ca42243bd8be8d7b1d77fded2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.501015 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.501976 14097 raft_consensus.cc:2243] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.503069 14097 raft_consensus.cc:2272] T 668e2b45abf747ec90001e857e9bd660 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.505852 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.507040 14097 raft_consensus.cc:2243] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.507745 14097 raft_consensus.cc:2272] T 7813bb792671456d923416caa83dba55 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.511426 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.512147 14097 raft_consensus.cc:2243] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.512730 14097 raft_consensus.cc:2272] T 77236aeb1698485ebbe657a40d6f6d72 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.515424 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.516114 14097 raft_consensus.cc:2243] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.516613 14097 raft_consensus.cc:2272] T 886dbd0c6f0243208c008309eab923ac P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.519043 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.519718 14097 raft_consensus.cc:2243] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.520242 14097 raft_consensus.cc:2272] T 3f402838ece44ca68fc177563a3827af P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.523679 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.524748 14097 raft_consensus.cc:2243] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.525982 14097 raft_consensus.cc:2272] T 9d864e05a46b452780b1d6da88f05538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.529933 24205 consensus_peers.cc:597] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.530634 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.531679 14097 raft_consensus.cc:2243] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.533020 14097 raft_consensus.cc:2272] T 799e2a0152b140759a74a55581347755 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.536326 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.537154 14097 raft_consensus.cc:2243] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.537761 14097 raft_consensus.cc:2272] T 619297e96cc440a391ca25a2d881345e P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.540956 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.541944 14097 raft_consensus.cc:2243] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.542610 14097 raft_consensus.cc:2272] T f2a7e71c709e4b1096bce054322ed8dd P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.546416 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.547386 14097 raft_consensus.cc:2243] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.548086 14097 raft_consensus.cc:2272] T f3101771b367478999c4973ad7df868f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.548832 24057 consensus_peers.cc:597] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.549443 24205 consensus_peers.cc:597] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.552402 14097 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.552795 24057 consensus_peers.cc:597] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.553470 14097 raft_consensus.cc:2243] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.554090 14097 raft_consensus.cc:2272] T f3007d344bdd4a2a81bf4ae8ae79f446 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.556946 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.557652 14097 raft_consensus.cc:2243] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.559283 14097 raft_consensus.cc:2272] T 41a5dbaa1db84031bb226476b1bfdccb P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.562397 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.563238 14097 raft_consensus.cc:2243] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.563858 14097 raft_consensus.cc:2272] T 0dfb395be48d4df5895b77cd94ea1512 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.567544 14097 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:17.568531 24057 consensus_peers.cc:597] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.568500 14097 raft_consensus.cc:2243] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.570178 14097 raft_consensus.cc:2272] T e1a25f18b7864945a89a86966153a568 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.574164 24057 consensus_peers.cc:597] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.574875 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.576121 14097 raft_consensus.cc:2243] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.576824 14097 raft_consensus.cc:2272] T b526e669ce164ea79b4d5b5132eac617 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.580554 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.581383 14097 raft_consensus.cc:2243] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.581854 14097 raft_consensus.cc:2272] T 732349b9a3cc4721af4b19673ecb3db7 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.585105 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.585886 14097 raft_consensus.cc:2243] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.586738 14097 raft_consensus.cc:2272] T 525d514eaa5240e593495ab5fcc122aa P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.589296 24131 consensus_peers.cc:597] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.590529 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.591451 14097 raft_consensus.cc:2243] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.592859 14097 raft_consensus.cc:2272] T edfb89428db741ae9e1417e2ece21538 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.597091 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.597992 14097 raft_consensus.cc:2243] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.598626 14097 raft_consensus.cc:2272] T 2fc852f89c8f4fafbb28f064daeebdb2 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.599996 24131 consensus_peers.cc:597] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.602504 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.603505 14097 raft_consensus.cc:2243] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.604094 14097 raft_consensus.cc:2272] T 437f3547914b45e2a61c419bdd3fe09f P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.607339 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.607986 14097 raft_consensus.cc:2243] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.608582 14097 raft_consensus.cc:2272] T d06fbedd20384f379daf18894c847ae3 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.611675 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.612296 14097 raft_consensus.cc:2243] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.612953 14097 raft_consensus.cc:2272] T feaea0cd237f463b89076aecb1d55c32 P 719fbcf5b03f4c428371a3bcd9bbb15d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.616205 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:17.616978 14097 raft_consensus.cc:2243] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.617596 14097 raft_consensus.cc:2272] T 2bf86c23dc92446f955db3e85bb4b3df P 719fbcf5b03f4c428371a3bcd9bbb15d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.640545 24057 consensus_peers.cc:597] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.672968 24057 consensus_peers.cc:597] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.673426 24205 consensus_peers.cc:597] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.718052 24205 consensus_peers.cc:597] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.719755 14097 tablet_server.cc:196] TabletServer@127.13.196.65:35647 shutdown complete.
W20260709 13:13:17.730530 24131 consensus_peers.cc:597] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.754159 24131 consensus_peers.cc:597] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.757635 24205 consensus_peers.cc:597] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Couldn't send request to peer 719fbcf5b03f4c428371a3bcd9bbb15d. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.854784 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
I20260709 13:13:17.912706 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.913666 14097 tablet_replica.cc:333] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.914577 14097 raft_consensus.cc:2243] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.915237 14097 raft_consensus.cc:2272] T a961e0b83f93496e8888d704a2d82065 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.918251 14097 tablet_replica.cc:333] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.919306 14097 raft_consensus.cc:2243] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.919998 14097 raft_consensus.cc:2272] T e6f7273b2a634d919bc68a4cad26f668 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.923619 14097 tablet_replica.cc:333] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.924728 14097 raft_consensus.cc:2243] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.925392 14097 raft_consensus.cc:2272] T 58db1c790ab94c0ba5756b94b1280302 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.928609 14097 tablet_replica.cc:333] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.929713 14097 raft_consensus.cc:2243] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.931083 14097 raft_consensus.cc:2272] T 1cdc73b179344810934aee531a69b292 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.931736 24205 consensus_peers.cc:597] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.935245 14097 tablet_replica.cc:333] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.946355 14097 raft_consensus.cc:2243] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.949478 14097 raft_consensus.cc:2272] T 2bf86c23dc92446f955db3e85bb4b3df P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.950384 24205 consensus_peers.cc:597] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:17.952687 24205 consensus_peers.cc:597] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.953770 14097 tablet_replica.cc:333] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.954990 14097 raft_consensus.cc:2243] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.955678 14097 raft_consensus.cc:2272] T 437f3547914b45e2a61c419bdd3fe09f P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.959520 14097 tablet_replica.cc:333] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.960933 14097 raft_consensus.cc:2243] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:17.961264 24131 consensus_peers.cc:597] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.962167 14097 raft_consensus.cc:2272] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.965552 14097 tablet_replica.cc:333] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.966645 14097 raft_consensus.cc:2243] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.967432 14097 raft_consensus.cc:2272] T f3101771b367478999c4973ad7df868f P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.967151 24205 consensus_peers.cc:597] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.971529 14097 tablet_replica.cc:333] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.973625 14097 raft_consensus.cc:2243] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.974488 14097 raft_consensus.cc:2272] T 41a5dbaa1db84031bb226476b1bfdccb P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.977924 14097 tablet_replica.cc:333] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.979005 14097 raft_consensus.cc:2243] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.979760 14097 raft_consensus.cc:2272] T aa9fdacd398142bb98d711e9a9a13697 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.983343 14097 tablet_replica.cc:333] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.984459 14097 raft_consensus.cc:2243] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.985948 14097 raft_consensus.cc:2272] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.993534 14097 tablet_replica.cc:333] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:17.994565 14097 raft_consensus.cc:2243] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.995931 14097 raft_consensus.cc:2272] T 068410948a164d408611c73e52af845e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.999599 14097 tablet_replica.cc:333] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.000540 14097 raft_consensus.cc:2243] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.001338 14097 raft_consensus.cc:2272] T 77236aeb1698485ebbe657a40d6f6d72 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.004804 14097 tablet_replica.cc:333] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.005494 14097 raft_consensus.cc:2243] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.006138 14097 raft_consensus.cc:2272] T 886dbd0c6f0243208c008309eab923ac P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.008708 14097 tablet_replica.cc:333] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.009836 14097 raft_consensus.cc:2243] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.011101 14097 raft_consensus.cc:2272] T 1a52f9f7e19642978555231fddcdc38e P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.013935 14097 tablet_replica.cc:333] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.014871 14097 raft_consensus.cc:2243] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.015715 14097 raft_consensus.cc:2272] T 566862ace4e445a998adbca005d9316b P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.018877 14097 tablet_replica.cc:333] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.019703 14097 raft_consensus.cc:2243] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.020676 14097 raft_consensus.cc:2272] T 20a307a7186f4c828e6851401a78c276 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.025228 14097 tablet_replica.cc:333] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.026496 14097 raft_consensus.cc:2243] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.027637 14097 raft_consensus.cc:2272] T e12d688dc9954b58b54c3ef416ca0da6 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.031587 14097 tablet_replica.cc:333] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.032843 14097 raft_consensus.cc:2243] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.033778 14097 raft_consensus.cc:2272] T b33cdb2ec12446faa2231acb16092baa P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.037041 14097 tablet_replica.cc:333] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.037724 14097 raft_consensus.cc:2243] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.038877 14097 raft_consensus.cc:2272] T deeadb805a464c1bb34f499463f846e3 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.041674 14097 tablet_replica.cc:333] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.042387 14097 raft_consensus.cc:2243] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.043464 14097 raft_consensus.cc:2272] T fa1bc51404a8482fb802e2ba85e80e88 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.046317 14097 tablet_replica.cc:333] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.047333 14097 raft_consensus.cc:2243] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.048159 14097 raft_consensus.cc:2272] T e6700a2c5fd44373aae4bf17748f91b0 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.051043 24205 consensus_peers.cc:597] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.051956 14097 tablet_replica.cc:333] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.053566 14097 raft_consensus.cc:2243] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.055447 14097 raft_consensus.cc:2272] T b526e669ce164ea79b4d5b5132eac617 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.055961 24131 consensus_peers.cc:597] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.058799 14097 tablet_replica.cc:333] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.059666 14097 raft_consensus.cc:2243] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.060328 14097 raft_consensus.cc:2272] T e1a25f18b7864945a89a86966153a568 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.063938 14097 tablet_replica.cc:333] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.065070 14097 raft_consensus.cc:2243] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.065847 14097 raft_consensus.cc:2272] T 668e2b45abf747ec90001e857e9bd660 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.066282 24131 consensus_peers.cc:597] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.069576 14097 tablet_replica.cc:333] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.070494 14097 raft_consensus.cc:2243] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.071434 14097 raft_consensus.cc:2272] T a5abba1ca42243bd8be8d7b1d77fded2 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.075346 14097 tablet_replica.cc:333] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.076581 14097 raft_consensus.cc:2243] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.077358 14097 raft_consensus.cc:2272] T f42f9b12b00946d9a5420824dac647b6 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.080891 14097 tablet_replica.cc:333] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.081950 14097 raft_consensus.cc:2243] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.082680 14097 raft_consensus.cc:2272] T 585e77c0a29944dfaecf265201b92507 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.085035 24205 consensus_peers.cc:597] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.085983 14097 tablet_replica.cc:333] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.087092 14097 raft_consensus.cc:2243] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.088461 14097 raft_consensus.cc:2272] T 619297e96cc440a391ca25a2d881345e P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.092264 14097 tablet_replica.cc:333] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.093298 14097 raft_consensus.cc:2243] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.094625 14097 raft_consensus.cc:2272] T 732349b9a3cc4721af4b19673ecb3db7 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.098724 14097 tablet_replica.cc:333] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.099792 14097 raft_consensus.cc:2243] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.100517 14097 raft_consensus.cc:2272] T 9d864e05a46b452780b1d6da88f05538 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.103941 14097 tablet_replica.cc:333] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.104987 14097 raft_consensus.cc:2243] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.105751 14097 raft_consensus.cc:2272] T 3f402838ece44ca68fc177563a3827af P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.109928 14097 tablet_replica.cc:333] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.111083 14097 raft_consensus.cc:2243] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.111948 14097 raft_consensus.cc:2272] T b5d1b8f8cfaa4c65b287b5f68413022a P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.114742 24205 consensus_peers.cc:597] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.115635 14097 tablet_replica.cc:333] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.116681 14097 raft_consensus.cc:2243] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.117995 14097 raft_consensus.cc:2272] T abdb73a1fad747ee8b290ec26121bac5 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.121856 14097 tablet_replica.cc:333] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.122835 14097 raft_consensus.cc:2243] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.123520 14097 raft_consensus.cc:2272] T 0cd52e84d46949fd9d8789814378866c P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.126861 14097 tablet_replica.cc:333] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.128400 14097 raft_consensus.cc:2243] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.129103 14097 raft_consensus.cc:2272] T 06398d76b1694a4490f087dd6e52c33e P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.133203 14097 tablet_replica.cc:333] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.134253 14097 raft_consensus.cc:2243] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.134960 14097 raft_consensus.cc:2272] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.138768 14097 tablet_replica.cc:333] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.139703 14097 raft_consensus.cc:2243] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.140568 14097 raft_consensus.cc:2272] T f20bd0670e6e43e3a412db4836eacf00 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.143127 14097 tablet_replica.cc:333] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.143888 14097 raft_consensus.cc:2243] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.144543 14097 raft_consensus.cc:2272] T f5fde7706e764fa8bcd5109c6e23f970 P 22ba00a563f342be8b8432bb050f9cad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.147071 14097 tablet_replica.cc:333] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.147722 14097 raft_consensus.cc:2243] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.148849 14097 raft_consensus.cc:2272] T 3e9e1136d57e4ad0b7b229647d268d85 P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.151252 14097 tablet_replica.cc:333] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.151919 14097 raft_consensus.cc:2243] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.152529 14097 raft_consensus.cc:2272] T c4fbad4af3f44d4fb97dfaca23e0e07b P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.155438 14097 tablet_replica.cc:333] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.156032 14097 raft_consensus.cc:2243] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.157106 14097 raft_consensus.cc:2272] T 7813bb792671456d923416caa83dba55 P 22ba00a563f342be8b8432bb050f9cad [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.159595 24205 consensus_peers.cc:597] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.159696 14097 tablet_replica.cc:333] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.160615 14097 raft_consensus.cc:2243] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.161195 14097 raft_consensus.cc:2272] T fccea2ecf3fb4019be0a669b6c1b6d2b P 22ba00a563f342be8b8432bb050f9cad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.163816 14097 tablet_replica.cc:333] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad: stopping tablet replica
I20260709 13:13:18.164543 14097 raft_consensus.cc:2243] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.165616 14097 raft_consensus.cc:2272] T 2fc852f89c8f4fafbb28f064daeebdb2 P 22ba00a563f342be8b8432bb050f9cad [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.199721 24205 consensus_peers.cc:597] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.200662 24131 consensus_peers.cc:597] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.228626 24205 consensus_peers.cc:597] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.252790 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
W20260709 13:13:18.374607 24131 consensus_peers.cc:597] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.381544 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
W20260709 13:13:18.409991 24205 consensus_peers.cc:597] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.413434 24205 consensus_peers.cc:597] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.440896 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:18.442359 14097 tablet_replica.cc:333] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.443540 14097 raft_consensus.cc:2243] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.444461 14097 raft_consensus.cc:2272] T e6f7273b2a634d919bc68a4cad26f668 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.449026 14097 tablet_replica.cc:333] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223: stopping tablet replica
W20260709 13:13:18.449461 24205 consensus_peers.cc:597] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Couldn't send request to peer 22ba00a563f342be8b8432bb050f9cad. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.449928 14097 raft_consensus.cc:2243] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.450819 14097 raft_consensus.cc:2272] T abdb73a1fad747ee8b290ec26121bac5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.454540 14097 tablet_replica.cc:333] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.455466 14097 raft_consensus.cc:2243] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.456202 14097 raft_consensus.cc:2272] T 1cdc73b179344810934aee531a69b292 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.459568 14097 tablet_replica.cc:333] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.460553 14097 raft_consensus.cc:2243] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.461704 14097 raft_consensus.cc:2272] T d06fbedd20384f379daf18894c847ae3 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.464617 14097 tablet_replica.cc:333] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.465288 14097 raft_consensus.cc:2243] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.466554 14097 raft_consensus.cc:2272] T feaea0cd237f463b89076aecb1d55c32 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.470425 14097 tablet_replica.cc:333] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.471784 14097 raft_consensus.cc:2243] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.472685 14097 raft_consensus.cc:2272] T fccea2ecf3fb4019be0a669b6c1b6d2b P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.476676 14097 tablet_replica.cc:333] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.477777 14097 raft_consensus.cc:2243] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.478524 14097 raft_consensus.cc:2272] T 9d864e05a46b452780b1d6da88f05538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.481391 24205 consensus_peers.cc:597] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.482133 14097 tablet_replica.cc:333] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.482872 14097 raft_consensus.cc:2243] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.483760 14097 raft_consensus.cc:2272] T 0dfb395be48d4df5895b77cd94ea1512 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.487140 14097 tablet_replica.cc:333] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.488122 14097 raft_consensus.cc:2243] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.488963 14097 raft_consensus.cc:2272] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.492057 14097 tablet_replica.cc:333] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.493052 14097 raft_consensus.cc:2243] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.493587 14097 raft_consensus.cc:2272] T 9ff3617135ac4b94a68ffb136a68c4b8 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.494261 25344 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.494813 25344 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:18.497758 25344 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34a8f98cd2994376ac09a9ce8fcbc487 (127.13.196.68:40339), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:13:18.498934 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "998f8cd3c00740049cb50291b59df964" candidate_uuid: "411dcd784dc842ecb490506483244223" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" is_pre_election: true
I20260709 13:13:18.499121 14097 tablet_replica.cc:333] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.500322 14097 raft_consensus.cc:2243] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.501952 14097 raft_consensus.cc:2272] T 525d514eaa5240e593495ab5fcc122aa P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.502836 24131 leader_election.cc:336] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:13:18.503362 24131 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 34a8f98cd2994376ac09a9ce8fcbc487, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.504091 25344 raft_consensus.cc:2749] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.505038 14097 tablet_replica.cc:333] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.505848 14097 raft_consensus.cc:2243] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.506470 14097 raft_consensus.cc:2272] T edfb89428db741ae9e1417e2ece21538 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.510676 14097 tablet_replica.cc:333] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.511880 14097 raft_consensus.cc:2243] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.513422 14097 raft_consensus.cc:2272] T cb615a7452f542cebc700c8750746552 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.517515 14097 tablet_replica.cc:333] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.518468 14097 raft_consensus.cc:2243] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.519191 14097 raft_consensus.cc:2272] T 504e7d24d8c24d4bbc62ae3b0eaa4ca5 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.522660 14097 tablet_replica.cc:333] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.523721 14097 raft_consensus.cc:2243] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:18.522698 24205 consensus_peers.cc:597] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.524577 14097 raft_consensus.cc:2272] T 998f8cd3c00740049cb50291b59df964 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.528656 14097 tablet_replica.cc:333] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.528777 25215 raft_consensus.cc:493] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.529451 25215 raft_consensus.cc:515] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:18.529819 14097 raft_consensus.cc:2243] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.530714 14097 raft_consensus.cc:2272] T 1a52f9f7e19642978555231fddcdc38e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.534726 14097 tablet_replica.cc:333] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.535832 14097 raft_consensus.cc:2243] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.531980 25215 leader_election.cc:290] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:18.536893 14097 raft_consensus.cc:2272] T e6fd3c07e7b741e0a01e60ebf1092778 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.540824 14097 tablet_replica.cc:333] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.541607 14097 raft_consensus.cc:2243] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.542961 14097 raft_consensus.cc:2272] T 20a307a7186f4c828e6851401a78c276 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.546478 14097 tablet_replica.cc:333] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.547869 14097 raft_consensus.cc:2243] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.549358 14097 raft_consensus.cc:2272] T e12d688dc9954b58b54c3ef416ca0da6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.552394 24205 leader_election.cc:336] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:13:18.553337 24205 leader_election.cc:336] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111)
I20260709 13:13:18.553499 14097 tablet_replica.cc:333] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.553793 24205 leader_election.cc:304] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.554654 25323 raft_consensus.cc:2749] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.554688 14097 raft_consensus.cc:2243] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.555771 14097 raft_consensus.cc:2272] T b33cdb2ec12446faa2231acb16092baa P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.556591 24205 consensus_peers.cc:597] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.559607 14097 tablet_replica.cc:333] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223: stopping tablet replica
W20260709 13:13:18.559746 24205 consensus_peers.cc:597] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.560912 14097 raft_consensus.cc:2243] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.561582 14097 raft_consensus.cc:2272] T deeadb805a464c1bb34f499463f846e3 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.564515 14097 tablet_replica.cc:333] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.565371 14097 raft_consensus.cc:2243] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.566020 14097 raft_consensus.cc:2272] T fa1bc51404a8482fb802e2ba85e80e88 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.569322 14097 tablet_replica.cc:333] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.570701 14097 raft_consensus.cc:2243] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.571291 14097 raft_consensus.cc:2272] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.572712 24205 consensus_peers.cc:597] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.574528 14097 tablet_replica.cc:333] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.575325 14097 raft_consensus.cc:2243] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.575870 14097 raft_consensus.cc:2272] T 58db1c790ab94c0ba5756b94b1280302 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.578322 14097 tablet_replica.cc:333] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.579005 14097 raft_consensus.cc:2243] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.580047 14097 raft_consensus.cc:2272] T 9400c6e36c194339911221cf57386f55 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.582966 14097 tablet_replica.cc:333] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.583930 14097 raft_consensus.cc:2243] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.584692 14097 raft_consensus.cc:2272] T c4fbad4af3f44d4fb97dfaca23e0e07b P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.587496 14097 tablet_replica.cc:333] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.588454 14097 raft_consensus.cc:2243] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.589869 14097 raft_consensus.cc:2272] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.593783 14097 tablet_replica.cc:333] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.594776 14097 raft_consensus.cc:2243] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.595407 14097 raft_consensus.cc:2272] T 06398d76b1694a4490f087dd6e52c33e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.596757 24205 consensus_peers.cc:597] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.598260 14097 tablet_replica.cc:333] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.599261 14097 raft_consensus.cc:2243] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.599936 14097 raft_consensus.cc:2272] T e6700a2c5fd44373aae4bf17748f91b0 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.602787 14097 tablet_replica.cc:333] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.603554 14097 raft_consensus.cc:2243] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.604115 14097 raft_consensus.cc:2272] T 619297e96cc440a391ca25a2d881345e P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.605288 25323 raft_consensus.cc:493] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.606171 25323 raft_consensus.cc:515] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:18.608361 14097 tablet_replica.cc:333] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.609635 14097 raft_consensus.cc:2243] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.610242 14097 raft_consensus.cc:2272] T 799e2a0152b140759a74a55581347755 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.614889 14097 tablet_replica.cc:333] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.610253 25323 leader_election.cc:290] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:18.616082 14097 raft_consensus.cc:2243] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.617884 14097 raft_consensus.cc:2272] T f3101771b367478999c4973ad7df868f P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.621748 14097 tablet_replica.cc:333] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.622617 14097 raft_consensus.cc:2243] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.623543 14097 raft_consensus.cc:2272] T f3007d344bdd4a2a81bf4ae8ae79f446 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.626008 24205 leader_election.cc:336] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:13:18.626920 14097 tablet_replica.cc:333] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223: stopping tablet replica
W20260709 13:13:18.627306 24205 leader_election.cc:336] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111)
I20260709 13:13:18.627928 14097 raft_consensus.cc:2243] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.628033 24205 leader_election.cc:304] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.628692 14097 raft_consensus.cc:2272] T 7813bb792671456d923416caa83dba55 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.629009 25323 raft_consensus.cc:2749] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.630342 25344 raft_consensus.cc:493] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.630962 25344 raft_consensus.cc:515] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } } peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } }
I20260709 13:13:18.632735 14097 tablet_replica.cc:333] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.633479 25344 leader_election.cc:290] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:18.633735 14097 raft_consensus.cc:2243] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.634496 14097 raft_consensus.cc:2272] T aa9fdacd398142bb98d711e9a9a13697 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.638480 14097 tablet_replica.cc:333] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.639356 14097 raft_consensus.cc:2243] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.640553 14097 raft_consensus.cc:2272] T 9df15e7ed7b64fc5a86f821e0330cef7 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.641134 24131 leader_election.cc:336] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:13:18.642828 24131 leader_election.cc:336] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111)
I20260709 13:13:18.643332 24131 leader_election.cc:304] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 411dcd784dc842ecb490506483244223; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.644238 14097 tablet_replica.cc:333] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.644306 25317 raft_consensus.cc:2749] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.645390 14097 raft_consensus.cc:2243] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.646173 14097 raft_consensus.cc:2272] T 068410948a164d408611c73e52af845e P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.646921 24205 consensus_peers.cc:597] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.649561 14097 tablet_replica.cc:333] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.650854 14097 raft_consensus.cc:2243] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.652271 14097 raft_consensus.cc:2272] T 77236aeb1698485ebbe657a40d6f6d72 P 411dcd784dc842ecb490506483244223 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.654137 25347 raft_consensus.cc:493] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.654911 25347 raft_consensus.cc:515] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:18.655947 14097 tablet_replica.cc:333] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.657001 14097 raft_consensus.cc:2243] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.657584 25347 leader_election.cc:290] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:18.658277 14097 raft_consensus.cc:2272] T 886dbd0c6f0243208c008309eab923ac P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.661816 14097 tablet_replica.cc:333] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.662871 14097 raft_consensus.cc:2243] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.663686 14097 raft_consensus.cc:2272] T f20bd0670e6e43e3a412db4836eacf00 P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.664286 24205 leader_election.cc:336] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111)
W20260709 13:13:18.665230 24205 leader_election.cc:336] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:13:18.666571 25347 raft_consensus.cc:493] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.666471 24205 leader_election.cc:304] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.667362 25347 raft_consensus.cc:515] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:18.667732 25323 raft_consensus.cc:2749] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.668104 14097 tablet_replica.cc:333] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.669301 14097 raft_consensus.cc:2243] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.670174 14097 raft_consensus.cc:2272] T f5fde7706e764fa8bcd5109c6e23f970 P 411dcd784dc842ecb490506483244223 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.670588 25347 leader_election.cc:290] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
I20260709 13:13:18.673848 14097 tablet_replica.cc:333] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.674855 14097 raft_consensus.cc:2243] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.676708 14097 raft_consensus.cc:2272] T f2a7e71c709e4b1096bce054322ed8dd P 411dcd784dc842ecb490506483244223 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:18.677304 24205 leader_election.cc:336] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:18.678198 24205 leader_election.cc:336] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:13:18.678664 24205 leader_election.cc:304] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.679557 25215 raft_consensus.cc:2749] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.680076 14097 tablet_replica.cc:333] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.681010 14097 raft_consensus.cc:2243] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.681671 14097 raft_consensus.cc:2272] T f42f9b12b00946d9a5420824dac647b6 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.685437 14097 tablet_replica.cc:333] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223: stopping tablet replica
I20260709 13:13:18.686218 14097 raft_consensus.cc:2243] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.686939 14097 raft_consensus.cc:2272] T 585e77c0a29944dfaecf265201b92507 P 411dcd784dc842ecb490506483244223 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.730731 25347 raft_consensus.cc:493] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.731575 25347 raft_consensus.cc:515] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:18.734368 25347 leader_election.cc:290] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
W20260709 13:13:18.740170 24205 leader_election.cc:336] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:13:18.740976 24205 leader_election.cc:336] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111)
I20260709 13:13:18.741369 24205 leader_election.cc:304] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.742388 25347 raft_consensus.cc:2749] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.754506 25347 raft_consensus.cc:493] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.755558 25347 raft_consensus.cc:515] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:18.758104 25347 leader_election.cc:290] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:13:18.765480 24205 leader_election.cc:336] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:13:18.766396 24205 leader_election.cc:336] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Network error: Client connection negotiation failed: client connection to 127.13.196.67:33929: connect: Connection refused (error 111)
I20260709 13:13:18.766911 24205 leader_election.cc:304] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.767866 25347 raft_consensus.cc:2749] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:18.781838 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
W20260709 13:13:18.814805 24205 consensus_peers.cc:597] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:33929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.827345 25347 raft_consensus.cc:493] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:18.828065 25347 raft_consensus.cc:515] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "411dcd784dc842ecb490506483244223" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33929 } } peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } }
I20260709 13:13:18.830549 25347 leader_election.cc:290] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 411dcd784dc842ecb490506483244223 (127.13.196.67:33929), 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647)
W20260709 13:13:18.836513 24205 leader_election.cc:336] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Network error: Client connection negotiation failed: client connection to 127.13.196.67:33929: connect: Connection refused (error 111)
W20260709 13:13:18.837584 24205 leader_election.cc:336] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
I20260709 13:13:18.838161 24205 leader_election.cc:304] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 411dcd784dc842ecb490506483244223, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:18.839032 25347 raft_consensus.cc:2749] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:18.878063 14097 tablet_server.cc:179] TabletServer@127.13.196.68:0 shutting down...
W20260709 13:13:18.935220 24205 consensus_peers.cc:597] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:33929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.944226 24205 consensus_peers.cc:597] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 -> Peer 411dcd784dc842ecb490506483244223 (127.13.196.67:33929): Couldn't send request to peer 411dcd784dc842ecb490506483244223. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.67:33929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.950125 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:18.951169 14097 tablet_replica.cc:333] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.952059 14097 raft_consensus.cc:2243] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.953100 14097 raft_consensus.cc:2272] T a961e0b83f93496e8888d704a2d82065 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.956030 14097 tablet_replica.cc:333] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.956816 14097 raft_consensus.cc:2243] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.957417 14097 raft_consensus.cc:2272] T d06fbedd20384f379daf18894c847ae3 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.960446 14097 tablet_replica.cc:333] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.961124 14097 raft_consensus.cc:2243] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.961694 14097 raft_consensus.cc:2272] T feaea0cd237f463b89076aecb1d55c32 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.964272 14097 tablet_replica.cc:333] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.965085 14097 raft_consensus.cc:2243] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.965651 14097 raft_consensus.cc:2272] T 0dfb395be48d4df5895b77cd94ea1512 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.968075 14097 tablet_replica.cc:333] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.968910 14097 raft_consensus.cc:2243] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.969477 14097 raft_consensus.cc:2272] T 1cdc73b179344810934aee531a69b292 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.972656 14097 tablet_replica.cc:333] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.973645 14097 raft_consensus.cc:2243] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.974363 14097 raft_consensus.cc:2272] T 2bf86c23dc92446f955db3e85bb4b3df P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.977444 14097 tablet_replica.cc:333] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.978168 14097 raft_consensus.cc:2243] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.979074 14097 raft_consensus.cc:2272] T 437f3547914b45e2a61c419bdd3fe09f P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.981532 14097 tablet_replica.cc:333] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.982208 14097 raft_consensus.cc:2243] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.982731 14097 raft_consensus.cc:2272] T 5d0f4ea311bb4330ba8fc5081e593dc2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.985080 14097 tablet_replica.cc:333] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.985759 14097 raft_consensus.cc:2243] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.986352 14097 raft_consensus.cc:2272] T 068410948a164d408611c73e52af845e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.989630 14097 tablet_replica.cc:333] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.990594 14097 raft_consensus.cc:2243] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.991328 14097 raft_consensus.cc:2272] T cb615a7452f542cebc700c8750746552 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.993561 14097 tablet_replica.cc:333] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.994774 14097 raft_consensus.cc:2243] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:18.995872 14097 raft_consensus.cc:2272] T 9ff3617135ac4b94a68ffb136a68c4b8 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:18.998344 14097 tablet_replica.cc:333] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:18.999172 14097 raft_consensus.cc:2243] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:18.999788 14097 raft_consensus.cc:2272] T 20a307a7186f4c828e6851401a78c276 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.003135 14097 tablet_replica.cc:333] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.004086 14097 raft_consensus.cc:2243] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.005247 14097 raft_consensus.cc:2272] T 566862ace4e445a998adbca005d9316b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.007619 14097 tablet_replica.cc:333] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.008242 14097 raft_consensus.cc:2243] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.008817 14097 raft_consensus.cc:2272] T 1a52f9f7e19642978555231fddcdc38e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.010754 25215 raft_consensus.cc:493] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 719fbcf5b03f4c428371a3bcd9bbb15d)
I20260709 13:13:19.011370 14097 tablet_replica.cc:333] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.011253 25215 raft_consensus.cc:515] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34a8f98cd2994376ac09a9ce8fcbc487" member_type: VOTER last_known_addr { host: "127.13.196.68" port: 40339 } } peers { permanent_uuid: "719fbcf5b03f4c428371a3bcd9bbb15d" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 35647 } } peers { permanent_uuid: "22ba00a563f342be8b8432bb050f9cad" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 36367 } }
I20260709 13:13:19.012493 14097 raft_consensus.cc:2243] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.013051 14097 raft_consensus.cc:2272] T 998f8cd3c00740049cb50291b59df964 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.013556 25215 leader_election.cc:290] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647), 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367)
I20260709 13:13:19.016460 14097 tablet_replica.cc:333] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.017325 14097 raft_consensus.cc:2243] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.017885 14097 raft_consensus.cc:2272] T 41a5dbaa1db84031bb226476b1bfdccb P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:19.018685 24205 leader_election.cc:336] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 719fbcf5b03f4c428371a3bcd9bbb15d (127.13.196.65:35647): Network error: Client connection negotiation failed: client connection to 127.13.196.65:35647: connect: Connection refused (error 111)
W20260709 13:13:19.019403 24205 leader_election.cc:336] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22ba00a563f342be8b8432bb050f9cad (127.13.196.66:36367): Network error: Client connection negotiation failed: client connection to 127.13.196.66:36367: connect: Connection refused (error 111)
I20260709 13:13:19.019733 24205 leader_election.cc:304] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34a8f98cd2994376ac09a9ce8fcbc487; no voters: 22ba00a563f342be8b8432bb050f9cad, 719fbcf5b03f4c428371a3bcd9bbb15d
I20260709 13:13:19.020401 25215 raft_consensus.cc:2749] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:19.020874 14097 tablet_replica.cc:333] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.021895 14097 raft_consensus.cc:2243] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.022538 14097 raft_consensus.cc:2272] T f3007d344bdd4a2a81bf4ae8ae79f446 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.026201 14097 tablet_replica.cc:333] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.027184 14097 raft_consensus.cc:2243] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.027662 14097 raft_consensus.cc:2272] T fa1bc51404a8482fb802e2ba85e80e88 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.030179 14097 tablet_replica.cc:333] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.030752 14097 raft_consensus.cc:2243] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.031172 14097 raft_consensus.cc:2272] T 3e9e1136d57e4ad0b7b229647d268d85 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.033434 14097 tablet_replica.cc:333] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.034021 14097 raft_consensus.cc:2243] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.034894 14097 raft_consensus.cc:2272] T 1b5f299f0dd64ce2a6147e78c234d2b2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.040299 14097 tablet_replica.cc:333] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.041139 14097 raft_consensus.cc:2243] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.042111 14097 raft_consensus.cc:2272] T b33cdb2ec12446faa2231acb16092baa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.044714 14097 tablet_replica.cc:333] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.045686 14097 raft_consensus.cc:2243] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.046413 14097 raft_consensus.cc:2272] T 799e2a0152b140759a74a55581347755 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.049455 14097 tablet_replica.cc:333] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.050449 14097 raft_consensus.cc:2243] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.051075 14097 raft_consensus.cc:2272] T 0cd52e84d46949fd9d8789814378866c P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.053524 14097 tablet_replica.cc:333] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.054196 14097 raft_consensus.cc:2243] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.055153 14097 raft_consensus.cc:2272] T 06398d76b1694a4490f087dd6e52c33e P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.057830 14097 tablet_replica.cc:333] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.058584 14097 raft_consensus.cc:2243] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.059551 14097 raft_consensus.cc:2272] T 58c5d2e9bae44e1cbc8eb9673d4e7b72 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.062219 14097 tablet_replica.cc:333] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.063059 14097 raft_consensus.cc:2243] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.063900 14097 raft_consensus.cc:2272] T fccea2ecf3fb4019be0a669b6c1b6d2b P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.071698 14097 tablet_replica.cc:333] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.072480 14097 raft_consensus.cc:2243] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.073104 14097 raft_consensus.cc:2272] T 2fc852f89c8f4fafbb28f064daeebdb2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.077414 14097 tablet_replica.cc:333] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.078555 14097 raft_consensus.cc:2243] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.079780 14097 raft_consensus.cc:2272] T aa9fdacd398142bb98d711e9a9a13697 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.083159 14097 tablet_replica.cc:333] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.084028 14097 raft_consensus.cc:2243] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.084764 14097 raft_consensus.cc:2272] T 9df15e7ed7b64fc5a86f821e0330cef7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.087492 14097 tablet_replica.cc:333] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.088205 14097 raft_consensus.cc:2243] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.088845 14097 raft_consensus.cc:2272] T e6fd3c07e7b741e0a01e60ebf1092778 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.091753 14097 tablet_replica.cc:333] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.092716 14097 raft_consensus.cc:2243] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.093240 14097 raft_consensus.cc:2272] T b526e669ce164ea79b4d5b5132eac617 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.095825 14097 tablet_replica.cc:333] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.096493 14097 raft_consensus.cc:2243] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.096982 14097 raft_consensus.cc:2272] T e1a25f18b7864945a89a86966153a568 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.099224 14097 tablet_replica.cc:333] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.099859 14097 raft_consensus.cc:2243] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.100319 14097 raft_consensus.cc:2272] T 668e2b45abf747ec90001e857e9bd660 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.102622 14097 tablet_replica.cc:333] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.103200 14097 raft_consensus.cc:2243] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.104084 14097 raft_consensus.cc:2272] T a5abba1ca42243bd8be8d7b1d77fded2 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.107806 14097 tablet_replica.cc:333] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.108505 14097 raft_consensus.cc:2243] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.109001 14097 raft_consensus.cc:2272] T f2a7e71c709e4b1096bce054322ed8dd P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.111160 14097 tablet_replica.cc:333] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.111815 14097 raft_consensus.cc:2243] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.113087 14097 raft_consensus.cc:2272] T f42f9b12b00946d9a5420824dac647b6 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.116470 14097 tablet_replica.cc:333] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.117084 14097 raft_consensus.cc:2243] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.117949 14097 raft_consensus.cc:2272] T 585e77c0a29944dfaecf265201b92507 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.120126 14097 tablet_replica.cc:333] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.120764 14097 raft_consensus.cc:2243] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.121598 14097 raft_consensus.cc:2272] T 58db1c790ab94c0ba5756b94b1280302 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.123792 14097 tablet_replica.cc:333] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.124322 14097 raft_consensus.cc:2243] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.124847 14097 raft_consensus.cc:2272] T 9400c6e36c194339911221cf57386f55 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.127110 14097 tablet_replica.cc:333] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.127647 14097 raft_consensus.cc:2243] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.128238 14097 raft_consensus.cc:2272] T b5d1b8f8cfaa4c65b287b5f68413022a P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.131249 14097 tablet_replica.cc:333] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.131819 14097 raft_consensus.cc:2243] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.132275 14097 raft_consensus.cc:2272] T 525d514eaa5240e593495ab5fcc122aa P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.134598 14097 tablet_replica.cc:333] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.135428 14097 raft_consensus.cc:2243] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.136225 14097 raft_consensus.cc:2272] T edfb89428db741ae9e1417e2ece21538 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.138646 14097 tablet_replica.cc:333] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.139240 14097 raft_consensus.cc:2243] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.139775 14097 raft_consensus.cc:2272] T 732349b9a3cc4721af4b19673ecb3db7 P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.142246 14097 tablet_replica.cc:333] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487: stopping tablet replica
I20260709 13:13:19.142854 14097 raft_consensus.cc:2243] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.143836 14097 raft_consensus.cc:2272] T 3f402838ece44ca68fc177563a3827af P 34a8f98cd2994376ac09a9ce8fcbc487 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.228983 14097 tablet_server.cc:196] TabletServer@127.13.196.68:0 shutdown complete.
I20260709 13:13:19.322640 14097 master.cc:562] Master@127.13.196.126:42321 shutting down...
I20260709 13:13:19.356453 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.357133 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.357456 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P ee6be353560a46edb7dcae64ec30501d: stopping tablet replica
I20260709 13:13:19.382318 14097 master.cc:584] Master@127.13.196.126:42321 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (40181 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:13:19.501111 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:36119
I20260709 13:13:19.502728 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:19.510810 25350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:19.512080 25349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:19.513073 25352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:19.514110 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:19.515470 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:19.515712 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:19.515897 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602799515873 us; error 0 us; skew 500 ppm
I20260709 13:13:19.516811 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:19.519811 14097 webserver.cc:533] Webserver started at http://127.13.196.126:37415/ using document root <none> and password file <none>
I20260709 13:13:19.520474 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:19.520709 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:19.521019 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:19.522357 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "25e7d44d10d44ac184bebb4e86c36241"
format_stamp: "Formatted at 2026-07-09 13:13:19 on dist-test-slave-ftjc"
I20260709 13:13:19.527690 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:19.532627 25357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:19.533787 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:13:19.534173 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "25e7d44d10d44ac184bebb4e86c36241"
format_stamp: "Formatted at 2026-07-09 13:13:19 on dist-test-slave-ftjc"
I20260709 13:13:19.534555 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:19.545490 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:19.546989 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:19.595201 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:36119
I20260709 13:13:19.595304 25408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:36119 every 8 connection(s)
I20260709 13:13:19.600265 25409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:19.616945 25409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241: Bootstrap starting.
I20260709 13:13:19.623062 25409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.628428 25409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241: No bootstrap required, opened a new log
I20260709 13:13:19.631037 25409 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e7d44d10d44ac184bebb4e86c36241" member_type: VOTER }
I20260709 13:13:19.631489 25409 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.631789 25409 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e7d44d10d44ac184bebb4e86c36241, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.632565 25409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e7d44d10d44ac184bebb4e86c36241" member_type: VOTER }
I20260709 13:13:19.633100 25409 raft_consensus.cc:399] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:19.633334 25409 raft_consensus.cc:493] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:19.633659 25409 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.640044 25409 raft_consensus.cc:515] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e7d44d10d44ac184bebb4e86c36241" member_type: VOTER }
I20260709 13:13:19.641093 25409 leader_election.cc:304] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25e7d44d10d44ac184bebb4e86c36241; no voters: 
I20260709 13:13:19.642623 25409 leader_election.cc:290] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:19.643191 25412 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.644837 25412 raft_consensus.cc:697] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 1 LEADER]: Becoming Leader. State: Replica: 25e7d44d10d44ac184bebb4e86c36241, State: Running, Role: LEADER
I20260709 13:13:19.645534 25412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e7d44d10d44ac184bebb4e86c36241" member_type: VOTER }
I20260709 13:13:19.646139 25409 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:19.651295 25413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25e7d44d10d44ac184bebb4e86c36241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e7d44d10d44ac184bebb4e86c36241" member_type: VOTER } }
I20260709 13:13:19.651842 25414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e7d44d10d44ac184bebb4e86c36241. Latest consensus state: current_term: 1 leader_uuid: "25e7d44d10d44ac184bebb4e86c36241" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e7d44d10d44ac184bebb4e86c36241" member_type: VOTER } }
I20260709 13:13:19.652572 25414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:19.652582 25413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:19.655710 25418 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:19.661988 25418 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:19.667007 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:19.674782 25418 catalog_manager.cc:1383] Generated new cluster ID: e45cd232296e4983b78e5717364a3bbf
I20260709 13:13:19.675462 25418 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:19.698117 25418 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:19.699728 25418 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:19.729387 25418 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241: Generated new TSK 0
I20260709 13:13:19.730108 25418 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:19.739807 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:19.747547 25430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:19.749784 25431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:19.752048 25433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:19.752581 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:19.753965 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:19.754384 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:19.754633 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602799754605 us; error 0 us; skew 500 ppm
I20260709 13:13:19.755255 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:19.758697 14097 webserver.cc:533] Webserver started at http://127.13.196.65:42031/ using document root <none> and password file <none>
I20260709 13:13:19.759372 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:19.759621 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:19.760005 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:19.761484 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "7bf01e666cba4b98aacde60a2a634711"
format_stamp: "Formatted at 2026-07-09 13:13:19 on dist-test-slave-ftjc"
I20260709 13:13:19.767088 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:19.771309 25438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:19.772550 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:19.772969 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "7bf01e666cba4b98aacde60a2a634711"
format_stamp: "Formatted at 2026-07-09 13:13:19 on dist-test-slave-ftjc"
I20260709 13:13:19.773567 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:19.813256 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:19.814795 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:19.817080 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:19.819881 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:19.820153 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:19.820482 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:19.820693 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:19.885569 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:38899
I20260709 13:13:19.885676 25500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:38899 every 8 connection(s)
I20260709 13:13:19.891427 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:19.900280 25505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:19.900976 25506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:19.905417 14097 server_base.cc:1061] running on GCE node
W20260709 13:13:19.906315 25509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:19.907795 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:19.908082 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:19.908303 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602799908275 us; error 0 us; skew 500 ppm
I20260709 13:13:19.909010 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:19.911648 25501 heartbeater.cc:344] Connected to a master server at 127.13.196.126:36119
I20260709 13:13:19.912077 25501 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:19.912441 14097 webserver.cc:533] Webserver started at http://127.13.196.66:33471/ using document root <none> and password file <none>
I20260709 13:13:19.913095 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:19.913034 25501 heartbeater.cc:507] Master 127.13.196.126:36119 requested a full tablet report, sending...
I20260709 13:13:19.913499 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:19.913831 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:19.915316 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
format_stamp: "Formatted at 2026-07-09 13:13:19 on dist-test-slave-ftjc"
I20260709 13:13:19.915730 25374 ts_manager.cc:194] Registered new tserver with Master: 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899)
I20260709 13:13:19.917858 25374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44890
I20260709 13:13:19.921023 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:19.925307 25513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:19.926301 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:19.926681 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
format_stamp: "Formatted at 2026-07-09 13:13:19 on dist-test-slave-ftjc"
I20260709 13:13:19.927023 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:19.980734 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:19.982285 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:19.984289 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:19.987582 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:19.987918 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:19.988246 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:19.988509 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:20.046064 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:37077
I20260709 13:13:20.046181 25575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:37077 every 8 connection(s)
I20260709 13:13:20.052863 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:20.061556 25579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:20.063297 25580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:20.066907 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:20.068117 25576 heartbeater.cc:344] Connected to a master server at 127.13.196.126:36119
W20260709 13:13:20.068244 25582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:20.068912 25576 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:20.069895 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:20.070284 25576 heartbeater.cc:507] Master 127.13.196.126:36119 requested a full tablet report, sending...
W20260709 13:13:20.070397 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:20.070797 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602800070770 us; error 0 us; skew 500 ppm
I20260709 13:13:20.071920 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:20.074321 25374 ts_manager.cc:194] Registered new tserver with Master: 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:20.076503 14097 webserver.cc:533] Webserver started at http://127.13.196.67:46107/ using document root <none> and password file <none>
I20260709 13:13:20.077184 25374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44896
I20260709 13:13:20.077471 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:20.077796 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:20.078135 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:20.079843 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-ftjc"
I20260709 13:13:20.085067 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:20.089336 25587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.090529 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:20.091089 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
format_stamp: "Formatted at 2026-07-09 13:13:20 on dist-test-slave-ftjc"
I20260709 13:13:20.091511 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:20.116750 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:20.118875 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:20.121539 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:20.124452 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:20.124706 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.125026 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:20.125212 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:20.179768 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:32915
I20260709 13:13:20.179878 25649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:32915 every 8 connection(s)
I20260709 13:13:20.197962 25650 heartbeater.cc:344] Connected to a master server at 127.13.196.126:36119
I20260709 13:13:20.198578 25650 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:20.199546 25650 heartbeater.cc:507] Master 127.13.196.126:36119 requested a full tablet report, sending...
I20260709 13:13:20.202102 25374 ts_manager.cc:194] Registered new tserver with Master: 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:20.203063 14097 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019506809s
I20260709 13:13:20.204082 25374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44906
I20260709 13:13:20.238822 25374 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44918:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:20.242704 25374 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:20.342135 25466 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8f2b796f0e4f8cb073068116374f84 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:20.343003 25465 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb10f12863445c5a3758cb49a9ad977 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:20.343856 25466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8f2b796f0e4f8cb073068116374f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.344848 25465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb10f12863445c5a3758cb49a9ad977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.349664 25464 tablet_service.cc:1511] Processing CreateTablet for tablet 7911d76881d24665bc1d9c2f44cb1d04 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:20.351388 25464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7911d76881d24665bc1d9c2f44cb1d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.361323 25463 tablet_service.cc:1511] Processing CreateTablet for tablet ce6136f5ac6545f0848f5360445b2fef (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:20.363278 25463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6136f5ac6545f0848f5360445b2fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.364935 25537 tablet_service.cc:1511] Processing CreateTablet for tablet 60bb4719ac0b4b2191e98522a14c8f7b (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:20.365782 25541 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8f2b796f0e4f8cb073068116374f84 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:20.366870 25537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60bb4719ac0b4b2191e98522a14c8f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.368481 25540 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb10f12863445c5a3758cb49a9ad977 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:20.370102 25540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb10f12863445c5a3758cb49a9ad977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.372764 25539 tablet_service.cc:1511] Processing CreateTablet for tablet 7911d76881d24665bc1d9c2f44cb1d04 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:20.375749 25538 tablet_service.cc:1511] Processing CreateTablet for tablet ce6136f5ac6545f0848f5360445b2fef (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:20.377774 25532 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf909e389504f57a78779640f384ffd (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:20.378674 25535 tablet_service.cc:1511] Processing CreateTablet for tablet f32bd4b1dda240d68537ea8e71e7e497 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:20.380748 25611 tablet_service.cc:1511] Processing CreateTablet for tablet 60bb4719ac0b4b2191e98522a14c8f7b (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:20.383337 25611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60bb4719ac0b4b2191e98522a14c8f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.384156 25614 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb10f12863445c5a3758cb49a9ad977 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:20.385936 25614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb10f12863445c5a3758cb49a9ad977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.387661 25461 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8e2f5c26f8464c93f0b0280708cf4b (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:20.388132 25610 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8e2f5c26f8464c93f0b0280708cf4b (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:20.389444 25461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8e2f5c26f8464c93f0b0280708cf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.389657 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8e2f5c26f8464c93f0b0280708cf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.389966 25536 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8e2f5c26f8464c93f0b0280708cf4b (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:20.391837 25607 tablet_service.cc:1511] Processing CreateTablet for tablet ad80245c26414e77bc09fb62984692ed (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:20.392150 25458 tablet_service.cc:1511] Processing CreateTablet for tablet ad80245c26414e77bc09fb62984692ed (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:20.393570 25607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad80245c26414e77bc09fb62984692ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.375754 25533 tablet_service.cc:1511] Processing CreateTablet for tablet ad80245c26414e77bc09fb62984692ed (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:20.394883 25457 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf909e389504f57a78779640f384ffd (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:20.393088 25608 tablet_service.cc:1511] Processing CreateTablet for tablet 0db2844b2592440f94b6c70b28ce13a6 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:20.396608 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db2844b2592440f94b6c70b28ce13a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.396387 25613 tablet_service.cc:1511] Processing CreateTablet for tablet 7911d76881d24665bc1d9c2f44cb1d04 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:20.397281 25609 tablet_service.cc:1511] Processing CreateTablet for tablet f32bd4b1dda240d68537ea8e71e7e497 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:20.397934 25613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7911d76881d24665bc1d9c2f44cb1d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.398726 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32bd4b1dda240d68537ea8e71e7e497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.393707 25460 tablet_service.cc:1511] Processing CreateTablet for tablet f32bd4b1dda240d68537ea8e71e7e497 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:20.378691 25612 tablet_service.cc:1511] Processing CreateTablet for tablet ce6136f5ac6545f0848f5360445b2fef (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:20.401696 25612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6136f5ac6545f0848f5360445b2fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.401865 25606 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf909e389504f57a78779640f384ffd (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:20.403314 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf909e389504f57a78779640f384ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.393710 25458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad80245c26414e77bc09fb62984692ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.384159 25615 tablet_service.cc:1511] Processing CreateTablet for tablet 1c8f2b796f0e4f8cb073068116374f84 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:20.406314 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8f2b796f0e4f8cb073068116374f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.381966 25534 tablet_service.cc:1511] Processing CreateTablet for tablet 0db2844b2592440f94b6c70b28ce13a6 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:20.408787 25457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf909e389504f57a78779640f384ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.385455 25462 tablet_service.cc:1511] Processing CreateTablet for tablet 60bb4719ac0b4b2191e98522a14c8f7b (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:20.411128 25462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60bb4719ac0b4b2191e98522a14c8f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.395004 25459 tablet_service.cc:1511] Processing CreateTablet for tablet 0db2844b2592440f94b6c70b28ce13a6 (DEFAULT_TABLE table=test-workload [id=8a6f3a30b9cf4cfda3c8c298fe59ec34]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:20.414425 25459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db2844b2592440f94b6c70b28ce13a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.416787 25460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32bd4b1dda240d68537ea8e71e7e497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.428509 25539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7911d76881d24665bc1d9c2f44cb1d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.429951 25535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32bd4b1dda240d68537ea8e71e7e497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.431301 25541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8f2b796f0e4f8cb073068116374f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.432760 25538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce6136f5ac6545f0848f5360445b2fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.434396 25533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad80245c26414e77bc09fb62984692ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.440857 25534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db2844b2592440f94b6c70b28ce13a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.444860 25532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf909e389504f57a78779640f384ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.448872 25536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8e2f5c26f8464c93f0b0280708cf4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:20.533291 25668 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.546254 25670 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:20.569772 25669 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:20.585155 25670 tablet_bootstrap.cc:654] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.591003 25668 tablet_bootstrap.cc:654] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.600502 25669 tablet_bootstrap.cc:654] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.619378 25668 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:20.620167 25668 ts_tablet_manager.cc:1403] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.020s
I20260709 13:13:20.622685 25670 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:20.623394 25670 ts_tablet_manager.cc:1403] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.015s
I20260709 13:13:20.623799 25668 raft_consensus.cc:359] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.624756 25668 raft_consensus.cc:385] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.625080 25668 raft_consensus.cc:740] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.626840 25669 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.626170 25668 consensus_queue.cc:260] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.627547 25669 ts_tablet_manager.cc:1403] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.009s
I20260709 13:13:20.627444 25670 raft_consensus.cc:359] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.628715 25670 raft_consensus.cc:385] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.629163 25670 raft_consensus.cc:740] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.630028 25501 heartbeater.cc:499] Master 127.13.196.126:36119 was elected leader, sending a full tablet report...
I20260709 13:13:20.630672 25668 ts_tablet_manager.cc:1434] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:13:20.630173 25670 consensus_queue.cc:260] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.631548 25669 raft_consensus.cc:359] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.632046 25668 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.632503 25669 raft_consensus.cc:385] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.632925 25669 raft_consensus.cc:740] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.634083 25669 consensus_queue.cc:260] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.642412 25668 tablet_bootstrap.cc:654] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.643714 25650 heartbeater.cc:499] Master 127.13.196.126:36119 was elected leader, sending a full tablet report...
I20260709 13:13:20.644480 25669 ts_tablet_manager.cc:1434] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.014s
I20260709 13:13:20.645715 25669 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
W20260709 13:13:20.648051 25502 tablet.cc:2406] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:20.654057 25669 tablet_bootstrap.cc:654] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:20.661293 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:20.664323 25679 raft_consensus.cc:493] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.664839 25669 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.666188 25669 ts_tablet_manager.cc:1403] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 13:13:20.668406 25668 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:20.669478 25668 ts_tablet_manager.cc:1403] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.012s
I20260709 13:13:20.670516 25669 raft_consensus.cc:359] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.671574 25669 raft_consensus.cc:385] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.671943 25669 raft_consensus.cc:740] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.673163 25669 consensus_queue.cc:260] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.674587 25668 raft_consensus.cc:359] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.675835 25668 raft_consensus.cc:385] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.676437 25669 ts_tablet_manager.cc:1434] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:13:20.665385 25679 raft_consensus.cc:515] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.677838 25669 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:20.686733 25669 tablet_bootstrap.cc:654] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.689128 25679 leader_election.cc:290] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:20.676292 25668 raft_consensus.cc:740] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.692577 25670 ts_tablet_manager.cc:1434] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.069s	user 0.036s	sys 0.034s
I20260709 13:13:20.692938 25576 heartbeater.cc:499] Master 127.13.196.126:36119 was elected leader, sending a full tablet report...
I20260709 13:13:20.694221 25670 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:20.694586 25668 consensus_queue.cc:260] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.699050 25668 ts_tablet_manager.cc:1434] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.001s
I20260709 13:13:20.700465 25668 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.700886 25669 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.701593 25669 ts_tablet_manager.cc:1403] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:13:20.705638 25669 raft_consensus.cc:359] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.706373 25669 raft_consensus.cc:385] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.706648 25669 raft_consensus.cc:740] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.707479 25669 consensus_queue.cc:260] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.709761 25669 ts_tablet_manager.cc:1434] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:20.710791 25669 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:20.715641 25670 tablet_bootstrap.cc:654] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.719529 25669 tablet_bootstrap.cc:654] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.727586 25668 tablet_bootstrap.cc:654] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.730260 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:20.734649 25676 raft_consensus.cc:493] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:20.735397 25439 leader_election.cc:343] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.735297 25676 raft_consensus.cc:515] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.741194 25676 leader_election.cc:290] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:20.747076 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
W20260709 13:13:20.752429 25439 leader_election.cc:343] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.753028 25439 leader_election.cc:304] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7bf01e666cba4b98aacde60a2a634711; no voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:20.754110 25670 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:20.754482 25679 raft_consensus.cc:2749] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:20.761564 25668 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:20.762578 25668 ts_tablet_manager.cc:1403] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.011s
I20260709 13:13:20.755686 25670 ts_tablet_manager.cc:1403] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.003s
I20260709 13:13:20.767493 25669 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.768893 25669 ts_tablet_manager.cc:1403] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.013s
I20260709 13:13:20.768893 25675 raft_consensus.cc:493] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.770455 25675 raft_consensus.cc:515] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.771482 25668 raft_consensus.cc:359] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.772614 25668 raft_consensus.cc:385] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.773023 25668 raft_consensus.cc:740] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.773552 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:20.774269 25668 consensus_queue.cc:260] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
W20260709 13:13:20.775775 25588 leader_election.cc:343] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.777406 25668 ts_tablet_manager.cc:1434] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:13:20.778903 25668 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.780311 25675 leader_election.cc:290] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:20.783659 25670 raft_consensus.cc:359] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.784569 25670 raft_consensus.cc:385] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.784914 25670 raft_consensus.cc:740] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.786722 25668 tablet_bootstrap.cc:654] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.773123 25669 raft_consensus.cc:359] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.790387 25669 raft_consensus.cc:385] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.790840 25669 raft_consensus.cc:740] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.791057 25670 consensus_queue.cc:260] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.792217 25669 consensus_queue.cc:260] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.794492 25670 ts_tablet_manager.cc:1434] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:13:20.794943 25669 ts_tablet_manager.cc:1434] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 13:13:20.796228 25670 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:20.796406 25669 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:20.800267 25668 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:20.801092 25668 ts_tablet_manager.cc:1403] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 13:13:20.805233 25669 tablet_bootstrap.cc:654] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.806486 25670 tablet_bootstrap.cc:654] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.805178 25668 raft_consensus.cc:359] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.810245 25668 raft_consensus.cc:385] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.811327 25668 raft_consensus.cc:740] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.813252 25668 consensus_queue.cc:260] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.816685 25668 ts_tablet_manager.cc:1434] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:13:20.818095 25668 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.833775 25669 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.833859 25668 tablet_bootstrap.cc:654] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.834748 25669 ts_tablet_manager.cc:1403] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.003s
I20260709 13:13:20.838588 25669 raft_consensus.cc:359] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.839440 25669 raft_consensus.cc:385] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.839753 25669 raft_consensus.cc:740] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.840811 25669 consensus_queue.cc:260] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.843551 25669 ts_tablet_manager.cc:1434] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:13:20.844185 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:20.844811 25669 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:20.845031 25625 raft_consensus.cc:2468] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 0.
I20260709 13:13:20.845645 25670 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:20.844844 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:20.846361 25670 ts_tablet_manager.cc:1403] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.004s
I20260709 13:13:20.847469 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:20.848274 25476 raft_consensus.cc:2468] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 0.
W20260709 13:13:20.850211 25588 leader_election.cc:343] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.850796 25588 leader_election.cc:304] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:20.851231 25670 raft_consensus.cc:359] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.852236 25676 raft_consensus.cc:2749] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:20.852612 25670 raft_consensus.cc:385] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.853129 25670 raft_consensus.cc:740] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.853832 25669 tablet_bootstrap.cc:654] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.853847 25514 leader_election.cc:304] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:20.855158 25675 raft_consensus.cc:2804] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.854414 25670 consensus_queue.cc:260] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.855597 25675 raft_consensus.cc:493] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.856133 25675 raft_consensus.cc:3060] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.862236 25668 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:20.862843 25668 ts_tablet_manager.cc:1403] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.006s
I20260709 13:13:20.865911 25668 raft_consensus.cc:359] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.866566 25668 raft_consensus.cc:385] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.866832 25668 raft_consensus.cc:740] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.867177 25669 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.867897 25669 ts_tablet_manager.cc:1403] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.010s
I20260709 13:13:20.867604 25668 consensus_queue.cc:260] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.869247 25675 raft_consensus.cc:515] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.871687 25669 raft_consensus.cc:359] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.872867 25669 raft_consensus.cc:385] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.873260 25669 raft_consensus.cc:740] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.873339 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:20.874372 25476 raft_consensus.cc:3060] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.875731 25669 consensus_queue.cc:260] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.876717 25670 ts_tablet_manager.cc:1434] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.030s	user 0.015s	sys 0.002s
I20260709 13:13:20.878017 25670 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:20.881603 25668 ts_tablet_manager.cc:1434] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:13:20.885982 25670 tablet_bootstrap.cc:654] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.886478 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:20.887202 25625 raft_consensus.cc:3060] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.889235 25669 ts_tablet_manager.cc:1434] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 13:13:20.890612 25669 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:20.896502 25675 leader_election.cc:290] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:20.898273 25669 tablet_bootstrap.cc:654] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.902721 25476 raft_consensus.cc:2468] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:20.905678 25514 leader_election.cc:304] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:20.907374 25675 raft_consensus.cc:2804] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.908715 25675 raft_consensus.cc:697] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:20.898818 25625 raft_consensus.cc:2468] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:20.907536 25668 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.911608 25670 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:20.918917 25670 ts_tablet_manager.cc:1403] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.015s
I20260709 13:13:20.912837 25695 raft_consensus.cc:493] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.911633 25675 consensus_queue.cc:237] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.920210 25695 raft_consensus.cc:515] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.923151 25669 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.922849 25670 raft_consensus.cc:359] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.923779 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:20.919564 25668 tablet_bootstrap.cc:654] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.924085 25695 leader_election.cc:290] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:20.925120 25670 raft_consensus.cc:385] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.925506 25670 raft_consensus.cc:740] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.925518 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
W20260709 13:13:20.925771 25514 leader_election.cc:343] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.926440 25670 consensus_queue.cc:260] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
W20260709 13:13:20.927103 25514 leader_election.cc:343] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.927677 25514 leader_election.cc:304] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:20.928900 25670 ts_tablet_manager.cc:1434] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:20.928697 25669 ts_tablet_manager.cc:1403] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.019s
I20260709 13:13:20.929409 25695 raft_consensus.cc:2749] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:20.930133 25670 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:20.932957 25669 raft_consensus.cc:359] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.933888 25669 raft_consensus.cc:385] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.934366 25669 raft_consensus.cc:740] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.934929 25668 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:20.935648 25669 consensus_queue.cc:260] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.938231 25669 ts_tablet_manager.cc:1434] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:20.938617 25670 tablet_bootstrap.cc:654] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.939435 25668 ts_tablet_manager.cc:1403] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.002s
I20260709 13:13:20.939860 25669 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:20.943250 25668 raft_consensus.cc:359] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.944286 25668 raft_consensus.cc:385] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.944653 25668 raft_consensus.cc:740] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.945716 25668 consensus_queue.cc:260] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.948902 25668 ts_tablet_manager.cc:1434] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:20.950453 25668 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.956069 25669 tablet_bootstrap.cc:654] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.957767 25668 tablet_bootstrap.cc:654] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.943310 25371 catalog_manager.cc:5697] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 1 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.964826 25676 raft_consensus.cc:493] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.965705 25676 raft_consensus.cc:515] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.969184 25668 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:20.969962 25668 ts_tablet_manager.cc:1403] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.001s
I20260709 13:13:20.970315 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
W20260709 13:13:20.972322 25588 leader_election.cc:343] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.972397 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:20.973696 25668 raft_consensus.cc:359] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.974630 25668 raft_consensus.cc:385] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:20.974962 25588 leader_election.cc:343] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.976248 25588 leader_election.cc:304] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:20.978183 25676 leader_election.cc:290] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:20.979256 25676 raft_consensus.cc:2749] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:20.974990 25668 raft_consensus.cc:740] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.981523 25668 consensus_queue.cc:260] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.984272 25668 ts_tablet_manager.cc:1434] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:13:20.986991 25669 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:20.987665 25668 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:20.987725 25669 ts_tablet_manager.cc:1403] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.014s
I20260709 13:13:20.986994 25670 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:20.991569 25670 ts_tablet_manager.cc:1403] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.015s
I20260709 13:13:20.991659 25669 raft_consensus.cc:359] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.992848 25669 raft_consensus.cc:385] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.993458 25669 raft_consensus.cc:740] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.994408 25669 consensus_queue.cc:260] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.995390 25670 raft_consensus.cc:359] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:20.996306 25670 raft_consensus.cc:385] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.996663 25670 raft_consensus.cc:740] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.997248 25669 ts_tablet_manager.cc:1434] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:13:20.997709 25670 consensus_queue.cc:260] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.000283 25668 tablet_bootstrap.cc:654] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.000399 25669 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:21.000672 25670 ts_tablet_manager.cc:1434] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:13:21.001979 25670 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:21.009727 25669 tablet_bootstrap.cc:654] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.011122 25668 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:21.009785 25670 tablet_bootstrap.cc:654] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.011732 25668 ts_tablet_manager.cc:1403] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 13:13:21.015235 25668 raft_consensus.cc:359] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.016047 25668 raft_consensus.cc:385] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.016371 25668 raft_consensus.cc:740] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.017217 25668 consensus_queue.cc:260] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.020990 25669 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
I20260709 13:13:21.021679 25669 ts_tablet_manager.cc:1403] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:13:21.025034 25669 raft_consensus.cc:359] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.025852 25669 raft_consensus.cc:385] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.025972 25668 ts_tablet_manager.cc:1434] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:13:21.026147 25669 raft_consensus.cc:740] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.027331 25669 consensus_queue.cc:260] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.027827 25668 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:21.030212 25669 ts_tablet_manager.cc:1434] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:13:21.031630 25669 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c: Bootstrap starting.
I20260709 13:13:21.036810 25704 raft_consensus.cc:493] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.037710 25704 raft_consensus.cc:515] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.038524 25669 tablet_bootstrap.cc:654] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.042326 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:21.043287 25476 raft_consensus.cc:2468] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 0.
I20260709 13:13:21.044798 25588 leader_election.cc:304] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.045704 25670 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:21.045835 25676 raft_consensus.cc:2804] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.046392 25676 raft_consensus.cc:493] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.046743 25676 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.046972 25704 leader_election.cc:290] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:21.049245 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
W20260709 13:13:21.051410 25588 leader_election.cc:343] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.053990 25668 tablet_bootstrap.cc:654] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.056792 25670 ts_tablet_manager.cc:1403] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.017s
I20260709 13:13:21.058020 25704 raft_consensus.cc:493] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.058140 25676 raft_consensus.cc:515] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.058923 25704 raft_consensus.cc:515] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.062345 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:21.064081 25676 leader_election.cc:290] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:21.065774 25669 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c: No bootstrap required, opened a new log
W20260709 13:13:21.066066 25588 leader_election.cc:343] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.066423 25669 ts_tablet_manager.cc:1403] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.011s
I20260709 13:13:21.066646 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.065439 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:21.067378 25704 leader_election.cc:290] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:21.067786 25476 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.068311 25668 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:21.068950 25668 ts_tablet_manager.cc:1403] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.000s
I20260709 13:13:21.069370 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.069855 25669 raft_consensus.cc:359] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.070617 25669 raft_consensus.cc:385] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.070917 25670 raft_consensus.cc:359] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.071807 25670 raft_consensus.cc:385] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.070923 25669 raft_consensus.cc:740] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.072165 25670 raft_consensus.cc:740] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
W20260709 13:13:21.073885 25588 leader_election.cc:343] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.074592 25588 leader_election.cc:304] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:21.073369 25668 raft_consensus.cc:359] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.075692 25704 raft_consensus.cc:2749] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.073369 25670 consensus_queue.cc:260] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.076545 25668 raft_consensus.cc:385] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.077515 25551 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.079586 25670 ts_tablet_manager.cc:1434] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:13:21.081049 25670 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:21.077710 25668 raft_consensus.cc:740] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.082398 25476 raft_consensus.cc:2468] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 1.
I20260709 13:13:21.082871 25669 consensus_queue.cc:260] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.083482 25704 raft_consensus.cc:493] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.083287 25668 consensus_queue.cc:260] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.084074 25704 raft_consensus.cc:515] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.085933 25675 raft_consensus.cc:493] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.086534 25675 raft_consensus.cc:515] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.089859 25679 raft_consensus.cc:493] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.090476 25679 raft_consensus.cc:515] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.093137 25679 leader_election.cc:290] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.095350 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.095225 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.096487 25675 leader_election.cc:290] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
W20260709 13:13:21.097158 25439 leader_election.cc:343] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.094322 25669 ts_tablet_manager.cc:1434] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:13:21.097616 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bd4b1dda240d68537ea8e71e7e497" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.098001 25704 leader_election.cc:290] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:21.096145 25625 raft_consensus.cc:2468] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.085954 25668 ts_tablet_manager.cc:1434] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:13:21.098456 25624 raft_consensus.cc:2468] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 0.
I20260709 13:13:21.099764 25668 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:21.099902 25439 leader_election.cc:304] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:21.099902 25514 leader_election.cc:304] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:21.101169 25674 raft_consensus.cc:493] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.101217 25675 raft_consensus.cc:2804] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.102031 25675 raft_consensus.cc:493] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.101922 25674 raft_consensus.cc:515] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.102789 25675 raft_consensus.cc:3060] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.105094 25674 leader_election.cc:290] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.101899 25679 raft_consensus.cc:2804] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.108127 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.105752 25679 raft_consensus.cc:493] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.109591 25550 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.111891 25674 raft_consensus.cc:493] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.112558 25439 leader_election.cc:304] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.113128 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.112756 25674 raft_consensus.cc:515] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.113936 25624 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.094345 25670 tablet_bootstrap.cc:654] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.115541 25674 leader_election.cc:290] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.115741 25475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:21.116518 25674 raft_consensus.cc:2804] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.116978 25475 raft_consensus.cc:2468] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 0.
I20260709 13:13:21.117173 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bd4b1dda240d68537ea8e71e7e497" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:21.110015 25679 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.119134 25551 raft_consensus.cc:2468] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 1.
I20260709 13:13:21.119362 25476 raft_consensus.cc:2468] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 0.
I20260709 13:13:21.120075 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.120186 25588 leader_election.cc:304] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.121008 25550 raft_consensus.cc:2468] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 0.
I20260709 13:13:21.121434 25588 leader_election.cc:304] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.127731 25675 raft_consensus.cc:515] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.128329 25670 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:21.130493 25675 leader_election.cc:290] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.130537 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.130990 25670 ts_tablet_manager.cc:1403] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.006s
I20260709 13:13:21.131506 25624 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.132100 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bd4b1dda240d68537ea8e71e7e497" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:21.132846 25625 raft_consensus.cc:3060] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.134687 25670 raft_consensus.cc:359] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.135824 25676 raft_consensus.cc:2804] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.139986 25668 tablet_bootstrap.cc:654] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.140908 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.141712 25712 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.142128 25439 leader_election.cc:304] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.142309 25712 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.141773 25550 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.144601 25704 raft_consensus.cc:2804] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.144928 25712 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.145051 25704 raft_consensus.cc:493] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.145532 25704 raft_consensus.cc:3060] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.145589 25712 raft_consensus.cc:2804] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.146081 25712 raft_consensus.cc:493] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.146440 25712 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.135571 25670 raft_consensus.cc:385] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.149961 25670 raft_consensus.cc:740] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.153010 25670 consensus_queue.cc:260] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.159173 25625 raft_consensus.cc:2468] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:21.155580 25712 raft_consensus.cc:515] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.161073 25514 leader_election.cc:304] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:21.162122 25712 leader_election.cc:290] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.162194 25675 raft_consensus.cc:2804] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.116983 25674 raft_consensus.cc:493] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.163101 25675 raft_consensus.cc:697] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:21.164240 25675 consensus_queue.cc:237] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.165176 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32bd4b1dda240d68537ea8e71e7e497" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:21.166251 25476 raft_consensus.cc:3060] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.166529 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.163203 25674 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.177392 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:21.178171 25624 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.180855 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.181737 25625 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.184732 25670 ts_tablet_manager.cc:1434] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.004s
I20260709 13:13:21.189497 25712 raft_consensus.cc:493] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.190433 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.203302 25676 raft_consensus.cc:697] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:21.204280 25550 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.192294 25624 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
W20260709 13:13:21.191635 25439 leader_election.cc:343] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.191612 25476 raft_consensus.cc:2468] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:21.204800 25712 raft_consensus.cc:515] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.210258 25676 consensus_queue.cc:237] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.212442 25712 leader_election.cc:290] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.213513 25668 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: No bootstrap required, opened a new log
I20260709 13:13:21.214449 25668 ts_tablet_manager.cc:1403] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.115s	user 0.036s	sys 0.036s
I20260709 13:13:21.217341 25670 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:21.221973 25668 raft_consensus.cc:359] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.222890 25668 raft_consensus.cc:385] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.223209 25668 raft_consensus.cc:740] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.220803 25674 raft_consensus.cc:515] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.222586 25372 catalog_manager.cc:5697] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 1 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.225867 25674 leader_election.cc:290] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.228193 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.229049 25551 raft_consensus.cc:2468] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.229179 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.228246 25439 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:21.230772 25624 raft_consensus.cc:2468] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.227377 25668 consensus_queue.cc:260] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.232281 25439 leader_election.cc:304] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.237119 25716 raft_consensus.cc:2804] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.209683 25679 raft_consensus.cc:515] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.241784 25679 leader_election.cc:290] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.234774 25674 raft_consensus.cc:2804] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.242872 25674 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.243248 25674 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.245810 25668 ts_tablet_manager.cc:1434] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:13:21.246321 25550 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.255501 25439 leader_election.cc:304] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.257122 25712 raft_consensus.cc:2804] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.257563 25712 raft_consensus.cc:493] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.257920 25712 raft_consensus.cc:3060] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.264844 25674 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.265683 25373 catalog_manager.cc:5697] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 1 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.267715 25674 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.255885 25704 raft_consensus.cc:515] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.273978 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.274152 25712 raft_consensus.cc:515] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.274878 25550 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.276682 25712 leader_election.cc:290] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.278019 25704 leader_election.cc:290] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:21.279815 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:21.280627 25476 raft_consensus.cc:3060] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.281482 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.281558 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:21.282248 25551 raft_consensus.cc:3060] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.282338 25624 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.284883 25550 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.270951 25716 raft_consensus.cc:697] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Running, Role: LEADER
I20260709 13:13:21.291942 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:21.292517 25476 raft_consensus.cc:2468] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 1.
I20260709 13:13:21.292775 25625 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.294400 25549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.294924 25624 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.295877 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:21.296625 25623 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.296988 25670 tablet_bootstrap.cc:654] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.296892 25588 leader_election.cc:304] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.298205 25704 raft_consensus.cc:2804] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.299002 25704 raft_consensus.cc:697] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:21.300140 25704 consensus_queue.cc:237] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.291942 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.292635 25716 consensus_queue.cc:237] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.315281 25625 raft_consensus.cc:2468] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.312927 25623 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.311329 25439 leader_election.cc:304] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711; no voters: 
W20260709 13:13:21.321346 25439 leader_election.cc:343] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.321410 25719 raft_consensus.cc:2804] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:21.322154 25439 leader_election.cc:343] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.322482 25719 raft_consensus.cc:697] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Running, Role: LEADER
I20260709 13:13:21.311923 25551 raft_consensus.cc:2468] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 1.
I20260709 13:13:21.323927 25719 consensus_queue.cc:237] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.325131 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.327261 25675 consensus_queue.cc:1048] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.328431 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:21.329495 25623 raft_consensus.cc:3060] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.326005 25550 raft_consensus.cc:3060] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.333531 25439 leader_election.cc:304] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:21.336727 25712 raft_consensus.cc:2804] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.337509 25712 raft_consensus.cc:697] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Running, Role: LEADER
I20260709 13:13:21.339541 25712 consensus_queue.cc:237] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.354282 25439 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:21.355412 25674 raft_consensus.cc:2804] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.355960 25674 raft_consensus.cc:697] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Running, Role: LEADER
I20260709 13:13:21.356559 25373 catalog_manager.cc:5697] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 1 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.357197 25674 consensus_queue.cc:237] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.360235 25675 consensus_queue.cc:1048] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.417307 25373 catalog_manager.cc:5697] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7bf01e666cba4b98aacde60a2a634711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.432199 25716 raft_consensus.cc:493] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.413843 25550 raft_consensus.cc:2468] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.432998 25716 raft_consensus.cc:515] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.434849 25439 leader_election.cc:304] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:21.435665 25716 leader_election.cc:290] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.438069 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.438273 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:21.438930 25624 raft_consensus.cc:2468] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 0.
I20260709 13:13:21.436658 25716 raft_consensus.cc:2804] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:21.440228 25439 leader_election.cc:343] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.441020 25716 raft_consensus.cc:697] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Running, Role: LEADER
I20260709 13:13:21.441316 25439 leader_election.cc:304] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:21.441171 25623 raft_consensus.cc:2468] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.442368 25679 raft_consensus.cc:2804] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.442942 25679 raft_consensus.cc:493] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.443362 25679 raft_consensus.cc:3060] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.443683 25670 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:21.444355 25670 ts_tablet_manager.cc:1403] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.227s	user 0.030s	sys 0.017s
I20260709 13:13:21.447764 25670 raft_consensus.cc:359] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.450086 25716 consensus_queue.cc:237] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.451429 25670 raft_consensus.cc:385] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.451853 25670 raft_consensus.cc:740] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.460479 25670 consensus_queue.cc:260] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.461154 25679 raft_consensus.cc:515] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.466542 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:21.468864 25670 ts_tablet_manager.cc:1434] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:13:21.470127 25670 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
W20260709 13:13:21.475800 25439 leader_election.cc:343] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.468513 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "7bf01e666cba4b98aacde60a2a634711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:21.477653 25625 raft_consensus.cc:3060] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.480173 25679 leader_election.cc:290] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.486228 25372 catalog_manager.cc:5697] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7bf01e666cba4b98aacde60a2a634711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.487020 25625 raft_consensus.cc:2468] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf01e666cba4b98aacde60a2a634711 in term 1.
I20260709 13:13:21.488262 25372 catalog_manager.cc:5697] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7bf01e666cba4b98aacde60a2a634711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.488896 25439 leader_election.cc:304] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:21.490207 25719 raft_consensus.cc:2804] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.490820 25719 raft_consensus.cc:697] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Running, Role: LEADER
I20260709 13:13:21.490026 25372 catalog_manager.cc:5697] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7bf01e666cba4b98aacde60a2a634711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.491748 25719 consensus_queue.cc:237] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.493335 25670 tablet_bootstrap.cc:654] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.505079 25670 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:21.505601 25670 ts_tablet_manager.cc:1403] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.004s
I20260709 13:13:21.508400 25670 raft_consensus.cc:359] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.509187 25670 raft_consensus.cc:385] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.509501 25670 raft_consensus.cc:740] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.510327 25670 consensus_queue.cc:260] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.512862 25670 ts_tablet_manager.cc:1434] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:21.512773 25372 catalog_manager.cc:5697] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7bf01e666cba4b98aacde60a2a634711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.514333 25670 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f: Bootstrap starting.
I20260709 13:13:21.515307 25372 catalog_manager.cc:5697] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7bf01e666cba4b98aacde60a2a634711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.521528 25670 tablet_bootstrap.cc:654] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.526958 25670 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f: No bootstrap required, opened a new log
I20260709 13:13:21.527486 25670 ts_tablet_manager.cc:1403] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:13:21.530438 25670 raft_consensus.cc:359] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.531069 25670 raft_consensus.cc:385] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.531306 25670 raft_consensus.cc:740] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.531854 25670 consensus_queue.cc:260] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.533586 25670 ts_tablet_manager.cc:1434] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:21.589499 25695 raft_consensus.cc:493] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.590214 25695 raft_consensus.cc:515] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.592301 25695 leader_election.cc:290] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.593487 25476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf01e666cba4b98aacde60a2a634711" is_pre_election: true
I20260709 13:13:21.593809 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.594676 25625 raft_consensus.cc:2393] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a01d3d7cd9342c7a62305e6ede6a87f in current term 1: Already voted for candidate 7bf01e666cba4b98aacde60a2a634711 in this term.
I20260709 13:13:21.595652 25514 leader_election.cc:304] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:21.596504 25695 raft_consensus.cc:3060] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.604077 25695 raft_consensus.cc:2749] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.633406 25695 consensus_queue.cc:1048] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.637841 25675 consensus_queue.cc:1048] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.690168 25704 consensus_queue.cc:1048] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.704444 25704 consensus_queue.cc:1048] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.722126 25719 consensus_queue.cc:1048] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.738304 25674 consensus_queue.cc:1048] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.742862 25704 consensus_queue.cc:1048] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.752254 25704 consensus_queue.cc:1048] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.772640 14097 ts_manager.cc:295] Set tserver state for 7bf01e666cba4b98aacde60a2a634711 to MAINTENANCE_MODE
I20260709 13:13:21.773942 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
I20260709 13:13:21.774652 25674 consensus_queue.cc:1048] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.792304 25679 consensus_queue.cc:1048] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.833359 25695 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.834633 25695 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.837603 25695 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.842396 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.844803 25623 raft_consensus.cc:2393] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5a01d3d7cd9342c7a62305e6ede6a87f in current term 1: Already voted for candidate 7bf01e666cba4b98aacde60a2a634711 in this term.
W20260709 13:13:21.848796 25514 leader_election.cc:336] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:21.848958 25679 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.849753 25514 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:21.850956 25695 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.859270 25695 raft_consensus.cc:2749] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.863619 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:21.865526 14097 tablet_replica.cc:333] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.866667 14097 raft_consensus.cc:2243] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.867214 25716 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.868160 14097 raft_consensus.cc:2272] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.872076 14097 tablet_replica.cc:333] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.873258 14097 raft_consensus.cc:2243] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.874316 14097 pending_rounds.cc:70] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Trying to abort 1 pending ops.
I20260709 13:13:21.874617 14097 pending_rounds.cc:77] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637074393661440 op_type: NO_OP noop_request { }
I20260709 13:13:21.874722 25550 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.875087 14097 raft_consensus.cc:2889] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:21.875478 14097 raft_consensus.cc:2272] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.879522 14097 tablet_replica.cc:333] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.880553 14097 raft_consensus.cc:2243] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.882117 14097 raft_consensus.cc:2272] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.885521 14097 tablet_replica.cc:333] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.886492 14097 raft_consensus.cc:2243] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.887102 14097 raft_consensus.cc:2272] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.891369 14097 tablet_replica.cc:333] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.892486 14097 raft_consensus.cc:2243] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.893993 14097 raft_consensus.cc:2272] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.897413 14097 tablet_replica.cc:333] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.898070 14097 raft_consensus.cc:2243] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.898851 14097 pending_rounds.cc:70] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Trying to abort 1 pending ops.
I20260709 13:13:21.899057 14097 pending_rounds.cc:77] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637074930688000 op_type: NO_OP noop_request { }
I20260709 13:13:21.899399 14097 raft_consensus.cc:2889] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:21.899721 14097 raft_consensus.cc:2272] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.902318 14097 tablet_replica.cc:333] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.903012 14097 raft_consensus.cc:2243] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.903745 14097 pending_rounds.cc:70] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Trying to abort 1 pending ops.
I20260709 13:13:21.903950 14097 pending_rounds.cc:77] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637074774159360 op_type: NO_OP noop_request { }
I20260709 13:13:21.904419 14097 raft_consensus.cc:2889] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:21.904733 14097 raft_consensus.cc:2272] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.907612 14097 tablet_replica.cc:333] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.908653 14097 raft_consensus.cc:2243] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.909446 14097 raft_consensus.cc:2272] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.913420 14097 tablet_replica.cc:333] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.914153 14097 raft_consensus.cc:2243] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.914711 14097 raft_consensus.cc:2272] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.918992 14097 tablet_replica.cc:333] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: stopping tablet replica
I20260709 13:13:21.919699 14097 raft_consensus.cc:2243] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.920243 14097 raft_consensus.cc:2272] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.945757 25514 consensus_peers.cc:597] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.965131 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
I20260709 13:13:21.986440 25695 raft_consensus.cc:493] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.987396 25695 raft_consensus.cc:515] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:21.990976 25695 leader_election.cc:290] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:21.993073 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:21.994146 25623 raft_consensus.cc:2468] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:21.996412 25514 leader_election.cc:304] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:21.997601 25695 raft_consensus.cc:2804] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:21.998301 25695 raft_consensus.cc:493] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.998705 25695 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:22.000135 25514 leader_election.cc:336] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:22.009886 25695 raft_consensus.cc:515] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:22.013494 25695 leader_election.cc:290] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:22.015466 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:22.016269 25623 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:22.018245 25514 leader_election.cc:336] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:22.026731 25623 raft_consensus.cc:2468] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:22.029068 25514 leader_election.cc:304] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:22.030176 25695 raft_consensus.cc:2804] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:22.030762 25695 raft_consensus.cc:697] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:22.031672 25695 consensus_queue.cc:237] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:22.042099 25372 catalog_manager.cc:5697] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 1 to 2, leader changed from 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 2 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:22.094111 25514 consensus_peers.cc:597] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.226337 25588 consensus_peers.cc:597] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.273304 25588 consensus_peers.cc:597] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.419263 25514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111) [suppressed 157 similar messages]
W20260709 13:13:22.464592 25514 consensus_peers.cc:597] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.548573 25623 raft_consensus.cc:1275] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:22.550658 25695 consensus_queue.cc:1048] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:22.679829 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:23.237138 25704 raft_consensus.cc:493] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.237808 25704 raft_consensus.cc:515] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.239843 25704 leader_election.cc:290] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:23.242304 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:23.243211 25550 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 1.
W20260709 13:13:23.244330 25588 leader_election.cc:336] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.245477 25588 leader_election.cc:304] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.246447 25704 raft_consensus.cc:2804] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:23.246928 25704 raft_consensus.cc:493] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.247251 25704 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.257459 25704 raft_consensus.cc:515] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.260181 25704 leader_election.cc:290] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:23.262264 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:23.262990 25550 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:23.264050 25588 leader_election.cc:336] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.269745 25550 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 2.
I20260709 13:13:23.271268 25588 leader_election.cc:304] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.272315 25704 raft_consensus.cc:2804] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.272928 25704 raft_consensus.cc:697] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:23.273769 25704 consensus_queue.cc:237] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.282387 25371 catalog_manager.cc:5697] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 1 to 2, leader changed from 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 2 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.290179 25737 raft_consensus.cc:493] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.291023 25737 raft_consensus.cc:515] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.291409 25704 raft_consensus.cc:493] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.292026 25704 raft_consensus.cc:515] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.293895 25737 leader_election.cc:290] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:23.294971 25704 leader_election.cc:290] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:23.297150 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:23.297924 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:23.299428 25623 raft_consensus.cc:2468] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
W20260709 13:13:23.299793 25588 leader_election.cc:336] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.300544 25588 leader_election.cc:304] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.301021 25737 raft_consensus.cc:493] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.301340 25514 leader_election.cc:304] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:23.301672 25737 raft_consensus.cc:515] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.302152 25704 raft_consensus.cc:2749] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:23.304435 25762 raft_consensus.cc:2804] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:23.304879 25737 leader_election.cc:290] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:23.305068 25762 raft_consensus.cc:493] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.305608 25762 raft_consensus.cc:3060] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:23.307621 25514 leader_election.cc:336] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.307544 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:23.308697 25623 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:23.309953 25514 leader_election.cc:304] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:23.310776 25737 raft_consensus.cc:2804] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:23.311190 25737 raft_consensus.cc:493] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.311590 25737 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:23.312529 25514 leader_election.cc:336] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.315598 25762 raft_consensus.cc:515] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.318778 25762 leader_election.cc:290] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:23.320626 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db2844b2592440f94b6c70b28ce13a6" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:23.321429 25623 raft_consensus.cc:3060] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.321388 25737 raft_consensus.cc:515] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.323729 25737 leader_election.cc:290] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
W20260709 13:13:23.324021 25514 leader_election.cc:336] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.326133 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:23.326850 25625 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:23.326898 25514 leader_election.cc:336] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.330585 25623 raft_consensus.cc:2468] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:23.332634 25514 leader_election.cc:304] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.333456 25737 raft_consensus.cc:2804] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.333999 25737 raft_consensus.cc:697] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:23.334864 25737 consensus_queue.cc:237] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.335289 25625 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:23.336781 25514 leader_election.cc:304] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.337715 25762 raft_consensus.cc:2804] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.340965 25762 raft_consensus.cc:697] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:23.342032 25762 consensus_queue.cc:237] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.345697 25371 catalog_manager.cc:5697] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 1 to 2, leader changed from 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 2 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.351773 25762 raft_consensus.cc:493] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.352458 25762 raft_consensus.cc:515] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.355098 25762 leader_election.cc:290] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:23.356917 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:23.357868 25625 raft_consensus.cc:2468] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:23.359108 25514 leader_election.cc:304] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:23.359987 25762 raft_consensus.cc:2804] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:23.360049 25514 leader_election.cc:336] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.360502 25762 raft_consensus.cc:493] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.360985 25762 raft_consensus.cc:3060] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.364507 25371 catalog_manager.cc:5697] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 1 to 2, leader changed from 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 2 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.366295 25704 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.366904 25704 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.369150 25704 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899)
I20260709 13:13:23.368999 25762 raft_consensus.cc:515] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.371160 25550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" is_pre_election: true
I20260709 13:13:23.371341 25762 leader_election.cc:290] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:23.374801 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad80245c26414e77bc09fb62984692ed" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:23.375552 25625 raft_consensus.cc:3060] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.376268 25762 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.376935 25762 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
W20260709 13:13:23.374717 25588 leader_election.cc:336] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.379251 25762 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:23.380232 25588 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c; no voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711
W20260709 13:13:23.380529 25514 leader_election.cc:336] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.382350 25704 raft_consensus.cc:2749] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:23.382596 25623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" is_pre_election: true
I20260709 13:13:23.383524 25623 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 1.
I20260709 13:13:23.383780 25625 raft_consensus.cc:2468] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
W20260709 13:13:23.384033 25514 leader_election.cc:336] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.385619 25514 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.386377 25762 raft_consensus.cc:2804] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:23.386755 25762 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7bf01e666cba4b98aacde60a2a634711)
I20260709 13:13:23.386875 25514 leader_election.cc:304] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.387230 25762 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.387837 25764 raft_consensus.cc:2804] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.388482 25764 raft_consensus.cc:697] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:23.389653 25764 consensus_queue.cc:237] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.397873 25762 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.400529 25762 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:23.400866 25371 catalog_manager.cc:5697] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 1 to 2, leader changed from 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 2 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.402704 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:23.403504 25625 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:23.405928 25514 leader_election.cc:336] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111)
I20260709 13:13:23.412726 25625 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:23.414003 25514 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 7bf01e666cba4b98aacde60a2a634711
I20260709 13:13:23.414897 25762 raft_consensus.cc:2804] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.415416 25762 raft_consensus.cc:697] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:23.416662 25762 consensus_queue.cc:237] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:23.425822 25371 catalog_manager.cc:5697] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 1 to 2, leader changed from 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 2 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.673542 25550 raft_consensus.cc:1275] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.675029 25704 consensus_queue.cc:1048] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:23.681013 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:23.695948 25588 consensus_peers.cc:597] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.726022 25514 consensus_peers.cc:597] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.766160 25625 raft_consensus.cc:1275] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:23.768252 25762 consensus_queue.cc:1048] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:23.785005 25514 consensus_peers.cc:597] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.794585 25625 raft_consensus.cc:1275] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.796001 25766 consensus_queue.cc:1048] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:23.827275 25514 consensus_peers.cc:597] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.874379 25514 consensus_peers.cc:597] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.945896 25625 raft_consensus.cc:1275] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:23.947492 25766 consensus_queue.cc:1048] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.971596 25625 raft_consensus.cc:1275] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.973145 25766 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:24.285513 25514 consensus_peers.cc:597] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:24.558205 25514 consensus_peers.cc:597] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:24.681856 25588 consensus_peers.cc:597] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:24.682271 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:24.917341 25514 consensus_peers.cc:597] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:24.938764 25588 consensus_peers.cc:597] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:25.683892 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:26.230124 25514 consensus_peers.cc:597] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:26.310958 25588 consensus_peers.cc:597] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:26.445091 25514 consensus_peers.cc:597] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:26.461809 25514 consensus_peers.cc:597] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:26.544013 25514 consensus_peers.cc:597] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:26.685679 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:26.803956 25514 consensus_peers.cc:597] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:26.994367 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:27.003913 25779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:27.004240 25780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:27.010460 14097 server_base.cc:1061] running on GCE node
W20260709 13:13:27.011135 25782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:27.013470 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:27.013824 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:27.014057 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602807014037 us; error 0 us; skew 500 ppm
I20260709 13:13:27.014962 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:27.018929 14097 webserver.cc:533] Webserver started at http://127.13.196.65:42031/ using document root <none> and password file <none>
I20260709 13:13:27.019690 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:27.019927 14097 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:27.025988 14097 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:13:27.032300 25787 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:27.033454 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:13:27.033871 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "7bf01e666cba4b98aacde60a2a634711"
format_stamp: "Formatted at 2026-07-09 13:13:19 on dist-test-slave-ftjc"
I20260709 13:13:27.034531 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:27.070794 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:27.072991 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:27.078336 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:27.085675 25794 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:13:27.123107 25514 consensus_peers.cc:597] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:27.169004 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:13:27.169505 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.085s	user 0.004s	sys 0.000s
I20260709 13:13:27.169889 14097 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:13:27.178115 25794 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.197556 25794 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.198513 25794 tablet_bootstrap.cc:492] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.199194 25794 ts_tablet_manager.cc:1403] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:13:27.201992 25794 raft_consensus.cc:359] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.202957 25794 raft_consensus.cc:740] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.203871 25794 consensus_queue.cc:260] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.207033 25794 ts_tablet_manager.cc:1434] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:13:27.207901 25794 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
W20260709 13:13:27.224133 25588 consensus_peers.cc:597] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:27.228780 25794 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:27.230089 25794 tablet_bootstrap.cc:492] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.230966 25794 ts_tablet_manager.cc:1403] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:13:27.234386 25794 raft_consensus.cc:359] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.235352 25794 raft_consensus.cc:740] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.236112 25794 consensus_queue.cc:260] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.236910 14097 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:13:27.237360 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.067s	user 0.067s	sys 0.000s
I20260709 13:13:27.238986 25794 ts_tablet_manager.cc:1434] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:27.240238 25794 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.263000 25794 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:27.264546 25794 tablet_bootstrap.cc:492] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.265304 25794 ts_tablet_manager.cc:1403] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:13:27.268761 25794 raft_consensus.cc:359] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.269819 25794 raft_consensus.cc:740] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.270800 25794 consensus_queue.cc:260] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.273171 25794 ts_tablet_manager.cc:1434] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:13:27.274204 25794 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.291025 25794 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.291972 25794 tablet_bootstrap.cc:492] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.292712 25794 ts_tablet_manager.cc:1403] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:13:27.295176 25794 raft_consensus.cc:359] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.295799 25794 raft_consensus.cc:740] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.296564 25794 consensus_queue.cc:260] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.298381 25794 ts_tablet_manager.cc:1434] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:13:27.299208 25794 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.315173 25794 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.316375 25794 tablet_bootstrap.cc:492] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.317063 25794 ts_tablet_manager.cc:1403] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:13:27.319924 25794 raft_consensus.cc:359] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.320640 25794 raft_consensus.cc:740] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.321468 25794 consensus_queue.cc:260] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.323371 25794 ts_tablet_manager.cc:1434] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:27.324100 25794 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.324404 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:38899
I20260709 13:13:27.324548 25857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:38899 every 8 connection(s)
I20260709 13:13:27.330765 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:27.362134 25794 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.363806 25794 tablet_bootstrap.cc:492] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.364967 25794 ts_tablet_manager.cc:1403] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.041s	user 0.027s	sys 0.008s
I20260709 13:13:27.368659 25858 heartbeater.cc:344] Connected to a master server at 127.13.196.126:36119
I20260709 13:13:27.369378 25858 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:27.369958 25794 raft_consensus.cc:359] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.370719 25858 heartbeater.cc:507] Master 127.13.196.126:36119 requested a full tablet report, sending...
I20260709 13:13:27.371187 25794 raft_consensus.cc:740] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.372074 25794 consensus_queue.cc:260] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.375101 25794 ts_tablet_manager.cc:1434] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:27.376233 25794 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.377785 25551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
mode: GRACEFUL
new_leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:44112
I20260709 13:13:27.378348 25832 raft_consensus.cc:3060] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.378739 25551 raft_consensus.cc:606] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Received request to transfer leadership to TS 42677b5f98ca4d948a90c7de23c1ce1c
I20260709 13:13:27.383951 25551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
mode: GRACEFUL
new_leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:44112
I20260709 13:13:27.384718 25551 raft_consensus.cc:606] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Received request to transfer leadership to TS 42677b5f98ca4d948a90c7de23c1ce1c
I20260709 13:13:27.390481 25371 ts_manager.cc:194] Re-registered known tserver with Master: 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899)
I20260709 13:13:27.393375 25832 pending_rounds.cc:85] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Aborting all ops after (but not including) 0
I20260709 13:13:27.393605 25551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cf909e389504f57a78779640f384ffd"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
mode: GRACEFUL
new_leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:44112
I20260709 13:13:27.393961 25832 pending_rounds.cc:107] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:27.394392 25551 raft_consensus.cc:606] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Received request to transfer leadership to TS 42677b5f98ca4d948a90c7de23c1ce1c
I20260709 13:13:27.394495 25832 raft_consensus.cc:2889] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:27.398710 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:27.399732 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:27.400794 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:27.404557 25794 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.405824 25794 tablet_bootstrap.cc:492] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.406596 25794 ts_tablet_manager.cc:1403] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.011s
I20260709 13:13:27.409046 25371 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41226
I20260709 13:13:27.410396 25794 raft_consensus.cc:359] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.411993 25794 raft_consensus.cc:740] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.413035 25794 consensus_queue.cc:260] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.414502 25858 heartbeater.cc:499] Master 127.13.196.126:36119 was elected leader, sending a full tablet report...
I20260709 13:13:27.417944 25794 ts_tablet_manager.cc:1434] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:27.419025 25794 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.433347 25794 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:27.434422 25794 tablet_bootstrap.cc:492] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.435168 25794 ts_tablet_manager.cc:1403] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:13:27.438104 25794 raft_consensus.cc:359] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.439039 25794 raft_consensus.cc:740] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.439790 25794 consensus_queue.cc:260] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.441718 25794 ts_tablet_manager.cc:1434] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:27.442765 25794 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.459909 25794 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.461243 25794 tablet_bootstrap.cc:492] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.461978 25794 ts_tablet_manager.cc:1403] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:13:27.464207 25794 raft_consensus.cc:359] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.464879 25794 raft_consensus.cc:740] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.465459 25794 consensus_queue.cc:260] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.467176 25794 ts_tablet_manager.cc:1434] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:27.468191 25794 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap starting.
I20260709 13:13:27.485715 25794 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.487254 25794 tablet_bootstrap.cc:492] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Bootstrap complete.
I20260709 13:13:27.488024 25794 ts_tablet_manager.cc:1403] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:13:27.490324 25794 raft_consensus.cc:359] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.490913 25794 raft_consensus.cc:740] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf01e666cba4b98aacde60a2a634711, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.491631 25794 consensus_queue.cc:260] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.493768 25794 ts_tablet_manager.cc:1434] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:13:27.583834 25776 raft_consensus.cc:993] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: : Instructing follower 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:27.584618 25795 raft_consensus.cc:1081] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Signalling peer 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:27.587332 25625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:54550
I20260709 13:13:27.588068 25625 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.588569 25625 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.596401 25625 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.598704 25625 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899)
I20260709 13:13:27.599826 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:27.600317 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:27.600844 25551 raft_consensus.cc:3055] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.600999 25832 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.601315 25551 raft_consensus.cc:740] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:27.602473 25551 consensus_queue.cc:260] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.604182 25551 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.605098 25831 raft_consensus.cc:3060] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.611841 25832 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:27.613730 25831 pending_rounds.cc:85] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Aborting all ops after (but not including) 0
I20260709 13:13:27.613731 25588 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:27.614465 25831 pending_rounds.cc:107] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:27.614797 25831 raft_consensus.cc:2889] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:27.615284 25551 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:27.615319 25676 raft_consensus.cc:2804] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:27.617123 25676 raft_consensus.cc:697] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:27.618957 25676 consensus_queue.cc:237] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.630118 25371 catalog_manager.cc:5697] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 2 to 3, leader changed from 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 3 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.647151 25831 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.686952 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:27.709578 25831 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.716964 25831 pending_rounds.cc:85] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Aborting all ops after (but not including) 0
I20260709 13:13:27.717257 25831 pending_rounds.cc:107] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:27.717561 25831 raft_consensus.cc:2889] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:27.732275 25831 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.828809 25776 raft_consensus.cc:993] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f: : Instructing follower 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:27.829342 25795 raft_consensus.cc:1081] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Signalling peer 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:27.831368 25625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:54550
I20260709 13:13:27.832028 25625 raft_consensus.cc:493] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.832443 25625 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.839017 25625 raft_consensus.cc:515] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.841189 25625 leader_election.cc:290] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:27.843214 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:27.844074 25831 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.844846 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8e2f5c26f8464c93f0b0280708cf4b" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:27.845602 25551 raft_consensus.cc:3055] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.845956 25551 raft_consensus.cc:740] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:27.846933 25551 consensus_queue.cc:260] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.848639 25551 raft_consensus.cc:3060] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.853682 25831 raft_consensus.cc:2468] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:27.855310 25588 leader_election.cc:304] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:27.856287 25676 raft_consensus.cc:2804] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:27.856886 25676 raft_consensus.cc:697] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:27.858300 25551 raft_consensus.cc:2468] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:27.858335 25676 consensus_queue.cc:237] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.871059 25371 catalog_manager.cc:5697] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 2 to 3, leader changed from 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 3 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.889990 25776 raft_consensus.cc:993] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f: : Instructing follower 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:27.890740 25795 raft_consensus.cc:1081] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Signalling peer 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:27.892602 25625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cf909e389504f57a78779640f384ffd"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:54550
I20260709 13:13:27.893246 25625 raft_consensus.cc:493] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.893606 25625 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.899708 25625 raft_consensus.cc:515] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.901616 25625 leader_election.cc:290] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:27.903100 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:27.903123 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf909e389504f57a78779640f384ffd" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:27.903924 25551 raft_consensus.cc:3055] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.903952 25831 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.904313 25551 raft_consensus.cc:740] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:27.905534 25551 consensus_queue.cc:260] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.908262 25551 raft_consensus.cc:3060] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.913919 25831 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:27.916376 25588 leader_election.cc:304] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:27.917673 25676 raft_consensus.cc:2804] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:27.919181 25676 raft_consensus.cc:697] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:27.919560 25551 raft_consensus.cc:2468] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:27.920356 25676 consensus_queue.cc:237] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:27.931602 25371 catalog_manager.cc:5697] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 2 to 3, leader changed from 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 3 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.097609 25831 raft_consensus.cc:1275] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.099669 25873 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.117455 25551 raft_consensus.cc:1275] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.119217 25873 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:28.348605 25831 raft_consensus.cc:1275] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:28.350221 25873 consensus_queue.cc:1048] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:28.361295 25832 raft_consensus.cc:1275] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.361754 25551 raft_consensus.cc:1275] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:28.366516 25676 consensus_queue.cc:1048] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:28.366725 25891 consensus_queue.cc:1048] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.382262 25551 raft_consensus.cc:1275] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.386098 25676 consensus_queue.cc:1048] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:28.415416 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:28.438457 25625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
mode: GRACEFUL
new_leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:35966
I20260709 13:13:28.439213 25625 raft_consensus.cc:606] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 LEADER]: Received request to transfer leadership to TS 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:28.441066 25891 raft_consensus.cc:993] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c: : Instructing follower 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:28.441741 25886 raft_consensus.cc:1081] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 LEADER]: Signalling peer 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:28.442975 25625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
mode: GRACEFUL
new_leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:35966
I20260709 13:13:28.443882 25625 raft_consensus.cc:606] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Received request to transfer leadership to TS 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:28.444104 25551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:47818
I20260709 13:13:28.445178 25551 raft_consensus.cc:493] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:28.445658 25551 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:28.446024 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:28.446885 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:28.447793 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:28.461712 25551 raft_consensus.cc:515] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:28.463898 25551 leader_election.cc:290] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 3 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:28.465365 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:28.465606 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:28.466413 25832 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:28.466415 25625 raft_consensus.cc:3055] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:28.467371 25625 raft_consensus.cc:740] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:28.468238 25625 consensus_queue.cc:260] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:28.469398 25625 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:28.474004 25832 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 3.
I20260709 13:13:28.475482 25625 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 3.
I20260709 13:13:28.475505 25514 leader_election.cc:304] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:28.477078 25795 raft_consensus.cc:2804] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:28.477576 25795 raft_consensus.cc:697] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:28.478916 25795 consensus_queue.cc:237] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:28.487800 25373 catalog_manager.cc:5697] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 2 to 3, leader changed from 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 3 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.643201 25891 raft_consensus.cc:993] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c: : Instructing follower 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:28.643849 25891 raft_consensus.cc:1081] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Signalling peer 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:28.645732 25551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:47818
I20260709 13:13:28.646390 25551 raft_consensus.cc:493] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:28.646826 25551 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.657913 25551 raft_consensus.cc:515] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:28.660738 25551 leader_election.cc:290] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:28.661890 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:28.661873 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:28.663225 25832 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.663306 25625 raft_consensus.cc:3055] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:28.663806 25625 raft_consensus.cc:740] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:28.664752 25625 consensus_queue.cc:260] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:28.666188 25625 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.673059 25625 raft_consensus.cc:2468] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:28.673062 25832 raft_consensus.cc:2468] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:28.674451 25514 leader_election.cc:304] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 5a01d3d7cd9342c7a62305e6ede6a87f; no voters: 
I20260709 13:13:28.675477 25795 raft_consensus.cc:2804] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.676265 25795 raft_consensus.cc:697] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:28.677429 25795 consensus_queue.cc:237] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:28.685812 25373 catalog_manager.cc:5697] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 1 to 2, leader changed from 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 2 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:28.688302 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:28.944666 25832 raft_consensus.cc:1275] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.946259 25795 consensus_queue.cc:1048] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:28.962306 25625 raft_consensus.cc:1275] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:28.964480 25795 consensus_queue.cc:1048] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:29.230115 25625 raft_consensus.cc:1275] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.230247 25832 raft_consensus.cc:1275] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.231742 25795 consensus_queue.cc:1048] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:29.232633 25905 consensus_queue.cc:1048] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.460669 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:29.471094 25551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
mode: GRACEFUL
new_leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:44112
I20260709 13:13:29.471788 25551 raft_consensus.cc:606] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Received request to transfer leadership to TS 42677b5f98ca4d948a90c7de23c1ce1c
I20260709 13:13:29.475737 25551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
mode: GRACEFUL
new_leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:44112
I20260709 13:13:29.476611 25551 raft_consensus.cc:606] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 LEADER]: Received request to transfer leadership to TS 42677b5f98ca4d948a90c7de23c1ce1c
I20260709 13:13:29.478210 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:29.479194 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:29.480065 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:29.587533 25795 raft_consensus.cc:993] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f: : Instructing follower 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:29.588450 25906 raft_consensus.cc:1081] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 LEADER]: Signalling peer 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:29.590677 25625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:54550
I20260709 13:13:29.591396 25625 raft_consensus.cc:493] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.591711 25625 raft_consensus.cc:3060] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.598214 25625 raft_consensus.cc:515] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:29.601177 25625 leader_election.cc:290] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:29.602023 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:29.602490 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce6136f5ac6545f0848f5360445b2fef" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:29.602798 25832 raft_consensus.cc:3060] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.603175 25551 raft_consensus.cc:3055] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.603847 25551 raft_consensus.cc:740] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:29.605036 25551 consensus_queue.cc:260] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:29.606710 25551 raft_consensus.cc:3060] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.612972 25832 raft_consensus.cc:2468] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 2.
I20260709 13:13:29.615056 25588 leader_election.cc:304] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:29.616195 25891 raft_consensus.cc:2804] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.616683 25551 raft_consensus.cc:2468] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 2.
I20260709 13:13:29.617537 25891 raft_consensus.cc:697] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:29.618801 25891 consensus_queue.cc:237] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:29.629395 25373 catalog_manager.cc:5697] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 1 to 2, leader changed from 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 2 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:29.689814 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:29.781764 25795 raft_consensus.cc:993] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f: : Instructing follower 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:29.782442 25906 raft_consensus.cc:1081] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Signalling peer 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:29.784284 25625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:54550
I20260709 13:13:29.785068 25625 raft_consensus.cc:493] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.785396 25625 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.792696 25625 raft_consensus.cc:515] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:29.794687 25625 leader_election.cc:290] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:29.795791 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:29.795867 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7911d76881d24665bc1d9c2f44cb1d04" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:29.796576 25832 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.796706 25551 raft_consensus.cc:3055] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:29.797140 25551 raft_consensus.cc:740] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:29.797878 25551 consensus_queue.cc:260] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:29.799067 25551 raft_consensus.cc:3060] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.805927 25832 raft_consensus.cc:2468] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:29.807787 25588 leader_election.cc:304] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:29.808091 25551 raft_consensus.cc:2468] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 3.
I20260709 13:13:29.808712 25891 raft_consensus.cc:2804] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:29.809425 25891 raft_consensus.cc:697] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:29.810384 25891 consensus_queue.cc:237] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:29.817848 25373 catalog_manager.cc:5697] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 2 to 3, leader changed from 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 3 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.056212 25551 raft_consensus.cc:1275] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.058344 25891 consensus_queue.cc:1048] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:30.075620 25832 raft_consensus.cc:1275] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.077572 25920 consensus_queue.cc:1048] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.398404 25832 raft_consensus.cc:1275] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:30.400516 25912 consensus_queue.cc:1048] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:30.402499 25551 raft_consensus.cc:1275] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:30.404174 25912 consensus_queue.cc:1048] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:30.488296 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:30.498181 25625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
mode: GRACEFUL
new_leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:35966
I20260709 13:13:30.498757 25625 raft_consensus.cc:606] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Received request to transfer leadership to TS 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:30.501858 25625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
mode: GRACEFUL
new_leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:35966
I20260709 13:13:30.502457 25625 raft_consensus.cc:606] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Received request to transfer leadership to TS 5a01d3d7cd9342c7a62305e6ede6a87f
I20260709 13:13:30.504165 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:30.504899 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:30.505595 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:30.638794 25920 raft_consensus.cc:993] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c: : Instructing follower 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:30.639382 25912 raft_consensus.cc:1081] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Signalling peer 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:30.641258 25551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:47818
I20260709 13:13:30.641881 25551 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.642206 25551 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.650280 25551 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:30.652541 25551 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 4 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:30.653467 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:30.653707 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:30.654268 25625 raft_consensus.cc:3055] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:30.654268 25830 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.654779 25625 raft_consensus.cc:740] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:30.656006 25625 consensus_queue.cc:260] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:30.657589 25625 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:30.664470 25830 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 4.
I20260709 13:13:30.665763 25625 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 4.
I20260709 13:13:30.666069 25514 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:30.666905 25906 raft_consensus.cc:2804] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:30.667372 25906 raft_consensus.cc:697] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:30.668140 25906 consensus_queue.cc:237] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:30.676622 25373 catalog_manager.cc:5697] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 3 to 4, leader changed from 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 4 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:30.690935 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:30.825589 25920 raft_consensus.cc:993] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c: : Instructing follower 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:30.826241 25912 raft_consensus.cc:1081] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Signalling peer 5a01d3d7cd9342c7a62305e6ede6a87f to start an election
I20260709 13:13:30.828047 25551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
 from {username='slave'} at 127.0.0.1:47818
I20260709 13:13:30.828665 25551 raft_consensus.cc:493] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.828965 25551 raft_consensus.cc:3060] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.835127 25551 raft_consensus.cc:515] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:30.837201 25551 leader_election.cc:290] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67:32915)
I20260709 13:13:30.838838 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:30.839177 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb10f12863445c5a3758cb49a9ad977" candidate_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
I20260709 13:13:30.839592 25830 raft_consensus.cc:3060] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.839967 25625 raft_consensus.cc:3055] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.840291 25625 raft_consensus.cc:740] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:30.841169 25625 consensus_queue.cc:260] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:30.842119 25625 raft_consensus.cc:3060] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.847710 25830 raft_consensus.cc:2468] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:30.848635 25625 raft_consensus.cc:2468] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a01d3d7cd9342c7a62305e6ede6a87f in term 2.
I20260709 13:13:30.849547 25514 leader_election.cc:304] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a01d3d7cd9342c7a62305e6ede6a87f, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:30.850579 25906 raft_consensus.cc:2804] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.851222 25906 raft_consensus.cc:697] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Becoming Leader. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:30.852223 25906 consensus_queue.cc:237] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:30.861310 25373 catalog_manager.cc:5697] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f reported cstate change: term changed from 1 to 2, leader changed from 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67) to 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66). New cstate: current_term: 2 leader_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.192662 25830 raft_consensus.cc:1275] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 4 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:31.194530 25906 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:31.209420 25625 raft_consensus.cc:1275] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:31.211382 25795 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:31.276628 25830 raft_consensus.cc:1275] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.278504 25795 consensus_queue.cc:1048] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.293744 25625 raft_consensus.cc:1275] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Refusing update from remote peer 5a01d3d7cd9342c7a62305e6ede6a87f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.296692 25938 consensus_queue.cc:1048] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:31.513665 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.523036 25551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
mode: GRACEFUL
new_leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:44112
I20260709 13:13:31.523871 25551 raft_consensus.cc:606] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 LEADER]: Received request to transfer leadership to TS 42677b5f98ca4d948a90c7de23c1ce1c
I20260709 13:13:31.527220 25551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b"
dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
mode: GRACEFUL
new_leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:44112
I20260709 13:13:31.528003 25551 raft_consensus.cc:606] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 LEADER]: Received request to transfer leadership to TS 42677b5f98ca4d948a90c7de23c1ce1c
I20260709 13:13:31.529753 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:31.530505 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:31.531215 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.623103 25906 raft_consensus.cc:993] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f: : Instructing follower 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:31.623835 25795 raft_consensus.cc:1081] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 LEADER]: Signalling peer 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:31.625770 25625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:54550
I20260709 13:13:31.626508 25625 raft_consensus.cc:493] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.626935 25625 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:31.634460 25625 raft_consensus.cc:515] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:31.636549 25625 leader_election.cc:290] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 4 election: Requested vote from peers 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899), 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077)
I20260709 13:13:31.637811 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:31.638522 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60bb4719ac0b4b2191e98522a14c8f7b" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:31.638751 25832 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:31.639166 25551 raft_consensus.cc:3055] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:31.639545 25551 raft_consensus.cc:740] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:31.640300 25551 consensus_queue.cc:260] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:31.641450 25551 raft_consensus.cc:3060] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:31.646692 25832 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 4.
I20260709 13:13:31.647224 25551 raft_consensus.cc:2468] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 4.
I20260709 13:13:31.648275 25588 leader_election.cc:304] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:31.649230 25912 raft_consensus.cc:2804] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:31.650309 25912 raft_consensus.cc:697] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:31.651075 25912 consensus_queue.cc:237] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:31.659890 25373 catalog_manager.cc:5697] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 3 to 4, leader changed from 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 4 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.690032 25938 raft_consensus.cc:993] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: : Instructing follower 42677b5f98ca4d948a90c7de23c1ce1c to start an election
I20260709 13:13:31.690667 25795 raft_consensus.cc:1081] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 LEADER]: Signalling peer 42677b5f98ca4d948a90c7de23c1ce1c to start an election
W20260709 13:13:31.692225 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:31.692981 25625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84"
dest_uuid: "42677b5f98ca4d948a90c7de23c1ce1c"
 from {username='slave'} at 127.0.0.1:54550
I20260709 13:13:31.693756 25625 raft_consensus.cc:493] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.694211 25625 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.700271 25625 raft_consensus.cc:515] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:31.702169 25625 leader_election.cc:290] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 5 election: Requested vote from peers 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077), 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899)
I20260709 13:13:31.703518 25551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f"
I20260709 13:13:31.703953 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c8f2b796f0e4f8cb073068116374f84" candidate_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7bf01e666cba4b98aacde60a2a634711"
I20260709 13:13:31.704315 25551 raft_consensus.cc:3055] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:31.704586 25832 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.704715 25551 raft_consensus.cc:740] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5a01d3d7cd9342c7a62305e6ede6a87f, State: Running, Role: LEADER
I20260709 13:13:31.705623 25551 consensus_queue.cc:260] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:31.707015 25551 raft_consensus.cc:3060] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.713966 25832 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 5.
I20260709 13:13:31.715658 25588 leader_election.cc:304] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42677b5f98ca4d948a90c7de23c1ce1c, 7bf01e666cba4b98aacde60a2a634711; no voters: 
I20260709 13:13:31.715739 25551 raft_consensus.cc:2468] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42677b5f98ca4d948a90c7de23c1ce1c in term 5.
I20260709 13:13:31.716754 25912 raft_consensus.cc:2804] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:31.717342 25912 raft_consensus.cc:697] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 5 LEADER]: Becoming Leader. State: Replica: 42677b5f98ca4d948a90c7de23c1ce1c, State: Running, Role: LEADER
I20260709 13:13:31.718175 25912 consensus_queue.cc:237] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } }
I20260709 13:13:31.726074 25373 catalog_manager.cc:5697] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c reported cstate change: term changed from 4 to 5, leader changed from 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66) to 42677b5f98ca4d948a90c7de23c1ce1c (127.13.196.67). New cstate: current_term: 5 leader_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42677b5f98ca4d948a90c7de23c1ce1c" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 32915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.103740 25551 raft_consensus.cc:1275] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 5 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:32.106031 25912 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:32.124554 25830 raft_consensus.cc:1275] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 5 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:32.127146 25912 consensus_queue.cc:1048] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:13:32.264806 25830 raft_consensus.cc:1275] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 4 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:32.266419 25946 consensus_queue.cc:1048] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf01e666cba4b98aacde60a2a634711" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 38899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:32.278151 25551 raft_consensus.cc:1275] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 FOLLOWER]: Refusing update from remote peer 42677b5f98ca4d948a90c7de23c1ce1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:32.280063 25940 consensus_queue.cc:1048] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a01d3d7cd9342c7a62305e6ede6a87f" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:32.539021 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.573504 14097 tablet_server.cc:179] TabletServer@127.13.196.65:38899 shutting down...
W20260709 13:13:32.603149 25588 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 98 similar messages]
I20260709 13:13:32.604657 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:32.605983 14097 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:32.607123 25588 consensus_peers.cc:597] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.607252 14097 raft_consensus.cc:2243] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.608248 14097 raft_consensus.cc:2272] T 1c8f2b796f0e4f8cb073068116374f84 P 7bf01e666cba4b98aacde60a2a634711 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.611928 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.612751 14097 raft_consensus.cc:2243] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.613243 14097 raft_consensus.cc:2272] T f32bd4b1dda240d68537ea8e71e7e497 P 7bf01e666cba4b98aacde60a2a634711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.615432 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.616108 14097 raft_consensus.cc:2243] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.616647 14097 raft_consensus.cc:2272] T 6cb10f12863445c5a3758cb49a9ad977 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.618793 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.619395 14097 raft_consensus.cc:2243] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.619894 14097 raft_consensus.cc:2272] T 60bb4719ac0b4b2191e98522a14c8f7b P 7bf01e666cba4b98aacde60a2a634711 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.622591 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.623293 14097 raft_consensus.cc:2243] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.623991 14097 raft_consensus.cc:2272] T 0b8e2f5c26f8464c93f0b0280708cf4b P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:32.626302 25514 consensus_peers.cc:597] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.626507 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.627323 14097 raft_consensus.cc:2243] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.627800 14097 raft_consensus.cc:2272] T 2cf909e389504f57a78779640f384ffd P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.630223 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.631053 14097 raft_consensus.cc:2243] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.631531 14097 raft_consensus.cc:2272] T ce6136f5ac6545f0848f5360445b2fef P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.633982 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.634564 14097 raft_consensus.cc:2243] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.635006 14097 raft_consensus.cc:2272] T 0db2844b2592440f94b6c70b28ce13a6 P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.637468 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.638290 14097 raft_consensus.cc:2243] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.639154 14097 raft_consensus.cc:2272] T ad80245c26414e77bc09fb62984692ed P 7bf01e666cba4b98aacde60a2a634711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.641213 14097 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:32.641683 14097 raft_consensus.cc:2243] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.642046 14097 raft_consensus.cc:2272] T 7911d76881d24665bc1d9c2f44cb1d04 P 7bf01e666cba4b98aacde60a2a634711 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:32.647279 25514 consensus_peers.cc:597] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.676474 14097 tablet_server.cc:196] TabletServer@127.13.196.65:38899 shutdown complete.
W20260709 13:13:32.692207 25588 consensus_peers.cc:597] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.694499 25422 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:32.695843 25588 consensus_peers.cc:597] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.696604 25588 consensus_peers.cc:597] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.706005 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
I20260709 13:13:32.740392 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:32.741307 14097 tablet_replica.cc:333] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.742585 14097 raft_consensus.cc:2243] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.743261 14097 raft_consensus.cc:2272] T 0b8e2f5c26f8464c93f0b0280708cf4b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:32.745580 25588 consensus_peers.cc:597] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Couldn't send request to peer 5a01d3d7cd9342c7a62305e6ede6a87f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.746536 14097 tablet_replica.cc:333] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.747300 14097 raft_consensus.cc:2243] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.747838 14097 raft_consensus.cc:2272] T 1c8f2b796f0e4f8cb073068116374f84 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.750813 14097 tablet_replica.cc:333] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.751551 14097 raft_consensus.cc:2243] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.752058 14097 raft_consensus.cc:2272] T 7911d76881d24665bc1d9c2f44cb1d04 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.754788 14097 tablet_replica.cc:333] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.755471 14097 raft_consensus.cc:2243] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.756007 14097 raft_consensus.cc:2272] T 2cf909e389504f57a78779640f384ffd P 5a01d3d7cd9342c7a62305e6ede6a87f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.758667 14097 tablet_replica.cc:333] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.759351 14097 raft_consensus.cc:2243] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.759929 14097 raft_consensus.cc:2272] T 60bb4719ac0b4b2191e98522a14c8f7b P 5a01d3d7cd9342c7a62305e6ede6a87f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.762893 14097 tablet_replica.cc:333] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.763569 14097 raft_consensus.cc:2243] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.764590 14097 raft_consensus.cc:2272] T 6cb10f12863445c5a3758cb49a9ad977 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.767230 14097 tablet_replica.cc:333] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.767874 14097 raft_consensus.cc:2243] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.768991 14097 raft_consensus.cc:2272] T f32bd4b1dda240d68537ea8e71e7e497 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.771996 14097 tablet_replica.cc:333] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.772950 14097 raft_consensus.cc:2243] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.773892 14097 raft_consensus.cc:2272] T 0db2844b2592440f94b6c70b28ce13a6 P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.777411 14097 tablet_replica.cc:333] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
W20260709 13:13:32.777925 25588 consensus_peers.cc:597] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Couldn't send request to peer 5a01d3d7cd9342c7a62305e6ede6a87f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.778061 14097 raft_consensus.cc:2243] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.779162 14097 raft_consensus.cc:2272] T ad80245c26414e77bc09fb62984692ed P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.782943 14097 tablet_replica.cc:333] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f: stopping tablet replica
I20260709 13:13:32.783788 14097 raft_consensus.cc:2243] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.784456 14097 raft_consensus.cc:2272] T ce6136f5ac6545f0848f5360445b2fef P 5a01d3d7cd9342c7a62305e6ede6a87f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:32.785809 25588 consensus_peers.cc:597] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Couldn't send request to peer 5a01d3d7cd9342c7a62305e6ede6a87f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.789119 25588 consensus_peers.cc:597] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 5a01d3d7cd9342c7a62305e6ede6a87f (127.13.196.66:37077): Couldn't send request to peer 5a01d3d7cd9342c7a62305e6ede6a87f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:32.794692 25588 consensus_peers.cc:597] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c -> Peer 7bf01e666cba4b98aacde60a2a634711 (127.13.196.65:38899): Couldn't send request to peer 7bf01e666cba4b98aacde60a2a634711. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:38899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:32.826213 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
I20260709 13:13:32.859095 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
I20260709 13:13:32.898865 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:32.899674 14097 tablet_replica.cc:333] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.900683 14097 raft_consensus.cc:2243] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.901753 14097 raft_consensus.cc:2272] T 1c8f2b796f0e4f8cb073068116374f84 P 42677b5f98ca4d948a90c7de23c1ce1c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.905589 14097 tablet_replica.cc:333] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.906370 14097 raft_consensus.cc:2243] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.906976 14097 raft_consensus.cc:2272] T f32bd4b1dda240d68537ea8e71e7e497 P 42677b5f98ca4d948a90c7de23c1ce1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.909637 14097 tablet_replica.cc:333] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.910324 14097 raft_consensus.cc:2243] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.911334 14097 raft_consensus.cc:2272] T 60bb4719ac0b4b2191e98522a14c8f7b P 42677b5f98ca4d948a90c7de23c1ce1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.914700 14097 tablet_replica.cc:333] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.915429 14097 raft_consensus.cc:2243] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.916473 14097 raft_consensus.cc:2272] T 0b8e2f5c26f8464c93f0b0280708cf4b P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.918776 14097 tablet_replica.cc:333] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.919471 14097 raft_consensus.cc:2243] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.920542 14097 raft_consensus.cc:2272] T 7911d76881d24665bc1d9c2f44cb1d04 P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.923132 14097 tablet_replica.cc:333] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.923791 14097 raft_consensus.cc:2243] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.924321 14097 raft_consensus.cc:2272] T 6cb10f12863445c5a3758cb49a9ad977 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.926826 14097 tablet_replica.cc:333] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.927455 14097 raft_consensus.cc:2243] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.928005 14097 raft_consensus.cc:2272] T ad80245c26414e77bc09fb62984692ed P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.930536 14097 tablet_replica.cc:333] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.931169 14097 raft_consensus.cc:2243] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.932139 14097 raft_consensus.cc:2272] T ce6136f5ac6545f0848f5360445b2fef P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.934890 14097 tablet_replica.cc:333] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.935510 14097 raft_consensus.cc:2243] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:32.936025 14097 raft_consensus.cc:2272] T 0db2844b2592440f94b6c70b28ce13a6 P 42677b5f98ca4d948a90c7de23c1ce1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.938582 14097 tablet_replica.cc:333] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c: stopping tablet replica
I20260709 13:13:32.939261 14097 raft_consensus.cc:2243] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:32.940197 14097 raft_consensus.cc:2272] T 2cf909e389504f57a78779640f384ffd P 42677b5f98ca4d948a90c7de23c1ce1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:32.980132 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
I20260709 13:13:33.012334 14097 master.cc:562] Master@127.13.196.126:36119 shutting down...
I20260709 13:13:33.049293 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:33.050505 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:33.051229 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P 25e7d44d10d44ac184bebb4e86c36241: stopping tablet replica
I20260709 13:13:33.081298 14097 master.cc:584] Master@127.13.196.126:36119 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13640 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:13:33.141510 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:34873
I20260709 13:13:33.142900 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.149508 25958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.149554 25957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.150159 25960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.152666 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:33.153784 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.153973 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.154093 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602813154081 us; error 0 us; skew 500 ppm
I20260709 13:13:33.154577 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.158226 14097 webserver.cc:533] Webserver started at http://127.13.196.126:38497/ using document root <none> and password file <none>
I20260709 13:13:33.158846 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.159031 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.159278 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.161024 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "bca2eee4bb16432b8b6b9083fa0427d6"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.166419 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:33.170629 25965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.171563 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:33.171896 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "bca2eee4bb16432b8b6b9083fa0427d6"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.172180 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.187690 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.189405 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.244428 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:34873
I20260709 13:13:33.244516 26016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:34873 every 8 connection(s)
I20260709 13:13:33.249461 26017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.266314 26017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6: Bootstrap starting.
I20260709 13:13:33.272671 26017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.278975 26017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6: No bootstrap required, opened a new log
I20260709 13:13:33.281713 26017 raft_consensus.cc:359] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" member_type: VOTER }
I20260709 13:13:33.282215 26017 raft_consensus.cc:385] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.282461 26017 raft_consensus.cc:740] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca2eee4bb16432b8b6b9083fa0427d6, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.283056 26017 consensus_queue.cc:260] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" member_type: VOTER }
I20260709 13:13:33.283600 26017 raft_consensus.cc:399] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:33.283850 26017 raft_consensus.cc:493] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:33.284101 26017 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.291658 26017 raft_consensus.cc:515] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" member_type: VOTER }
I20260709 13:13:33.292790 26017 leader_election.cc:304] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bca2eee4bb16432b8b6b9083fa0427d6; no voters: 
I20260709 13:13:33.294462 26017 leader_election.cc:290] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:33.294902 26020 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:33.296666 26020 raft_consensus.cc:697] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 1 LEADER]: Becoming Leader. State: Replica: bca2eee4bb16432b8b6b9083fa0427d6, State: Running, Role: LEADER
I20260709 13:13:33.297659 26020 consensus_queue.cc:237] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" member_type: VOTER }
I20260709 13:13:33.297855 26017 sys_catalog.cc:565] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:33.303414 26021 sys_catalog.cc:455] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" member_type: VOTER } }
I20260709 13:13:33.305274 26021 sys_catalog.cc:458] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:33.304591 26022 sys_catalog.cc:455] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bca2eee4bb16432b8b6b9083fa0427d6. Latest consensus state: current_term: 1 leader_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bca2eee4bb16432b8b6b9083fa0427d6" member_type: VOTER } }
I20260709 13:13:33.306655 26022 sys_catalog.cc:458] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:33.310079 26029 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:33.315928 26029 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:33.317684 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:33.327455 26029 catalog_manager.cc:1383] Generated new cluster ID: 51591fdc3f6b456db849c3b7ec16e6bb
I20260709 13:13:33.327852 26029 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:33.343784 26029 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:33.345216 26029 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:33.361904 26029 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6: Generated new TSK 0
I20260709 13:13:33.362716 26029 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:33.385412 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.392524 26038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.394755 26039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.395742 26041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.396603 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:33.397684 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.397944 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.398129 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602813398107 us; error 0 us; skew 500 ppm
I20260709 13:13:33.398783 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.402182 14097 webserver.cc:533] Webserver started at http://127.13.196.65:43983/ using document root <none> and password file <none>
I20260709 13:13:33.402838 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.403069 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.403367 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.404778 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "170cf8f4b5a2423a81647e331d4efb4e"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.410319 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:33.414757 26046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.415794 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:33.416193 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "170cf8f4b5a2423a81647e331d4efb4e"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.416630 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.436417 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.437880 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.439742 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:33.442940 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:33.443274 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.443625 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:33.443840 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.503166 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:46801
I20260709 13:13:33.503257 26108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:46801 every 8 connection(s)
I20260709 13:13:33.509666 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.518368 26113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.519816 26114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.524927 26116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.525205 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:33.526887 26109 heartbeater.cc:344] Connected to a master server at 127.13.196.126:34873
I20260709 13:13:33.526983 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.527490 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.527555 26109 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:33.527686 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602813527650 us; error 0 us; skew 500 ppm
I20260709 13:13:33.528764 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.528880 26109 heartbeater.cc:507] Master 127.13.196.126:34873 requested a full tablet report, sending...
I20260709 13:13:33.532024 25982 ts_manager.cc:194] Registered new tserver with Master: 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801)
I20260709 13:13:33.532176 14097 webserver.cc:533] Webserver started at http://127.13.196.66:40127/ using document root <none> and password file <none>
I20260709 13:13:33.533051 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.533339 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.533701 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.534897 25982 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53796
I20260709 13:13:33.535458 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "9d2026a7165f476b975c7ce0b62922cc"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.541378 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:13:33.545696 26121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.546809 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:33.547251 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "9d2026a7165f476b975c7ce0b62922cc"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.547581 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.588032 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.589756 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.591698 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:33.594722 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:33.594966 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.595326 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:33.595490 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.648841 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:38163
I20260709 13:13:33.648988 26183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:38163 every 8 connection(s)
I20260709 13:13:33.655433 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:33.665122 26187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.670717 26188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:33.673151 26190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:33.673203 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:33.674616 26184 heartbeater.cc:344] Connected to a master server at 127.13.196.126:34873
I20260709 13:13:33.675249 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:33.675585 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:33.675848 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602813675828 us; error 0 us; skew 500 ppm
I20260709 13:13:33.675639 26184 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:33.676622 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:33.677049 26184 heartbeater.cc:507] Master 127.13.196.126:34873 requested a full tablet report, sending...
I20260709 13:13:33.680194 25982 ts_manager.cc:194] Registered new tserver with Master: 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163)
I20260709 13:13:33.680269 14097 webserver.cc:533] Webserver started at http://127.13.196.67:41381/ using document root <none> and password file <none>
I20260709 13:13:33.681169 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:33.681402 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:33.681710 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:33.682253 25982 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53802
I20260709 13:13:33.682981 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.689399 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:13:33.694334 26195 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.695549 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:13:33.695955 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
format_stamp: "Formatted at 2026-07-09 13:13:33 on dist-test-slave-ftjc"
I20260709 13:13:33.696282 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:33.712021 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:33.714252 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:33.716895 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:33.721661 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:33.721958 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.722294 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:33.722541 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:33.775378 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:33141
I20260709 13:13:33.775655 26257 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:33141 every 8 connection(s)
I20260709 13:13:33.793112 26258 heartbeater.cc:344] Connected to a master server at 127.13.196.126:34873
I20260709 13:13:33.793609 26258 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:33.794409 26258 heartbeater.cc:507] Master 127.13.196.126:34873 requested a full tablet report, sending...
I20260709 13:13:33.797045 25982 ts_manager.cc:194] Registered new tserver with Master: 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:33.798045 14097 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019077909s
I20260709 13:13:33.798934 25982 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53808
I20260709 13:13:33.832573 25982 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53822:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:33.835095 25982 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:33.889930 26074 tablet_service.cc:1511] Processing CreateTablet for tablet f5df7f0f84d94936bee030b9106d8d42 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ea486a089cae49058d9038b6d70f85bb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:33.892050 26074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5df7f0f84d94936bee030b9106d8d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.889973 26073 tablet_service.cc:1511] Processing CreateTablet for tablet e4e22988fa33488db30f97bc98e63912 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ea486a089cae49058d9038b6d70f85bb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:33.895589 26073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e22988fa33488db30f97bc98e63912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.916674 26149 tablet_service.cc:1511] Processing CreateTablet for tablet f5df7f0f84d94936bee030b9106d8d42 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ea486a089cae49058d9038b6d70f85bb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:33.917373 26148 tablet_service.cc:1511] Processing CreateTablet for tablet e4e22988fa33488db30f97bc98e63912 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ea486a089cae49058d9038b6d70f85bb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:33.918800 26149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5df7f0f84d94936bee030b9106d8d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.918486 26223 tablet_service.cc:1511] Processing CreateTablet for tablet f5df7f0f84d94936bee030b9106d8d42 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ea486a089cae49058d9038b6d70f85bb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:33.919589 26148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e22988fa33488db30f97bc98e63912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.921566 26222 tablet_service.cc:1511] Processing CreateTablet for tablet e4e22988fa33488db30f97bc98e63912 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=ea486a089cae49058d9038b6d70f85bb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:33.919939 26223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5df7f0f84d94936bee030b9106d8d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.928910 26222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e22988fa33488db30f97bc98e63912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:33.968922 26273 tablet_bootstrap.cc:492] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc: Bootstrap starting.
I20260709 13:13:33.969442 26272 tablet_bootstrap.cc:492] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e: Bootstrap starting.
I20260709 13:13:33.978279 26272 tablet_bootstrap.cc:654] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.980273 26274 tablet_bootstrap.cc:492] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9: Bootstrap starting.
I20260709 13:13:33.980307 26273 tablet_bootstrap.cc:654] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.986809 26272 tablet_bootstrap.cc:492] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e: No bootstrap required, opened a new log
I20260709 13:13:33.987289 26273 tablet_bootstrap.cc:492] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc: No bootstrap required, opened a new log
I20260709 13:13:33.987511 26272 ts_tablet_manager.cc:1403] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:13:33.987951 26273 ts_tablet_manager.cc:1403] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:13:33.989482 26274 tablet_bootstrap.cc:654] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:33.991905 26273 raft_consensus.cc:359] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:33.991717 26272 raft_consensus.cc:359] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:33.992822 26273 raft_consensus.cc:385] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.993093 26272 raft_consensus.cc:385] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.993302 26273 raft_consensus.cc:740] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.993618 26272 raft_consensus.cc:740] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.994411 26273 consensus_queue.cc:260] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:33.994658 26272 consensus_queue.cc:260] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:33.996054 26274 tablet_bootstrap.cc:492] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9: No bootstrap required, opened a new log
I20260709 13:13:33.996956 26274 ts_tablet_manager.cc:1403] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:13:33.997565 26109 heartbeater.cc:499] Master 127.13.196.126:34873 was elected leader, sending a full tablet report...
I20260709 13:13:33.998149 26272 ts_tablet_manager.cc:1434] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:13:33.999478 26272 tablet_bootstrap.cc:492] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e: Bootstrap starting.
I20260709 13:13:34.002286 26274 raft_consensus.cc:359] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.003912 26274 raft_consensus.cc:385] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.004410 26274 raft_consensus.cc:740] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 643bcca892a6480cb7d5a4e07c1c5bf9, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.005918 26274 consensus_queue.cc:260] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.012795 26272 tablet_bootstrap.cc:654] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.013124 26273 ts_tablet_manager.cc:1434] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc: Time spent starting tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 13:13:34.013041 26184 heartbeater.cc:499] Master 127.13.196.126:34873 was elected leader, sending a full tablet report...
I20260709 13:13:34.014855 26273 tablet_bootstrap.cc:492] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc: Bootstrap starting.
I20260709 13:13:34.024621 26273 tablet_bootstrap.cc:654] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.026572 26272 tablet_bootstrap.cc:492] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e: No bootstrap required, opened a new log
I20260709 13:13:34.027434 26272 ts_tablet_manager.cc:1403] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.011s
I20260709 13:13:34.029958 26258 heartbeater.cc:499] Master 127.13.196.126:34873 was elected leader, sending a full tablet report...
I20260709 13:13:34.036936 26272 raft_consensus.cc:359] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.038436 26272 raft_consensus.cc:385] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.038856 26272 raft_consensus.cc:740] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.040956 26272 consensus_queue.cc:260] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.042888 26273 tablet_bootstrap.cc:492] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc: No bootstrap required, opened a new log
I20260709 13:13:34.043619 26272 ts_tablet_manager.cc:1434] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:13:34.043656 26273 ts_tablet_manager.cc:1403] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.016s
I20260709 13:13:34.044574 26274 ts_tablet_manager.cc:1434] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent starting tablet: real 0.047s	user 0.021s	sys 0.005s
I20260709 13:13:34.045902 26274 tablet_bootstrap.cc:492] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9: Bootstrap starting.
I20260709 13:13:34.048477 26273 raft_consensus.cc:359] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.049638 26273 raft_consensus.cc:385] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.050083 26273 raft_consensus.cc:740] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.051142 26273 consensus_queue.cc:260] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.053759 26273 ts_tablet_manager.cc:1434] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:13:34.054435 26274 tablet_bootstrap.cc:654] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.060565 26274 tablet_bootstrap.cc:492] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9: No bootstrap required, opened a new log
I20260709 13:13:34.061236 26274 ts_tablet_manager.cc:1403] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:13:34.063894 26274 raft_consensus.cc:359] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.064671 26274 raft_consensus.cc:385] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.064932 26274 raft_consensus.cc:740] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 643bcca892a6480cb7d5a4e07c1c5bf9, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.065891 26274 consensus_queue.cc:260] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.067682 26274 ts_tablet_manager.cc:1434] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:34.124408 26279 raft_consensus.cc:493] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.125082 26279 raft_consensus.cc:515] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.127490 26279 leader_election.cc:290] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.133857 26279 raft_consensus.cc:493] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.134493 26279 raft_consensus.cc:515] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.137478 26279 leader_election.cc:290] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.138990 26084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e" is_pre_election: true
I20260709 13:13:34.139160 26083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e" is_pre_election: true
I20260709 13:13:34.140156 26084 raft_consensus.cc:2468] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 0.
I20260709 13:13:34.140277 26083 raft_consensus.cc:2468] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 0.
I20260709 13:13:34.141925 26124 leader_election.cc:304] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 9d2026a7165f476b975c7ce0b62922cc; no voters: 
I20260709 13:13:34.141836 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" is_pre_election: true
I20260709 13:13:34.142228 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" is_pre_election: true
I20260709 13:13:34.142894 26233 raft_consensus.cc:2468] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 0.
I20260709 13:13:34.143028 26232 raft_consensus.cc:2468] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 0.
I20260709 13:13:34.143038 26279 raft_consensus.cc:2804] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.143250 26124 leader_election.cc:304] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 9d2026a7165f476b975c7ce0b62922cc; no voters: 
I20260709 13:13:34.143893 26279 raft_consensus.cc:493] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.144349 26279 raft_consensus.cc:3060] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.145928 26285 raft_consensus.cc:2804] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.146360 26285 raft_consensus.cc:493] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.146688 26285 raft_consensus.cc:3060] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.152081 26279 raft_consensus.cc:515] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.154426 26279 leader_election.cc:290] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 election: Requested vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.154009 26285 raft_consensus.cc:515] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.155453 26084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
I20260709 13:13:34.155936 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:34.156162 26084 raft_consensus.cc:3060] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.156652 26232 raft_consensus.cc:3060] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.158417 26083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
I20260709 13:13:34.158772 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:34.159083 26083 raft_consensus.cc:3060] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.159488 26233 raft_consensus.cc:3060] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.166831 26232 raft_consensus.cc:2468] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 1.
I20260709 13:13:34.168706 26122 leader_election.cc:304] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 643bcca892a6480cb7d5a4e07c1c5bf9, 9d2026a7165f476b975c7ce0b62922cc; no voters: 
I20260709 13:13:34.169209 26233 raft_consensus.cc:2468] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 1.
I20260709 13:13:34.169508 26084 raft_consensus.cc:2468] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 1.
I20260709 13:13:34.169426 26083 raft_consensus.cc:2468] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 1.
I20260709 13:13:34.169929 26285 leader_election.cc:290] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 election: Requested vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.169947 26279 raft_consensus.cc:2804] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.170792 26279 raft_consensus.cc:697] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Becoming Leader. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Running, Role: LEADER
I20260709 13:13:34.171554 26122 leader_election.cc:304] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 643bcca892a6480cb7d5a4e07c1c5bf9, 9d2026a7165f476b975c7ce0b62922cc; no voters: 
I20260709 13:13:34.172586 26285 raft_consensus.cc:2804] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.172559 26279 consensus_queue.cc:237] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.174450 26285 raft_consensus.cc:697] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Becoming Leader. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Running, Role: LEADER
I20260709 13:13:34.175545 26285 consensus_queue.cc:237] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.184875 25981 catalog_manager.cc:5697] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66). New cstate: current_term: 1 leader_uuid: "9d2026a7165f476b975c7ce0b62922cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.201267 25981 catalog_manager.cc:5697] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66). New cstate: current_term: 1 leader_uuid: "9d2026a7165f476b975c7ce0b62922cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.251878 25981 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53834:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:34.254302 25981 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:34.282635 26074 tablet_service.cc:1511] Processing CreateTablet for tablet 38e19886915c4a5ab6541bbeb3c67e72 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80af6b2f21bc4bf2bd8c0e7cd89bdfd0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:34.284193 26148 tablet_service.cc:1511] Processing CreateTablet for tablet 38e19886915c4a5ab6541bbeb3c67e72 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80af6b2f21bc4bf2bd8c0e7cd89bdfd0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:34.285769 26148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e19886915c4a5ab6541bbeb3c67e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.285821 26223 tablet_service.cc:1511] Processing CreateTablet for tablet 38e19886915c4a5ab6541bbeb3c67e72 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80af6b2f21bc4bf2bd8c0e7cd89bdfd0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:34.284268 26074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e19886915c4a5ab6541bbeb3c67e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.287448 26223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e19886915c4a5ab6541bbeb3c67e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.290503 26149 tablet_service.cc:1511] Processing CreateTablet for tablet 98b07a782f4d4438a040513a7396cc49 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80af6b2f21bc4bf2bd8c0e7cd89bdfd0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:34.292098 26149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b07a782f4d4438a040513a7396cc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.293457 26222 tablet_service.cc:1511] Processing CreateTablet for tablet 98b07a782f4d4438a040513a7396cc49 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80af6b2f21bc4bf2bd8c0e7cd89bdfd0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:34.294402 26073 tablet_service.cc:1511] Processing CreateTablet for tablet 98b07a782f4d4438a040513a7396cc49 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=80af6b2f21bc4bf2bd8c0e7cd89bdfd0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:34.295027 26222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b07a782f4d4438a040513a7396cc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:34.295895 26073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b07a782f4d4438a040513a7396cc49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:34.311115 26030 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:34.311892 26274 tablet_bootstrap.cc:492] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9: Bootstrap starting.
I20260709 13:13:34.319571 26274 tablet_bootstrap.cc:654] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.321480 26272 tablet_bootstrap.cc:492] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e: Bootstrap starting.
I20260709 13:13:34.331260 26272 tablet_bootstrap.cc:654] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.332473 26274 tablet_bootstrap.cc:492] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9: No bootstrap required, opened a new log
I20260709 13:13:34.333177 26274 ts_tablet_manager.cc:1403] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:13:34.337193 26274 raft_consensus.cc:359] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.338366 26273 tablet_bootstrap.cc:492] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: Bootstrap starting.
I20260709 13:13:34.338496 26274 raft_consensus.cc:385] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.339089 26274 raft_consensus.cc:740] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 643bcca892a6480cb7d5a4e07c1c5bf9, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.340612 26274 consensus_queue.cc:260] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.346228 26272 tablet_bootstrap.cc:492] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e: No bootstrap required, opened a new log
I20260709 13:13:34.347007 26272 ts_tablet_manager.cc:1403] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.016s
I20260709 13:13:34.351013 26272 raft_consensus.cc:359] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.351915 26272 raft_consensus.cc:385] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.352255 26272 raft_consensus.cc:740] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.352873 26273 tablet_bootstrap.cc:654] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.352998 26274 ts_tablet_manager.cc:1434] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:13:34.353477 26272 consensus_queue.cc:260] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.354424 26274 tablet_bootstrap.cc:492] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9: Bootstrap starting.
I20260709 13:13:34.358422 26272 ts_tablet_manager.cc:1434] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:13:34.359959 26272 tablet_bootstrap.cc:492] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e: Bootstrap starting.
I20260709 13:13:34.362075 26274 tablet_bootstrap.cc:654] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.371778 26272 tablet_bootstrap.cc:654] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.372107 26273 tablet_bootstrap.cc:492] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: No bootstrap required, opened a new log
I20260709 13:13:34.372792 26274 tablet_bootstrap.cc:492] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9: No bootstrap required, opened a new log
I20260709 13:13:34.372766 26273 ts_tablet_manager.cc:1403] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.013s
I20260709 13:13:34.373602 26274 ts_tablet_manager.cc:1403] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:13:34.374689 26280 raft_consensus.cc:493] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.375329 26280 raft_consensus.cc:515] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.377876 26273 raft_consensus.cc:359] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.381690 26273 raft_consensus.cc:385] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.382189 26273 raft_consensus.cc:740] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.380512 26274 raft_consensus.cc:359] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.383833 26274 raft_consensus.cc:385] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.384403 26274 raft_consensus.cc:740] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 643bcca892a6480cb7d5a4e07c1c5bf9, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.383666 26273 consensus_queue.cc:260] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.385780 26274 consensus_queue.cc:260] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.387619 26272 tablet_bootstrap.cc:492] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e: No bootstrap required, opened a new log
I20260709 13:13:34.388433 26272 ts_tablet_manager.cc:1403] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 13:13:34.389767 26280 leader_election.cc:290] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163)
I20260709 13:13:34.392464 26272 raft_consensus.cc:359] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.393513 26272 raft_consensus.cc:385] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.393911 26272 raft_consensus.cc:740] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.394937 26272 consensus_queue.cc:260] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.396773 26273 ts_tablet_manager.cc:1434] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 13:13:34.401059 26272 ts_tablet_manager.cc:1434] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:13:34.405308 26278 raft_consensus.cc:493] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.406107 26278 raft_consensus.cc:515] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.409626 26278 leader_election.cc:290] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.412317 26273 tablet_bootstrap.cc:492] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc: Bootstrap starting.
I20260709 13:13:34.422771 26273 tablet_bootstrap.cc:654] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:34.438697 26084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e" is_pre_election: true
I20260709 13:13:34.440070 26084 raft_consensus.cc:2468] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 643bcca892a6480cb7d5a4e07c1c5bf9 in term 0.
I20260709 13:13:34.440517 26274 ts_tablet_manager.cc:1434] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9: Time spent starting tablet: real 0.067s	user 0.039s	sys 0.012s
I20260709 13:13:34.441946 26198 leader_election.cc:304] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 643bcca892a6480cb7d5a4e07c1c5bf9; no voters: 
I20260709 13:13:34.443419 26301 raft_consensus.cc:2804] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.443939 26301 raft_consensus.cc:493] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.444319 26301 raft_consensus.cc:3060] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.455567 26279 raft_consensus.cc:493] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.456844 26279 raft_consensus.cc:515] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.457252 26301 raft_consensus.cc:515] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.461877 26279 leader_election.cc:290] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.462924 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" is_pre_election: true
I20260709 13:13:34.463307 26084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
I20260709 13:13:34.463862 26233 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 0.
I20260709 13:13:34.464309 26084 raft_consensus.cc:3060] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.465772 26122 leader_election.cc:304] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 643bcca892a6480cb7d5a4e07c1c5bf9, 9d2026a7165f476b975c7ce0b62922cc; no voters: 
I20260709 13:13:34.467078 26301 leader_election.cc:290] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 1 election: Requested vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163)
I20260709 13:13:34.468739 26279 raft_consensus.cc:2804] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.469259 26279 raft_consensus.cc:493] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.469650 26279 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.475986 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" is_pre_election: true
I20260709 13:13:34.476974 26233 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 170cf8f4b5a2423a81647e331d4efb4e in term 0.
I20260709 13:13:34.475098 26083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e" is_pre_election: true
I20260709 13:13:34.479847 26083 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 0.
I20260709 13:13:34.483286 26047 leader_election.cc:304] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 643bcca892a6480cb7d5a4e07c1c5bf9; no voters: 
I20260709 13:13:34.485397 26278 raft_consensus.cc:2804] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:34.485891 26278 raft_consensus.cc:493] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.486325 26278 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.491312 26158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
I20260709 13:13:34.491271 26159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2026a7165f476b975c7ce0b62922cc" is_pre_election: true
W20260709 13:13:34.494222 26196 leader_election.cc:343] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:34.495359 26196 leader_election.cc:343] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:34.500198 26084 raft_consensus.cc:2468] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 643bcca892a6480cb7d5a4e07c1c5bf9 in term 1.
I20260709 13:13:34.502656 26198 leader_election.cc:304] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 643bcca892a6480cb7d5a4e07c1c5bf9; no voters: 9d2026a7165f476b975c7ce0b62922cc
I20260709 13:13:34.504415 26301 raft_consensus.cc:2804] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.504136 26279 raft_consensus.cc:515] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.505815 26301 raft_consensus.cc:697] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 643bcca892a6480cb7d5a4e07c1c5bf9, State: Running, Role: LEADER
I20260709 13:13:34.504136 26278 raft_consensus.cc:515] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.508584 26301 consensus_queue.cc:237] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.507133 26273 tablet_bootstrap.cc:492] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc: No bootstrap required, opened a new log
I20260709 13:13:34.509917 26279 leader_election.cc:290] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 election: Requested vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.510702 26273 ts_tablet_manager.cc:1403] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc: Time spent bootstrapping tablet: real 0.099s	user 0.045s	sys 0.047s
I20260709 13:13:34.511299 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:34.511679 26232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:34.512113 26233 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.514222 26084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
I20260709 13:13:34.515172 26084 raft_consensus.cc:2393] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d2026a7165f476b975c7ce0b62922cc in current term 1: Already voted for candidate 170cf8f4b5a2423a81647e331d4efb4e in this term.
I20260709 13:13:34.514729 26273 raft_consensus.cc:359] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.515719 26273 raft_consensus.cc:385] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:34.516413 26273 raft_consensus.cc:740] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Initialized, Role: FOLLOWER
I20260709 13:13:34.517376 26273 consensus_queue.cc:260] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.509924 26278 leader_election.cc:290] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 1 election: Requested vote from peers 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.520951 26273 ts_tablet_manager.cc:1434] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:13:34.522373 26159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2026a7165f476b975c7ce0b62922cc" is_pre_election: true
I20260709 13:13:34.523346 26159 raft_consensus.cc:2393] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 170cf8f4b5a2423a81647e331d4efb4e in current term 1: Already voted for candidate 9d2026a7165f476b975c7ce0b62922cc in this term.
I20260709 13:13:34.524482 26158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
I20260709 13:13:34.525532 26158 raft_consensus.cc:2393] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 170cf8f4b5a2423a81647e331d4efb4e in current term 1: Already voted for candidate 9d2026a7165f476b975c7ce0b62922cc in this term.
I20260709 13:13:34.525631 26233 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 1.
I20260709 13:13:34.527217 26122 leader_election.cc:304] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 643bcca892a6480cb7d5a4e07c1c5bf9, 9d2026a7165f476b975c7ce0b62922cc; no voters: 170cf8f4b5a2423a81647e331d4efb4e
I20260709 13:13:34.527948 26047 leader_election.cc:304] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e; no voters: 643bcca892a6480cb7d5a4e07c1c5bf9, 9d2026a7165f476b975c7ce0b62922cc
I20260709 13:13:34.528277 26279 raft_consensus.cc:2804] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:34.529021 26278 raft_consensus.cc:2749] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.529471 26279 raft_consensus.cc:697] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Becoming Leader. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Running, Role: LEADER
I20260709 13:13:34.530529 26279 consensus_queue.cc:237] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.537974 25982 catalog_manager.cc:5697] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.549237 25980 catalog_manager.cc:5697] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66). New cstate: current_term: 1 leader_uuid: "9d2026a7165f476b975c7ce0b62922cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.560472 26279 consensus_queue.cc:1048] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.573865 26279 consensus_queue.cc:1048] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.610020 26158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42"
dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
mode: GRACEFUL
new_leader_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
 from {username='slave'} at 127.0.0.1:50034
I20260709 13:13:34.610981 26158 raft_consensus.cc:606] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Received request to transfer leadership to TS 170cf8f4b5a2423a81647e331d4efb4e
I20260709 13:13:34.618556 26158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912"
dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
mode: GRACEFUL
new_leader_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
 from {username='slave'} at 127.0.0.1:50034
I20260709 13:13:34.619294 26158 raft_consensus.cc:606] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Received request to transfer leadership to TS 643bcca892a6480cb7d5a4e07c1c5bf9
I20260709 13:13:34.636106 26233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72"
dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
mode: GRACEFUL
new_leader_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
 from {username='slave'} at 127.0.0.1:46906
I20260709 13:13:34.636878 26233 raft_consensus.cc:606] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 LEADER]: Received request to transfer leadership to TS 170cf8f4b5a2423a81647e331d4efb4e
I20260709 13:13:34.644001 26158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49"
dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
mode: GRACEFUL
new_leader_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
 from {username='slave'} at 127.0.0.1:50034
I20260709 13:13:34.644817 26158 raft_consensus.cc:606] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Received request to transfer leadership to TS 170cf8f4b5a2423a81647e331d4efb4e
I20260709 13:13:34.648427 26279 consensus_queue.cc:1048] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.666090 26315 consensus_queue.cc:1048] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:34.676802 26285 raft_consensus.cc:993] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc: : Instructing follower 170cf8f4b5a2423a81647e331d4efb4e to start an election
I20260709 13:13:34.677346 26285 raft_consensus.cc:1081] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Signalling peer 170cf8f4b5a2423a81647e331d4efb4e to start an election
I20260709 13:13:34.680646 26084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42"
dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
 from {username='slave'} at 127.0.0.1:33310
I20260709 13:13:34.681455 26084 raft_consensus.cc:493] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.681923 26084 raft_consensus.cc:3060] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.689989 26084 raft_consensus.cc:515] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.692600 26084 leader_election.cc:290] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 2 election: Requested vote from peers 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141), 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163)
I20260709 13:13:34.694921 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:34.694753 26158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5df7f0f84d94936bee030b9106d8d42" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
I20260709 13:13:34.695886 26233 raft_consensus.cc:3060] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.696028 26158 raft_consensus.cc:3055] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:34.696532 26158 raft_consensus.cc:740] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Running, Role: LEADER
I20260709 13:13:34.697484 26158 consensus_queue.cc:260] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.699107 26158 raft_consensus.cc:3060] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.705044 26233 raft_consensus.cc:2468] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 170cf8f4b5a2423a81647e331d4efb4e in term 2.
I20260709 13:13:34.706595 26047 leader_election.cc:304] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 643bcca892a6480cb7d5a4e07c1c5bf9; no voters: 
I20260709 13:13:34.707620 26278 raft_consensus.cc:2804] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:34.708714 26158 raft_consensus.cc:2468] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 170cf8f4b5a2423a81647e331d4efb4e in term 2.
I20260709 13:13:34.709419 26278 raft_consensus.cc:697] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Becoming Leader. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Running, Role: LEADER
I20260709 13:13:34.710589 26278 consensus_queue.cc:237] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } }
I20260709 13:13:34.718995 25980 catalog_manager.cc:5697] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e reported cstate change: term changed from 1 to 2, leader changed from 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66) to 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65). New cstate: current_term: 2 leader_uuid: "170cf8f4b5a2423a81647e331d4efb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.728744 26315 raft_consensus.cc:493] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.729470 26315 raft_consensus.cc:515] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.731878 26315 leader_election.cc:290] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.732839 26084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e" is_pre_election: true
I20260709 13:13:34.733042 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" is_pre_election: true
I20260709 13:13:34.733732 26084 raft_consensus.cc:2393] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d2026a7165f476b975c7ce0b62922cc in current term 1: Already voted for candidate 643bcca892a6480cb7d5a4e07c1c5bf9 in this term.
I20260709 13:13:34.734864 26122 leader_election.cc:304] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d2026a7165f476b975c7ce0b62922cc; no voters: 170cf8f4b5a2423a81647e331d4efb4e, 643bcca892a6480cb7d5a4e07c1c5bf9
I20260709 13:13:34.735751 26315 raft_consensus.cc:3060] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:34.742969 26315 raft_consensus.cc:2749] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:34.906214 26301 consensus_queue.cc:1048] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.922538 26319 consensus_queue.cc:1048] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:34.931787 26319 raft_consensus.cc:993] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9: : Instructing follower 170cf8f4b5a2423a81647e331d4efb4e to start an election
I20260709 13:13:34.932410 26319 raft_consensus.cc:1081] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 LEADER]: Signalling peer 170cf8f4b5a2423a81647e331d4efb4e to start an election
I20260709 13:13:34.934216 26084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72"
dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
 from {username='slave'} at 127.0.0.1:33324
I20260709 13:13:34.935025 26084 raft_consensus.cc:493] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.935387 26084 raft_consensus.cc:3060] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.942651 26084 raft_consensus.cc:515] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.944872 26084 leader_election.cc:290] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 2 election: Requested vote from peers 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:34.945873 26158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
I20260709 13:13:34.946214 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e19886915c4a5ab6541bbeb3c67e72" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:34.946674 26158 raft_consensus.cc:3060] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.946823 26233 raft_consensus.cc:3055] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:34.947185 26233 raft_consensus.cc:740] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 643bcca892a6480cb7d5a4e07c1c5bf9, State: Running, Role: LEADER
I20260709 13:13:34.947968 26233 consensus_queue.cc:260] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.949210 26233 raft_consensus.cc:3060] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:34.955600 26158 raft_consensus.cc:2468] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 170cf8f4b5a2423a81647e331d4efb4e in term 2.
I20260709 13:13:34.956069 26233 raft_consensus.cc:2468] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 170cf8f4b5a2423a81647e331d4efb4e in term 2.
I20260709 13:13:34.957152 26047 leader_election.cc:304] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 9d2026a7165f476b975c7ce0b62922cc; no voters: 
I20260709 13:13:34.958276 26278 raft_consensus.cc:2804] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:34.958798 26278 raft_consensus.cc:697] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Becoming Leader. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Running, Role: LEADER
I20260709 13:13:34.959563 26278 consensus_queue.cc:237] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:34.966580 25980 catalog_manager.cc:5697] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e reported cstate change: term changed from 1 to 2, leader changed from 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67) to 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65). New cstate: current_term: 2 leader_uuid: "170cf8f4b5a2423a81647e331d4efb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.091784 26315 consensus_queue.cc:1048] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.100638 26285 raft_consensus.cc:993] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: : Instructing follower 170cf8f4b5a2423a81647e331d4efb4e to start an election
I20260709 13:13:35.101243 26285 raft_consensus.cc:1081] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Signalling peer 170cf8f4b5a2423a81647e331d4efb4e to start an election
I20260709 13:13:35.103881 26083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49"
dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
 from {username='slave'} at 127.0.0.1:33310
I20260709 13:13:35.107146 26083 raft_consensus.cc:493] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.107682 26083 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.107693 26315 consensus_queue.cc:1048] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:35.118510 26083 raft_consensus.cc:515] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.121325 26083 leader_election.cc:290] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 2 election: Requested vote from peers 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:35.122066 26158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
I20260709 13:13:35.122593 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "170cf8f4b5a2423a81647e331d4efb4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:35.122884 26158 raft_consensus.cc:3055] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.123355 26158 raft_consensus.cc:740] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Running, Role: LEADER
I20260709 13:13:35.123335 26233 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.124572 26158 consensus_queue.cc:260] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.126157 26158 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.133559 26233 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 170cf8f4b5a2423a81647e331d4efb4e in term 2.
I20260709 13:13:35.135272 26047 leader_election.cc:304] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 643bcca892a6480cb7d5a4e07c1c5bf9; no voters: 
I20260709 13:13:35.135914 26158 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 170cf8f4b5a2423a81647e331d4efb4e in term 2.
I20260709 13:13:35.136384 26317 raft_consensus.cc:2804] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.137005 26317 raft_consensus.cc:697] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Becoming Leader. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Running, Role: LEADER
I20260709 13:13:35.138545 26158 raft_consensus.cc:1275] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Refusing update from remote peer 170cf8f4b5a2423a81647e331d4efb4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.138008 26317 consensus_queue.cc:237] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.140736 26278 consensus_queue.cc:1048] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.152874 26233 raft_consensus.cc:1275] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Refusing update from remote peer 170cf8f4b5a2423a81647e331d4efb4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.155575 26323 consensus_queue.cc:1048] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:13:35.157975 25982 catalog_manager.cc:5697] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e reported cstate change: term changed from 1 to 2, leader changed from 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66) to 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65). New cstate: current_term: 2 leader_uuid: "170cf8f4b5a2423a81647e331d4efb4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.187363 26286 raft_consensus.cc:993] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc: : Instructing follower 643bcca892a6480cb7d5a4e07c1c5bf9 to start an election
I20260709 13:13:35.188064 26315 raft_consensus.cc:1081] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Signalling peer 643bcca892a6480cb7d5a4e07c1c5bf9 to start an election
I20260709 13:13:35.190650 26233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912"
dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
 from {username='slave'} at 127.0.0.1:46888
I20260709 13:13:35.191282 26233 raft_consensus.cc:493] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.191962 26233 raft_consensus.cc:3060] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.201161 26233 raft_consensus.cc:515] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.203161 26233 leader_election.cc:290] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 2 election: Requested vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66:38163)
I20260709 13:13:35.204416 26158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912" candidate_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
I20260709 13:13:35.204406 26083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e22988fa33488db30f97bc98e63912" candidate_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
I20260709 13:13:35.205338 26083 raft_consensus.cc:3060] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.205338 26158 raft_consensus.cc:3055] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:35.205879 26158 raft_consensus.cc:740] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Running, Role: LEADER
I20260709 13:13:35.206859 26158 consensus_queue.cc:260] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.208384 26158 raft_consensus.cc:3060] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:35.214833 26083 raft_consensus.cc:2468] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 643bcca892a6480cb7d5a4e07c1c5bf9 in term 2.
I20260709 13:13:35.217020 26198 leader_election.cc:304] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170cf8f4b5a2423a81647e331d4efb4e, 643bcca892a6480cb7d5a4e07c1c5bf9; no voters: 
I20260709 13:13:35.217291 26158 raft_consensus.cc:2468] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 643bcca892a6480cb7d5a4e07c1c5bf9 in term 2.
I20260709 13:13:35.218128 26319 raft_consensus.cc:2804] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:35.219107 26319 raft_consensus.cc:697] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 LEADER]: Becoming Leader. State: Replica: 643bcca892a6480cb7d5a4e07c1c5bf9, State: Running, Role: LEADER
I20260709 13:13:35.220082 26319 consensus_queue.cc:237] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.227447 25981 catalog_manager.cc:5697] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 reported cstate change: term changed from 1 to 2, leader changed from 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66) to 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:35.346390 26158 raft_consensus.cc:1275] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Refusing update from remote peer 170cf8f4b5a2423a81647e331d4efb4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.348654 26324 consensus_queue.cc:1048] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:35.358664 26233 raft_consensus.cc:1275] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Refusing update from remote peer 170cf8f4b5a2423a81647e331d4efb4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.360916 26317 consensus_queue.cc:1048] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.496367 14097 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:13:35.498775 14097 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:13:35.499923 14097 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:13:35.528402 26083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49"
dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
mode: GRACEFUL
new_leader_uuid: "9d2026a7165f476b975c7ce0b62922cc"
 from {username='slave'} at 127.0.0.1:33326
I20260709 13:13:35.529325 26083 raft_consensus.cc:606] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Received request to transfer leadership to TS 9d2026a7165f476b975c7ce0b62922cc
I20260709 13:13:35.531530 14097 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:13:35.537810 26158 raft_consensus.cc:1275] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Refusing update from remote peer 170cf8f4b5a2423a81647e331d4efb4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.540486 26324 consensus_queue.cc:1048] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:35.552932 26317 raft_consensus.cc:993] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e: : Instructing follower 9d2026a7165f476b975c7ce0b62922cc to start an election
I20260709 13:13:35.554181 26317 raft_consensus.cc:1081] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Signalling peer 9d2026a7165f476b975c7ce0b62922cc to start an election
I20260709 13:13:35.560111 26159 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49"
dest_uuid: "9d2026a7165f476b975c7ce0b62922cc"
 from {username='slave'} at 127.0.0.1:50020
I20260709 13:13:35.561105 26159 raft_consensus.cc:493] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.561685 26159 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.563428 26233 raft_consensus.cc:1275] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Refusing update from remote peer 170cf8f4b5a2423a81647e331d4efb4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.567049 26329 consensus_queue.cc:1048] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:35.584961 26159 raft_consensus.cc:515] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.588238 26159 leader_election.cc:290] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 3 election: Requested vote from peers 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65:46801), 643bcca892a6480cb7d5a4e07c1c5bf9 (127.13.196.67:33141)
I20260709 13:13:35.589459 26083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "170cf8f4b5a2423a81647e331d4efb4e"
I20260709 13:13:35.590420 26083 raft_consensus.cc:3055] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:35.590771 26083 raft_consensus.cc:740] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 170cf8f4b5a2423a81647e331d4efb4e, State: Running, Role: LEADER
I20260709 13:13:35.591423 26233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b07a782f4d4438a040513a7396cc49" candidate_uuid: "9d2026a7165f476b975c7ce0b62922cc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9"
I20260709 13:13:35.592468 26083 consensus_queue.cc:260] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.593125 26233 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.594348 26083 raft_consensus.cc:3060] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.606294 26233 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 3.
I20260709 13:13:35.607648 26159 raft_consensus.cc:1275] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Refusing update from remote peer 643bcca892a6480cb7d5a4e07c1c5bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.610414 26319 consensus_queue.cc:1048] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:35.612222 26122 leader_election.cc:304] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 643bcca892a6480cb7d5a4e07c1c5bf9, 9d2026a7165f476b975c7ce0b62922cc; no voters: 
I20260709 13:13:35.613869 26315 raft_consensus.cc:2804] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:35.614538 26315 raft_consensus.cc:697] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 3 LEADER]: Becoming Leader. State: Replica: 9d2026a7165f476b975c7ce0b62922cc, State: Running, Role: LEADER
I20260709 13:13:35.616606 26315 consensus_queue.cc:237] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } }
I20260709 13:13:35.620092 26083 raft_consensus.cc:2468] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2026a7165f476b975c7ce0b62922cc in term 3.
I20260709 13:13:35.630112 25982 catalog_manager.cc:5697] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc reported cstate change: term changed from 2 to 3, leader changed from 170cf8f4b5a2423a81647e331d4efb4e (127.13.196.65) to 9d2026a7165f476b975c7ce0b62922cc (127.13.196.66). New cstate: current_term: 3 leader_uuid: "9d2026a7165f476b975c7ce0b62922cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2026a7165f476b975c7ce0b62922cc" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 38163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "643bcca892a6480cb7d5a4e07c1c5bf9" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 33141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.631918 26083 raft_consensus.cc:1275] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Refusing update from remote peer 643bcca892a6480cb7d5a4e07c1c5bf9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:35.635504 26319 consensus_queue.cc:1048] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "170cf8f4b5a2423a81647e331d4efb4e" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 46801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:35.662629 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
I20260709 13:13:35.711124 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:35.712383 14097 tablet_replica.cc:333] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e: stopping tablet replica
I20260709 13:13:35.713220 14097 raft_consensus.cc:2243] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.714924 14097 raft_consensus.cc:2272] T 38e19886915c4a5ab6541bbeb3c67e72 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.719887 14097 tablet_replica.cc:333] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e: stopping tablet replica
I20260709 13:13:35.720743 14097 raft_consensus.cc:2243] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.721304 14097 raft_consensus.cc:2272] T 98b07a782f4d4438a040513a7396cc49 P 170cf8f4b5a2423a81647e331d4efb4e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.725521 14097 tablet_replica.cc:333] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e: stopping tablet replica
I20260709 13:13:35.726362 14097 raft_consensus.cc:2243] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.726999 14097 raft_consensus.cc:2272] T e4e22988fa33488db30f97bc98e63912 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.730785 14097 tablet_replica.cc:333] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e: stopping tablet replica
I20260709 13:13:35.731597 14097 raft_consensus.cc:2243] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.732896 14097 raft_consensus.cc:2272] T f5df7f0f84d94936bee030b9106d8d42 P 170cf8f4b5a2423a81647e331d4efb4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.758054 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
I20260709 13:13:35.784528 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
I20260709 13:13:35.821036 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:35.821884 14097 tablet_replica.cc:333] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc: stopping tablet replica
I20260709 13:13:35.822590 14097 raft_consensus.cc:2243] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.823240 14097 raft_consensus.cc:2272] T 38e19886915c4a5ab6541bbeb3c67e72 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.827489 14097 tablet_replica.cc:333] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: stopping tablet replica
I20260709 13:13:35.828183 14097 raft_consensus.cc:2243] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.829041 14097 pending_rounds.cc:70] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: Trying to abort 1 pending ops.
I20260709 13:13:35.829234 14097 pending_rounds.cc:77] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637132778065920 op_type: NO_OP noop_request { }
I20260709 13:13:35.829522 14097 raft_consensus.cc:2889] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:35.829811 14097 raft_consensus.cc:2272] T 98b07a782f4d4438a040513a7396cc49 P 9d2026a7165f476b975c7ce0b62922cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.833638 14097 tablet_replica.cc:333] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc: stopping tablet replica
I20260709 13:13:35.834240 14097 raft_consensus.cc:2243] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.834841 14097 raft_consensus.cc:2272] T f5df7f0f84d94936bee030b9106d8d42 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.838155 14097 tablet_replica.cc:333] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc: stopping tablet replica
I20260709 13:13:35.838754 14097 raft_consensus.cc:2243] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.839277 14097 raft_consensus.cc:2272] T e4e22988fa33488db30f97bc98e63912 P 9d2026a7165f476b975c7ce0b62922cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.873476 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
I20260709 13:13:35.898051 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
I20260709 13:13:35.943513 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:35.944754 14097 tablet_replica.cc:333] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9: stopping tablet replica
I20260709 13:13:35.945524 14097 raft_consensus.cc:2243] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.946200 14097 raft_consensus.cc:2272] T 38e19886915c4a5ab6541bbeb3c67e72 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.950165 14097 tablet_replica.cc:333] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9: stopping tablet replica
I20260709 13:13:35.950843 14097 raft_consensus.cc:2243] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.951323 14097 raft_consensus.cc:2272] T 98b07a782f4d4438a040513a7396cc49 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.956311 14097 tablet_replica.cc:333] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9: stopping tablet replica
I20260709 13:13:35.957146 14097 raft_consensus.cc:2243] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:35.958518 14097 raft_consensus.cc:2272] T e4e22988fa33488db30f97bc98e63912 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.962460 14097 tablet_replica.cc:333] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9: stopping tablet replica
I20260709 13:13:35.963069 14097 raft_consensus.cc:2243] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:35.963840 14097 raft_consensus.cc:2272] T f5df7f0f84d94936bee030b9106d8d42 P 643bcca892a6480cb7d5a4e07c1c5bf9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:35.985791 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
I20260709 13:13:36.008111 14097 master.cc:562] Master@127.13.196.126:34873 shutting down...
I20260709 13:13:36.035974 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.036907 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.037356 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P bca2eee4bb16432b8b6b9083fa0427d6: stopping tablet replica
I20260709 13:13:36.060446 14097 master.cc:584] Master@127.13.196.126:34873 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2971 ms)
[----------] 6 tests from LeaderRebalancerTest (384597 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:13:36.113459 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:43937
I20260709 13:13:36.114837 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:36.122496 26334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.122496 26335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.124089 26337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.126451 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:36.127611 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:36.127964 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:36.128157 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602816128136 us; error 0 us; skew 500 ppm
I20260709 13:13:36.128932 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:36.131976 14097 webserver.cc:533] Webserver started at http://127.13.196.126:42759/ using document root <none> and password file <none>
I20260709 13:13:36.132644 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:36.132841 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:36.133107 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:36.134497 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "f0b332303f914fab89a11f608e344023"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.140033 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:13:36.144826 26342 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.145917 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:36.146308 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "f0b332303f914fab89a11f608e344023"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.146613 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:36.179913 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:36.181643 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:36.241618 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:43937
I20260709 13:13:36.241775 26393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:43937 every 8 connection(s)
I20260709 13:13:36.247071 26394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.264497 26394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023: Bootstrap starting.
I20260709 13:13:36.271080 26394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.276813 26394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023: No bootstrap required, opened a new log
I20260709 13:13:36.280619 26394 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0b332303f914fab89a11f608e344023" member_type: VOTER }
I20260709 13:13:36.281140 26394 raft_consensus.cc:385] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.281366 26394 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0b332303f914fab89a11f608e344023, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.281986 26394 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0b332303f914fab89a11f608e344023" member_type: VOTER }
I20260709 13:13:36.282536 26394 raft_consensus.cc:399] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:36.282752 26394 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:36.282991 26394 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.290333 26394 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0b332303f914fab89a11f608e344023" member_type: VOTER }
I20260709 13:13:36.291082 26394 leader_election.cc:304] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0b332303f914fab89a11f608e344023; no voters: 
I20260709 13:13:36.292521 26394 leader_election.cc:290] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:36.293290 26397 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.295352 26397 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 1 LEADER]: Becoming Leader. State: Replica: f0b332303f914fab89a11f608e344023, State: Running, Role: LEADER
I20260709 13:13:36.296661 26394 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:36.296599 26397 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0b332303f914fab89a11f608e344023" member_type: VOTER }
I20260709 13:13:36.302662 26399 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0b332303f914fab89a11f608e344023. Latest consensus state: current_term: 1 leader_uuid: "f0b332303f914fab89a11f608e344023" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0b332303f914fab89a11f608e344023" member_type: VOTER } }
I20260709 13:13:36.303534 26399 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:36.306317 26398 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0b332303f914fab89a11f608e344023" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0b332303f914fab89a11f608e344023" member_type: VOTER } }
I20260709 13:13:36.306718 26404 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:36.307152 26398 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:36.316712 26404 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:36.318485 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:36.332401 26404 catalog_manager.cc:1383] Generated new cluster ID: 770913bef52549f9bcc32daab46fc70a
I20260709 13:13:36.332743 26404 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:36.368968 26404 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:36.370719 26404 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:36.389132 26404 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023: Generated new TSK 0
I20260709 13:13:36.390218 26404 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:36.450626 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:36.459067 26415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.460698 26416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.462930 26418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.464521 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:36.465781 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:36.466009 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:36.466241 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602816466221 us; error 0 us; skew 500 ppm
I20260709 13:13:36.466920 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:36.470211 14097 webserver.cc:533] Webserver started at http://127.13.196.65:36479/ using document root <none> and password file <none>
I20260709 13:13:36.470827 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:36.471037 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:36.471354 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:36.472965 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.478893 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:36.483598 26423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.484773 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:13:36.485172 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.485519 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:36.515631 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:36.517603 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:36.519496 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:36.522732 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:36.523047 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.523340 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:36.523561 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.579852 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:34595
I20260709 13:13:36.579967 26485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:34595 every 8 connection(s)
I20260709 13:13:36.586606 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:36.598379 26490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.598978 26491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.603511 26493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.603581 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:36.605489 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:36.605844 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:36.606079 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602816606058 us; error 0 us; skew 500 ppm
I20260709 13:13:36.606711 26486 heartbeater.cc:344] Connected to a master server at 127.13.196.126:43937
I20260709 13:13:36.606869 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:36.607300 26486 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:36.608464 26486 heartbeater.cc:507] Master 127.13.196.126:43937 requested a full tablet report, sending...
I20260709 13:13:36.610859 14097 webserver.cc:533] Webserver started at http://127.13.196.66:44557/ using document root <none> and password file <none>
I20260709 13:13:36.611806 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:36.611774 26359 ts_manager.cc:194] Registered new tserver with Master: f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595)
I20260709 13:13:36.612488 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:36.612946 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:36.615141 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.615247 26359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39696
I20260709 13:13:36.622094 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:13:36.627110 26498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.628144 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:36.628593 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.628922 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:36.645478 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:36.646979 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:36.648622 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:36.652084 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:36.652475 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:36.652714 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:36.652868 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.712100 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:37471
I20260709 13:13:36.712203 26560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:37471 every 8 connection(s)
I20260709 13:13:36.718394 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:36.728204 26564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.728752 26565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.733310 14097 server_base.cc:1061] running on GCE node
W20260709 13:13:36.733596 26568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.734040 26561 heartbeater.cc:344] Connected to a master server at 127.13.196.126:43937
I20260709 13:13:36.734992 26561 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:36.735554 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:36.735888 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:36.736094 26561 heartbeater.cc:507] Master 127.13.196.126:43937 requested a full tablet report, sending...
I20260709 13:13:36.736117 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602816736097 us; error 0 us; skew 500 ppm
I20260709 13:13:36.737785 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:36.739641 26359 ts_manager.cc:194] Registered new tserver with Master: ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:36.741575 26359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39702
I20260709 13:13:36.742175 14097 webserver.cc:533] Webserver started at http://127.13.196.67:34615/ using document root <none> and password file <none>
I20260709 13:13:36.742982 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:36.743255 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:36.743674 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:36.745164 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.751585 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:36.757066 26572 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.758347 14097 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:36.759087 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-ftjc"
I20260709 13:13:36.759503 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:36.780980 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:36.782456 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:36.784233 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:36.787586 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:36.787897 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.788188 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:36.788403 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:36.849609 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:39229
I20260709 13:13:36.849732 26634 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:39229 every 8 connection(s)
I20260709 13:13:36.870868 26635 heartbeater.cc:344] Connected to a master server at 127.13.196.126:43937
I20260709 13:13:36.871407 26635 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:36.872804 26635 heartbeater.cc:507] Master 127.13.196.126:43937 requested a full tablet report, sending...
I20260709 13:13:36.875656 26359 ts_manager.cc:194] Registered new tserver with Master: fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:36.876201 14097 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022631898s
I20260709 13:13:36.878165 26359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39716
I20260709 13:13:36.913682 26359 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39724:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:36.917743 26359 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:37.015431 26600 tablet_service.cc:1511] Processing CreateTablet for tablet 03592e543c614badbecb5f587c00e4d3 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:37.017822 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03592e543c614badbecb5f587c00e4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.018980 26599 tablet_service.cc:1511] Processing CreateTablet for tablet a6db43462970464eb3d2ca9abc071996 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:37.021683 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6db43462970464eb3d2ca9abc071996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.028597 26598 tablet_service.cc:1511] Processing CreateTablet for tablet c331c336bc894a37a9b7ff2589eb2db3 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:37.030259 26598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c331c336bc894a37a9b7ff2589eb2db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.033881 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4cc38430e14c26a90b625a781282e2 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:37.036461 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4cc38430e14c26a90b625a781282e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.045300 26594 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe09b075d084a648d8d3e5cae7e54cd (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:37.047302 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe09b075d084a648d8d3e5cae7e54cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.047129 26593 tablet_service.cc:1511] Processing CreateTablet for tablet 66fa2c1f77e9434d8523cda0e5aa87a9 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:37.048924 26593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fa2c1f77e9434d8523cda0e5aa87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.053352 26596 tablet_service.cc:1511] Processing CreateTablet for tablet a11ea7817b734d67a116a1a14dc14daf (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:37.055054 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ea7817b734d67a116a1a14dc14daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.052218 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 1e225ff26f7d4f2094c30b7a6495d05b (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:37.059206 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e225ff26f7d4f2094c30b7a6495d05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.084717 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 6479fc955c944947bcb331cde5deb4b4 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:37.086524 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6479fc955c944947bcb331cde5deb4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.101421 26526 tablet_service.cc:1511] Processing CreateTablet for tablet 03592e543c614badbecb5f587c00e4d3 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:37.101681 26451 tablet_service.cc:1511] Processing CreateTablet for tablet 03592e543c614badbecb5f587c00e4d3 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:37.104727 26525 tablet_service.cc:1511] Processing CreateTablet for tablet a6db43462970464eb3d2ca9abc071996 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:37.105623 26449 tablet_service.cc:1511] Processing CreateTablet for tablet c331c336bc894a37a9b7ff2589eb2db3 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:37.104727 26447 tablet_service.cc:1511] Processing CreateTablet for tablet a11ea7817b734d67a116a1a14dc14daf (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:37.108388 26448 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4cc38430e14c26a90b625a781282e2 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:37.110739 26653 tablet_bootstrap.cc:492] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.111121 26446 tablet_service.cc:1511] Processing CreateTablet for tablet 1e225ff26f7d4f2094c30b7a6495d05b (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:37.111891 26524 tablet_service.cc:1511] Processing CreateTablet for tablet c331c336bc894a37a9b7ff2589eb2db3 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:37.113812 26445 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe09b075d084a648d8d3e5cae7e54cd (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:37.116555 26444 tablet_service.cc:1511] Processing CreateTablet for tablet 66fa2c1f77e9434d8523cda0e5aa87a9 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:37.103348 26451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03592e543c614badbecb5f587c00e4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.118497 26447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ea7817b734d67a116a1a14dc14daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.119489 26450 tablet_service.cc:1511] Processing CreateTablet for tablet a6db43462970464eb3d2ca9abc071996 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:37.121057 26450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6db43462970464eb3d2ca9abc071996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.118037 26523 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4cc38430e14c26a90b625a781282e2 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:37.105453 26443 tablet_service.cc:1511] Processing CreateTablet for tablet 6479fc955c944947bcb331cde5deb4b4 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:37.125067 26443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6479fc955c944947bcb331cde5deb4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.126333 26522 tablet_service.cc:1511] Processing CreateTablet for tablet a11ea7817b734d67a116a1a14dc14daf (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:37.128870 26449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c331c336bc894a37a9b7ff2589eb2db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.129739 26444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fa2c1f77e9434d8523cda0e5aa87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.130438 26521 tablet_service.cc:1511] Processing CreateTablet for tablet 1e225ff26f7d4f2094c30b7a6495d05b (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:37.133306 26445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe09b075d084a648d8d3e5cae7e54cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.135104 26520 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe09b075d084a648d8d3e5cae7e54cd (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:37.103292 26526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03592e543c614badbecb5f587c00e4d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.137009 26448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4cc38430e14c26a90b625a781282e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.138927 26519 tablet_service.cc:1511] Processing CreateTablet for tablet 66fa2c1f77e9434d8523cda0e5aa87a9 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:37.140800 26521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e225ff26f7d4f2094c30b7a6495d05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.141016 26653 tablet_bootstrap.cc:654] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.141711 26519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66fa2c1f77e9434d8523cda0e5aa87a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.142527 26522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11ea7817b734d67a116a1a14dc14daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.144523 26446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e225ff26f7d4f2094c30b7a6495d05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.144737 26520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe09b075d084a648d8d3e5cae7e54cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.146770 26518 tablet_service.cc:1511] Processing CreateTablet for tablet 6479fc955c944947bcb331cde5deb4b4 (DEFAULT_TABLE table=test-workload [id=9d377bc9efe8480f9e9239bce6a631bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:37.149231 26518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6479fc955c944947bcb331cde5deb4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.150156 26523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4cc38430e14c26a90b625a781282e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.153383 26525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6db43462970464eb3d2ca9abc071996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.155370 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c331c336bc894a37a9b7ff2589eb2db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.191370 26653 tablet_bootstrap.cc:492] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.192524 26653 ts_tablet_manager.cc:1403] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.082s	user 0.022s	sys 0.024s
I20260709 13:13:37.196326 26653 raft_consensus.cc:359] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.197319 26653 raft_consensus.cc:385] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.197710 26653 raft_consensus.cc:740] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.203269 26653 consensus_queue.cc:260] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.213353 26656 tablet_bootstrap.cc:492] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.225112 26635 heartbeater.cc:499] Master 127.13.196.126:43937 was elected leader, sending a full tablet report...
I20260709 13:13:37.228514 26656 tablet_bootstrap.cc:654] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.260499 26653 ts_tablet_manager.cc:1434] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.068s	user 0.014s	sys 0.008s
I20260709 13:13:37.270614 26656 tablet_bootstrap.cc:492] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.271437 26656 ts_tablet_manager.cc:1403] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.008s
I20260709 13:13:37.275357 26656 raft_consensus.cc:359] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.276300 26656 raft_consensus.cc:385] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.276674 26656 raft_consensus.cc:740] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.266188 26653 tablet_bootstrap.cc:492] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.292804 26656 consensus_queue.cc:260] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
W20260709 13:13:37.310497 26407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:37.325603 26486 heartbeater.cc:499] Master 127.13.196.126:43937 was elected leader, sending a full tablet report...
I20260709 13:13:37.326931 26656 ts_tablet_manager.cc:1434] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.006s
I20260709 13:13:37.331987 26659 tablet_bootstrap.cc:492] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.338775 26653 tablet_bootstrap.cc:654] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.342700 26656 tablet_bootstrap.cc:492] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.356328 26659 tablet_bootstrap.cc:654] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.357455 26658 raft_consensus.cc:493] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.358281 26658 raft_consensus.cc:515] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.366194 26656 tablet_bootstrap.cc:654] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.373035 26658 leader_election.cc:290] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:37.376696 26653 tablet_bootstrap.cc:492] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.377750 26653 ts_tablet_manager.cc:1403] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.115s	user 0.018s	sys 0.015s
I20260709 13:13:37.383765 26653 raft_consensus.cc:359] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.384784 26653 raft_consensus.cc:385] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.385155 26653 raft_consensus.cc:740] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.387643 26653 consensus_queue.cc:260] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.390339 26653 ts_tablet_manager.cc:1434] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:37.391579 26653 tablet_bootstrap.cc:492] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.395985 26656 tablet_bootstrap.cc:492] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.396917 26656 ts_tablet_manager.cc:1403] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.023s
I20260709 13:13:37.400827 26653 tablet_bootstrap.cc:654] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.405467 26656 raft_consensus.cc:359] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.406558 26656 raft_consensus.cc:385] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.406992 26656 raft_consensus.cc:740] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.407760 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:37.407980 26656 consensus_queue.cc:260] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.409075 26659 tablet_bootstrap.cc:492] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.410233 26659 ts_tablet_manager.cc:1403] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.010s
W20260709 13:13:37.410125 26425 leader_election.cc:343] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.411298 26656 ts_tablet_manager.cc:1434] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:13:37.412942 26656 tablet_bootstrap.cc:492] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.417721 26653 tablet_bootstrap.cc:492] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.418444 26653 ts_tablet_manager.cc:1403] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 13:13:37.419838 26659 raft_consensus.cc:359] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.420836 26659 raft_consensus.cc:385] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.421316 26659 raft_consensus.cc:740] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.422006 26656 tablet_bootstrap.cc:654] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.422219 26659 consensus_queue.cc:260] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.422480 26653 raft_consensus.cc:359] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.423372 26653 raft_consensus.cc:385] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.423789 26653 raft_consensus.cc:740] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.430033 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:37.431407 26653 consensus_queue.cc:260] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.433200 26610 raft_consensus.cc:2468] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 0.
I20260709 13:13:37.435498 26653 ts_tablet_manager.cc:1434] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:13:37.437529 26653 tablet_bootstrap.cc:492] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.438411 26425 leader_election.cc:304] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:37.439988 26658 raft_consensus.cc:2804] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.440500 26658 raft_consensus.cc:493] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.440866 26658 raft_consensus.cc:3060] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.443104 26659 ts_tablet_manager.cc:1434] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.032s	user 0.014s	sys 0.004s
I20260709 13:13:37.444715 26659 tablet_bootstrap.cc:492] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.445278 26656 tablet_bootstrap.cc:492] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.445659 26561 heartbeater.cc:499] Master 127.13.196.126:43937 was elected leader, sending a full tablet report...
I20260709 13:13:37.446074 26656 ts_tablet_manager.cc:1403] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.020s
I20260709 13:13:37.449784 26653 tablet_bootstrap.cc:654] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.451310 26656 raft_consensus.cc:359] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.452605 26656 raft_consensus.cc:385] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.452961 26656 raft_consensus.cc:740] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.453121 26659 tablet_bootstrap.cc:654] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.454133 26656 consensus_queue.cc:260] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.464461 26653 tablet_bootstrap.cc:492] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.465638 26653 ts_tablet_manager.cc:1403] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 13:13:37.470935 26653 raft_consensus.cc:359] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.472579 26653 raft_consensus.cc:385] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.473177 26653 raft_consensus.cc:740] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.474951 26653 consensus_queue.cc:260] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.478423 26653 ts_tablet_manager.cc:1434] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:13:37.479782 26653 tablet_bootstrap.cc:492] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.488930 26658 raft_consensus.cc:515] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.494099 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:37.494400 26653 tablet_bootstrap.cc:654] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.495918 26659 tablet_bootstrap.cc:492] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
W20260709 13:13:37.496480 26425 leader_election.cc:343] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.496685 26659 ts_tablet_manager.cc:1403] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.052s	user 0.031s	sys 0.013s
I20260709 13:13:37.501405 26659 raft_consensus.cc:359] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.502715 26659 raft_consensus.cc:385] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.503170 26659 raft_consensus.cc:740] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.504326 26659 consensus_queue.cc:260] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.507807 26659 ts_tablet_manager.cc:1434] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:37.509639 26659 tablet_bootstrap.cc:492] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.520141 26656 ts_tablet_manager.cc:1434] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.074s	user 0.037s	sys 0.026s
I20260709 13:13:37.520668 26659 tablet_bootstrap.cc:654] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.521024 26658 leader_election.cc:290] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:37.520736 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:37.521962 26610 raft_consensus.cc:3060] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.527802 26653 tablet_bootstrap.cc:492] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.528395 26659 tablet_bootstrap.cc:492] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.528656 26653 ts_tablet_manager.cc:1403] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.012s
I20260709 13:13:37.529052 26659 ts_tablet_manager.cc:1403] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:13:37.532738 26659 raft_consensus.cc:359] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.533196 26653 raft_consensus.cc:359] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.533993 26659 raft_consensus.cc:385] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.534283 26653 raft_consensus.cc:385] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.534377 26659 raft_consensus.cc:740] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.534765 26653 raft_consensus.cc:740] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.535329 26656 tablet_bootstrap.cc:492] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.535432 26659 consensus_queue.cc:260] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.535830 26653 consensus_queue.cc:260] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.539013 26659 ts_tablet_manager.cc:1434] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 13:13:37.540302 26670 raft_consensus.cc:493] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.541059 26670 raft_consensus.cc:515] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.542030 26653 ts_tablet_manager.cc:1434] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:13:37.543416 26653 tablet_bootstrap.cc:492] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.543676 26670 leader_election.cc:290] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.546518 26610 raft_consensus.cc:2468] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 1.
I20260709 13:13:37.547260 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03592e543c614badbecb5f587c00e4d3" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:37.548111 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03592e543c614badbecb5f587c00e4d3" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:37.549062 26656 tablet_bootstrap.cc:654] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.548097 26609 raft_consensus.cc:2468] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 0.
I20260709 13:13:37.552911 26425 leader_election.cc:304] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:37.553656 26653 tablet_bootstrap.cc:654] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.554509 26425 leader_election.cc:304] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:37.556536 26658 raft_consensus.cc:2804] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.558323 26670 raft_consensus.cc:2804] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.558915 26670 raft_consensus.cc:493] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.559682 26670 raft_consensus.cc:3060] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.556047 26656 tablet_bootstrap.cc:492] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
W20260709 13:13:37.560654 26425 leader_election.cc:343] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.561532 26656 ts_tablet_manager.cc:1403] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.002s
I20260709 13:13:37.540542 26659 tablet_bootstrap.cc:492] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.567185 26656 raft_consensus.cc:359] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.562549 26658 raft_consensus.cc:697] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:37.570235 26658 consensus_queue.cc:237] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.568151 26656 raft_consensus.cc:385] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.572595 26656 raft_consensus.cc:740] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.573582 26656 consensus_queue.cc:260] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.576169 26659 tablet_bootstrap.cc:654] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.579129 26656 ts_tablet_manager.cc:1434] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:13:37.583418 26653 tablet_bootstrap.cc:492] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.584476 26656 tablet_bootstrap.cc:492] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.584105 26670 raft_consensus.cc:515] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.586774 26670 leader_election.cc:290] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Requested vote from peers fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.584174 26653 ts_tablet_manager.cc:1403] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.018s
I20260709 13:13:37.589735 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03592e543c614badbecb5f587c00e4d3" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:37.590544 26609 raft_consensus.cc:3060] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.596544 26653 raft_consensus.cc:359] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.596823 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03592e543c614badbecb5f587c00e4d3" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:37.598320 26653 raft_consensus.cc:385] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.599166 26653 raft_consensus.cc:740] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
W20260709 13:13:37.600592 26425 leader_election.cc:343] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.600287 26653 consensus_queue.cc:260] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.602211 26357 catalog_manager.cc:5697] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 0 to 1, leader changed from <none> to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.603454 26653 ts_tablet_manager.cc:1434] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:13:37.604786 26659 tablet_bootstrap.cc:492] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.604851 26653 tablet_bootstrap.cc:492] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.605669 26659 ts_tablet_manager.cc:1403] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.022s
I20260709 13:13:37.606156 26609 raft_consensus.cc:2468] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 1.
I20260709 13:13:37.608409 26425 leader_election.cc:304] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:37.614331 26653 tablet_bootstrap.cc:654] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.616287 26658 raft_consensus.cc:2804] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.617141 26658 raft_consensus.cc:697] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:37.614372 26659 raft_consensus.cc:359] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.618068 26659 raft_consensus.cc:385] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.618558 26659 raft_consensus.cc:740] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.618431 26658 consensus_queue.cc:237] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.620174 26659 consensus_queue.cc:260] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:37.616488 26656 tablet_bootstrap.cc:654] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.628880 26653 tablet_bootstrap.cc:492] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.629534 26653 ts_tablet_manager.cc:1403] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.009s
I20260709 13:13:37.630067 26659 ts_tablet_manager.cc:1434] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 13:13:37.632227 26659 tablet_bootstrap.cc:492] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.634048 26653 raft_consensus.cc:359] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.635370 26653 raft_consensus.cc:385] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.635861 26653 raft_consensus.cc:740] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.637331 26653 consensus_queue.cc:260] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.643222 26655 raft_consensus.cc:493] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.643918 26655 raft_consensus.cc:515] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.647017 26659 tablet_bootstrap.cc:654] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.650705 26656 tablet_bootstrap.cc:492] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.653962 26656 ts_tablet_manager.cc:1403] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.000s
I20260709 13:13:37.654124 26653 ts_tablet_manager.cc:1434] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 13:13:37.656109 26653 tablet_bootstrap.cc:492] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.659030 26656 raft_consensus.cc:359] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.659965 26656 raft_consensus.cc:385] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.651820 26655 leader_election.cc:290] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.660311 26656 raft_consensus.cc:740] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.667136 26656 consensus_queue.cc:260] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.665709 26653 tablet_bootstrap.cc:654] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.669829 26656 ts_tablet_manager.cc:1434] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:13:37.671214 26656 tablet_bootstrap.cc:492] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.675997 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:37.677234 26461 raft_consensus.cc:2468] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:37.679171 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
W20260709 13:13:37.681403 26574 leader_election.cc:343] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.682559 26656 tablet_bootstrap.cc:654] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.682783 26573 leader_election.cc:304] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:37.684331 26655 raft_consensus.cc:2804] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.684784 26655 raft_consensus.cc:493] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.685140 26655 raft_consensus.cc:3060] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.695849 26659 tablet_bootstrap.cc:492] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.696681 26659 ts_tablet_manager.cc:1403] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.003s
I20260709 13:13:37.700151 26655 raft_consensus.cc:515] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.701049 26659 raft_consensus.cc:359] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.701921 26659 raft_consensus.cc:385] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.702270 26659 raft_consensus.cc:740] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.703200 26659 consensus_queue.cc:260] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.704403 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:37.705121 26461 raft_consensus.cc:3060] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.705919 26659 ts_tablet_manager.cc:1434] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:37.707281 26659 tablet_bootstrap.cc:492] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.713430 26357 catalog_manager.cc:5697] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 0 to 1, leader changed from <none> to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.715334 26659 tablet_bootstrap.cc:654] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.717137 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
W20260709 13:13:37.719038 26574 leader_election.cc:343] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.721153 26655 leader_election.cc:290] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.723305 26689 raft_consensus.cc:493] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.724718 26689 raft_consensus.cc:515] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.727491 26689 leader_election.cc:290] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.723908 26653 tablet_bootstrap.cc:492] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:37.728500 26653 ts_tablet_manager.cc:1403] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.019s
I20260709 13:13:37.730258 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:37.735200 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:37.735232 26653 raft_consensus.cc:359] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.736591 26653 raft_consensus.cc:385] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.736879 26653 raft_consensus.cc:740] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
W20260709 13:13:37.737313 26574 leader_election.cc:343] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.737892 26689 raft_consensus.cc:493] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.738420 26689 raft_consensus.cc:515] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
W20260709 13:13:37.738541 26573 leader_election.cc:343] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.739154 26573 leader_election.cc:304] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:37.739913 26659 tablet_bootstrap.cc:492] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.740032 26655 raft_consensus.cc:2749] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.726392 26461 raft_consensus.cc:2468] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:37.737416 26653 consensus_queue.cc:260] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.741690 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:37.742424 26460 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:37.743050 26653 ts_tablet_manager.cc:1434] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:37.743444 26573 leader_election.cc:304] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:37.743883 26656 tablet_bootstrap.cc:492] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.744218 26653 tablet_bootstrap.cc:492] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:37.744503 26656 ts_tablet_manager.cc:1403] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.023s
I20260709 13:13:37.743099 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:37.746147 26536 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:37.747795 26574 leader_election.cc:304] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:37.748406 26656 raft_consensus.cc:359] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.740628 26689 leader_election.cc:290] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.740602 26659 ts_tablet_manager.cc:1403] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.012s
I20260709 13:13:37.750150 26689 raft_consensus.cc:2804] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.750548 26689 raft_consensus.cc:493] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.750869 26689 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.748957 26655 raft_consensus.cc:2804] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.752842 26655 raft_consensus.cc:697] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:37.753693 26659 raft_consensus.cc:359] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.749444 26656 raft_consensus.cc:385] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.754565 26659 raft_consensus.cc:385] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.754698 26656 raft_consensus.cc:740] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.754982 26659 raft_consensus.cc:740] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.754201 26655 consensus_queue.cc:237] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.755928 26659 consensus_queue.cc:260] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.755927 26656 consensus_queue.cc:260] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.760751 26689 raft_consensus.cc:515] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.763521 26656 ts_tablet_manager.cc:1434] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:13:37.764007 26659 ts_tablet_manager.cc:1434] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:37.764812 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:37.765120 26656 tablet_bootstrap.cc:492] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.765445 26659 tablet_bootstrap.cc:492] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.765559 26536 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.772801 26653 tablet_bootstrap.cc:654] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.785157 26659 tablet_bootstrap.cc:654] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.771402 26689 leader_election.cc:290] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.789680 26358 catalog_manager.cc:5697] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.793879 26536 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:37.795433 26574 leader_election.cc:304] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:37.796906 26691 raft_consensus.cc:2804] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.797541 26691 raft_consensus.cc:697] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:37.798641 26691 consensus_queue.cc:237] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.800532 26653 tablet_bootstrap.cc:492] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
W20260709 13:13:37.796900 26573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:34595, user_credentials={real_user=slave}} blocked reactor thread for 53563.8us
I20260709 13:13:37.801247 26653 ts_tablet_manager.cc:1403] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.005s
I20260709 13:13:37.804045 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:37.804242 26689 raft_consensus.cc:493] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.804780 26653 raft_consensus.cc:359] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.804865 26460 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.805384 26689 raft_consensus.cc:515] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.797550 26656 tablet_bootstrap.cc:654] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.810177 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:37.811004 26461 raft_consensus.cc:2468] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:37.813001 26573 leader_election.cc:304] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:37.814091 26655 raft_consensus.cc:2804] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.814636 26655 raft_consensus.cc:493] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.815047 26655 raft_consensus.cc:3060] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.816833 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:37.818361 26536 raft_consensus.cc:2468] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:37.821673 26460 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:37.823217 26689 leader_election.cc:290] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.805645 26653 raft_consensus.cc:385] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.826386 26653 raft_consensus.cc:740] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.827771 26653 consensus_queue.cc:260] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.832556 26653 ts_tablet_manager.cc:1434] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:13:37.829396 26655 raft_consensus.cc:515] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.834509 26659 tablet_bootstrap.cc:492] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.835192 26659 ts_tablet_manager.cc:1403] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.012s
I20260709 13:13:37.837354 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:37.838325 26536 raft_consensus.cc:3060] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.839239 26659 raft_consensus.cc:359] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.840143 26659 raft_consensus.cc:385] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.840517 26659 raft_consensus.cc:740] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.841450 26659 consensus_queue.cc:260] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.841926 26358 catalog_manager.cc:5697] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.843963 26666 raft_consensus.cc:493] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.844211 26659 ts_tablet_manager.cc:1434] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:37.844517 26666 raft_consensus.cc:515] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.845643 26659 tablet_bootstrap.cc:492] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.848281 26536 raft_consensus.cc:2468] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:37.849135 26655 leader_election.cc:290] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:37.853902 26574 leader_election.cc:304] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:37.854947 26659 tablet_bootstrap.cc:654] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.857292 26655 raft_consensus.cc:2804] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.858108 26655 raft_consensus.cc:697] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:37.859315 26655 consensus_queue.cc:237] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.866235 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:37.867368 26460 raft_consensus.cc:3060] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.869859 26666 leader_election.cc:290] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:37.878996 26359 catalog_manager.cc:5697] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.883673 26656 tablet_bootstrap.cc:492] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.884624 26656 ts_tablet_manager.cc:1403] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.011s
I20260709 13:13:37.890417 26656 raft_consensus.cc:359] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.891523 26656 raft_consensus.cc:385] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.891664 26659 tablet_bootstrap.cc:492] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.891875 26656 raft_consensus.cc:740] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.892525 26659 ts_tablet_manager.cc:1403] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.012s
I20260709 13:13:37.893381 26656 consensus_queue.cc:260] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.896962 26659 raft_consensus.cc:359] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.897878 26659 raft_consensus.cc:385] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.898144 26659 raft_consensus.cc:740] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.898900 26659 consensus_queue.cc:260] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.899703 26656 ts_tablet_manager.cc:1434] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:13:37.901356 26460 raft_consensus.cc:2468] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:37.901921 26659 ts_tablet_manager.cc:1434] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:37.903235 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:37.907519 26656 tablet_bootstrap.cc:492] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.905676 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:37.908249 26659 tablet_bootstrap.cc:492] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:37.908723 26609 raft_consensus.cc:2393] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba3951cc1f6f412cb73e29fd4bd7c870 in current term 1: Already voted for candidate f49dd24da3994a6eb3e6c0b10fe00784 in this term.
I20260709 13:13:37.910687 26499 leader_election.cc:304] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870; no voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:37.911967 26698 raft_consensus.cc:3060] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.916401 26659 tablet_bootstrap.cc:654] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.917548 26656 tablet_bootstrap.cc:654] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.931088 26656 tablet_bootstrap.cc:492] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.931792 26656 ts_tablet_manager.cc:1403] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 13:13:37.935619 26656 raft_consensus.cc:359] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.936232 26656 raft_consensus.cc:385] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.936527 26656 raft_consensus.cc:740] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.936640 26698 raft_consensus.cc:2749] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.937340 26659 tablet_bootstrap.cc:492] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:37.937239 26656 consensus_queue.cc:260] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.937937 26659 ts_tablet_manager.cc:1403] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.011s
I20260709 13:13:37.939148 26656 ts_tablet_manager.cc:1434] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:37.940398 26656 tablet_bootstrap.cc:492] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:37.941334 26659 raft_consensus.cc:359] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.941891 26659 raft_consensus.cc:385] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.942058 26659 raft_consensus.cc:740] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.942734 26659 consensus_queue.cc:260] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.944988 26659 ts_tablet_manager.cc:1434] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:37.948371 26656 tablet_bootstrap.cc:654] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.955694 26656 tablet_bootstrap.cc:492] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:37.956233 26656 ts_tablet_manager.cc:1403] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:13:37.959424 26656 raft_consensus.cc:359] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.960258 26656 raft_consensus.cc:385] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.960546 26656 raft_consensus.cc:740] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.961220 26656 consensus_queue.cc:260] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.963320 26656 ts_tablet_manager.cc:1434] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:37.969544 26658 raft_consensus.cc:493] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.970196 26658 raft_consensus.cc:515] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.972415 26658 leader_election.cc:290] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:37.973702 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:37.974648 26536 raft_consensus.cc:2468] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 0.
I20260709 13:13:37.974673 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:37.975556 26609 raft_consensus.cc:2468] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 0.
I20260709 13:13:37.976961 26425 leader_election.cc:304] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:37.978056 26658 raft_consensus.cc:2804] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.978529 26658 raft_consensus.cc:493] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.978932 26658 raft_consensus.cc:3060] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.985579 26658 raft_consensus.cc:515] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:37.987694 26658 leader_election.cc:290] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:37.988876 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:37.988689 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:37.989637 26609 raft_consensus.cc:3060] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.989714 26536 raft_consensus.cc:3060] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.998831 26609 raft_consensus.cc:2468] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 1.
I20260709 13:13:37.998831 26536 raft_consensus.cc:2468] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 1.
I20260709 13:13:38.000808 26425 leader_election.cc:304] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.001789 26658 raft_consensus.cc:2804] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.002605 26658 raft_consensus.cc:697] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:38.003535 26658 consensus_queue.cc:237] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.006134 26698 raft_consensus.cc:493] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.006775 26698 raft_consensus.cc:515] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.008996 26698 leader_election.cc:290] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.010440 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:38.010762 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:38.011319 26609 raft_consensus.cc:2468] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:38.011590 26461 raft_consensus.cc:2468] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:38.013592 26500 leader_election.cc:304] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.014562 26698 raft_consensus.cc:2804] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.014210 26357 catalog_manager.cc:5697] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 0 to 1, leader changed from <none> to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.015087 26698 raft_consensus.cc:493] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.015549 26698 raft_consensus.cc:3060] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.023553 26698 raft_consensus.cc:515] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.026502 26698 leader_election.cc:290] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.026962 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.027314 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.027751 26461 raft_consensus.cc:3060] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.027969 26609 raft_consensus.cc:3060] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.034823 26461 raft_consensus.cc:2468] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:38.036002 26609 raft_consensus.cc:2468] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:38.036212 26499 leader_election.cc:304] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:38.037387 26698 raft_consensus.cc:2804] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.037911 26698 raft_consensus.cc:697] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.038753 26658 consensus_queue.cc:1048] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.038736 26698 consensus_queue.cc:237] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.049446 26357 catalog_manager.cc:5697] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.062283 26698 raft_consensus.cc:493] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.063037 26698 raft_consensus.cc:515] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } }
I20260709 13:13:38.066428 26698 leader_election.cc:290] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229), f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595)
I20260709 13:13:38.066538 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03592e543c614badbecb5f587c00e4d3" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:38.067068 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03592e543c614badbecb5f587c00e4d3" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:38.067639 26609 raft_consensus.cc:2393] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba3951cc1f6f412cb73e29fd4bd7c870 in current term 1: Already voted for candidate f49dd24da3994a6eb3e6c0b10fe00784 in this term.
I20260709 13:13:38.066462 26670 consensus_queue.cc:1048] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:13:38.071084 26500 leader_election.cc:304] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870; no voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:38.071962 26698 raft_consensus.cc:3060] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.080533 26698 raft_consensus.cc:2749] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:38.087163 26655 raft_consensus.cc:493] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.087961 26655 raft_consensus.cc:515] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.090160 26655 leader_election.cc:290] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:38.091214 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:38.091454 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:38.092238 26461 raft_consensus.cc:2468] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:38.092307 26536 raft_consensus.cc:2468] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:38.093969 26574 leader_election.cc:304] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.095288 26655 raft_consensus.cc:2804] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.095985 26655 raft_consensus.cc:493] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.096588 26655 raft_consensus.cc:3060] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.103979 26655 raft_consensus.cc:515] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.106068 26655 leader_election.cc:290] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:38.107321 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.107358 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:38.108261 26461 raft_consensus.cc:3060] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.108423 26536 raft_consensus.cc:3060] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.109659 26698 raft_consensus.cc:493] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.110273 26698 raft_consensus.cc:515] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.113044 26698 leader_election.cc:290] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.114159 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:38.115114 26460 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:38.117264 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:38.118430 26675 consensus_queue.cc:1048] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.118355 26461 raft_consensus.cc:2468] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:38.117348 26499 leader_election.cc:304] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:38.120484 26573 leader_election.cc:304] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.121397 26698 raft_consensus.cc:2804] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.121421 26655 raft_consensus.cc:2804] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.122406 26675 consensus_queue.cc:1048] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.123970 26655 raft_consensus.cc:697] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:38.125049 26655 consensus_queue.cc:237] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.127130 26536 raft_consensus.cc:2468] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:38.122326 26698 raft_consensus.cc:493] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.127854 26698 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.126014 26609 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:38.162490 26698 raft_consensus.cc:515] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.162681 26357 catalog_manager.cc:5697] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.166457 26698 leader_election.cc:290] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.167595 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.168401 26609 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.174014 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.174957 26461 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.177896 26609 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:38.179405 26500 leader_election.cc:304] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.180413 26698 raft_consensus.cc:2804] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.181002 26698 raft_consensus.cc:697] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.181713 26535 raft_consensus.cc:3060] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.181968 26698 consensus_queue.cc:237] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.184381 26461 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:38.192516 26655 consensus_queue.cc:1048] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.194016 26358 catalog_manager.cc:5697] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.206557 26689 consensus_queue.cc:1048] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.261955 26689 consensus_queue.cc:1048] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.276250 26655 consensus_queue.cc:1048] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.377890 26535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
mode: GRACEFUL
new_leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:37690
I20260709 13:13:38.378600 26535 raft_consensus.cc:606] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Received request to transfer leadership to TS f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:38.382153 26655 consensus_queue.cc:1048] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.397279 26692 consensus_queue.cc:1048] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.402082 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
mode: GRACEFUL
new_leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:13:38.402877 26609 raft_consensus.cc:606] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Received request to transfer leadership to TS f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:38.412514 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
mode: GRACEFUL
new_leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:13:38.413223 26609 raft_consensus.cc:606] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Received request to transfer leadership to TS f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:38.429849 26461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
mode: GRACEFUL
new_leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:33356
I20260709 13:13:38.430627 26461 raft_consensus.cc:606] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Received request to transfer leadership to TS ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:38.437893 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
mode: GRACEFUL
new_leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:13:38.438575 26609 raft_consensus.cc:606] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Received request to transfer leadership to TS ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:38.445540 26461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
mode: GRACEFUL
new_leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:33356
I20260709 13:13:38.446265 26461 raft_consensus.cc:606] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Received request to transfer leadership to TS ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:38.452564 26715 consensus_queue.cc:1048] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.454701 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
mode: GRACEFUL
new_leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:13:38.455778 26609 raft_consensus.cc:606] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Received request to transfer leadership to TS ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:38.463835 26536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
mode: GRACEFUL
new_leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:37690
I20260709 13:13:38.464668 26536 raft_consensus.cc:606] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Received request to transfer leadership to TS fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:38.465139 26670 raft_consensus.cc:993] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784: : Instructing follower ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.465729 26670 raft_consensus.cc:1081] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Signalling peer ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.472050 26535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:37668
I20260709 13:13:38.472862 26670 consensus_queue.cc:1048] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.473074 26535 raft_consensus.cc:493] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.475811 26535 raft_consensus.cc:3060] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.485909 26535 raft_consensus.cc:515] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.489475 26535 leader_election.cc:290] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.490934 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.491792 26461 raft_consensus.cc:3055] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.492184 26461 raft_consensus.cc:740] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:38.492797 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11ea7817b734d67a116a1a14dc14daf" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.493160 26461 consensus_queue.cc:260] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.493750 26609 raft_consensus.cc:3060] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.495333 26461 raft_consensus.cc:3060] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.502033 26609 raft_consensus.cc:2468] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.502645 26461 raft_consensus.cc:2468] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.503626 26500 leader_election.cc:304] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.504802 26698 raft_consensus.cc:2804] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.505376 26698 raft_consensus.cc:697] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.506383 26698 consensus_queue.cc:237] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.514635 26359 catalog_manager.cc:5697] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 1 to 2, leader changed from f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65) to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.549464 26698 consensus_queue.cc:1048] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.564651 26670 raft_consensus.cc:993] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784: : Instructing follower ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.565239 26670 raft_consensus.cc:1081] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Signalling peer ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.567338 26535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:37668
I20260709 13:13:38.567457 26730 consensus_queue.cc:1048] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.568136 26535 raft_consensus.cc:493] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.568719 26535 raft_consensus.cc:3060] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.576501 26692 consensus_queue.cc:1048] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.580116 26698 raft_consensus.cc:993] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870: : Instructing follower fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:38.580731 26666 raft_consensus.cc:1081] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Signalling peer fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:38.580600 26535 raft_consensus.cc:515] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.584571 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.585347 26460 raft_consensus.cc:3055] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.585703 26460 raft_consensus.cc:740] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:38.585884 26609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:36736
I20260709 13:13:38.586722 26609 raft_consensus.cc:493] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.587240 26609 raft_consensus.cc:3060] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.586733 26460 consensus_queue.cc:260] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.596216 26460 raft_consensus.cc:3060] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.597921 26655 consensus_queue.cc:1048] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.589485 26535 leader_election.cc:290] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.592758 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe09b075d084a648d8d3e5cae7e54cd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.603442 26610 raft_consensus.cc:3060] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.603760 26609 raft_consensus.cc:515] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.607589 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.610339 26461 raft_consensus.cc:3060] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.615792 26689 raft_consensus.cc:993] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624: : Instructing follower ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.609640 26609 leader_election.cc:290] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 2 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:38.612962 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6479fc955c944947bcb331cde5deb4b4" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:38.616696 26689 raft_consensus.cc:1081] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Signalling peer ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.617081 26535 raft_consensus.cc:3055] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.617462 26535 raft_consensus.cc:740] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.618880 26536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:37678
I20260709 13:13:38.619545 26536 raft_consensus.cc:493] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.619940 26536 raft_consensus.cc:3060] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.622223 26610 raft_consensus.cc:2468] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.623924 26500 leader_election.cc:304] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.625010 26730 raft_consensus.cc:2804] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.625269 26461 raft_consensus.cc:2468] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 2.
I20260709 13:13:38.625793 26730 raft_consensus.cc:697] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.626333 26460 raft_consensus.cc:2468] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.624862 26535 consensus_queue.cc:260] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.626881 26730 consensus_queue.cc:237] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.628005 26535 raft_consensus.cc:3060] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.628741 26573 leader_election.cc:304] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.629756 26689 raft_consensus.cc:2804] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.630463 26689 raft_consensus.cc:697] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:38.631407 26689 consensus_queue.cc:237] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.637446 26535 raft_consensus.cc:2468] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 2.
I20260709 13:13:38.639216 26536 raft_consensus.cc:515] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.640816 26359 catalog_manager.cc:5697] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 1 to 2, leader changed from ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66) to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.642376 26536 leader_election.cc:290] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.643357 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.644114 26610 raft_consensus.cc:3055] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.644517 26610 raft_consensus.cc:740] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:38.644331 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e225ff26f7d4f2094c30b7a6495d05b" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.645370 26460 raft_consensus.cc:3060] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.645826 26610 consensus_queue.cc:260] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.647531 26610 raft_consensus.cc:3060] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.654598 26357 catalog_manager.cc:5697] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 1 to 2, leader changed from f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65) to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.656524 26460 raft_consensus.cc:2468] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.658102 26499 leader_election.cc:304] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:38.658980 26730 raft_consensus.cc:2804] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.659504 26730 raft_consensus.cc:697] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.660211 26610 raft_consensus.cc:2468] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.660502 26730 consensus_queue.cc:237] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.671008 26357 catalog_manager.cc:5697] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 1 to 2, leader changed from fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67) to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.738629 26730 consensus_queue.cc:1048] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.751380 26698 consensus_queue.cc:1048] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.761934 26730 raft_consensus.cc:993] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870: : Instructing follower f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:38.762669 26698 raft_consensus.cc:1081] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Signalling peer f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:38.764928 26460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:33354
I20260709 13:13:38.765697 26460 raft_consensus.cc:493] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.766095 26460 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.774027 26460 raft_consensus.cc:515] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.776479 26460 leader_election.cc:290] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.777583 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:38.778394 26536 raft_consensus.cc:3055] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.778481 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.778826 26536 raft_consensus.cc:740] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.779173 26610 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.779762 26536 consensus_queue.cc:260] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.781380 26536 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.787791 26610 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:38.789278 26425 leader_election.cc:304] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.789906 26536 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:38.790652 26670 raft_consensus.cc:2804] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.791208 26670 raft_consensus.cc:697] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:38.792116 26670 consensus_queue.cc:237] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.800683 26359 catalog_manager.cc:5697] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 1 to 2, leader changed from ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66) to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 2 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.816017 26655 raft_consensus.cc:993] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624: : Instructing follower ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.816677 26689 raft_consensus.cc:1081] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Signalling peer ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:38.818851 26536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:37678
I20260709 13:13:38.819594 26536 raft_consensus.cc:493] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.819919 26536 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.826588 26655 raft_consensus.cc:993] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624: : Instructing follower f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:38.827296 26689 raft_consensus.cc:1081] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Signalling peer f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:38.828104 26536 raft_consensus.cc:515] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.829500 26460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:33342
I20260709 13:13:38.830263 26460 raft_consensus.cc:493] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.831223 26536 leader_election.cc:290] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.831570 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:38.831904 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.830968 26460 raft_consensus.cc:3060] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.832273 26461 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.832921 26610 raft_consensus.cc:3055] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.833329 26610 raft_consensus.cc:740] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:38.834240 26610 consensus_queue.cc:260] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.835817 26610 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.841670 26461 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.841670 26460 raft_consensus.cc:515] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.842684 26610 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:38.844180 26500 leader_election.cc:304] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:38.845155 26460 leader_election.cc:290] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.845604 26698 raft_consensus.cc:2804] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.846428 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.846313 26698 raft_consensus.cc:697] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:38.846223 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c331c336bc894a37a9b7ff2589eb2db3" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:38.847232 26610 raft_consensus.cc:3055] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.847623 26536 raft_consensus.cc:3060] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.847779 26610 raft_consensus.cc:740] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:38.848031 26698 consensus_queue.cc:237] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.849061 26610 consensus_queue.cc:260] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.850530 26610 raft_consensus.cc:3060] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.856585 26536 raft_consensus.cc:2468] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:38.857856 26425 leader_election.cc:304] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:38.857846 26359 catalog_manager.cc:5697] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 1 to 2, leader changed from fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67) to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.859048 26610 raft_consensus.cc:2468] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:38.859287 26670 raft_consensus.cc:2804] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.860009 26670 raft_consensus.cc:697] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:38.861022 26670 consensus_queue.cc:237] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.870826 26357 catalog_manager.cc:5697] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 1 to 2, leader changed from fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67) to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 2 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.875352 26655 raft_consensus.cc:993] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624: : Instructing follower f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:38.876411 26689 raft_consensus.cc:1081] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Signalling peer f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:38.879004 26460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:33342
I20260709 13:13:38.879765 26460 raft_consensus.cc:493] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.880149 26460 raft_consensus.cc:3060] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.888152 26460 raft_consensus.cc:515] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.890707 26460 leader_election.cc:290] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:38.891714 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:38.891937 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4cc38430e14c26a90b625a781282e2" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:38.892539 26536 raft_consensus.cc:3060] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.892628 26610 raft_consensus.cc:3055] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.893316 26610 raft_consensus.cc:740] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:38.894438 26610 consensus_queue.cc:260] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.896510 26610 raft_consensus.cc:3060] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.903221 26536 raft_consensus.cc:2468] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:38.905067 26425 leader_election.cc:304] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:38.905962 26610 raft_consensus.cc:2468] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:38.906365 26670 raft_consensus.cc:2804] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.907042 26670 raft_consensus.cc:697] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:38.908393 26670 consensus_queue.cc:237] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:38.917414 26357 catalog_manager.cc:5697] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 1 to 2, leader changed from fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67) to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 2 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.925485 26610 raft_consensus.cc:1275] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.927326 26698 consensus_queue.cc:1048] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:38.937369 26460 raft_consensus.cc:1275] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.939581 26730 consensus_queue.cc:1048] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.062163 26610 raft_consensus.cc:1275] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.064320 26730 consensus_queue.cc:1048] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.080022 26460 raft_consensus.cc:1275] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.082903 26730 consensus_queue.cc:1048] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.085170 26536 raft_consensus.cc:1275] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.087369 26689 consensus_queue.cc:1048] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.100394 26460 raft_consensus.cc:1275] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.102276 26691 consensus_queue.cc:1048] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.230552 26610 raft_consensus.cc:1275] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.232218 26609 raft_consensus.cc:1275] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.232215 26730 consensus_queue.cc:1048] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.234557 26670 consensus_queue.cc:1048] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.241098 26460 raft_consensus.cc:1275] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.244242 26698 consensus_queue.cc:1048] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.246173 26609 raft_consensus.cc:1275] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.248153 26698 consensus_queue.cc:1048] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.252738 26536 raft_consensus.cc:1275] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.259999 26738 consensus_queue.cc:1048] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.274972 26460 raft_consensus.cc:1275] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.277130 26698 consensus_queue.cc:1048] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.361997 26536 raft_consensus.cc:1275] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.363699 26738 consensus_queue.cc:1048] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.373992 26610 raft_consensus.cc:1275] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.377298 26670 consensus_queue.cc:1048] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:39.379173 26536 raft_consensus.cc:1275] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.382686 26670 consensus_queue.cc:1048] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.401240 26610 raft_consensus.cc:1275] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.403363 26738 consensus_queue.cc:1048] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:41.497653 26358 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39736:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:41.500624 26358 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:41.561025 26450 tablet_service.cc:1511] Processing CreateTablet for tablet fb789c84e8964cd3b28380186b862f3d (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:41.561892 26518 tablet_service.cc:1511] Processing CreateTablet for tablet fb789c84e8964cd3b28380186b862f3d (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:41.563225 26450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb789c84e8964cd3b28380186b862f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.563563 26518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb789c84e8964cd3b28380186b862f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.568442 26597 tablet_service.cc:1511] Processing CreateTablet for tablet fb789c84e8964cd3b28380186b862f3d (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:41.569424 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 81c9f09806ad4eb4a01e76b8b3daa633 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:41.570250 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb789c84e8964cd3b28380186b862f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.571768 26447 tablet_service.cc:1511] Processing CreateTablet for tablet ecce7eebafcc412cbf20b7f6c02c212e (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:41.573359 26447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecce7eebafcc412cbf20b7f6c02c212e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.573101 26446 tablet_service.cc:1511] Processing CreateTablet for tablet 81c9f09806ad4eb4a01e76b8b3daa633 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:41.574471 26446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c9f09806ad4eb4a01e76b8b3daa633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.580812 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c9f09806ad4eb4a01e76b8b3daa633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.584251 26521 tablet_service.cc:1511] Processing CreateTablet for tablet ecce7eebafcc412cbf20b7f6c02c212e (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:41.586061 26521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecce7eebafcc412cbf20b7f6c02c212e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.590266 26596 tablet_service.cc:1511] Processing CreateTablet for tablet ecce7eebafcc412cbf20b7f6c02c212e (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:41.592160 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecce7eebafcc412cbf20b7f6c02c212e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.571913 26525 tablet_service.cc:1511] Processing CreateTablet for tablet 81c9f09806ad4eb4a01e76b8b3daa633 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:41.598028 26525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c9f09806ad4eb4a01e76b8b3daa633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.599077 26443 tablet_service.cc:1511] Processing CreateTablet for tablet c7b49b865ce848b984e54f1256b30e9c (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:41.601114 26443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b49b865ce848b984e54f1256b30e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.612461 26524 tablet_service.cc:1511] Processing CreateTablet for tablet c7b49b865ce848b984e54f1256b30e9c (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:41.614440 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b49b865ce848b984e54f1256b30e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.632791 26759 tablet_bootstrap.cc:492] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:41.641255 26759 tablet_bootstrap.cc:654] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.648566 26447 tablet_service.cc:1511] Processing CreateTablet for tablet c72625637fe2423aac5dc3dc1a9509fd (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:41.650849 26447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72625637fe2423aac5dc3dc1a9509fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.662748 26522 tablet_service.cc:1511] Processing CreateTablet for tablet c72625637fe2423aac5dc3dc1a9509fd (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:41.669965 26522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72625637fe2423aac5dc3dc1a9509fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.673353 26598 tablet_service.cc:1511] Processing CreateTablet for tablet c72625637fe2423aac5dc3dc1a9509fd (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:41.675549 26598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72625637fe2423aac5dc3dc1a9509fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.677788 26449 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab8ac9c00b043bfbeca5784f67fc6cc (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:41.683954 26449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab8ac9c00b043bfbeca5784f67fc6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.683671 26518 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab8ac9c00b043bfbeca5784f67fc6cc (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:41.684681 26597 tablet_service.cc:1511] Processing CreateTablet for tablet c7b49b865ce848b984e54f1256b30e9c (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:41.685745 26518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab8ac9c00b043bfbeca5784f67fc6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.686337 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b49b865ce848b984e54f1256b30e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.696434 26760 tablet_bootstrap.cc:492] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:41.712234 26759 tablet_bootstrap.cc:492] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:41.721588 26762 tablet_bootstrap.cc:492] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:41.723711 26596 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab8ac9c00b043bfbeca5784f67fc6cc (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:41.733300 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab8ac9c00b043bfbeca5784f67fc6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.728130 26524 tablet_service.cc:1511] Processing CreateTablet for tablet 22ab98cc1f6b48bfbe50491860ca4f27 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:41.736995 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ab98cc1f6b48bfbe50491860ca4f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.740777 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 22ab98cc1f6b48bfbe50491860ca4f27 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:41.742683 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ab98cc1f6b48bfbe50491860ca4f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.745530 26450 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab614a178494fa7aec072933bd7dbb6 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:41.747880 26593 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab614a178494fa7aec072933bd7dbb6 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:41.749665 26593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab614a178494fa7aec072933bd7dbb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.749550 26521 tablet_service.cc:1511] Processing CreateTablet for tablet 2ab614a178494fa7aec072933bd7dbb6 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:41.751367 26521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab614a178494fa7aec072933bd7dbb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.757507 26446 tablet_service.cc:1511] Processing CreateTablet for tablet ef7c458c37dc469b99bcaa42b09fe74b (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:41.758213 26450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ab614a178494fa7aec072933bd7dbb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.759145 26446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7c458c37dc469b99bcaa42b09fe74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.763513 26600 tablet_service.cc:1511] Processing CreateTablet for tablet ef7c458c37dc469b99bcaa42b09fe74b (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:41.765166 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7c458c37dc469b99bcaa42b09fe74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.713021 26759 ts_tablet_manager.cc:1403] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.003s
I20260709 13:13:41.729521 26443 tablet_service.cc:1511] Processing CreateTablet for tablet 22ab98cc1f6b48bfbe50491860ca4f27 (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:41.773526 26443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ab98cc1f6b48bfbe50491860ca4f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.771932 26522 tablet_service.cc:1511] Processing CreateTablet for tablet ef7c458c37dc469b99bcaa42b09fe74b (DEFAULT_TABLE table=soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:41.781735 26522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7c458c37dc469b99bcaa42b09fe74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:41.794736 26760 tablet_bootstrap.cc:654] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.776301 26759 raft_consensus.cc:359] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.803570 26759 raft_consensus.cc:385] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.803966 26759 raft_consensus.cc:740] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.804893 26759 consensus_queue.cc:260] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.838433 26759 ts_tablet_manager.cc:1434] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.003s
I20260709 13:13:41.839799 26759 tablet_bootstrap.cc:492] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:41.860378 26762 tablet_bootstrap.cc:654] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.876024 26759 tablet_bootstrap.cc:654] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.883767 26759 tablet_bootstrap.cc:492] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:41.888273 26760 tablet_bootstrap.cc:492] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:41.889118 26760 ts_tablet_manager.cc:1403] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.193s	user 0.013s	sys 0.006s
I20260709 13:13:41.884663 26759 ts_tablet_manager.cc:1403] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.008s
I20260709 13:13:41.892518 26760 raft_consensus.cc:359] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.893293 26760 raft_consensus.cc:385] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.893575 26760 raft_consensus.cc:740] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.894073 26759 raft_consensus.cc:359] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.894377 26760 consensus_queue.cc:260] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.895079 26759 raft_consensus.cc:385] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.895452 26759 raft_consensus.cc:740] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.896311 26759 consensus_queue.cc:260] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.897161 26760 ts_tablet_manager.cc:1434] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:41.898401 26760 tablet_bootstrap.cc:492] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:41.899271 26759 ts_tablet_manager.cc:1434] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:13:41.900966 26759 tablet_bootstrap.cc:492] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:41.907058 26760 tablet_bootstrap.cc:654] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.909528 26759 tablet_bootstrap.cc:654] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.910712 26762 tablet_bootstrap.cc:492] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:41.911432 26762 ts_tablet_manager.cc:1403] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.190s	user 0.015s	sys 0.000s
I20260709 13:13:41.915659 26762 raft_consensus.cc:359] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.916646 26762 raft_consensus.cc:385] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.916993 26762 raft_consensus.cc:740] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.917907 26762 consensus_queue.cc:260] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.920203 26762 ts_tablet_manager.cc:1434] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:41.922024 26762 tablet_bootstrap.cc:492] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:41.924434 26759 tablet_bootstrap.cc:492] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:41.925094 26759 ts_tablet_manager.cc:1403] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:13:41.928825 26759 raft_consensus.cc:359] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.929692 26759 raft_consensus.cc:385] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.930044 26759 raft_consensus.cc:740] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.931182 26759 consensus_queue.cc:260] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.934121 26762 tablet_bootstrap.cc:654] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.934204 26759 ts_tablet_manager.cc:1434] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:13:41.939499 26759 tablet_bootstrap.cc:492] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:41.943187 26760 tablet_bootstrap.cc:492] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:41.944064 26760 ts_tablet_manager.cc:1403] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.008s
I20260709 13:13:41.948004 26760 raft_consensus.cc:359] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.948833 26760 raft_consensus.cc:385] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.949155 26760 raft_consensus.cc:740] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.950161 26760 consensus_queue.cc:260] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.951705 26759 tablet_bootstrap.cc:654] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.953115 26760 ts_tablet_manager.cc:1434] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:41.954435 26760 tablet_bootstrap.cc:492] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:41.956017 26762 tablet_bootstrap.cc:492] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:41.956781 26762 ts_tablet_manager.cc:1403] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.000s
I20260709 13:13:41.960865 26762 raft_consensus.cc:359] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.962697 26760 tablet_bootstrap.cc:654] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.963943 26762 raft_consensus.cc:385] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.965799 26762 raft_consensus.cc:740] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.966482 26759 tablet_bootstrap.cc:492] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:41.967163 26759 ts_tablet_manager.cc:1403] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:13:41.967306 26762 consensus_queue.cc:260] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.970955 26759 raft_consensus.cc:359] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.971448 26762 ts_tablet_manager.cc:1434] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:13:41.971848 26759 raft_consensus.cc:385] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.972378 26759 raft_consensus.cc:740] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.973313 26759 consensus_queue.cc:260] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.976543 26759 ts_tablet_manager.cc:1434] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:13:41.977775 26759 tablet_bootstrap.cc:492] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:41.973318 26762 tablet_bootstrap.cc:492] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:41.983553 26760 tablet_bootstrap.cc:492] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:41.984405 26760 ts_tablet_manager.cc:1403] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.012s
I20260709 13:13:41.988320 26760 raft_consensus.cc:359] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.989332 26760 raft_consensus.cc:385] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.989676 26760 raft_consensus.cc:740] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.990478 26760 consensus_queue.cc:260] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:41.993255 26760 ts_tablet_manager.cc:1434] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:41.995741 26762 tablet_bootstrap.cc:654] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.998170 26760 tablet_bootstrap.cc:492] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:41.998430 26759 tablet_bootstrap.cc:654] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.002306 26762 tablet_bootstrap.cc:492] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:42.009038 26760 tablet_bootstrap.cc:654] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.009055 26762 ts_tablet_manager.cc:1403] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 13:13:42.011384 26759 tablet_bootstrap.cc:492] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:42.012142 26759 ts_tablet_manager.cc:1403] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.011s
I20260709 13:13:42.013888 26762 raft_consensus.cc:359] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.014942 26762 raft_consensus.cc:385] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.015352 26762 raft_consensus.cc:740] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.016750 26745 raft_consensus.cc:493] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.016330 26762 consensus_queue.cc:260] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.017390 26745 raft_consensus.cc:515] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.019622 26762 ts_tablet_manager.cc:1434] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:42.020948 26748 raft_consensus.cc:493] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.021524 26748 raft_consensus.cc:515] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.021732 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.022557 26745 leader_election.cc:290] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.022812 26460 raft_consensus.cc:2468] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:42.016389 26759 raft_consensus.cc:359] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.023864 26748 leader_election.cc:290] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.024241 26759 raft_consensus.cc:385] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.024600 26759 raft_consensus.cc:740] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.024890 26573 leader_election.cc:304] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.025425 26759 consensus_queue.cc:260] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.026782 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:42.026897 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb789c84e8964cd3b28380186b862f3d" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:42.028048 26610 raft_consensus.cc:2468] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 0.
I20260709 13:13:42.030071 26745 raft_consensus.cc:2804] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.030627 26745 raft_consensus.cc:493] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.031014 26745 raft_consensus.cc:3060] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:42.031530 26574 leader_election.cc:343] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:42.031551 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb789c84e8964cd3b28380186b862f3d" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:42.034338 26425 leader_election.cc:304] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.035559 26763 raft_consensus.cc:2804] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.036003 26763 raft_consensus.cc:493] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.037948 26763 raft_consensus.cc:3060] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.042412 26760 tablet_bootstrap.cc:492] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:42.043169 26760 ts_tablet_manager.cc:1403] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.012s
I20260709 13:13:42.046648 26760 raft_consensus.cc:359] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.047412 26760 raft_consensus.cc:385] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.033452 26536 raft_consensus.cc:2468] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 0.
I20260709 13:13:42.047729 26760 raft_consensus.cc:740] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.048660 26760 consensus_queue.cc:260] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.051616 26760 ts_tablet_manager.cc:1434] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:42.036049 26762 tablet_bootstrap.cc:492] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:42.052960 26745 raft_consensus.cc:515] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.056568 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.057503 26460 raft_consensus.cc:3060] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.061441 26762 tablet_bootstrap.cc:654] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.051883 26763 raft_consensus.cc:515] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.070351 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:42.071823 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb789c84e8964cd3b28380186b862f3d" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:42.072014 26460 raft_consensus.cc:2468] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:42.072602 26535 raft_consensus.cc:3060] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.070248 26745 leader_election.cc:290] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.073994 26760 tablet_bootstrap.cc:492] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
W20260709 13:13:42.077162 26574 leader_election.cc:343] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:42.079586 26573 leader_election.cc:304] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:42.082386 26745 raft_consensus.cc:2804] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.083244 26745 raft_consensus.cc:697] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:42.084806 26745 consensus_queue.cc:237] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.090251 26759 ts_tablet_manager.cc:1434] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.078s	user 0.029s	sys 0.010s
I20260709 13:13:42.092895 26776 raft_consensus.cc:493] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.093557 26776 raft_consensus.cc:515] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.097605 26759 tablet_bootstrap.cc:492] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:42.100106 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.101230 26460 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:42.101987 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb789c84e8964cd3b28380186b862f3d" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:42.102756 26610 raft_consensus.cc:3060] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.103188 26573 leader_election.cc:304] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.105080 26535 raft_consensus.cc:2468] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 1.
I20260709 13:13:42.108991 26760 tablet_bootstrap.cc:654] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.098127 26763 leader_election.cc:290] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.111425 26759 tablet_bootstrap.cc:654] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.113310 26745 raft_consensus.cc:2804] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.113968 26745 raft_consensus.cc:493] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.114403 26745 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.117139 26776 leader_election.cc:290] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.124118 26610 raft_consensus.cc:2468] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 1.
I20260709 13:13:42.121423 26762 tablet_bootstrap.cc:492] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:42.123559 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:42.142848 26535 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:42.142982 26762 ts_tablet_manager.cc:1403] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.012s
I20260709 13:13:42.149247 26425 leader_election.cc:304] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:42.140874 26358 catalog_manager.cc:5697] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:42.154163 26762 raft_consensus.cc:359] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.157502 26762 raft_consensus.cc:385] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.158164 26762 raft_consensus.cc:740] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.156042 26745 raft_consensus.cc:515] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.162432 26763 raft_consensus.cc:2804] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.168431 26762 consensus_queue.cc:260] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.169430 26763 raft_consensus.cc:697] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:42.170527 26763 consensus_queue.cc:237] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.171531 26759 tablet_bootstrap.cc:492] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:42.171998 26762 ts_tablet_manager.cc:1434] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 13:13:42.172220 26759 ts_tablet_manager.cc:1403] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.076s	user 0.027s	sys 0.024s
I20260709 13:13:42.173475 26762 tablet_bootstrap.cc:492] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:42.176116 26760 tablet_bootstrap.cc:492] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:42.177033 26760 ts_tablet_manager.cc:1403] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.103s	user 0.036s	sys 0.031s
I20260709 13:13:42.180449 26746 raft_consensus.cc:493] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.181366 26746 raft_consensus.cc:515] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.183238 26762 tablet_bootstrap.cc:654] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.188150 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.197037 26460 raft_consensus.cc:2393] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba3951cc1f6f412cb73e29fd4bd7c870 in current term 1: Already voted for candidate fbbb99e3c5b74db0b238f87f36b0c624 in this term.
I20260709 13:13:42.205709 26745 leader_election.cc:290] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.207044 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:42.210278 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:42.210772 26535 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.212226 26500 leader_election.cc:304] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870; no voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:42.208859 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.213858 26764 raft_consensus.cc:3060] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.220840 26460 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.208117 26746 leader_election.cc:290] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.232069 26760 raft_consensus.cc:359] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.240573 26760 raft_consensus.cc:385] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.232703 26759 raft_consensus.cc:359] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.241848 26759 raft_consensus.cc:385] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.242241 26759 raft_consensus.cc:740] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.237747 26357 catalog_manager.cc:5697] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 0 to 1, leader changed from <none> to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 1 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.222340 26787 raft_consensus.cc:493] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.243191 26759 consensus_queue.cc:260] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.244397 26787 raft_consensus.cc:515] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.245992 26762 tablet_bootstrap.cc:492] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:42.246711 26762 ts_tablet_manager.cc:1403] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.073s	user 0.029s	sys 0.028s
I20260709 13:13:42.247069 26760 raft_consensus.cc:740] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.249517 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.251504 26461 raft_consensus.cc:2468] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.251984 26762 raft_consensus.cc:359] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.252979 26762 raft_consensus.cc:385] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.253305 26762 raft_consensus.cc:740] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.253461 26499 leader_election.cc:304] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:42.254148 26762 consensus_queue.cc:260] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.256744 26759 ts_tablet_manager.cc:1434] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 13:13:42.256897 26762 ts_tablet_manager.cc:1434] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:13:42.258386 26762 tablet_bootstrap.cc:492] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:42.259364 26760 consensus_queue.cc:260] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.268378 26762 tablet_bootstrap.cc:654] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.228293 26535 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:42.250735 26787 leader_election.cc:290] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.275839 26574 leader_election.cc:304] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.277460 26776 raft_consensus.cc:2804] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.278045 26776 raft_consensus.cc:697] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:42.278999 26776 consensus_queue.cc:237] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.263782 26764 raft_consensus.cc:2749] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:42.281097 26787 raft_consensus.cc:2804] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.282227 26787 raft_consensus.cc:493] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.283094 26787 raft_consensus.cc:3060] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.285779 26760 ts_tablet_manager.cc:1434] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.001s
I20260709 13:13:42.285992 26762 tablet_bootstrap.cc:492] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:42.266043 26759 tablet_bootstrap.cc:492] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:42.303712 26760 tablet_bootstrap.cc:492] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:42.304399 26762 ts_tablet_manager.cc:1403] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 13:13:42.308168 26762 raft_consensus.cc:359] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.296296 26787 raft_consensus.cc:515] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.309309 26762 raft_consensus.cc:385] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.309931 26762 raft_consensus.cc:740] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.296561 26359 catalog_manager.cc:5697] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:42.299614 26499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.196.65:34595, user_credentials={real_user=slave}} blocked reactor thread for 46394.9us
I20260709 13:13:42.301577 26460 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:42.311049 26762 consensus_queue.cc:260] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.315236 26762 ts_tablet_manager.cc:1434] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:42.316031 26787 leader_election.cc:290] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
W20260709 13:13:42.317960 26500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39229, user_credentials={real_user=slave}} blocked reactor thread for 73913.2us
I20260709 13:13:42.318609 26762 tablet_bootstrap.cc:492] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:42.318799 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.319548 26461 raft_consensus.cc:3060] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.324805 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:42.325778 26610 raft_consensus.cc:2468] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.326297 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:42.327086 26609 raft_consensus.cc:3060] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.327421 26759 tablet_bootstrap.cc:654] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.351217 26760 tablet_bootstrap.cc:654] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.360483 26609 raft_consensus.cc:2468] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.356560 26461 raft_consensus.cc:2468] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.363952 26762 tablet_bootstrap.cc:654] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.363433 26500 leader_election.cc:304] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.365192 26746 raft_consensus.cc:2804] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.365770 26746 raft_consensus.cc:697] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:42.366717 26746 consensus_queue.cc:237] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.367790 26759 tablet_bootstrap.cc:492] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:42.368564 26759 ts_tablet_manager.cc:1403] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.103s	user 0.033s	sys 0.017s
I20260709 13:13:42.374775 26759 raft_consensus.cc:359] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.375994 26759 raft_consensus.cc:385] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.376403 26759 raft_consensus.cc:740] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.377561 26759 consensus_queue.cc:260] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.381475 26759 ts_tablet_manager.cc:1434] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.004s
W20260709 13:13:42.386034 26407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:42.390548 26759 tablet_bootstrap.cc:492] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:42.392446 26776 raft_consensus.cc:493] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.393313 26776 raft_consensus.cc:515] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.398159 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab8ac9c00b043bfbeca5784f67fc6cc" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
W20260709 13:13:42.400096 26573 leader_election.cc:343] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:42.415112 26776 leader_election.cc:290] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.416338 26760 tablet_bootstrap.cc:492] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:42.417332 26760 ts_tablet_manager.cc:1403] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.114s	user 0.035s	sys 0.016s
I20260709 13:13:42.417192 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab8ac9c00b043bfbeca5784f67fc6cc" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:42.417701 26759 tablet_bootstrap.cc:654] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:42.419637 26574 leader_election.cc:343] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:42.420207 26574 leader_election.cc:304] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbbb99e3c5b74db0b238f87f36b0c624; no voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:42.421705 26776 raft_consensus.cc:2749] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:42.422333 26760 raft_consensus.cc:359] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.423374 26760 raft_consensus.cc:385] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.423667 26760 raft_consensus.cc:740] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.424645 26760 consensus_queue.cc:260] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.427430 26760 ts_tablet_manager.cc:1434] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:42.427991 26359 catalog_manager.cc:5697] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.429138 26760 tablet_bootstrap.cc:492] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:42.430846 26762 tablet_bootstrap.cc:492] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:42.432134 26762 ts_tablet_manager.cc:1403] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.116s	user 0.044s	sys 0.018s
I20260709 13:13:42.438773 26762 raft_consensus.cc:359] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.439638 26762 raft_consensus.cc:385] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.439996 26762 raft_consensus.cc:740] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.440997 26762 consensus_queue.cc:260] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.441076 26760 tablet_bootstrap.cc:654] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.443691 26762 ts_tablet_manager.cc:1434] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:42.444963 26762 tablet_bootstrap.cc:492] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:42.446348 26759 tablet_bootstrap.cc:492] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:42.447288 26759 ts_tablet_manager.cc:1403] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.010s
I20260709 13:13:42.452308 26759 raft_consensus.cc:359] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.453660 26759 raft_consensus.cc:385] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.454123 26759 raft_consensus.cc:740] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.454391 26762 tablet_bootstrap.cc:654] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.455394 26759 consensus_queue.cc:260] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.459192 26759 ts_tablet_manager.cc:1434] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:42.460687 26759 tablet_bootstrap.cc:492] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624: Bootstrap starting.
I20260709 13:13:42.481774 26759 tablet_bootstrap.cc:654] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.497388 26759 tablet_bootstrap.cc:492] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624: No bootstrap required, opened a new log
I20260709 13:13:42.498220 26759 ts_tablet_manager.cc:1403] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.010s
I20260709 13:13:42.501395 26762 tablet_bootstrap.cc:492] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:42.502051 26762 ts_tablet_manager.cc:1403] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.026s
I20260709 13:13:42.502516 26760 tablet_bootstrap.cc:492] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:42.503158 26760 ts_tablet_manager.cc:1403] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.021s
I20260709 13:13:42.503062 26759 raft_consensus.cc:359] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.504016 26759 raft_consensus.cc:385] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.504395 26759 raft_consensus.cc:740] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.504884 26762 raft_consensus.cc:359] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.505607 26762 raft_consensus.cc:385] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.505252 26759 consensus_queue.cc:260] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.505888 26762 raft_consensus.cc:740] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.506736 26762 consensus_queue.cc:260] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.506922 26760 raft_consensus.cc:359] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.507730 26760 raft_consensus.cc:385] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.508036 26760 raft_consensus.cc:740] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.508872 26760 consensus_queue.cc:260] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.511229 26759 ts_tablet_manager.cc:1434] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:13:42.511556 26760 ts_tablet_manager.cc:1434] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:13:42.509060 26762 ts_tablet_manager.cc:1434] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:42.513136 26762 tablet_bootstrap.cc:492] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: Bootstrap starting.
I20260709 13:13:42.513139 26760 tablet_bootstrap.cc:492] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:42.520176 26762 tablet_bootstrap.cc:654] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.524262 26760 tablet_bootstrap.cc:654] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.531527 26760 tablet_bootstrap.cc:492] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:42.532577 26762 tablet_bootstrap.cc:492] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: No bootstrap required, opened a new log
I20260709 13:13:42.532562 26776 raft_consensus.cc:493] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.533401 26762 ts_tablet_manager.cc:1403] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:13:42.533360 26776 raft_consensus.cc:515] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.537165 26776 leader_election.cc:290] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.532232 26760 ts_tablet_manager.cc:1403] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.008s
I20260709 13:13:42.538837 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:42.538841 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.540149 26461 raft_consensus.cc:2468] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:42.537179 26762 raft_consensus.cc:359] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.541306 26762 raft_consensus.cc:385] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.541669 26573 leader_election.cc:304] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.541973 26762 raft_consensus.cc:740] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.540207 26535 raft_consensus.cc:2468] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:42.542550 26776 raft_consensus.cc:2804] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.543066 26776 raft_consensus.cc:493] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.543510 26776 raft_consensus.cc:3060] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.541301 26760 raft_consensus.cc:359] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.543130 26762 consensus_queue.cc:260] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.544183 26760 raft_consensus.cc:385] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.544560 26760 raft_consensus.cc:740] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.545365 26760 consensus_queue.cc:260] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.546484 26762 ts_tablet_manager.cc:1434] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:13:42.547933 26760 ts_tablet_manager.cc:1434] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:13:42.554631 26760 tablet_bootstrap.cc:492] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784: Bootstrap starting.
I20260709 13:13:42.558918 26776 raft_consensus.cc:515] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.562849 26760 tablet_bootstrap.cc:654] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:42.563998 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.564766 26461 raft_consensus.cc:3060] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.567576 26776 leader_election.cc:290] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.568858 26776 raft_consensus.cc:493] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.569784 26776 raft_consensus.cc:515] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.570755 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:42.571488 26535 raft_consensus.cc:3060] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.572813 26745 consensus_queue.cc:1048] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:42.573654 26776 leader_election.cc:290] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.576066 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7c458c37dc469b99bcaa42b09fe74b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" is_pre_election: true
I20260709 13:13:42.576957 26536 raft_consensus.cc:2468] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:42.578409 26574 leader_election.cc:304] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.579591 26745 raft_consensus.cc:2804] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.580031 26745 raft_consensus.cc:493] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.580431 26745 raft_consensus.cc:3060] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.580739 26760 tablet_bootstrap.cc:492] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784: No bootstrap required, opened a new log
I20260709 13:13:42.581614 26760 ts_tablet_manager.cc:1403] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.011s
I20260709 13:13:42.582887 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7c458c37dc469b99bcaa42b09fe74b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.583736 26460 raft_consensus.cc:2468] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 0.
I20260709 13:13:42.584301 26535 raft_consensus.cc:2468] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:42.585830 26574 leader_election.cc:304] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.588743 26776 raft_consensus.cc:2804] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.589355 26776 raft_consensus.cc:697] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:42.590354 26776 consensus_queue.cc:237] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.594383 26760 raft_consensus.cc:359] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.595897 26760 raft_consensus.cc:385] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:42.596362 26760 raft_consensus.cc:740] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Initialized, Role: FOLLOWER
I20260709 13:13:42.597496 26760 consensus_queue.cc:260] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.601253 26760 ts_tablet_manager.cc:1434] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:13:42.613916 26461 raft_consensus.cc:2468] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:42.615883 26745 raft_consensus.cc:515] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.617108 26356 catalog_manager.cc:5697] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:42.620682 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7c458c37dc469b99bcaa42b09fe74b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.622341 26745 leader_election.cc:290] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:42.624176 26459 raft_consensus.cc:3060] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.627812 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7c458c37dc469b99bcaa42b09fe74b" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:42.628711 26535 raft_consensus.cc:3060] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.629264 26746 raft_consensus.cc:493] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.629880 26746 raft_consensus.cc:515] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.632834 26746 leader_election.cc:290] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.634421 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72625637fe2423aac5dc3dc1a9509fd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:42.635356 26609 raft_consensus.cc:2468] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.635514 26777 consensus_queue.cc:1048] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:42.641355 26500 leader_election.cc:304] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.643882 26535 raft_consensus.cc:2468] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:42.645308 26459 raft_consensus.cc:2468] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 1.
I20260709 13:13:42.645646 26746 raft_consensus.cc:2804] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.645794 26574 leader_election.cc:304] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.634829 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72625637fe2423aac5dc3dc1a9509fd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.646390 26746 raft_consensus.cc:493] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.646850 26746 raft_consensus.cc:3060] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.646946 26461 raft_consensus.cc:2468] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.648102 26777 raft_consensus.cc:2804] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.648732 26777 raft_consensus.cc:697] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:42.649767 26777 consensus_queue.cc:237] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.661055 26746 raft_consensus.cc:515] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.664641 26746 leader_election.cc:290] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.665513 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72625637fe2423aac5dc3dc1a9509fd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.664943 26357 catalog_manager.cc:5697] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:42.666301 26461 raft_consensus.cc:3060] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.667032 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72625637fe2423aac5dc3dc1a9509fd" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:42.667788 26609 raft_consensus.cc:3060] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.676313 26461 raft_consensus.cc:2468] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.678059 26499 leader_election.cc:304] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:42.679241 26746 raft_consensus.cc:2804] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.679772 26609 raft_consensus.cc:2468] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.679873 26746 raft_consensus.cc:697] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:42.681181 26746 consensus_queue.cc:237] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.691303 26356 catalog_manager.cc:5697] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.695161 26746 raft_consensus.cc:493] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.695747 26746 raft_consensus.cc:515] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.699424 26746 leader_election.cc:290] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.699702 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.700737 26461 raft_consensus.cc:2468] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.700661 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:42.703835 26499 leader_election.cc:304] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:42.705016 26746 raft_consensus.cc:2804] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.705435 26746 raft_consensus.cc:493] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.702162 26609 raft_consensus.cc:2468] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.705814 26746 raft_consensus.cc:3060] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.706790 26777 consensus_queue.cc:1048] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:42.711570 26788 raft_consensus.cc:493] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.713130 26788 raft_consensus.cc:515] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.716660 26746 raft_consensus.cc:515] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.718209 26788 leader_election.cc:290] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.720219 26746 leader_election.cc:290] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.720635 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.721323 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab8ac9c00b043bfbeca5784f67fc6cc" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" is_pre_election: true
I20260709 13:13:42.722141 26461 raft_consensus.cc:2468] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.721391 26459 raft_consensus.cc:3060] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.722981 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab8ac9c00b043bfbeca5784f67fc6cc" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" is_pre_election: true
I20260709 13:13:42.723105 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:42.723810 26609 raft_consensus.cc:2468] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 0.
I20260709 13:13:42.724803 26499 leader_election.cc:304] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:42.725860 26776 consensus_queue.cc:1048] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:42.725889 26746 raft_consensus.cc:2804] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:42.723837 26610 raft_consensus.cc:3060] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.727088 26746 raft_consensus.cc:493] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.727517 26746 raft_consensus.cc:3060] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.740401 26459 raft_consensus.cc:2468] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.746893 26499 leader_election.cc:304] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:42.747977 26788 raft_consensus.cc:2804] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.749173 26788 raft_consensus.cc:697] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:42.750546 26788 consensus_queue.cc:237] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.755090 26746 raft_consensus.cc:515] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.747336 26610 raft_consensus.cc:2468] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.766323 26748 consensus_queue.cc:1048] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:42.768186 26746 leader_election.cc:290] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:42.769090 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab8ac9c00b043bfbeca5784f67fc6cc" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:42.770012 26461 raft_consensus.cc:3060] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.771281 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab8ac9c00b043bfbeca5784f67fc6cc" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:42.771958 26609 raft_consensus.cc:3060] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:42.783455 26609 raft_consensus.cc:2468] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.785386 26500 leader_election.cc:304] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:42.787721 26746 raft_consensus.cc:2804] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:42.788630 26746 raft_consensus.cc:697] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:42.789603 26746 consensus_queue.cc:237] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:42.791085 26461 raft_consensus.cc:2468] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 1.
I20260709 13:13:42.790903 26357 catalog_manager.cc:5697] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.799434 26763 consensus_queue.cc:1048] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:42.823370 26357 catalog_manager.cc:5697] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 1 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.911312 26746 consensus_queue.cc:1048] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:42.926450 26787 consensus_queue.cc:1048] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.057838 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
mode: GRACEFUL
new_leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:13:43.058531 26610 raft_consensus.cc:606] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Received request to transfer leadership to TS f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:43.065950 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
mode: GRACEFUL
new_leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:13:43.066526 26610 raft_consensus.cc:606] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Received request to transfer leadership to TS f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:43.072000 26745 consensus_queue.cc:1048] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.073532 26536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
mode: GRACEFUL
new_leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:37690
I20260709 13:13:43.074573 26536 raft_consensus.cc:606] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Received request to transfer leadership to TS f49dd24da3994a6eb3e6c0b10fe00784
I20260709 13:13:43.078267 26745 consensus_queue.cc:1048] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:13:43.106331 26609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
mode: GRACEFUL
new_leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:36752
I20260709 13:13:43.107131 26609 raft_consensus.cc:606] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Received request to transfer leadership to TS ba3951cc1f6f412cb73e29fd4bd7c870
I20260709 13:13:43.126714 26787 consensus_queue.cc:1048] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.130244 26776 consensus_queue.cc:1048] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:43.146914 26822 consensus_queue.cc:1048] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.156376 26822 raft_consensus.cc:993] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: : Instructing follower ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:43.156558 26788 consensus_queue.cc:1048] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.156980 26822 raft_consensus.cc:1081] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Signalling peer ba3951cc1f6f412cb73e29fd4bd7c870 to start an election
I20260709 13:13:43.159403 26535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
 from {username='slave'} at 127.0.0.1:37678
I20260709 13:13:43.160758 26535 raft_consensus.cc:493] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.161353 26535 raft_consensus.cc:3060] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.175045 26535 raft_consensus.cc:515] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.180112 26535 leader_election.cc:290] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:43.183218 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:43.185284 26609 raft_consensus.cc:3055] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.185837 26609 raft_consensus.cc:740] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:43.184407 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ab98cc1f6b48bfbe50491860ca4f27" candidate_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:43.186896 26609 consensus_queue.cc:260] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.188055 26461 raft_consensus.cc:3060] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.189303 26609 raft_consensus.cc:3060] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.196183 26461 raft_consensus.cc:2468] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:43.196312 26609 raft_consensus.cc:2468] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba3951cc1f6f412cb73e29fd4bd7c870 in term 2.
I20260709 13:13:43.197857 26499 leader_election.cc:304] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:43.199218 26787 raft_consensus.cc:2804] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:43.200098 26787 raft_consensus.cc:697] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Becoming Leader. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:43.201071 26787 consensus_queue.cc:237] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.210191 26357 catalog_manager.cc:5697] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 reported cstate change: term changed from 1 to 2, leader changed from fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67) to ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66). New cstate: current_term: 2 leader_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.227815 26822 raft_consensus.cc:993] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: : Instructing follower f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:43.228490 26745 raft_consensus.cc:1081] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Signalling peer f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:43.230506 26461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:33342
I20260709 13:13:43.231554 26461 raft_consensus.cc:493] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.232036 26461 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.240679 26461 raft_consensus.cc:515] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.243048 26461 leader_election.cc:290] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:43.243484 26788 consensus_queue.cc:1048] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.244822 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:43.245214 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:43.245581 26610 raft_consensus.cc:3055] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.245946 26535 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.245980 26610 raft_consensus.cc:740] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:43.247305 26610 consensus_queue.cc:260] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.248678 26787 consensus_queue.cc:1048] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.253540 26610 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.257223 26535 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:43.259341 26425 leader_election.cc:304] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:43.260524 26748 raft_consensus.cc:2804] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:43.261101 26748 raft_consensus.cc:697] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:43.262070 26748 consensus_queue.cc:237] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.266269 26610 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:43.285827 26359 catalog_manager.cc:5697] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 1 to 2, leader changed from fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67) to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 2 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.355800 26787 consensus_queue.cc:1048] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:43.356897 26788 consensus_queue.cc:1048] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:43.520128 26787 raft_consensus.cc:993] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: : Instructing follower f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:43.520860 26831 raft_consensus.cc:1081] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Signalling peer f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:43.523209 26461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:33354
I20260709 13:13:43.523898 26461 raft_consensus.cc:493] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.524322 26461 raft_consensus.cc:3060] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.531615 26461 raft_consensus.cc:515] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.533524 26461 leader_election.cc:290] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:43.535102 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:43.535534 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b49b865ce848b984e54f1256b30e9c" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:43.535845 26535 raft_consensus.cc:3055] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.536258 26535 raft_consensus.cc:740] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:43.536314 26609 raft_consensus.cc:3060] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.537464 26535 consensus_queue.cc:260] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.538972 26535 raft_consensus.cc:3060] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.543125 26609 raft_consensus.cc:2468] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:43.544700 26425 leader_election.cc:304] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:43.545778 26748 raft_consensus.cc:2804] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:43.546379 26822 raft_consensus.cc:993] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: : Instructing follower f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:43.546336 26748 raft_consensus.cc:697] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:43.546823 26535 raft_consensus.cc:2468] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:43.547020 26822 raft_consensus.cc:1081] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Signalling peer f49dd24da3994a6eb3e6c0b10fe00784 to start an election
I20260709 13:13:43.547642 26748 consensus_queue.cc:237] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.549320 26461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
 from {username='slave'} at 127.0.0.1:33342
I20260709 13:13:43.550034 26461 raft_consensus.cc:493] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.550491 26461 raft_consensus.cc:3060] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.557471 26359 catalog_manager.cc:5697] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 1 to 2, leader changed from ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66) to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 2 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.558287 26461 raft_consensus.cc:515] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.560501 26461 leader_election.cc:290] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Requested vote from peers ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471), fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67:39229)
I20260709 13:13:43.561241 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:43.562130 26535 raft_consensus.cc:3060] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.562897 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecce7eebafcc412cbf20b7f6c02c212e" candidate_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
I20260709 13:13:43.563623 26610 raft_consensus.cc:3055] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.563970 26610 raft_consensus.cc:740] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:43.564869 26610 consensus_queue.cc:260] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.566224 26610 raft_consensus.cc:3060] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.573920 26535 raft_consensus.cc:2468] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:43.575389 26425 leader_election.cc:304] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, f49dd24da3994a6eb3e6c0b10fe00784; no voters: 
I20260709 13:13:43.576378 26610 raft_consensus.cc:2468] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f49dd24da3994a6eb3e6c0b10fe00784 in term 2.
I20260709 13:13:43.576834 26748 raft_consensus.cc:2804] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:43.577494 26748 raft_consensus.cc:697] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Leader. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:43.578336 26748 consensus_queue.cc:237] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:43.586444 26359 catalog_manager.cc:5697] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 reported cstate change: term changed from 1 to 2, leader changed from fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67) to f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65). New cstate: current_term: 2 leader_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.626283 26461 raft_consensus.cc:1275] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.627820 26787 consensus_queue.cc:1048] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.629390 26610 raft_consensus.cc:1275] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer ba3951cc1f6f412cb73e29fd4bd7c870: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.631528 26787 consensus_queue.cc:1048] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.826077 26535 raft_consensus.cc:1275] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.827553 26792 consensus_queue.cc:1048] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.840970 26610 raft_consensus.cc:1275] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.842994 26833 consensus_queue.cc:1048] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:43.963292 26535 raft_consensus.cc:1275] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.964926 26833 consensus_queue.cc:1048] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:43.976624 26610 raft_consensus.cc:1275] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:43.978585 26748 consensus_queue.cc:1048] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.005792 26610 raft_consensus.cc:1275] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.007326 26748 consensus_queue.cc:1048] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.018162 26535 raft_consensus.cc:1275] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer f49dd24da3994a6eb3e6c0b10fe00784: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.019925 26833 consensus_queue.cc:1048] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:46.122795 26357 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39736:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:46.156806 26357 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39736:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:46.364774 14097 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:13:46.436421 26866 log.cc:927] Time spent T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:13:46.468210 26881 tablet.cc:1724] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:46.491611 26879 log.cc:927] Time spent T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:13:46.522894 26886 tablet.cc:1724] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:46.529071 26880 log.cc:927] Time spent T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:13:46.545849 26896 tablet.cc:1724] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:46.581367 26884 log.cc:927] Time spent T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: Append to log took a long time: real 0.145s	user 0.006s	sys 0.000s
I20260709 13:13:46.561925 26887 tablet.cc:1724] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.600025 26906 tablet.cc:1724] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.575435 26897 tablet.cc:1724] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.611902 26899 tablet.cc:1724] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:46.624157 26425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39229, user_credentials={real_user=slave}} blocked reactor thread for 103439us
W20260709 13:13:46.642802 26636 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:6ab8ac9c00b043bfbeca5784f67fc6cc)
W20260709 13:13:46.652295 26636 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:6ab8ac9c00b043bfbeca5784f67fc6cc)
W20260709 13:13:46.657243 26636 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:6ab8ac9c00b043bfbeca5784f67fc6cc)
W20260709 13:13:46.669970 26903 log.cc:927] Time spent T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:13:46.696671 26908 tablet.cc:1724] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.700752 26912 tablet.cc:1724] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.697249 26911 tablet.cc:1724] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.704006 26881 tablet.cc:1724] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:46.715016 26425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.67:39229, user_credentials={real_user=slave}} blocked reactor thread for 59006.7us
I20260709 13:13:46.717414 26909 tablet.cc:1724] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.723272 26899 tablet.cc:1724] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.716939 26910 tablet.cc:1724] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:46.716256 26499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:34595, user_credentials={real_user=slave}} blocked reactor thread for 59926.9us
I20260709 13:13:46.774008 26897 tablet.cc:1724] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.785542 26909 tablet.cc:1724] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.786864 26911 tablet.cc:1724] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.804282 26886 tablet.cc:1724] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.808115 26887 tablet.cc:1724] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.821884 26910 tablet.cc:1724] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.825659 26908 tablet.cc:1724] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.811662 26896 tablet.cc:1724] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.864826 26906 tablet.cc:1724] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.867174 26911 tablet.cc:1724] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.871399 26881 tablet.cc:1724] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.881896 26899 tablet.cc:1724] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.894480 26896 tablet.cc:1724] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:46.903139 26536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
mode: GRACEFUL
new_leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:13:46.904171 26536 raft_consensus.cc:606] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Received request to transfer leadership to TS fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:46.960454 26460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
mode: GRACEFUL
new_leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:46042
I20260709 13:13:46.961068 26460 raft_consensus.cc:606] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Received request to transfer leadership to TS fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:46.962953 14097 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:46.963604 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:46.963877 26357 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023: soft_deleted_table [id=b3ef5136463143e0af6a81d398291a04] alter complete (version 1)
I20260709 13:13:46.974849 26536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9"
dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
mode: GRACEFUL
new_leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:36268
I20260709 13:13:46.975594 26536 raft_consensus.cc:606] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Received request to transfer leadership to TS fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:46.980980 26460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996"
dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
mode: GRACEFUL
new_leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:46042
I20260709 13:13:46.981762 26460 raft_consensus.cc:606] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Received request to transfer leadership to TS fbbb99e3c5b74db0b238f87f36b0c624
I20260709 13:13:46.983383 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:46.984089 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:47.107120 26792 raft_consensus.cc:993] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784: : Instructing follower fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.107959 26914 raft_consensus.cc:1081] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Signalling peer fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.110316 26610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:36724
I20260709 13:13:47.111047 26610 raft_consensus.cc:493] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.111440 26610 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.112931 26792 raft_consensus.cc:993] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: : Instructing follower fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.113631 26914 raft_consensus.cc:1081] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Signalling peer fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.117518 26606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:36724
I20260709 13:13:47.118489 26606 raft_consensus.cc:493] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.118964 26904 raft_consensus.cc:993] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: : Instructing follower fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.119087 26606 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.120612 26904 raft_consensus.cc:1081] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Signalling peer fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.123179 26605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:36736
I20260709 13:13:47.123368 26610 raft_consensus.cc:515] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.123974 26605 raft_consensus.cc:493] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.124527 26605 raft_consensus.cc:3060] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.125797 26610 leader_election.cc:290] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 3 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:47.126897 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:47.127485 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6db43462970464eb3d2ca9abc071996" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:47.128374 26536 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.128269 26460 raft_consensus.cc:3055] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:47.132097 26460 raft_consensus.cc:740] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:47.135466 26460 consensus_queue.cc:260] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.137056 26460 raft_consensus.cc:3060] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.138276 26606 raft_consensus.cc:515] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.142917 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:47.143734 26458 raft_consensus.cc:3055] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:47.143801 26606 leader_election.cc:290] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 3 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:47.144227 26458 raft_consensus.cc:740] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f49dd24da3994a6eb3e6c0b10fe00784, State: Running, Role: LEADER
I20260709 13:13:47.144855 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c9f09806ad4eb4a01e76b8b3daa633" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:47.145601 26534 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.145421 26458 consensus_queue.cc:260] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.146868 26460 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 3.
I20260709 13:13:47.147200 26458 raft_consensus.cc:3060] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.148066 26605 raft_consensus.cc:515] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.143029 26536 raft_consensus.cc:2468] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 3.
I20260709 13:13:47.149130 26573 leader_election.cc:304] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:47.151333 26822 raft_consensus.cc:2804] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:47.151795 26605 leader_election.cc:290] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 2 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:47.154486 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:47.155516 26460 raft_consensus.cc:3060] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.158288 26534 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 3.
I20260709 13:13:47.160147 26574 leader_election.cc:304] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba3951cc1f6f412cb73e29fd4bd7c870, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:47.164608 26822 raft_consensus.cc:697] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:47.165508 26921 raft_consensus.cc:2804] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:47.166206 26921 raft_consensus.cc:697] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:47.166045 26822 consensus_queue.cc:237] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.166819 26460 raft_consensus.cc:2468] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 2.
I20260709 13:13:47.167483 26921 consensus_queue.cc:237] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.168572 26573 leader_election.cc:304] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:47.170524 26920 raft_consensus.cc:2804] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.172938 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ab614a178494fa7aec072933bd7dbb6" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:47.175659 26920 raft_consensus.cc:697] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:47.175865 26536 raft_consensus.cc:3055] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:47.181691 26536 raft_consensus.cc:740] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:47.182725 26536 consensus_queue.cc:260] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.178644 26920 consensus_queue.cc:237] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.188958 26536 raft_consensus.cc:3060] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.189688 26458 raft_consensus.cc:2468] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 3.
I20260709 13:13:47.201864 26536 raft_consensus.cc:2468] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 2.
I20260709 13:13:47.202684 26355 catalog_manager.cc:5697] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 2 to 3, leader changed from f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65) to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 3 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.220682 26355 catalog_manager.cc:5697] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 2 to 3, leader changed from f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65) to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 3 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.222524 26355 catalog_manager.cc:5697] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 1 to 2, leader changed from ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66) to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.451957 26892 raft_consensus.cc:993] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870: : Instructing follower fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.452623 26907 raft_consensus.cc:1081] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Signalling peer fbbb99e3c5b74db0b238f87f36b0c624 to start an election
I20260709 13:13:47.454582 26605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9"
dest_uuid: "fbbb99e3c5b74db0b238f87f36b0c624"
 from {username='slave'} at 127.0.0.1:36736
I20260709 13:13:47.455525 26605 raft_consensus.cc:493] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.456331 26605 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.463189 26605 raft_consensus.cc:515] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.465582 26605 leader_election.cc:290] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 3 election: Requested vote from peers f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595), ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471)
I20260709 13:13:47.466616 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f49dd24da3994a6eb3e6c0b10fe00784"
I20260709 13:13:47.467072 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66fa2c1f77e9434d8523cda0e5aa87a9" candidate_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870"
I20260709 13:13:47.467725 26458 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.467905 26536 raft_consensus.cc:3055] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:47.468433 26536 raft_consensus.cc:740] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba3951cc1f6f412cb73e29fd4bd7c870, State: Running, Role: LEADER
I20260709 13:13:47.469728 26536 consensus_queue.cc:260] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.470800 26536 raft_consensus.cc:3060] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.474697 26458 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 3.
I20260709 13:13:47.476635 26573 leader_election.cc:304] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f49dd24da3994a6eb3e6c0b10fe00784, fbbb99e3c5b74db0b238f87f36b0c624; no voters: 
I20260709 13:13:47.477629 26822 raft_consensus.cc:2804] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:47.478169 26822 raft_consensus.cc:697] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 LEADER]: Becoming Leader. State: Replica: fbbb99e3c5b74db0b238f87f36b0c624, State: Running, Role: LEADER
I20260709 13:13:47.478609 26536 raft_consensus.cc:2468] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbbb99e3c5b74db0b238f87f36b0c624 in term 3.
I20260709 13:13:47.479250 26822 consensus_queue.cc:237] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } }
I20260709 13:13:47.489310 26355 catalog_manager.cc:5697] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 reported cstate change: term changed from 2 to 3, leader changed from ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66) to fbbb99e3c5b74db0b238f87f36b0c624 (127.13.196.67). New cstate: current_term: 3 leader_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbbb99e3c5b74db0b238f87f36b0c624" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 39229 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.564616 26458 raft_consensus.cc:1275] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:47.565613 26460 raft_consensus.cc:1275] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:47.566071 26822 consensus_queue.cc:1048] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:47.567198 26920 consensus_queue.cc:1048] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:47.579736 26534 raft_consensus.cc:1275] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:47.581858 26921 consensus_queue.cc:1048] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:47.597402 26536 raft_consensus.cc:1275] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:47.599691 26822 consensus_queue.cc:1048] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:13:47.746222 26534 raft_consensus.cc:1275] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:47.747575 26920 consensus_queue.cc:1048] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:47.757921 26458 raft_consensus.cc:1275] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:47.762192 26822 consensus_queue.cc:1048] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:48.035359 26458 raft_consensus.cc:1275] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.037295 26822 consensus_queue.cc:1048] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49dd24da3994a6eb3e6c0b10fe00784" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 34595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:48.050343 26534 raft_consensus.cc:1275] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Refusing update from remote peer fbbb99e3c5b74db0b238f87f36b0c624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.052071 26927 consensus_queue.cc:1048] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba3951cc1f6f412cb73e29fd4bd7c870" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 37471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:48.080968 14097 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:48.086499 14097 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:48.087091 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:48.093273 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:48.094087 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:49.135339 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
W20260709 13:13:49.141587 26573 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:13:49.147082 26573 consensus_peers.cc:597] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.176934 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:49.178129 14097 tablet_replica.cc:333] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.179342 14097 raft_consensus.cc:2243] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.180264 14097 raft_consensus.cc:2272] T 22ab98cc1f6b48bfbe50491860ca4f27 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.183893 14097 tablet_replica.cc:333] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.184931 14097 raft_consensus.cc:2243] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.185462 14097 raft_consensus.cc:2272] T 6ab8ac9c00b043bfbeca5784f67fc6cc P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.188791 14097 tablet_replica.cc:333] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.189970 14097 raft_consensus.cc:2243] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.190657 14097 raft_consensus.cc:2272] T ef7c458c37dc469b99bcaa42b09fe74b P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:49.193288 26499 consensus_peers.cc:597] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.194449 14097 tablet_replica.cc:333] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.195308 14097 raft_consensus.cc:2243] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.196058 14097 raft_consensus.cc:2272] T c72625637fe2423aac5dc3dc1a9509fd P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.198930 14097 tablet_replica.cc:333] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.199939 14097 raft_consensus.cc:2243] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.201249 14097 raft_consensus.cc:2272] T c7b49b865ce848b984e54f1256b30e9c P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.204710 14097 tablet_replica.cc:333] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.206081 14097 raft_consensus.cc:2243] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.207015 14097 raft_consensus.cc:2272] T 6479fc955c944947bcb331cde5deb4b4 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.210304 14097 tablet_replica.cc:333] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.211131 14097 raft_consensus.cc:2243] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.212265 14097 raft_consensus.cc:2272] T ecce7eebafcc412cbf20b7f6c02c212e P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.215351 14097 tablet_replica.cc:333] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.216136 14097 raft_consensus.cc:2243] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.217235 14097 raft_consensus.cc:2272] T fb789c84e8964cd3b28380186b862f3d P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.220863 14097 tablet_replica.cc:333] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.221745 14097 raft_consensus.cc:2243] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.222380 14097 raft_consensus.cc:2272] T a6db43462970464eb3d2ca9abc071996 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.225350 14097 tablet_replica.cc:333] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.226078 14097 raft_consensus.cc:2243] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.226640 14097 raft_consensus.cc:2272] T 1e225ff26f7d4f2094c30b7a6495d05b P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.229410 14097 tablet_replica.cc:333] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.230136 14097 raft_consensus.cc:2243] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.231217 14097 raft_consensus.cc:2272] T 03592e543c614badbecb5f587c00e4d3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.234438 14097 tablet_replica.cc:333] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.235132 14097 raft_consensus.cc:2243] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.235968 14097 raft_consensus.cc:2272] T a11ea7817b734d67a116a1a14dc14daf P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.238473 14097 tablet_replica.cc:333] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.239730 14097 raft_consensus.cc:2243] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.241071 14097 raft_consensus.cc:2272] T c331c336bc894a37a9b7ff2589eb2db3 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.245487 14097 tablet_replica.cc:333] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
W20260709 13:13:49.246388 26499 consensus_peers.cc:597] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.246588 14097 raft_consensus.cc:2243] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.247241 14097 raft_consensus.cc:2272] T 66fa2c1f77e9434d8523cda0e5aa87a9 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.249998 14097 tablet_replica.cc:333] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.250674 14097 raft_consensus.cc:2243] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.251936 14097 raft_consensus.cc:2272] T 0a4cc38430e14c26a90b625a781282e2 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.255497 14097 tablet_replica.cc:333] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.256263 14097 raft_consensus.cc:2243] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.256855 14097 raft_consensus.cc:2272] T 2ab614a178494fa7aec072933bd7dbb6 P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.259421 14097 tablet_replica.cc:333] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.260053 14097 raft_consensus.cc:2243] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.260630 14097 raft_consensus.cc:2272] T 81c9f09806ad4eb4a01e76b8b3daa633 P f49dd24da3994a6eb3e6c0b10fe00784 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.263365 14097 tablet_replica.cc:333] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784: stopping tablet replica
I20260709 13:13:49.264756 14097 raft_consensus.cc:2243] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.265699 14097 raft_consensus.cc:2272] T 7fe09b075d084a648d8d3e5cae7e54cd P f49dd24da3994a6eb3e6c0b10fe00784 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.318368 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
I20260709 13:13:49.367561 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
W20260709 13:13:49.399304 26573 consensus_peers.cc:597] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:34595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.410014 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:49.411274 14097 tablet_replica.cc:333] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.412402 14097 raft_consensus.cc:2243] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.413146 14097 raft_consensus.cc:2272] T ef7c458c37dc469b99bcaa42b09fe74b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.415719 14097 tablet_replica.cc:333] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.416525 14097 raft_consensus.cc:2243] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.417500 14097 raft_consensus.cc:2272] T 6ab8ac9c00b043bfbeca5784f67fc6cc P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.419945 14097 tablet_replica.cc:333] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.420915 14097 raft_consensus.cc:2243] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.422405 14097 raft_consensus.cc:2272] T 22ab98cc1f6b48bfbe50491860ca4f27 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.425518 14097 tablet_replica.cc:333] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.426483 14097 raft_consensus.cc:2243] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:49.426513 26574 consensus_peers.cc:597] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Couldn't send request to peer ba3951cc1f6f412cb73e29fd4bd7c870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.427696 14097 raft_consensus.cc:2272] T c72625637fe2423aac5dc3dc1a9509fd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.430974 14097 tablet_replica.cc:333] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.432241 14097 raft_consensus.cc:2243] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.433143 14097 raft_consensus.cc:2272] T fb789c84e8964cd3b28380186b862f3d P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.436260 14097 tablet_replica.cc:333] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.437124 14097 raft_consensus.cc:2243] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.437752 14097 raft_consensus.cc:2272] T a6db43462970464eb3d2ca9abc071996 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.441033 14097 tablet_replica.cc:333] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.441727 14097 raft_consensus.cc:2243] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.442317 14097 raft_consensus.cc:2272] T ecce7eebafcc412cbf20b7f6c02c212e P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.445079 14097 tablet_replica.cc:333] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.445801 14097 raft_consensus.cc:2243] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:49.445869 26499 consensus_peers.cc:597] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:34595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.446494 14097 raft_consensus.cc:2272] T 6479fc955c944947bcb331cde5deb4b4 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.449643 14097 tablet_replica.cc:333] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.450543 14097 raft_consensus.cc:2243] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.451136 14097 raft_consensus.cc:2272] T 66fa2c1f77e9434d8523cda0e5aa87a9 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.453845 14097 tablet_replica.cc:333] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.454562 14097 raft_consensus.cc:2243] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.455149 14097 raft_consensus.cc:2272] T c331c336bc894a37a9b7ff2589eb2db3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.458988 14097 tablet_replica.cc:333] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.459751 14097 raft_consensus.cc:2243] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.461071 14097 raft_consensus.cc:2272] T a11ea7817b734d67a116a1a14dc14daf P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:49.461145 26574 consensus_peers.cc:597] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Couldn't send request to peer ba3951cc1f6f412cb73e29fd4bd7c870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.463969 14097 tablet_replica.cc:333] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.464751 14097 raft_consensus.cc:2243] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.465325 14097 raft_consensus.cc:2272] T c7b49b865ce848b984e54f1256b30e9c P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.467814 14097 tablet_replica.cc:333] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.468573 14097 raft_consensus.cc:2243] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.469794 14097 raft_consensus.cc:2272] T 1e225ff26f7d4f2094c30b7a6495d05b P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.472898 14097 tablet_replica.cc:333] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.473585 14097 raft_consensus.cc:2243] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.474134 14097 raft_consensus.cc:2272] T 03592e543c614badbecb5f587c00e4d3 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.476858 14097 tablet_replica.cc:333] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.477520 14097 raft_consensus.cc:2243] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.478075 14097 raft_consensus.cc:2272] T 0a4cc38430e14c26a90b625a781282e2 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.480754 14097 tablet_replica.cc:333] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.481415 14097 raft_consensus.cc:2243] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.481889 14097 raft_consensus.cc:2272] T 2ab614a178494fa7aec072933bd7dbb6 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.484524 14097 tablet_replica.cc:333] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.485181 14097 raft_consensus.cc:2243] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.485702 14097 raft_consensus.cc:2272] T 81c9f09806ad4eb4a01e76b8b3daa633 P ba3951cc1f6f412cb73e29fd4bd7c870 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.488986 14097 tablet_replica.cc:333] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870: stopping tablet replica
I20260709 13:13:49.489718 14097 raft_consensus.cc:2243] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.491248 14097 raft_consensus.cc:2272] T 7fe09b075d084a648d8d3e5cae7e54cd P ba3951cc1f6f412cb73e29fd4bd7c870 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:49.491660 26574 consensus_peers.cc:597] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Couldn't send request to peer ba3951cc1f6f412cb73e29fd4bd7c870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.492422 26573 consensus_peers.cc:597] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:34595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.504814 26573 consensus_peers.cc:597] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:34595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:49.505975 26574 consensus_peers.cc:597] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Couldn't send request to peer ba3951cc1f6f412cb73e29fd4bd7c870. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.534636 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
I20260709 13:13:49.581001 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
W20260709 13:13:49.589166 26574 consensus_peers.cc:597] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Couldn't send request to peer ba3951cc1f6f412cb73e29fd4bd7c870. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.617409 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:49.618301 14097 tablet_replica.cc:333] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.619036 14097 raft_consensus.cc:2243] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.619575 14097 raft_consensus.cc:2272] T 22ab98cc1f6b48bfbe50491860ca4f27 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.621946 14097 tablet_replica.cc:333] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.622633 14097 raft_consensus.cc:2243] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.623118 14097 raft_consensus.cc:2272] T c72625637fe2423aac5dc3dc1a9509fd P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.625895 14097 tablet_replica.cc:333] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.626510 14097 raft_consensus.cc:2243] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.627439 14097 raft_consensus.cc:2272] T ef7c458c37dc469b99bcaa42b09fe74b P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.630129 14097 tablet_replica.cc:333] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.631040 14097 raft_consensus.cc:2243] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.631659 14097 raft_consensus.cc:2272] T 6ab8ac9c00b043bfbeca5784f67fc6cc P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.634974 14097 tablet_replica.cc:333] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.635855 14097 raft_consensus.cc:2243] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.636513 14097 raft_consensus.cc:2272] T c7b49b865ce848b984e54f1256b30e9c P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:49.638691 26574 consensus_peers.cc:597] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer ba3951cc1f6f412cb73e29fd4bd7c870 (127.13.196.66:37471): Couldn't send request to peer ba3951cc1f6f412cb73e29fd4bd7c870. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:37471: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.639899 14097 tablet_replica.cc:333] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.640673 14097 raft_consensus.cc:2243] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.641176 14097 raft_consensus.cc:2272] T fb789c84e8964cd3b28380186b862f3d P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.643663 14097 tablet_replica.cc:333] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.644320 14097 raft_consensus.cc:2243] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.644915 14097 raft_consensus.cc:2272] T ecce7eebafcc412cbf20b7f6c02c212e P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.647312 14097 tablet_replica.cc:333] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.647953 14097 raft_consensus.cc:2243] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.649072 14097 raft_consensus.cc:2272] T 6479fc955c944947bcb331cde5deb4b4 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.651890 14097 tablet_replica.cc:333] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.652750 14097 raft_consensus.cc:2243] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.653332 14097 raft_consensus.cc:2272] T a11ea7817b734d67a116a1a14dc14daf P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.656594 14097 tablet_replica.cc:333] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.657347 14097 raft_consensus.cc:2243] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.658342 14097 raft_consensus.cc:2272] T 66fa2c1f77e9434d8523cda0e5aa87a9 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.661022 14097 tablet_replica.cc:333] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.661861 14097 raft_consensus.cc:2243] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.662420 14097 raft_consensus.cc:2272] T c331c336bc894a37a9b7ff2589eb2db3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.664932 14097 tablet_replica.cc:333] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.665570 14097 raft_consensus.cc:2243] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.666108 14097 raft_consensus.cc:2272] T 1e225ff26f7d4f2094c30b7a6495d05b P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.668653 14097 tablet_replica.cc:333] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.669313 14097 raft_consensus.cc:2243] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.669970 14097 raft_consensus.cc:2272] T 03592e543c614badbecb5f587c00e4d3 P fbbb99e3c5b74db0b238f87f36b0c624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.673558 14097 tablet_replica.cc:333] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.674484 14097 raft_consensus.cc:2243] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.675709 14097 raft_consensus.cc:2272] T 2ab614a178494fa7aec072933bd7dbb6 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:49.677573 26573 consensus_peers.cc:597] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 -> Peer f49dd24da3994a6eb3e6c0b10fe00784 (127.13.196.65:34595): Couldn't send request to peer f49dd24da3994a6eb3e6c0b10fe00784. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:34595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:49.678712 14097 tablet_replica.cc:333] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.679563 14097 raft_consensus.cc:2243] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.680508 14097 raft_consensus.cc:2272] T 81c9f09806ad4eb4a01e76b8b3daa633 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.683082 14097 tablet_replica.cc:333] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.683738 14097 raft_consensus.cc:2243] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.684249 14097 raft_consensus.cc:2272] T 7fe09b075d084a648d8d3e5cae7e54cd P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.686918 14097 tablet_replica.cc:333] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.687505 14097 raft_consensus.cc:2243] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:49.688028 14097 raft_consensus.cc:2272] T 0a4cc38430e14c26a90b625a781282e2 P fbbb99e3c5b74db0b238f87f36b0c624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.690828 14097 tablet_replica.cc:333] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624: stopping tablet replica
I20260709 13:13:49.691668 14097 raft_consensus.cc:2243] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.692866 14097 raft_consensus.cc:2272] T a6db43462970464eb3d2ca9abc071996 P fbbb99e3c5b74db0b238f87f36b0c624 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.742604 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
I20260709 13:13:49.789059 14097 master.cc:562] Master@127.13.196.126:43937 shutting down...
I20260709 13:13:49.823784 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:49.824589 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:49.825136 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P f0b332303f914fab89a11f608e344023: stopping tablet replica
I20260709 13:13:49.849673 14097 master.cc:584] Master@127.13.196.126:43937 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13805 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:49.919678 14097 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.196.126:46099
I20260709 13:13:49.921411 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:49.928184 26942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:49.930236 26945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:49.930552 26943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:49.930843 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:49.932109 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:49.932396 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:49.932555 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602829932539 us; error 0 us; skew 500 ppm
I20260709 13:13:49.933099 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:49.937064 14097 webserver.cc:533] Webserver started at http://127.13.196.126:46757/ using document root <none> and password file <none>
I20260709 13:13:49.937637 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:49.937812 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:49.938035 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:49.939574 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/master-0-root/instance:
uuid: "4de7883820ff4707aa00522cc665dc51"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-ftjc"
I20260709 13:13:49.945062 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:13:49.949585 26950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.950868 14097 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:49.951285 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/master-0-root
uuid: "4de7883820ff4707aa00522cc665dc51"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-ftjc"
I20260709 13:13:49.951622 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:49.969419 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:49.971596 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.026965 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.126:46099
I20260709 13:13:50.027170 27001 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.126:46099 every 8 connection(s)
I20260709 13:13:50.031839 27002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.044909 27002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51: Bootstrap starting.
I20260709 13:13:50.051403 27002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.057391 27002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51: No bootstrap required, opened a new log
I20260709 13:13:50.060216 27002 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de7883820ff4707aa00522cc665dc51" member_type: VOTER }
I20260709 13:13:50.060848 27002 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.061167 27002 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de7883820ff4707aa00522cc665dc51, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.061949 27002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de7883820ff4707aa00522cc665dc51" member_type: VOTER }
I20260709 13:13:50.062515 27002 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:50.062772 27002 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:50.063102 27002 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.070267 27002 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de7883820ff4707aa00522cc665dc51" member_type: VOTER }
I20260709 13:13:50.071301 27002 leader_election.cc:304] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4de7883820ff4707aa00522cc665dc51; no voters: 
I20260709 13:13:50.072999 27002 leader_election.cc:290] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:50.073449 27005 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.075834 27005 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 1 LEADER]: Becoming Leader. State: Replica: 4de7883820ff4707aa00522cc665dc51, State: Running, Role: LEADER
I20260709 13:13:50.076933 27005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de7883820ff4707aa00522cc665dc51" member_type: VOTER }
I20260709 13:13:50.077366 27002 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:50.082803 27006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4de7883820ff4707aa00522cc665dc51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de7883820ff4707aa00522cc665dc51" member_type: VOTER } }
I20260709 13:13:50.083791 27006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:50.083027 27007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4de7883820ff4707aa00522cc665dc51. Latest consensus state: current_term: 1 leader_uuid: "4de7883820ff4707aa00522cc665dc51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de7883820ff4707aa00522cc665dc51" member_type: VOTER } }
I20260709 13:13:50.084901 27007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:50.090582 27011 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:50.101454 27011 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:50.113858 14097 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:50.116925 27011 catalog_manager.cc:1383] Generated new cluster ID: 47c3304d15174bf48a7585eb3b6fb821
I20260709 13:13:50.117316 27011 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:50.137471 27011 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:50.139349 27011 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:50.161687 27011 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51: Generated new TSK 0
I20260709 13:13:50.162497 27011 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:50.181901 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.189442 27023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.190644 27024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.192739 27026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.194021 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:50.195350 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.195643 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.195909 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602830195867 us; error 0 us; skew 500 ppm
I20260709 13:13:50.196758 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.200191 14097 webserver.cc:533] Webserver started at http://127.13.196.65:40149/ using document root <none> and password file <none>
I20260709 13:13:50.200925 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.201154 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:50.201508 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:50.202879 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-0-root/instance:
uuid: "7d00d1065237495b95262e0bba919c8a"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-ftjc"
I20260709 13:13:50.208920 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:50.213850 27031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.214955 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:13:50.215274 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-0-root
uuid: "7d00d1065237495b95262e0bba919c8a"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-ftjc"
I20260709 13:13:50.215729 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.229965 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.231578 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.233433 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:50.236202 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:50.236440 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:50.236809 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:50.237007 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.291227 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.65:36665
I20260709 13:13:50.291368 27093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.65:36665 every 8 connection(s)
I20260709 13:13:50.297343 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.306094 27098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.307314 27099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.311167 27101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.313277 27094 heartbeater.cc:344] Connected to a master server at 127.13.196.126:46099
I20260709 13:13:50.314218 27094 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:50.314638 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:50.315526 27094 heartbeater.cc:507] Master 127.13.196.126:46099 requested a full tablet report, sending...
I20260709 13:13:50.315996 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.316311 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.316589 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602830316570 us; error 0 us; skew 500 ppm
I20260709 13:13:50.317673 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.319041 26967 ts_manager.cc:194] Registered new tserver with Master: 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665)
I20260709 13:13:50.321727 14097 webserver.cc:533] Webserver started at http://127.13.196.66:42675/ using document root <none> and password file <none>
I20260709 13:13:50.322645 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.322587 26967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45338
I20260709 13:13:50.323174 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:50.323616 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:50.325423 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-1-root/instance:
uuid: "c73779539f1349b2a36d720d7c0edfab"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-ftjc"
I20260709 13:13:50.331166 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:50.335337 27106 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.336803 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:50.337162 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-1-root
uuid: "c73779539f1349b2a36d720d7c0edfab"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-ftjc"
I20260709 13:13:50.337499 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.369407 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.371081 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.372944 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:50.375905 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:50.376133 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.376531 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:50.376720 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.432004 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.66:35673
I20260709 13:13:50.432155 27168 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.66:35673 every 8 connection(s)
I20260709 13:13:50.438252 14097 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.448930 27172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.449558 27173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.453940 27175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.455076 14097 server_base.cc:1061] running on GCE node
I20260709 13:13:50.455893 27169 heartbeater.cc:344] Connected to a master server at 127.13.196.126:46099
I20260709 13:13:50.456511 27169 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:50.456817 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.457271 14097 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.457510 14097 hybrid_clock.cc:648] HybridClock initialized: now 1783602830457483 us; error 0 us; skew 500 ppm
I20260709 13:13:50.457860 27169 heartbeater.cc:507] Master 127.13.196.126:46099 requested a full tablet report, sending...
I20260709 13:13:50.458372 14097 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.460565 26967 ts_manager.cc:194] Registered new tserver with Master: c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:50.461536 14097 webserver.cc:533] Webserver started at http://127.13.196.67:38091/ using document root <none> and password file <none>
I20260709 13:13:50.462214 14097 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.462427 14097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:50.462617 26967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45350
I20260709 13:13:50.462740 14097 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:50.464504 14097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-2-root/instance:
uuid: "f03431098129496c8e4d64f56b3128b1"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-ftjc"
I20260709 13:13:50.469901 14097 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
I20260709 13:13:50.474284 27180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.475342 14097 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:13:50.475726 14097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-2-root
uuid: "f03431098129496c8e4d64f56b3128b1"
format_stamp: "Formatted at 2026-07-09 13:13:50 on dist-test-slave-ftjc"
I20260709 13:13:50.476076 14097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOlevqR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602431295977-14097-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.492396 14097 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.493877 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.495590 14097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:50.498351 14097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:50.498615 14097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.498883 14097 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:50.499070 14097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.554883 14097 rpc_server.cc:307] RPC server started. Bound to: 127.13.196.67:38645
I20260709 13:13:50.555034 27242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.196.67:38645 every 8 connection(s)
I20260709 13:13:50.573280 27243 heartbeater.cc:344] Connected to a master server at 127.13.196.126:46099
I20260709 13:13:50.574002 27243 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:50.574930 27243 heartbeater.cc:507] Master 127.13.196.126:46099 requested a full tablet report, sending...
I20260709 13:13:50.577648 26967 ts_manager.cc:194] Registered new tserver with Master: f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:50.578315 14097 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020057945s
I20260709 13:13:50.580224 26967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45354
I20260709 13:13:50.613103 26967 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45364:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:50.617027 26967 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:50.704360 27208 tablet_service.cc:1511] Processing CreateTablet for tablet f00f09104d28472193f45353a187e05a (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:50.709721 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00f09104d28472193f45353a187e05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.717078 27207 tablet_service.cc:1511] Processing CreateTablet for tablet 35b44a3612a948d6a7a782bf4732a0ac (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:50.718920 27207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b44a3612a948d6a7a782bf4732a0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.723021 27206 tablet_service.cc:1511] Processing CreateTablet for tablet fe691b26661c42a59f4e6e46a96b989e (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:50.726539 27205 tablet_service.cc:1511] Processing CreateTablet for tablet 3a443d470e0b4771beccc3ce51aa29d6 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:50.727819 27057 tablet_service.cc:1511] Processing CreateTablet for tablet fe691b26661c42a59f4e6e46a96b989e (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:50.724915 27206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe691b26661c42a59f4e6e46a96b989e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.729171 27203 tablet_service.cc:1511] Processing CreateTablet for tablet 808608154e3440369d46e51c2a4f5591 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:50.729841 27057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe691b26661c42a59f4e6e46a96b989e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.731230 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808608154e3440369d46e51c2a4f5591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.731077 27054 tablet_service.cc:1511] Processing CreateTablet for tablet 808608154e3440369d46e51c2a4f5591 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:50.732178 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a443d470e0b4771beccc3ce51aa29d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.732694 27054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808608154e3440369d46e51c2a4f5591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.733767 27056 tablet_service.cc:1511] Processing CreateTablet for tablet 3a443d470e0b4771beccc3ce51aa29d6 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:50.735384 27056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a443d470e0b4771beccc3ce51aa29d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.736527 27059 tablet_service.cc:1511] Processing CreateTablet for tablet f00f09104d28472193f45353a187e05a (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:50.738163 27059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00f09104d28472193f45353a187e05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.737774 27055 tablet_service.cc:1511] Processing CreateTablet for tablet 619839991657438d8cb20965ae24980f (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:50.739347 27055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619839991657438d8cb20965ae24980f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.727892 27204 tablet_service.cc:1511] Processing CreateTablet for tablet 619839991657438d8cb20965ae24980f (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:50.742146 27204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619839991657438d8cb20965ae24980f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.729293 27058 tablet_service.cc:1511] Processing CreateTablet for tablet 35b44a3612a948d6a7a782bf4732a0ac (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:50.745317 27058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b44a3612a948d6a7a782bf4732a0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.777009 27053 tablet_service.cc:1511] Processing CreateTablet for tablet b3fc7af05891478d95c06041bd893937 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:50.778714 27053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fc7af05891478d95c06041bd893937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.792383 27257 tablet_bootstrap.cc:492] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:50.794195 27134 tablet_service.cc:1511] Processing CreateTablet for tablet f00f09104d28472193f45353a187e05a (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:50.795390 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 3a443d470e0b4771beccc3ce51aa29d6 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:50.796269 27134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f00f09104d28472193f45353a187e05a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.799659 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 619839991657438d8cb20965ae24980f (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:50.802006 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619839991657438d8cb20965ae24980f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.802536 27257 tablet_bootstrap.cc:654] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.797861 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 35b44a3612a948d6a7a782bf4732a0ac (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:50.799362 27132 tablet_service.cc:1511] Processing CreateTablet for tablet fe691b26661c42a59f4e6e46a96b989e (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:50.807868 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b44a3612a948d6a7a782bf4732a0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.808774 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a443d470e0b4771beccc3ce51aa29d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.812489 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe691b26661c42a59f4e6e46a96b989e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.826326 27129 tablet_service.cc:1511] Processing CreateTablet for tablet 808608154e3440369d46e51c2a4f5591 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:50.828547 27129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808608154e3440369d46e51c2a4f5591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.832903 27128 tablet_service.cc:1511] Processing CreateTablet for tablet b3fc7af05891478d95c06041bd893937 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:50.839751 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fc7af05891478d95c06041bd893937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.872887 27204 tablet_service.cc:1511] Processing CreateTablet for tablet b3fc7af05891478d95c06041bd893937 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:50.874709 27204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fc7af05891478d95c06041bd893937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.878165 27052 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6bfdbfbfb54f948b54fbfe78a1dc8c (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:50.880793 27052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6bfdbfbfb54f948b54fbfe78a1dc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.895248 27257 tablet_bootstrap.cc:492] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:50.900848 27257 ts_tablet_manager.cc:1403] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.044s
I20260709 13:13:50.919660 27257 raft_consensus.cc:359] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:50.920619 27257 raft_consensus.cc:385] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.920936 27257 raft_consensus.cc:740] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.921823 27257 consensus_queue.cc:260] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:50.925901 27259 tablet_bootstrap.cc:492] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:50.947058 27243 heartbeater.cc:499] Master 127.13.196.126:46099 was elected leader, sending a full tablet report...
I20260709 13:13:50.949990 27257 ts_tablet_manager.cc:1434] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:13:50.951180 27257 tablet_bootstrap.cc:492] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:50.956070 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6bfdbfbfb54f948b54fbfe78a1dc8c (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:50.958949 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6bfdbfbfb54f948b54fbfe78a1dc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.959082 27260 tablet_bootstrap.cc:492] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:50.967144 27260 tablet_bootstrap.cc:654] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.967144 27259 tablet_bootstrap.cc:654] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.976822 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6bfdbfbfb54f948b54fbfe78a1dc8c (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:50.978826 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6bfdbfbfb54f948b54fbfe78a1dc8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.988711 27257 tablet_bootstrap.cc:654] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.991652 27057 tablet_service.cc:1511] Processing CreateTablet for tablet 95a12ece97fd4bfe8854ad306d9ba252 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:50.993780 27057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a12ece97fd4bfe8854ad306d9ba252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.996824 27260 tablet_bootstrap.cc:492] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:50.997128 27259 tablet_bootstrap.cc:492] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:50.997651 27259 ts_tablet_manager.cc:1403] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.011s
I20260709 13:13:50.997620 27260 ts_tablet_manager.cc:1403] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.016s
I20260709 13:13:51.001863 27260 raft_consensus.cc:359] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.003005 27260 raft_consensus.cc:385] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.002832 27132 tablet_service.cc:1511] Processing CreateTablet for tablet 95a12ece97fd4bfe8854ad306d9ba252 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:51.003571 27260 raft_consensus.cc:740] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.004650 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a12ece97fd4bfe8854ad306d9ba252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.004769 27260 consensus_queue.cc:260] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.005142 27204 tablet_service.cc:1511] Processing CreateTablet for tablet 95a12ece97fd4bfe8854ad306d9ba252 (DEFAULT_TABLE table=test-workload [id=6d671c1b94f9414db341bedf4fbbe47a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:51.006659 27204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a12ece97fd4bfe8854ad306d9ba252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.020728 27259 raft_consensus.cc:359] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.025426 27259 raft_consensus.cc:385] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.024811 27260 ts_tablet_manager.cc:1434] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:13:51.024138 27169 heartbeater.cc:499] Master 127.13.196.126:46099 was elected leader, sending a full tablet report...
I20260709 13:13:51.025949 27259 raft_consensus.cc:740] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.031767 27260 tablet_bootstrap.cc:492] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:51.034778 27257 tablet_bootstrap.cc:492] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.035507 27257 ts_tablet_manager.cc:1403] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.005s
I20260709 13:13:51.035210 27259 consensus_queue.cc:260] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.039567 27257 raft_consensus.cc:359] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.040609 27257 raft_consensus.cc:385] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.040948 27257 raft_consensus.cc:740] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.041927 27257 consensus_queue.cc:260] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.042856 27260 tablet_bootstrap.cc:654] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.044847 27257 ts_tablet_manager.cc:1434] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.004s
I20260709 13:13:51.046144 27257 tablet_bootstrap.cc:492] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:51.046789 27094 heartbeater.cc:499] Master 127.13.196.126:46099 was elected leader, sending a full tablet report...
I20260709 13:13:51.050988 27259 ts_tablet_manager.cc:1434] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.004s
I20260709 13:13:51.052675 27259 tablet_bootstrap.cc:492] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.054455 27257 tablet_bootstrap.cc:654] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:51.060245 27244 tablet.cc:2406] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:51.064329 27264 raft_consensus.cc:493] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.065240 27264 raft_consensus.cc:515] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.069654 27259 tablet_bootstrap.cc:654] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.074036 27264 leader_election.cc:290] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.099596 27259 tablet_bootstrap.cc:492] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.103061 27259 ts_tablet_manager.cc:1403] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.015s
I20260709 13:13:51.104272 27257 tablet_bootstrap.cc:492] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.104938 27257 ts_tablet_manager.cc:1403] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.035s
I20260709 13:13:51.106765 27261 raft_consensus.cc:493] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.108572 27257 raft_consensus.cc:359] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.109484 27257 raft_consensus.cc:385] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.109805 27257 raft_consensus.cc:740] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
W20260709 13:13:51.110518 27015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:51.110718 27257 consensus_queue.cc:260] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.107633 27261 raft_consensus.cc:515] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.124550 27261 leader_election.cc:290] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.135351 27272 raft_consensus.cc:493] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.136121 27272 raft_consensus.cc:515] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.139710 27259 raft_consensus.cc:359] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.140700 27259 raft_consensus.cc:385] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.141024 27259 raft_consensus.cc:740] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.141892 27259 consensus_queue.cc:260] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.145622 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.146570 27272 leader_election.cc:290] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.146888 27069 raft_consensus.cc:2468] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 0.
I20260709 13:13:51.147702 27259 ts_tablet_manager.cc:1434] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 13:13:51.149168 27259 tablet_bootstrap.cc:492] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.149741 27110 leader_election.cc:304] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:51.151724 27264 raft_consensus.cc:2804] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.152520 27264 raft_consensus.cc:493] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.153023 27264 raft_consensus.cc:3060] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.157871 27259 tablet_bootstrap.cc:654] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.166836 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.167798 27218 raft_consensus.cc:2468] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 0.
I20260709 13:13:51.173833 27260 tablet_bootstrap.cc:492] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.174640 27260 ts_tablet_manager.cc:1403] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.143s	user 0.037s	sys 0.019s
I20260709 13:13:51.179514 27260 raft_consensus.cc:359] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.180578 27260 raft_consensus.cc:385] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.180976 27260 raft_consensus.cc:740] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.182266 27260 consensus_queue.cc:260] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.197626 27257 ts_tablet_manager.cc:1434] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.092s	user 0.057s	sys 0.028s
I20260709 13:13:51.197805 27260 ts_tablet_manager.cc:1434] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:13:51.199270 27259 tablet_bootstrap.cc:492] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.199450 27257 tablet_bootstrap.cc:492] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:51.200043 27259 ts_tablet_manager.cc:1403] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.005s
I20260709 13:13:51.203528 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.205389 27266 raft_consensus.cc:493] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.205519 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a443d470e0b4771beccc3ce51aa29d6" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.206081 27266 raft_consensus.cc:515] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.206504 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.209404 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a443d470e0b4771beccc3ce51aa29d6" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.211521 27266 leader_election.cc:290] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.213326 27257 tablet_bootstrap.cc:654] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.214100 27260 tablet_bootstrap.cc:492] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:51.214599 27264 raft_consensus.cc:515] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
W20260709 13:13:51.212066 27184 leader_election.cc:343] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.204473 27259 raft_consensus.cc:359] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.219013 27259 raft_consensus.cc:385] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.220604 27259 raft_consensus.cc:740] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
W20260709 13:13:51.217685 27184 leader_election.cc:343] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:51.224144 27184 leader_election.cc:343] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.224771 27184 leader_election.cc:304] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:51.225751 27273 raft_consensus.cc:2749] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.225168 27259 consensus_queue.cc:260] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
W20260709 13:13:51.227394 27184 leader_election.cc:343] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.227893 27184 leader_election.cc:304] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:51.230856 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:51.231667 27218 raft_consensus.cc:3060] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.234153 27260 tablet_bootstrap.cc:654] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.242141 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:51.242985 27218 raft_consensus.cc:2468] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 1.
I20260709 13:13:51.243412 27069 raft_consensus.cc:3060] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.244773 27110 leader_election.cc:304] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.246052 27278 raft_consensus.cc:2804] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.247354 27264 leader_election.cc:290] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.252713 27273 raft_consensus.cc:2749] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.257479 27278 raft_consensus.cc:697] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:51.259071 27260 tablet_bootstrap.cc:492] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.258739 27278 consensus_queue.cc:237] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.259778 27260 ts_tablet_manager.cc:1403] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.000s
I20260709 13:13:51.260737 27259 ts_tablet_manager.cc:1434] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.002s
I20260709 13:13:51.267912 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.268992 27260 raft_consensus.cc:359] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.270112 27260 raft_consensus.cc:385] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.270514 27260 raft_consensus.cc:740] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.271895 27260 consensus_queue.cc:260] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.272943 27257 tablet_bootstrap.cc:492] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.273809 27257 ts_tablet_manager.cc:1403] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.075s	user 0.042s	sys 0.024s
I20260709 13:13:51.274626 27260 ts_tablet_manager.cc:1434] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:13:51.275974 27260 tablet_bootstrap.cc:492] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
W20260709 13:13:51.276186 27035 leader_election.cc:343] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.278087 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
W20260709 13:13:51.280575 27035 leader_election.cc:343] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.281112 27069 raft_consensus.cc:2468] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 1.
I20260709 13:13:51.281245 27035 leader_election.cc:304] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a; no voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:51.282627 27266 raft_consensus.cc:2749] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.282603 27259 tablet_bootstrap.cc:492] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.284691 27257 raft_consensus.cc:359] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.285769 27257 raft_consensus.cc:385] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.286211 27257 raft_consensus.cc:740] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.287262 27257 consensus_queue.cc:260] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.285280 27260 tablet_bootstrap.cc:654] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.288656 26967 catalog_manager.cc:5697] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 0 to 1, leader changed from <none> to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 1 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.294034 27257 ts_tablet_manager.cc:1434] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:13:51.295512 27257 tablet_bootstrap.cc:492] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:51.300580 27273 raft_consensus.cc:493] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.301329 27273 raft_consensus.cc:515] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.306496 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
W20260709 13:13:51.308439 27184 leader_election.cc:343] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.308815 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.309237 27273 leader_election.cc:290] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.309782 27069 raft_consensus.cc:2468] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:51.311200 27184 leader_election.cc:304] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:51.312939 27273 raft_consensus.cc:2804] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.313534 27273 raft_consensus.cc:493] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.313987 27273 raft_consensus.cc:3060] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.314733 27259 tablet_bootstrap.cc:654] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.324708 27260 tablet_bootstrap.cc:492] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.324739 27278 raft_consensus.cc:493] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.325444 27260 ts_tablet_manager.cc:1403] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.010s
I20260709 13:13:51.325529 27278 raft_consensus.cc:515] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.329064 27259 tablet_bootstrap.cc:492] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.330190 27259 ts_tablet_manager.cc:1403] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.005s
I20260709 13:13:51.329856 27260 raft_consensus.cc:359] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.331686 27260 raft_consensus.cc:385] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.332459 27278 leader_election.cc:290] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.332638 27260 raft_consensus.cc:740] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.329761 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.338922 27257 tablet_bootstrap.cc:654] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.340631 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.339395 27260 consensus_queue.cc:260] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
W20260709 13:13:51.343345 27110 leader_election.cc:343] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:51.344158 27110 leader_election.cc:343] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.344553 27260 ts_tablet_manager.cc:1434] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:13:51.344664 27110 leader_election.cc:304] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab; no voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:51.344842 27273 raft_consensus.cc:515] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.346271 27260 tablet_bootstrap.cc:492] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:51.346323 27278 raft_consensus.cc:2749] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.348658 27273 leader_election.cc:290] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.346475 27259 raft_consensus.cc:359] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.350277 27259 raft_consensus.cc:385] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.350700 27259 raft_consensus.cc:740] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.350828 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:51.351827 27144 raft_consensus.cc:3060] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.352391 27259 consensus_queue.cc:260] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.356571 27260 tablet_bootstrap.cc:654] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.356861 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:51.357607 27069 raft_consensus.cc:3060] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.366508 27259 ts_tablet_manager.cc:1434] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:13:51.371622 27257 tablet_bootstrap.cc:492] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.369045 27069 raft_consensus.cc:2468] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:51.372334 27257 ts_tablet_manager.cc:1403] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.000s
I20260709 13:13:51.374359 27184 leader_election.cc:304] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.374607 27260 tablet_bootstrap.cc:492] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.376101 27144 raft_consensus.cc:2468] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:51.376448 27260 ts_tablet_manager.cc:1403] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 13:13:51.372665 27259 tablet_bootstrap.cc:492] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.375432 27273 raft_consensus.cc:2804] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.381079 27260 raft_consensus.cc:359] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.382054 27260 raft_consensus.cc:385] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.382498 27260 raft_consensus.cc:740] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.383472 27260 consensus_queue.cc:260] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.384596 27273 raft_consensus.cc:697] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:51.385784 27273 consensus_queue.cc:237] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.387042 27260 ts_tablet_manager.cc:1434] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:13:51.388660 27266 raft_consensus.cc:493] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.389086 27259 tablet_bootstrap.cc:654] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.389372 27266 raft_consensus.cc:515] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.392186 27266 leader_election.cc:290] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.393265 27260 tablet_bootstrap.cc:492] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:51.393390 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
W20260709 13:13:51.396173 27035 leader_election.cc:343] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.390012 27257 raft_consensus.cc:359] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.399272 27257 raft_consensus.cc:385] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.399633 27257 raft_consensus.cc:740] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.400840 27257 consensus_queue.cc:260] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.403846 27257 ts_tablet_manager.cc:1434] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:13:51.405176 27257 tablet_bootstrap.cc:492] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:51.405304 27260 tablet_bootstrap.cc:654] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.416752 27257 tablet_bootstrap.cc:654] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.419895 26963 catalog_manager.cc:5697] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:51.430184 27257 tablet_bootstrap.cc:492] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.430994 27257 ts_tablet_manager.cc:1403] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.013s
I20260709 13:13:51.434674 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.434743 27257 raft_consensus.cc:359] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.435839 27257 raft_consensus.cc:385] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.436223 27257 raft_consensus.cc:740] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.437534 27257 consensus_queue.cc:260] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.437744 27278 raft_consensus.cc:493] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.439024 27278 raft_consensus.cc:515] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.440856 27257 ts_tablet_manager.cc:1434] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.003s
I20260709 13:13:51.441478 27278 leader_election.cc:290] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.443670 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619839991657438d8cb20965ae24980f" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.444028 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619839991657438d8cb20965ae24980f" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.444869 27217 raft_consensus.cc:2468] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 0.
I20260709 13:13:51.446517 27110 leader_election.cc:304] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.447517 27278 raft_consensus.cc:2804] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.447983 27278 raft_consensus.cc:493] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:51.448153 27110 leader_election.cc:343] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.448458 27278 raft_consensus.cc:3060] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.450191 27257 tablet_bootstrap.cc:492] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
W20260709 13:13:51.452046 27035 leader_election.cc:343] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.452682 27035 leader_election.cc:304] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a; no voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:51.454257 27266 raft_consensus.cc:2749] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.459182 27257 tablet_bootstrap.cc:654] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.463640 27278 raft_consensus.cc:515] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.471488 27278 leader_election.cc:290] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.473129 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619839991657438d8cb20965ae24980f" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:51.473610 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619839991657438d8cb20965ae24980f" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:51.473982 27259 tablet_bootstrap.cc:492] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.474086 27217 raft_consensus.cc:3060] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.474046 27260 tablet_bootstrap.cc:492] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.474934 27259 ts_tablet_manager.cc:1403] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.103s	user 0.038s	sys 0.041s
I20260709 13:13:51.475251 27260 ts_tablet_manager.cc:1403] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.087s	user 0.033s	sys 0.023s
W20260709 13:13:51.476765 27110 leader_election.cc:343] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.477180 27257 tablet_bootstrap.cc:492] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.477923 27257 ts_tablet_manager.cc:1403] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.018s
I20260709 13:13:51.479353 27260 raft_consensus.cc:359] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.480540 27260 raft_consensus.cc:385] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.479287 27259 raft_consensus.cc:359] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.480932 27260 raft_consensus.cc:740] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.481109 27259 raft_consensus.cc:385] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.481694 27259 raft_consensus.cc:740] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.481452 27257 raft_consensus.cc:359] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.482348 27257 raft_consensus.cc:385] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.482689 27257 raft_consensus.cc:740] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.482708 27259 consensus_queue.cc:260] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.483327 27260 consensus_queue.cc:260] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.483814 27257 consensus_queue.cc:260] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.486685 27257 ts_tablet_manager.cc:1434] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:51.487844 27257 tablet_bootstrap.cc:492] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:51.490984 27259 ts_tablet_manager.cc:1434] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:13:51.492482 27259 tablet_bootstrap.cc:492] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.496030 27257 tablet_bootstrap.cc:654] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.498323 27260 ts_tablet_manager.cc:1434] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:13:51.500819 27259 tablet_bootstrap.cc:654] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.506747 27260 tablet_bootstrap.cc:492] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:51.507079 27266 raft_consensus.cc:493] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.507973 27266 raft_consensus.cc:515] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.519341 27260 tablet_bootstrap.cc:654] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.531734 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a443d470e0b4771beccc3ce51aa29d6" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.532931 27144 raft_consensus.cc:2468] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:51.532711 27266 leader_election.cc:290] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.532943 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a443d470e0b4771beccc3ce51aa29d6" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.535567 27218 raft_consensus.cc:2468] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:51.535904 27217 raft_consensus.cc:2468] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 1.
I20260709 13:13:51.538056 27110 leader_election.cc:304] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:51.538472 27035 leader_election.cc:304] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:51.540192 27278 raft_consensus.cc:2804] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.541026 27278 raft_consensus.cc:697] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:51.541311 27266 raft_consensus.cc:2804] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.542232 27266 raft_consensus.cc:493] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.542898 27266 raft_consensus.cc:3060] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.542428 27278 consensus_queue.cc:237] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.557967 27260 tablet_bootstrap.cc:492] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.559994 27260 ts_tablet_manager.cc:1403] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.000s
I20260709 13:13:51.562608 26963 catalog_manager.cc:5697] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 0 to 1, leader changed from <none> to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 1 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.564018 27259 tablet_bootstrap.cc:492] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.564950 27259 ts_tablet_manager.cc:1403] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.041s
I20260709 13:13:51.568408 27266 raft_consensus.cc:515] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.568763 27259 raft_consensus.cc:359] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.569753 27259 raft_consensus.cc:385] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.570093 27259 raft_consensus.cc:740] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.571187 27266 leader_election.cc:290] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.564021 27257 tablet_bootstrap.cc:492] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.572113 27257 ts_tablet_manager.cc:1403] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.037s
I20260709 13:13:51.573096 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a443d470e0b4771beccc3ce51aa29d6" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:51.573937 27144 raft_consensus.cc:3060] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.575366 27257 raft_consensus.cc:359] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.576099 27257 raft_consensus.cc:385] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.570968 27259 consensus_queue.cc:260] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.573297 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a443d470e0b4771beccc3ce51aa29d6" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:51.576349 27257 raft_consensus.cc:740] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.576845 27217 raft_consensus.cc:3060] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.577440 27257 consensus_queue.cc:260] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.578761 27259 ts_tablet_manager.cc:1434] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:13:51.582779 27144 raft_consensus.cc:2468] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:51.563803 27260 raft_consensus.cc:359] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.583398 27257 ts_tablet_manager.cc:1434] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:51.583864 27260 raft_consensus.cc:385] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.584794 27257 tablet_bootstrap.cc:492] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:51.584620 27035 leader_election.cc:304] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:51.585567 27260 raft_consensus.cc:740] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.586699 27260 consensus_queue.cc:260] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.587846 27266 raft_consensus.cc:2804] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.589051 27259 tablet_bootstrap.cc:492] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.589280 27217 raft_consensus.cc:2468] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:51.591202 27260 ts_tablet_manager.cc:1434] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:13:51.592501 27257 tablet_bootstrap.cc:654] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.592703 27260 tablet_bootstrap.cc:492] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:51.599064 27259 tablet_bootstrap.cc:654] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.608453 27273 raft_consensus.cc:493] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.609485 27273 raft_consensus.cc:515] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.610292 27266 raft_consensus.cc:697] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:51.611558 27266 consensus_queue.cc:237] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.614115 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.615265 27069 raft_consensus.cc:2468] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:51.616318 27260 tablet_bootstrap.cc:654] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.617313 27184 leader_election.cc:304] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.618896 27272 raft_consensus.cc:2804] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.619441 27272 raft_consensus.cc:493] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.620505 27272 raft_consensus.cc:3060] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.621194 27273 leader_election.cc:290] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.626855 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.627812 27144 raft_consensus.cc:2468] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:51.637238 27272 raft_consensus.cc:515] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.641953 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:51.643098 27069 raft_consensus.cc:3060] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.643543 27257 tablet_bootstrap.cc:492] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:51.644215 27257 ts_tablet_manager.cc:1403] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.060s	user 0.003s	sys 0.015s
I20260709 13:13:51.639734 26967 catalog_manager.cc:5697] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.646600 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:51.647439 27144 raft_consensus.cc:3060] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.647687 27257 raft_consensus.cc:359] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.648955 27257 raft_consensus.cc:385] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.649338 27257 raft_consensus.cc:740] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.650274 27257 consensus_queue.cc:260] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.653805 27069 raft_consensus.cc:2468] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:51.657768 27272 leader_election.cc:290] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.656430 27257 ts_tablet_manager.cc:1434] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:13:51.660154 27260 tablet_bootstrap.cc:492] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.660557 27259 tablet_bootstrap.cc:492] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.660812 27260 ts_tablet_manager.cc:1403] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.010s
I20260709 13:13:51.661257 27259 ts_tablet_manager.cc:1403] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.073s	user 0.039s	sys 0.014s
I20260709 13:13:51.663071 27184 leader_election.cc:304] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.657626 27144 raft_consensus.cc:2468] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:51.664606 27259 raft_consensus.cc:359] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.665443 27259 raft_consensus.cc:385] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.665751 27259 raft_consensus.cc:740] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.666021 27260 raft_consensus.cc:359] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.666838 27260 raft_consensus.cc:385] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.667075 27260 raft_consensus.cc:740] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.666607 27259 consensus_queue.cc:260] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.667737 27260 consensus_queue.cc:260] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.668576 27272 raft_consensus.cc:2804] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.669397 27272 raft_consensus.cc:697] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:51.669508 27259 ts_tablet_manager.cc:1434] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:51.670830 27259 tablet_bootstrap.cc:492] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.670416 27272 consensus_queue.cc:237] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:51.679626 27259 tablet_bootstrap.cc:654] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.682171 27266 raft_consensus.cc:493] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.682927 27260 ts_tablet_manager.cc:1434] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:51.682824 27266 raft_consensus.cc:515] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.685212 27266 leader_election.cc:290] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.687597 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.688447 27217 raft_consensus.cc:2468] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:51.689265 27278 consensus_queue.cc:1048] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:13:51.690413 27035 leader_election.cc:304] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.693257 27266 raft_consensus.cc:2804] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.694586 27266 raft_consensus.cc:493] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.695163 27266 raft_consensus.cc:3060] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.697829 27260 tablet_bootstrap.cc:492] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:51.699759 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.700655 27144 raft_consensus.cc:2468] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:51.706598 27260 tablet_bootstrap.cc:654] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.716841 27260 tablet_bootstrap.cc:492] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:51.717437 27260 ts_tablet_manager.cc:1403] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:13:51.720615 27260 raft_consensus.cc:359] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.721490 27260 raft_consensus.cc:385] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.721859 27260 raft_consensus.cc:740] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.722930 27260 consensus_queue.cc:260] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.725529 26967 catalog_manager.cc:5697] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.731655 27266 raft_consensus.cc:515] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.735268 27301 raft_consensus.cc:493] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.736018 27301 raft_consensus.cc:515] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.738544 27301 leader_election.cc:290] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.738721 27266 leader_election.cc:290] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.740998 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619839991657438d8cb20965ae24980f" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.741307 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:51.741398 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619839991657438d8cb20965ae24980f" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.742357 27216 raft_consensus.cc:2393] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d00d1065237495b95262e0bba919c8a in current term 1: Already voted for candidate c73779539f1349b2a36d720d7c0edfab in this term.
I20260709 13:13:51.743376 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:51.744163 27144 raft_consensus.cc:3060] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.744315 27035 leader_election.cc:304] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a; no voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:51.745539 27217 raft_consensus.cc:3060] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.747737 27301 raft_consensus.cc:3060] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.758800 27259 tablet_bootstrap.cc:492] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.759652 27259 ts_tablet_manager.cc:1403] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.089s	user 0.034s	sys 0.048s
I20260709 13:13:51.758903 27278 consensus_queue.cc:1048] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:51.761368 27144 raft_consensus.cc:2468] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:51.762641 27266 raft_consensus.cc:493] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.762766 27260 ts_tablet_manager.cc:1434] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:13:51.763098 27035 leader_election.cc:304] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:51.763350 27266 raft_consensus.cc:515] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.765904 27266 leader_election.cc:290] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.766636 27266 raft_consensus.cc:2804] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.767138 27266 raft_consensus.cc:697] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:51.768110 27266 consensus_queue.cc:237] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.782307 27259 raft_consensus.cc:359] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.781636 27272 raft_consensus.cc:493] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.784222 27259 raft_consensus.cc:385] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.784636 27259 raft_consensus.cc:740] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.785615 27272 raft_consensus.cc:515] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.788321 27301 raft_consensus.cc:2749] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.789696 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a12ece97fd4bfe8854ad306d9ba252" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:51.789999 27217 raft_consensus.cc:2468] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
W20260709 13:13:51.794236 27184 leader_election.cc:343] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.794544 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.795547 27144 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:51.798452 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:51.799235 27218 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:51.800987 27272 leader_election.cc:290] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.800889 27035 leader_election.cc:304] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.799984 26967 catalog_manager.cc:5697] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.803949 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a12ece97fd4bfe8854ad306d9ba252" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:51.809440 27144 raft_consensus.cc:2468] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:51.802865 27312 raft_consensus.cc:2804] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.811106 27184 leader_election.cc:304] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:51.816097 27272 raft_consensus.cc:2804] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.809813 27259 consensus_queue.cc:260] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.811574 27312 raft_consensus.cc:493] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.819031 27259 ts_tablet_manager.cc:1434] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:13:51.819897 27272 raft_consensus.cc:493] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.820518 27272 raft_consensus.cc:3060] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.817315 27312 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.828181 27273 consensus_queue.cc:1048] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:51.829384 27259 tablet_bootstrap.cc:492] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:51.835426 27272 raft_consensus.cc:515] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.842139 27272 leader_election.cc:290] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:51.843266 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a12ece97fd4bfe8854ad306d9ba252" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:51.844005 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a12ece97fd4bfe8854ad306d9ba252" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:51.844763 27143 raft_consensus.cc:3060] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:51.845364 27184 leader_election.cc:343] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.847311 27259 tablet_bootstrap.cc:654] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.855283 27143 raft_consensus.cc:2468] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:51.856931 27184 leader_election.cc:304] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:51.859368 27273 raft_consensus.cc:2804] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.859650 27312 raft_consensus.cc:515] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.864004 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:51.864786 27144 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.864886 27272 consensus_queue.cc:1048] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:51.867645 27312 leader_election.cc:290] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:51.870170 27259 tablet_bootstrap.cc:492] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:51.871930 27273 raft_consensus.cc:697] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:51.873538 27273 consensus_queue.cc:237] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.874199 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:51.872262 27259 ts_tablet_manager.cc:1403] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.013s
I20260709 13:13:51.875494 27217 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.879848 27259 raft_consensus.cc:359] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.880795 27259 raft_consensus.cc:385] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.881101 27259 raft_consensus.cc:740] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.881914 27259 consensus_queue.cc:260] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.884588 27259 ts_tablet_manager.cc:1434] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:51.889690 27217 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:51.891650 27035 leader_election.cc:304] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:51.893301 27312 raft_consensus.cc:2804] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.894835 27312 raft_consensus.cc:697] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:51.896040 27312 consensus_queue.cc:237] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.902276 27144 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:51.911096 26963 catalog_manager.cc:5697] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.912690 26967 catalog_manager.cc:5697] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:51.961598 27278 consensus_queue.cc:1048] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:51.978020 27278 consensus_queue.cc:1048] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:51.994844 27273 raft_consensus.cc:493] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.995464 27273 raft_consensus.cc:515] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:51.997084 27312 consensus_queue.cc:1048] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.000593 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:52.001446 27143 raft_consensus.cc:2468] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:52.003217 27184 leader_election.cc:304] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:52.004595 27319 raft_consensus.cc:2804] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.005105 27319 raft_consensus.cc:493] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.005474 27319 raft_consensus.cc:3060] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.007766 27273 leader_election.cc:290] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:52.008874 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:52.009681 27069 raft_consensus.cc:2468] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:52.016445 27319 raft_consensus.cc:515] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.018085 27266 consensus_queue.cc:1048] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.019016 27319 leader_election.cc:290] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:52.020493 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:52.020618 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:52.021533 27069 raft_consensus.cc:3060] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.021618 27143 raft_consensus.cc:3060] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.033071 27143 raft_consensus.cc:2468] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:52.034852 27184 leader_election.cc:304] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:52.036044 27319 raft_consensus.cc:2804] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.037104 27319 raft_consensus.cc:697] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:52.038157 27319 consensus_queue.cc:237] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.040447 27069 raft_consensus.cc:2468] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:52.048909 26963 catalog_manager.cc:5697] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.141301 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f00f09104d28472193f45353a187e05a"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
mode: GRACEFUL
new_leader_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:40312
I20260709 13:13:52.141996 27217 raft_consensus.cc:606] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Received request to transfer leadership to TS 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:52.159250 27143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
mode: GRACEFUL
new_leader_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:40578
I20260709 13:13:52.160405 27143 raft_consensus.cc:606] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Received request to transfer leadership to TS 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:52.173851 27312 raft_consensus.cc:493] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.174597 27312 raft_consensus.cc:515] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.177059 27312 leader_election.cc:290] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:52.178637 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a12ece97fd4bfe8854ad306d9ba252" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:52.178705 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a12ece97fd4bfe8854ad306d9ba252" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:52.180157 27143 raft_consensus.cc:2393] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d00d1065237495b95262e0bba919c8a in current term 1: Already voted for candidate f03431098129496c8e4d64f56b3128b1 in this term.
I20260709 13:13:52.180158 27218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "808608154e3440369d46e51c2a4f5591"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
mode: GRACEFUL
new_leader_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40312
I20260709 13:13:52.181115 27218 raft_consensus.cc:606] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Received request to transfer leadership to TS c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:52.181613 27035 leader_election.cc:304] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a; no voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:52.182713 27312 raft_consensus.cc:3060] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.191324 27312 raft_consensus.cc:2749] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.194382 27273 consensus_queue.cc:1048] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.198823 27069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fc7af05891478d95c06041bd893937"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
mode: GRACEFUL
new_leader_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:45168
I20260709 13:13:52.198814 27273 consensus_queue.cc:1048] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.199710 27069 raft_consensus.cc:606] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Received request to transfer leadership to TS c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:52.209414 27218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
mode: GRACEFUL
new_leader_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40312
I20260709 13:13:52.210151 27218 raft_consensus.cc:606] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Received request to transfer leadership to TS c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:52.218323 27272 raft_consensus.cc:993] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1: : Instructing follower 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:52.219098 27272 raft_consensus.cc:1081] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Signalling peer 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:52.224485 27069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f00f09104d28472193f45353a187e05a"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:45160
I20260709 13:13:52.225250 27069 raft_consensus.cc:493] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.225698 27069 raft_consensus.cc:3060] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.234385 27312 consensus_queue.cc:1048] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.234596 27069 raft_consensus.cc:515] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:52.236919 27069 leader_election.cc:290] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Requested vote from peers f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:52.238026 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:52.238121 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f00f09104d28472193f45353a187e05a" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:52.238859 27217 raft_consensus.cc:3055] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:52.239333 27217 raft_consensus.cc:740] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:52.239360 27143 raft_consensus.cc:3060] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.240286 27217 consensus_queue.cc:260] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:52.241945 27217 raft_consensus.cc:3060] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.249558 27143 raft_consensus.cc:2468] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:52.251144 27035 leader_election.cc:304] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:52.251341 27217 raft_consensus.cc:2468] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:52.252158 27301 consensus_queue.cc:1048] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.252519 27266 raft_consensus.cc:2804] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:52.253924 27266 raft_consensus.cc:697] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:52.255036 27266 consensus_queue.cc:237] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } }
I20260709 13:13:52.268599 26967 catalog_manager.cc:5697] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 1 to 2, leader changed from f03431098129496c8e4d64f56b3128b1 (127.13.196.67) to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 2 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.348480 27318 consensus_queue.cc:1048] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.365437 27319 consensus_queue.cc:1048] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.371678 27283 raft_consensus.cc:993] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab: : Instructing follower 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:52.371940 27319 raft_consensus.cc:993] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1: : Instructing follower c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:52.372452 27283 raft_consensus.cc:1081] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Signalling peer 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:52.372594 27272 raft_consensus.cc:1081] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Signalling peer c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:52.375151 27068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:45154
I20260709 13:13:52.375151 27143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "808608154e3440369d46e51c2a4f5591"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40558
I20260709 13:13:52.376003 27068 raft_consensus.cc:493] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.376102 27143 raft_consensus.cc:493] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.376500 27068 raft_consensus.cc:3060] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.376638 27143 raft_consensus.cc:3060] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.386511 27143 raft_consensus.cc:515] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.387269 27068 raft_consensus.cc:515] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.389882 27068 leader_election.cc:290] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:52.391988 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:52.392279 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:52.392890 27217 raft_consensus.cc:3060] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.393157 27067 raft_consensus.cc:3060] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.393795 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b44a3612a948d6a7a782bf4732a0ac" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:52.394133 27143 leader_election.cc:290] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:52.394601 27144 raft_consensus.cc:3055] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:52.395048 27144 raft_consensus.cc:740] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:52.395999 27144 consensus_queue.cc:260] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.397591 27144 raft_consensus.cc:3060] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.398077 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "808608154e3440369d46e51c2a4f5591" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:52.398798 27218 raft_consensus.cc:3055] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:52.399142 27218 raft_consensus.cc:740] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:52.400038 27218 consensus_queue.cc:260] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.401543 27218 raft_consensus.cc:3060] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.402877 27067 raft_consensus.cc:2468] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:52.404568 27110 leader_election.cc:304] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:52.405594 27278 raft_consensus.cc:2804] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:52.406185 27278 raft_consensus.cc:697] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:52.407130 27278 consensus_queue.cc:237] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.407956 27144 raft_consensus.cc:2468] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:52.410650 27217 raft_consensus.cc:2468] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:52.413254 27035 leader_election.cc:304] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:52.414256 27266 raft_consensus.cc:2804] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:52.414832 27266 raft_consensus.cc:697] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:52.415853 27266 consensus_queue.cc:237] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.417207 26964 catalog_manager.cc:5697] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 1 to 2, leader changed from f03431098129496c8e4d64f56b3128b1 (127.13.196.67) to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 2 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.421381 27218 raft_consensus.cc:2468] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:52.427974 26967 catalog_manager.cc:5697] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 1 to 2, leader changed from c73779539f1349b2a36d720d7c0edfab (127.13.196.66) to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 2 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.429507 27312 consensus_queue.cc:1048] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.436276 27266 consensus_queue.cc:1048] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.440424 27312 raft_consensus.cc:993] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a: : Instructing follower c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:52.441313 27336 raft_consensus.cc:1081] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Signalling peer c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:52.444109 27143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fc7af05891478d95c06041bd893937"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40568
I20260709 13:13:52.445432 27143 raft_consensus.cc:493] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.445894 27143 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.455627 27143 raft_consensus.cc:515] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.457883 27143 leader_election.cc:290] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:52.458922 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:52.459741 27067 raft_consensus.cc:3055] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:52.460062 27067 raft_consensus.cc:740] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:52.459163 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:52.460649 27217 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.460963 27067 consensus_queue.cc:260] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.462401 27067 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.469966 27217 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:52.471873 27110 leader_election.cc:304] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:52.472445 27067 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:52.472972 27278 raft_consensus.cc:2804] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:52.473582 27278 raft_consensus.cc:697] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:52.474506 27278 consensus_queue.cc:237] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.484489 26965 catalog_manager.cc:5697] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 1 to 2, leader changed from 7d00d1065237495b95262e0bba919c8a (127.13.196.65) to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 2 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.602774 27319 consensus_queue.cc:1048] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.617093 27318 consensus_queue.cc:1048] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.627406 27272 raft_consensus.cc:993] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1: : Instructing follower c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:52.628048 27318 raft_consensus.cc:1081] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Signalling peer c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:52.630023 27143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40558
I20260709 13:13:52.630640 27143 raft_consensus.cc:493] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.630992 27143 raft_consensus.cc:3060] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.638320 27143 raft_consensus.cc:515] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.640827 27143 leader_election.cc:290] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:52.642572 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:52.643680 27067 raft_consensus.cc:3060] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.643554 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6bfdbfbfb54f948b54fbfe78a1dc8c" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:52.644889 27217 raft_consensus.cc:3055] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:52.645851 27217 raft_consensus.cc:740] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:52.647502 27217 consensus_queue.cc:260] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.649895 27217 raft_consensus.cc:3060] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:52.654059 27067 raft_consensus.cc:2468] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:52.655508 27110 leader_election.cc:304] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:52.656383 27278 raft_consensus.cc:2804] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:52.656898 27278 raft_consensus.cc:697] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:52.657644 27217 raft_consensus.cc:2468] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:52.657740 27278 consensus_queue.cc:237] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:52.666006 26964 catalog_manager.cc:5697] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 1 to 2, leader changed from f03431098129496c8e4d64f56b3128b1 (127.13.196.67) to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 2 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.708693 27143 raft_consensus.cc:1275] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.710569 27312 consensus_queue.cc:1048] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.721048 27217 raft_consensus.cc:1275] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.723316 27312 consensus_queue.cc:1048] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.811573 27217 raft_consensus.cc:1275] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.813413 27266 consensus_queue.cc:1048] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.827941 27143 raft_consensus.cc:1275] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.829680 27312 consensus_queue.cc:1048] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.851174 27217 raft_consensus.cc:1275] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.855235 27278 consensus_queue.cc:1048] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.866102 27067 raft_consensus.cc:1275] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.867988 27346 consensus_queue.cc:1048] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:52.895644 27067 raft_consensus.cc:1275] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.897240 27278 consensus_queue.cc:1048] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.907459 27217 raft_consensus.cc:1275] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.909325 27264 consensus_queue.cc:1048] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:53.147646 27217 raft_consensus.cc:1275] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:53.149452 27264 consensus_queue.cc:1048] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:53.160692 27067 raft_consensus.cc:1275] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:53.162699 27346 consensus_queue.cc:1048] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.257766 26965 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46852:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:55.260977 26965 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:55.326427 27057 tablet_service.cc:1511] Processing CreateTablet for tablet 09bcb2e2737a460f9a62312f5456adbf (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:55.327484 27132 tablet_service.cc:1511] Processing CreateTablet for tablet 09bcb2e2737a460f9a62312f5456adbf (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:55.329465 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bcb2e2737a460f9a62312f5456adbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.331045 27204 tablet_service.cc:1511] Processing CreateTablet for tablet 09bcb2e2737a460f9a62312f5456adbf (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:55.331432 27052 tablet_service.cc:1511] Processing CreateTablet for tablet 9132f7f30d694826b9da1b1bc2227c87 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:55.332791 27204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bcb2e2737a460f9a62312f5456adbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.334839 27057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09bcb2e2737a460f9a62312f5456adbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.336534 27133 tablet_service.cc:1511] Processing CreateTablet for tablet 9132f7f30d694826b9da1b1bc2227c87 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:55.338181 27133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9132f7f30d694826b9da1b1bc2227c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.339365 27055 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0ba611b825459292203dfcc62d2420 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:55.341534 27208 tablet_service.cc:1511] Processing CreateTablet for tablet 9132f7f30d694826b9da1b1bc2227c87 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:55.343071 27208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9132f7f30d694826b9da1b1bc2227c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.343570 27134 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0ba611b825459292203dfcc62d2420 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:55.345080 27207 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0ba611b825459292203dfcc62d2420 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:55.346515 27207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0ba611b825459292203dfcc62d2420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.345139 27134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0ba611b825459292203dfcc62d2420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.358948 27055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0ba611b825459292203dfcc62d2420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.361469 27052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9132f7f30d694826b9da1b1bc2227c87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.363857 27360 tablet_bootstrap.cc:492] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:55.364173 27056 tablet_service.cc:1511] Processing CreateTablet for tablet f7f14c2cde0f48cea7fc7de5b228de23 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:55.371467 27056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f14c2cde0f48cea7fc7de5b228de23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.373219 27360 tablet_bootstrap.cc:654] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.377509 27132 tablet_service.cc:1511] Processing CreateTablet for tablet f7f14c2cde0f48cea7fc7de5b228de23 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:55.379228 27132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f14c2cde0f48cea7fc7de5b228de23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.382992 27053 tablet_service.cc:1511] Processing CreateTablet for tablet 1149eb3177da4c79b644fd0577eb0cbc (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:55.383373 27203 tablet_service.cc:1511] Processing CreateTablet for tablet f7f14c2cde0f48cea7fc7de5b228de23 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:55.384891 27053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1149eb3177da4c79b644fd0577eb0cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.385113 27203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f14c2cde0f48cea7fc7de5b228de23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.389453 27205 tablet_service.cc:1511] Processing CreateTablet for tablet 1149eb3177da4c79b644fd0577eb0cbc (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:55.390300 27059 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7dbcf045194958991d755ef18a1647 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:55.391060 27205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1149eb3177da4c79b644fd0577eb0cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.391685 27059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7dbcf045194958991d755ef18a1647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.393422 27206 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7dbcf045194958991d755ef18a1647 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:55.394853 27206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7dbcf045194958991d755ef18a1647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.395903 27054 tablet_service.cc:1511] Processing CreateTablet for tablet 30580a1ff03b40af8476e12d12e8f23d (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:55.397419 27054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30580a1ff03b40af8476e12d12e8f23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.388209 27131 tablet_service.cc:1511] Processing CreateTablet for tablet 1149eb3177da4c79b644fd0577eb0cbc (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:55.399035 27131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1149eb3177da4c79b644fd0577eb0cbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.401206 27058 tablet_service.cc:1511] Processing CreateTablet for tablet 80019b759bcd4769bbe37daefe516690 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:55.401561 27130 tablet_service.cc:1511] Processing CreateTablet for tablet 30580a1ff03b40af8476e12d12e8f23d (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:55.401903 27051 tablet_service.cc:1511] Processing CreateTablet for tablet cf2c46bf2783453b87f53f89e4928d7e (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:55.402985 27058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80019b759bcd4769bbe37daefe516690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.404147 27051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2c46bf2783453b87f53f89e4928d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.402997 27130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30580a1ff03b40af8476e12d12e8f23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.405471 27128 tablet_service.cc:1511] Processing CreateTablet for tablet 80019b759bcd4769bbe37daefe516690 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:55.406558 27202 tablet_service.cc:1511] Processing CreateTablet for tablet 30580a1ff03b40af8476e12d12e8f23d (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:55.407114 27128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80019b759bcd4769bbe37daefe516690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.408915 27127 tablet_service.cc:1511] Processing CreateTablet for tablet cf2c46bf2783453b87f53f89e4928d7e (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:55.409382 27200 tablet_service.cc:1511] Processing CreateTablet for tablet cf2c46bf2783453b87f53f89e4928d7e (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:55.409621 27201 tablet_service.cc:1511] Processing CreateTablet for tablet 80019b759bcd4769bbe37daefe516690 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:55.408188 27202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30580a1ff03b40af8476e12d12e8f23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.410882 27127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2c46bf2783453b87f53f89e4928d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.411695 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80019b759bcd4769bbe37daefe516690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.413120 27200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2c46bf2783453b87f53f89e4928d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.397486 27129 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7dbcf045194958991d755ef18a1647 (DEFAULT_TABLE table=soft_deleted_table [id=6dea1dea03454228a3433227fce6c759]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:55.415761 27129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7dbcf045194958991d755ef18a1647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:55.530308 27362 tablet_bootstrap.cc:492] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:55.537727 27363 tablet_bootstrap.cc:492] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:55.617323 27362 tablet_bootstrap.cc:654] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.627050 27363 tablet_bootstrap.cc:654] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.627127 27360 tablet_bootstrap.cc:492] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:55.632364 27362 tablet_bootstrap.cc:492] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:55.633080 27362 ts_tablet_manager.cc:1403] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.003s
I20260709 13:13:55.628110 27360 ts_tablet_manager.cc:1403] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.265s	user 0.049s	sys 0.073s
I20260709 13:13:55.638265 27362 raft_consensus.cc:359] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.639183 27362 raft_consensus.cc:385] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.639518 27362 raft_consensus.cc:740] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.640399 27362 consensus_queue.cc:260] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.640944 27360 raft_consensus.cc:359] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.641814 27360 raft_consensus.cc:385] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.642124 27360 raft_consensus.cc:740] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.643317 27360 consensus_queue.cc:260] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.645058 27362 ts_tablet_manager.cc:1434] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:13:55.731720 27360 ts_tablet_manager.cc:1434] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.000s
I20260709 13:13:55.736622 27362 tablet_bootstrap.cc:492] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:55.744316 27360 tablet_bootstrap.cc:492] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:55.754794 27363 tablet_bootstrap.cc:492] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:55.756474 27363 ts_tablet_manager.cc:1403] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.219s	user 0.016s	sys 0.013s
I20260709 13:13:55.764106 27363 raft_consensus.cc:359] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.776031 27362 tablet_bootstrap.cc:654] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.776157 27363 raft_consensus.cc:385] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.776798 27360 tablet_bootstrap.cc:654] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.776834 27363 raft_consensus.cc:740] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.778565 27363 consensus_queue.cc:260] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.786823 27363 ts_tablet_manager.cc:1434] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.030s	user 0.012s	sys 0.003s
I20260709 13:13:55.790586 27363 tablet_bootstrap.cc:492] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:55.800961 27362 tablet_bootstrap.cc:492] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:55.801713 27362 ts_tablet_manager.cc:1403] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.010s
I20260709 13:13:55.801963 27360 tablet_bootstrap.cc:492] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:55.802701 27360 ts_tablet_manager.cc:1403] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.025s
I20260709 13:13:55.805784 27363 tablet_bootstrap.cc:654] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.806066 27362 raft_consensus.cc:359] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.807138 27362 raft_consensus.cc:385] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.807644 27362 raft_consensus.cc:740] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.807178 27360 raft_consensus.cc:359] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.808316 27360 raft_consensus.cc:385] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.808772 27360 raft_consensus.cc:740] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.808691 27362 consensus_queue.cc:260] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.810289 27360 consensus_queue.cc:260] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.817804 27362 ts_tablet_manager.cc:1434] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:13:55.820101 27362 tablet_bootstrap.cc:492] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:55.833168 27362 tablet_bootstrap.cc:654] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.835309 27360 ts_tablet_manager.cc:1434] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.015s
I20260709 13:13:55.837522 27360 tablet_bootstrap.cc:492] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:55.842859 27363 tablet_bootstrap.cc:492] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:55.843612 27363 ts_tablet_manager.cc:1403] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.019s
I20260709 13:13:55.846844 27362 tablet_bootstrap.cc:492] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:55.847929 27362 ts_tablet_manager.cc:1403] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.005s
I20260709 13:13:55.847782 27363 raft_consensus.cc:359] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.848897 27363 raft_consensus.cc:385] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.849314 27363 raft_consensus.cc:740] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.850349 27363 consensus_queue.cc:260] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.853116 27360 tablet_bootstrap.cc:654] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.854549 27363 ts_tablet_manager.cc:1434] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 13:13:55.856562 27363 tablet_bootstrap.cc:492] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:55.862800 27362 raft_consensus.cc:359] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.863786 27362 raft_consensus.cc:385] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.864132 27362 raft_consensus.cc:740] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.865332 27362 consensus_queue.cc:260] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.865947 27363 tablet_bootstrap.cc:654] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.868590 27362 ts_tablet_manager.cc:1434] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 13:13:55.881413 27362 tablet_bootstrap.cc:492] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:55.891297 27362 tablet_bootstrap.cc:654] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.894933 27360 tablet_bootstrap.cc:492] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:55.895757 27360 ts_tablet_manager.cc:1403] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.023s
I20260709 13:13:55.897454 27363 tablet_bootstrap.cc:492] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:55.898319 27363 ts_tablet_manager.cc:1403] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.019s
I20260709 13:13:55.900786 27360 raft_consensus.cc:359] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.901779 27360 raft_consensus.cc:385] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.902122 27360 raft_consensus.cc:740] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.902930 27363 raft_consensus.cc:359] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.903184 27360 consensus_queue.cc:260] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.903929 27363 raft_consensus.cc:385] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.904289 27363 raft_consensus.cc:740] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.905318 27363 consensus_queue.cc:260] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.906586 27360 ts_tablet_manager.cc:1434] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.004s
I20260709 13:13:55.908521 27360 tablet_bootstrap.cc:492] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:55.908586 27363 ts_tablet_manager.cc:1434] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:13:55.910181 27363 tablet_bootstrap.cc:492] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:55.920166 27363 tablet_bootstrap.cc:654] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.920166 27360 tablet_bootstrap.cc:654] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.920570 27371 raft_consensus.cc:493] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.921343 27371 raft_consensus.cc:515] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.926707 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:55.927848 27362 tablet_bootstrap.cc:492] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:55.928918 27362 ts_tablet_manager.cc:1403] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.005s
I20260709 13:13:55.927616 27067 raft_consensus.cc:2468] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 0.
I20260709 13:13:55.934566 27362 raft_consensus.cc:359] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.935796 27362 raft_consensus.cc:385] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.929868 27371 leader_election.cc:290] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:55.936115 27362 raft_consensus.cc:740] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.938977 27362 consensus_queue.cc:260] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.940109 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:55.942235 27360 tablet_bootstrap.cc:492] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:55.942672 27362 ts_tablet_manager.cc:1434] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:13:55.942972 27360 ts_tablet_manager.cc:1403] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.007s
I20260709 13:13:55.945358 27362 tablet_bootstrap.cc:492] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:55.945576 27110 leader_election.cc:304] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:55.946707 27371 raft_consensus.cc:2804] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:55.946940 27110 leader_election.cc:343] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.947364 27360 raft_consensus.cc:359] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.948287 27360 raft_consensus.cc:385] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.948702 27360 raft_consensus.cc:740] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.947113 27371 raft_consensus.cc:493] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.949934 27371 raft_consensus.cc:3060] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.949694 27360 consensus_queue.cc:260] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.950716 27363 tablet_bootstrap.cc:492] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:55.951721 27363 ts_tablet_manager.cc:1403] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.001s
I20260709 13:13:55.961472 27319 raft_consensus.cc:493] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.961557 27363 raft_consensus.cc:359] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.962224 27319 raft_consensus.cc:515] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.966854 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2c46bf2783453b87f53f89e4928d7e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:55.967694 27069 raft_consensus.cc:2468] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:55.969513 27184 leader_election.cc:304] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:55.974017 27319 leader_election.cc:290] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:55.975242 27319 raft_consensus.cc:2804] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.970357 27363 raft_consensus.cc:385] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.979526 27363 raft_consensus.cc:740] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.993933 27363 consensus_queue.cc:260] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:55.995869 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2c46bf2783453b87f53f89e4928d7e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:55.996297 27380 raft_consensus.cc:493] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.997010 27360 ts_tablet_manager.cc:1434] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.054s	user 0.028s	sys 0.027s
I20260709 13:13:55.996937 27380 raft_consensus.cc:515] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
W20260709 13:13:55.998523 27184 leader_election.cc:343] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.999048 27360 tablet_bootstrap.cc:492] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:55.999759 27380 leader_election.cc:290] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.001233 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.001924 27362 tablet_bootstrap.cc:654] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.976042 27319 raft_consensus.cc:493] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.016343 27360 tablet_bootstrap.cc:654] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.006981 27319 raft_consensus.cc:3060] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:56.006966 27110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.65:36665, user_credentials={real_user=slave}} blocked reactor thread for 46208.7us
I20260709 13:13:56.022395 27355 raft_consensus.cc:493] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.023514 27355 raft_consensus.cc:515] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.034953 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.034942 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.035902 27218 raft_consensus.cc:2468] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:56.036584 27355 leader_election.cc:290] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.041299 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.042565 27143 raft_consensus.cc:2468] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:56.044642 27035 leader_election.cc:304] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
W20260709 13:13:56.046532 27035 leader_election.cc:343] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.046129 27319 raft_consensus.cc:515] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
W20260709 13:13:56.048223 27184 leader_election.cc:343] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.049723 27184 leader_election.cc:304] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:56.050155 27319 leader_election.cc:290] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.051219 27380 raft_consensus.cc:2804] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.051867 27380 raft_consensus.cc:493] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.052313 27380 raft_consensus.cc:3060] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.053772 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2c46bf2783453b87f53f89e4928d7e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:56.054661 27069 raft_consensus.cc:3060] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.056633 27355 raft_consensus.cc:2804] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.059494 27355 raft_consensus.cc:493] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.060055 27355 raft_consensus.cc:3060] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.066573 27380 raft_consensus.cc:515] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.067063 27069 raft_consensus.cc:2468] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:56.070216 27380 leader_election.cc:290] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.072238 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:56.072656 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.073966 27144 raft_consensus.cc:3060] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.077210 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2c46bf2783453b87f53f89e4928d7e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.084007 27184 leader_election.cc:304] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
W20260709 13:13:56.086050 27184 leader_election.cc:343] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.086874 27382 raft_consensus.cc:2804] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.087890 27382 raft_consensus.cc:697] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:56.089147 27382 consensus_queue.cc:237] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.090387 27363 ts_tablet_manager.cc:1434] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.138s	user 0.021s	sys 0.045s
I20260709 13:13:56.083002 27371 raft_consensus.cc:515] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.092118 27363 tablet_bootstrap.cc:492] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
W20260709 13:13:56.087105 27184 leader_election.cc:343] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.095059 27379 raft_consensus.cc:493] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.100831 27379 raft_consensus.cc:515] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.102360 27363 tablet_bootstrap.cc:654] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.098506 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:56.102985 27069 raft_consensus.cc:3060] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.103776 27379 leader_election.cc:290] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.097688 27360 tablet_bootstrap.cc:492] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:56.101969 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:56.104961 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.105360 27360 ts_tablet_manager.cc:1403] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.107s	user 0.034s	sys 0.027s
I20260709 13:13:56.109163 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.110083 27360 raft_consensus.cc:359] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.111057 27360 raft_consensus.cc:385] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.111351 27360 raft_consensus.cc:740] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.093057 27371 leader_election.cc:290] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
W20260709 13:13:56.113521 27110 leader_election.cc:343] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.120934 27362 tablet_bootstrap.cc:492] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:56.121697 27362 ts_tablet_manager.cc:1403] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.177s	user 0.024s	sys 0.021s
I20260709 13:13:56.122869 27144 raft_consensus.cc:2468] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:56.112241 27360 consensus_queue.cc:260] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.125583 27069 raft_consensus.cc:2468] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 1.
W20260709 13:13:56.127820 27110 leader_election.cc:343] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:56.131407 27110 leader_election.cc:343] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.125880 27362 raft_consensus.cc:359] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.131883 27110 leader_election.cc:304] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab; no voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:56.140013 26965 catalog_manager.cc:5697] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.141712 27360 ts_tablet_manager.cc:1434] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:13:56.143558 27360 tablet_bootstrap.cc:492] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:56.129980 27355 raft_consensus.cc:515] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.148483 27355 leader_election.cc:290] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.149411 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:56.150074 27218 raft_consensus.cc:3060] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.150409 27371 raft_consensus.cc:2749] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.151911 27110 leader_election.cc:304] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: f03431098129496c8e4d64f56b3128b1
I20260709 13:13:56.148281 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.153847 27371 raft_consensus.cc:2804] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.155409 27371 raft_consensus.cc:697] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
W20260709 13:13:56.155519 27035 leader_election.cc:343] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.157275 27371 consensus_queue.cc:237] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.145294 27382 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.132635 27362 raft_consensus.cc:385] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.161386 27184 leader_election.cc:304] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:56.162564 27360 tablet_bootstrap.cc:654] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.162773 27380 raft_consensus.cc:2804] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.163239 27218 raft_consensus.cc:2468] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:56.163384 27380 raft_consensus.cc:697] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:56.164829 27380 consensus_queue.cc:237] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.165169 27035 leader_election.cc:304] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:56.163830 27382 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.161374 27362 raft_consensus.cc:740] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.168887 27382 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.170727 27355 raft_consensus.cc:2804] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.169963 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.176566 27367 raft_consensus.cc:493] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:56.178025 27015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:56.178669 27363 tablet_bootstrap.cc:492] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:56.177585 27367 raft_consensus.cc:515] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.180011 27379 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.179311 27363 ts_tablet_manager.cc:1403] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.017s
I20260709 13:13:56.180941 27379 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.172807 27355 raft_consensus.cc:697] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:56.184185 27355 consensus_queue.cc:237] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.185922 27367 leader_election.cc:290] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.186353 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.169335 27362 consensus_queue.cc:260] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.190146 27379 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
W20260709 13:13:56.191134 27184 leader_election.cc:343] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.190129 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
W20260709 13:13:56.192126 27110 leader_election.cc:343] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.192283 27143 raft_consensus.cc:2468] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:56.191015 27218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.194972 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.195865 27217 raft_consensus.cc:2468] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 0.
W20260709 13:13:56.196427 27035 leader_election.cc:343] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.198761 27110 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:56.199065 27184 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:56.200477 27382 raft_consensus.cc:2804] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.200937 27382 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.201718 27382 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.201056 27379 raft_consensus.cc:2804] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.203032 27379 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.203513 27379 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.209414 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.198783 27362 ts_tablet_manager.cc:1434] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.002s
I20260709 13:13:56.216514 27363 raft_consensus.cc:359] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.218127 27362 tablet_bootstrap.cc:492] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:56.218164 27363 raft_consensus.cc:385] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.219369 27363 raft_consensus.cc:740] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.229332 27363 consensus_queue.cc:260] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
W20260709 13:13:56.236919 27035 leader_election.cc:343] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.237718 27035 leader_election.cc:304] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a; no voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:56.240113 27363 ts_tablet_manager.cc:1434] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.058s	user 0.000s	sys 0.010s
I20260709 13:13:56.243557 27355 raft_consensus.cc:2749] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.246578 27363 tablet_bootstrap.cc:492] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:56.248533 27362 tablet_bootstrap.cc:654] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.248785 26967 catalog_manager.cc:5697] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.250463 27379 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.255321 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:56.243920 27382 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.258167 27382 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.259824 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.264453 27144 raft_consensus.cc:2393] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f03431098129496c8e4d64f56b3128b1 in current term 1: Already voted for candidate c73779539f1349b2a36d720d7c0edfab in this term.
W20260709 13:13:56.264652 27110 leader_election.cc:343] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.266482 27371 raft_consensus.cc:493] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.267167 27371 raft_consensus.cc:515] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.260702 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:56.272573 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2c46bf2783453b87f53f89e4928d7e" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
W20260709 13:13:56.272603 27184 leader_election.cc:343] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.270982 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2c46bf2783453b87f53f89e4928d7e" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.273746 27184 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:56.274425 27067 raft_consensus.cc:2393] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c73779539f1349b2a36d720d7c0edfab in current term 1: Already voted for candidate f03431098129496c8e4d64f56b3128b1 in this term.
I20260709 13:13:56.275034 27382 raft_consensus.cc:2749] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.275138 27371 leader_election.cc:290] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.277976 27360 tablet_bootstrap.cc:492] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:56.278416 27363 tablet_bootstrap.cc:654] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.278759 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:56.278774 27360 ts_tablet_manager.cc:1403] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.136s	user 0.017s	sys 0.015s
I20260709 13:13:56.279713 27217 raft_consensus.cc:2393] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c73779539f1349b2a36d720d7c0edfab in current term 1: Already voted for candidate f03431098129496c8e4d64f56b3128b1 in this term.
I20260709 13:13:56.279431 27110 leader_election.cc:304] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab; no voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:56.281668 26965 catalog_manager.cc:5697] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 0 to 1, leader changed from <none> to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 1 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.282051 27110 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab; no voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:56.284646 27371 raft_consensus.cc:3060] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.285863 27381 raft_consensus.cc:2749] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.283151 27379 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.300756 27360 raft_consensus.cc:359] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.302270 27360 raft_consensus.cc:385] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.302729 27360 raft_consensus.cc:740] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.303701 27360 consensus_queue.cc:260] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.306999 27360 ts_tablet_manager.cc:1434] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:13:56.309772 27360 tablet_bootstrap.cc:492] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:56.309860 26964 catalog_manager.cc:5697] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.307516 27371 raft_consensus.cc:2749] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.320996 27360 tablet_bootstrap.cc:654] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.329771 27362 tablet_bootstrap.cc:492] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:56.330675 27362 ts_tablet_manager.cc:1403] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.113s	user 0.026s	sys 0.020s
I20260709 13:13:56.339893 27360 tablet_bootstrap.cc:492] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:56.339901 27363 tablet_bootstrap.cc:492] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:56.335383 27362 raft_consensus.cc:359] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.340931 27362 raft_consensus.cc:385] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.340960 27360 ts_tablet_manager.cc:1403] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.009s
I20260709 13:13:56.341013 27363 ts_tablet_manager.cc:1403] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.016s
I20260709 13:13:56.341428 27362 raft_consensus.cc:740] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.342542 27362 consensus_queue.cc:260] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.344867 27363 raft_consensus.cc:359] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.345453 27362 ts_tablet_manager.cc:1434] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:13:56.345639 27363 raft_consensus.cc:385] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.346084 27363 raft_consensus.cc:740] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.346952 27362 tablet_bootstrap.cc:492] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:56.346958 27363 consensus_queue.cc:260] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.349565 27363 ts_tablet_manager.cc:1434] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:56.351197 27360 raft_consensus.cc:359] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.352116 27360 raft_consensus.cc:385] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.352494 27360 raft_consensus.cc:740] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.353402 27360 consensus_queue.cc:260] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.356256 27362 tablet_bootstrap.cc:654] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.356634 27360 ts_tablet_manager.cc:1434] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:13:56.358345 27360 tablet_bootstrap.cc:492] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:56.360136 27382 raft_consensus.cc:493] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.361486 27363 tablet_bootstrap.cc:492] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:56.361025 27382 raft_consensus.cc:515] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.365604 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
W20260709 13:13:56.370523 27184 leader_election.cc:343] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.371028 27363 tablet_bootstrap.cc:654] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.375587 27362 tablet_bootstrap.cc:492] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:56.376235 27362 ts_tablet_manager.cc:1403] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 13:13:56.380162 27382 leader_election.cc:290] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.381517 27360 tablet_bootstrap.cc:654] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.381880 27362 raft_consensus.cc:359] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.382372 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.386204 27362 raft_consensus.cc:385] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.386616 27362 raft_consensus.cc:740] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
W20260709 13:13:56.387816 27184 leader_election.cc:343] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.388520 27184 leader_election.cc:304] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:56.390784 27380 raft_consensus.cc:2749] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.392012 27363 tablet_bootstrap.cc:492] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:56.392757 27363 ts_tablet_manager.cc:1403] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.019s
I20260709 13:13:56.396597 27363 raft_consensus.cc:359] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.387537 27362 consensus_queue.cc:260] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.397831 27363 raft_consensus.cc:385] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.398370 27363 raft_consensus.cc:740] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.399937 27363 consensus_queue.cc:260] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.401073 27362 ts_tablet_manager.cc:1434] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.004s
I20260709 13:13:56.403111 27362 tablet_bootstrap.cc:492] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:56.403124 27363 ts_tablet_manager.cc:1434] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:56.404986 27363 tablet_bootstrap.cc:492] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:56.416273 27360 tablet_bootstrap.cc:492] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:56.416934 27360 ts_tablet_manager.cc:1403] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.023s
I20260709 13:13:56.416972 27362 tablet_bootstrap.cc:654] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.420861 27360 raft_consensus.cc:359] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.422597 27360 raft_consensus.cc:385] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.422996 27360 raft_consensus.cc:740] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.424119 27360 consensus_queue.cc:260] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.435127 27360 ts_tablet_manager.cc:1434] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:13:56.436558 27360 tablet_bootstrap.cc:492] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab: Bootstrap starting.
I20260709 13:13:56.437326 27363 tablet_bootstrap.cc:654] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.437379 27362 tablet_bootstrap.cc:492] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:56.438477 27362 ts_tablet_manager.cc:1403] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.007s
I20260709 13:13:56.446591 27362 raft_consensus.cc:359] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.447643 27362 raft_consensus.cc:385] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.448066 27362 raft_consensus.cc:740] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.449012 27362 consensus_queue.cc:260] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.453701 27360 tablet_bootstrap.cc:654] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.456209 27362 ts_tablet_manager.cc:1434] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:56.458302 27362 tablet_bootstrap.cc:492] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a: Bootstrap starting.
I20260709 13:13:56.459798 27355 raft_consensus.cc:493] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.460808 27355 raft_consensus.cc:515] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.462257 27363 tablet_bootstrap.cc:492] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:56.462885 27363 ts_tablet_manager.cc:1403] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.015s
I20260709 13:13:56.464244 27355 leader_election.cc:290] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.467739 27360 tablet_bootstrap.cc:492] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab: No bootstrap required, opened a new log
I20260709 13:13:56.466441 27363 raft_consensus.cc:359] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.469625 27363 raft_consensus.cc:385] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.469813 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f14c2cde0f48cea7fc7de5b228de23" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.470255 27363 raft_consensus.cc:740] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.469832 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f14c2cde0f48cea7fc7de5b228de23" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.470861 27217 raft_consensus.cc:2468] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:56.471197 27144 raft_consensus.cc:2468] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:56.471560 27363 consensus_queue.cc:260] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.472834 27035 leader_election.cc:304] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:56.474905 27355 raft_consensus.cc:2804] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.475404 27355 raft_consensus.cc:493] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.476111 27355 raft_consensus.cc:3060] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.469668 27360 ts_tablet_manager.cc:1403] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.012s
I20260709 13:13:56.478199 27363 ts_tablet_manager.cc:1434] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:13:56.479966 27363 tablet_bootstrap.cc:492] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: Bootstrap starting.
I20260709 13:13:56.481932 27360 raft_consensus.cc:359] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.482808 27360 raft_consensus.cc:385] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.483116 27360 raft_consensus.cc:740] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.484006 27360 consensus_queue.cc:260] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.486599 27360 ts_tablet_manager.cc:1434] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:56.487884 27362 tablet_bootstrap.cc:654] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.491326 27363 tablet_bootstrap.cc:654] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.487794 27355 raft_consensus.cc:515] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.496065 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f14c2cde0f48cea7fc7de5b228de23" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.497002 27144 raft_consensus.cc:3060] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.499125 27355 leader_election.cc:290] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.501371 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f14c2cde0f48cea7fc7de5b228de23" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:56.508739 27217 raft_consensus.cc:3060] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.513741 27363 tablet_bootstrap.cc:492] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: No bootstrap required, opened a new log
I20260709 13:13:56.514489 27363 ts_tablet_manager.cc:1403] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.019s
I20260709 13:13:56.515341 27144 raft_consensus.cc:2468] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:56.517030 27035 leader_election.cc:304] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:56.518433 27363 raft_consensus.cc:359] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.518999 27301 raft_consensus.cc:2804] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.519296 27363 raft_consensus.cc:385] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.519639 27301 raft_consensus.cc:697] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:56.519708 27363 raft_consensus.cc:740] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.520785 27301 consensus_queue.cc:237] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.520920 27363 consensus_queue.cc:260] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.523447 27363 ts_tablet_manager.cc:1434] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:56.527427 27217 raft_consensus.cc:2468] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:56.531121 27362 tablet_bootstrap.cc:492] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a: No bootstrap required, opened a new log
I20260709 13:13:56.531893 27362 ts_tablet_manager.cc:1403] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.015s
I20260709 13:13:56.532656 26964 catalog_manager.cc:5697] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.535190 27362 raft_consensus.cc:359] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.536046 27362 raft_consensus.cc:385] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.536234 27362 raft_consensus.cc:740] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.537063 27362 consensus_queue.cc:260] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.540016 27362 ts_tablet_manager.cc:1434] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:56.602353 27382 raft_consensus.cc:493] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.602975 27382 raft_consensus.cc:515] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.605470 27382 leader_election.cc:290] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.606513 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.606812 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.607498 27067 raft_consensus.cc:2393] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f03431098129496c8e4d64f56b3128b1 in current term 1: Already voted for candidate c73779539f1349b2a36d720d7c0edfab in this term.
I20260709 13:13:56.608798 27184 leader_election.cc:304] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:56.609635 27382 raft_consensus.cc:3060] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.616508 27382 raft_consensus.cc:2749] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.646407 27301 raft_consensus.cc:493] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.647185 27301 raft_consensus.cc:515] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.649009 27382 consensus_queue.cc:1048] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.649796 27301 leader_election.cc:290] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.650583 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.651546 27144 raft_consensus.cc:2393] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d00d1065237495b95262e0bba919c8a in current term 1: Already voted for candidate f03431098129496c8e4d64f56b3128b1 in this term.
I20260709 13:13:56.652427 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.652490 27355 consensus_queue.cc:1048] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.654841 27144 raft_consensus.cc:3060] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.655705 27035 leader_election.cc:304] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a; no voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:56.657181 27301 raft_consensus.cc:3060] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.667539 27355 consensus_queue.cc:1048] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.670931 27301 raft_consensus.cc:2749] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.701182 27319 raft_consensus.cc:493] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.702104 27319 raft_consensus.cc:515] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.704767 27301 raft_consensus.cc:493] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.705464 27301 raft_consensus.cc:515] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.709805 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.708055 27301 leader_election.cc:290] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.710184 27319 leader_election.cc:290] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.710807 27143 raft_consensus.cc:2468] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:56.713606 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.714386 27216 raft_consensus.cc:2468] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 0.
I20260709 13:13:56.714365 27319 consensus_queue.cc:1048] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.715358 27371 consensus_queue.cc:1048] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.716276 27319 consensus_queue.cc:1048] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.716907 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.717384 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.717695 27067 raft_consensus.cc:2468] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:56.718472 27143 raft_consensus.cc:2468] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:56.721616 27379 consensus_queue.cc:1048] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.748489 27184 leader_election.cc:304] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:56.732127 27035 leader_election.cc:304] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:56.767261 27319 raft_consensus.cc:2804] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.773350 27319 raft_consensus.cc:493] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.773830 27319 raft_consensus.cc:3060] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.772091 27367 raft_consensus.cc:2804] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.777662 27367 raft_consensus.cc:493] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.778100 27367 raft_consensus.cc:3060] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.801901 27382 raft_consensus.cc:493] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.802668 27382 raft_consensus.cc:515] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.811292 27420 consensus_queue.cc:1048] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.834072 27382 leader_election.cc:290] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.848661 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:56.849545 27067 raft_consensus.cc:2468] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:56.852761 27319 raft_consensus.cc:515] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.858976 27143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.859814 27319 leader_election.cc:290] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.860046 27143 raft_consensus.cc:2468] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 0.
I20260709 13:13:56.864073 27184 leader_election.cc:304] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:56.865209 27420 raft_consensus.cc:2804] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.865748 27420 raft_consensus.cc:493] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.866837 27420 raft_consensus.cc:3060] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.874293 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:56.875788 27067 raft_consensus.cc:3060] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.889931 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.884076 27367 raft_consensus.cc:515] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.890090 27067 raft_consensus.cc:2468] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:56.878496 27420 raft_consensus.cc:515] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.891974 27184 leader_election.cc:304] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:56.893285 27319 raft_consensus.cc:2804] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.893831 27319 raft_consensus.cc:697] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:56.894237 27420 leader_election.cc:290] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:56.891060 27144 raft_consensus.cc:3060] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.894898 27319 consensus_queue.cc:237] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.895991 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:56.899186 27216 raft_consensus.cc:3060] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.893694 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.901930 27142 raft_consensus.cc:3060] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.910991 27144 raft_consensus.cc:2468] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:56.922281 27216 raft_consensus.cc:2468] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:56.922789 27142 raft_consensus.cc:2468] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 1.
I20260709 13:13:56.895332 27367 leader_election.cc:290] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.897809 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:56.924908 27068 raft_consensus.cc:3060] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.898366 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:56.929347 27141 raft_consensus.cc:3060] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.929749 27035 leader_election.cc:304] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:56.930754 27367 raft_consensus.cc:2804] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.931371 27367 raft_consensus.cc:697] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:56.932452 27367 consensus_queue.cc:237] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.938733 27068 raft_consensus.cc:2468] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:56.940587 27184 leader_election.cc:304] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:56.941568 27319 raft_consensus.cc:2804] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.942111 27319 raft_consensus.cc:697] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:56.942211 27416 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.942858 27416 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.942649 26964 catalog_manager.cc:5697] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.943246 27319 consensus_queue.cc:237] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:56.943468 27141 raft_consensus.cc:2468] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:56.948925 27416 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:56.954137 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03431098129496c8e4d64f56b3128b1" is_pre_election: true
I20260709 13:13:56.955273 27217 raft_consensus.cc:2393] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d00d1065237495b95262e0bba919c8a in current term 1: Already voted for candidate f03431098129496c8e4d64f56b3128b1 in this term.
I20260709 13:13:56.960029 26963 catalog_manager.cc:5697] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 1 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.961376 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:56.962322 27141 raft_consensus.cc:2393] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d00d1065237495b95262e0bba919c8a in current term 1: Already voted for candidate c73779539f1349b2a36d720d7c0edfab in this term.
I20260709 13:13:56.964088 27035 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a; no voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1
I20260709 13:13:56.965108 27416 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.972342 26964 catalog_manager.cc:5697] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 1 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.979303 27416 raft_consensus.cc:2749] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.091033 27367 consensus_queue.cc:1048] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.107939 27355 consensus_queue.cc:1048] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:57.185209 27015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:57.322880 27416 consensus_queue.cc:1048] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.336939 27355 consensus_queue.cc:1048] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.341899 27419 consensus_queue.cc:1048] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.370541 27319 consensus_queue.cc:1048] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.432523 27319 consensus_queue.cc:1048] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.447177 27319 consensus_queue.cc:1048] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.068125 27319 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.068857 27319 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.071482 27319 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:58.072628 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a" is_pre_election: true
I20260709 13:13:58.072628 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab" is_pre_election: true
I20260709 13:13:58.074106 27068 raft_consensus.cc:2468] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:58.074106 27142 raft_consensus.cc:2468] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 1.
I20260709 13:13:58.076086 27184 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:58.076960 27319 raft_consensus.cc:2804] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:58.077564 27319 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.078192 27319 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.085274 27319 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.087479 27319 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:13:58.088733 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:58.088624 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:58.089761 27142 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.089761 27068 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.099476 27068 raft_consensus.cc:2468] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 2.
I20260709 13:13:58.099476 27142 raft_consensus.cc:2468] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 2.
I20260709 13:13:58.101437 27184 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:58.102524 27319 raft_consensus.cc:2804] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.103200 27319 raft_consensus.cc:697] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:58.104056 27319 consensus_queue.cc:237] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.113240 26964 catalog_manager.cc:5697] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 0 to 2, leader changed from <none> to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:58.238236 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
mode: GRACEFUL
new_leader_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:40312
I20260709 13:13:58.238977 27217 raft_consensus.cc:606] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Received request to transfer leadership to TS 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:58.246706 27142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
mode: GRACEFUL
new_leader_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:40578
I20260709 13:13:58.247383 27142 raft_consensus.cc:606] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Received request to transfer leadership to TS 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:58.254230 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
mode: GRACEFUL
new_leader_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:40312
I20260709 13:13:58.254907 27217 raft_consensus.cc:606] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Received request to transfer leadership to TS 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:58.264766 27068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
mode: GRACEFUL
new_leader_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:45168
I20260709 13:13:58.265388 27068 raft_consensus.cc:606] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Received request to transfer leadership to TS c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:58.271910 27068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
mode: GRACEFUL
new_leader_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:45168
I20260709 13:13:58.272573 27068 raft_consensus.cc:606] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Received request to transfer leadership to TS c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:58.279112 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
mode: GRACEFUL
new_leader_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40312
I20260709 13:13:58.279922 27217 raft_consensus.cc:606] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Received request to transfer leadership to TS c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:58.286278 27435 raft_consensus.cc:993] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: : Instructing follower 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:58.286953 27319 raft_consensus.cc:1081] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Signalling peer 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:58.287110 27217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80019b759bcd4769bbe37daefe516690"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
mode: GRACEFUL
new_leader_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40312
I20260709 13:13:58.287859 27217 raft_consensus.cc:606] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 LEADER]: Received request to transfer leadership to TS c73779539f1349b2a36d720d7c0edfab
I20260709 13:13:58.289201 27068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:45160
I20260709 13:13:58.290102 27068 raft_consensus.cc:493] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.290544 27068 raft_consensus.cc:3060] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.298085 27068 raft_consensus.cc:515] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.300792 27068 leader_election.cc:290] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:58.302028 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:58.301964 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0ba611b825459292203dfcc62d2420" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:58.303052 27217 raft_consensus.cc:3055] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.303066 27142 raft_consensus.cc:3060] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.303560 27217 raft_consensus.cc:740] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:58.304723 27217 consensus_queue.cc:260] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.306275 27217 raft_consensus.cc:3060] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.313966 27142 raft_consensus.cc:2468] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:58.315436 27217 raft_consensus.cc:2468] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:58.315645 27035 leader_election.cc:304] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:58.316722 27301 raft_consensus.cc:2804] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.317328 27301 raft_consensus.cc:697] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:58.318303 27301 consensus_queue.cc:237] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.329087 26964 catalog_manager.cc:5697] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 1 to 2, leader changed from f03431098129496c8e4d64f56b3128b1 (127.13.196.67) to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 2 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.435454 27379 raft_consensus.cc:993] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: : Instructing follower 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:58.436142 27445 raft_consensus.cc:1081] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Signalling peer 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:58.438162 27068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:45154
I20260709 13:13:58.438901 27068 raft_consensus.cc:493] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.439289 27068 raft_consensus.cc:3060] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.447956 27068 raft_consensus.cc:515] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.450194 27068 leader_election.cc:290] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:58.451263 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:58.451651 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9132f7f30d694826b9da1b1bc2227c87" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:58.452105 27142 raft_consensus.cc:3055] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.452338 27217 raft_consensus.cc:3060] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.452666 27142 raft_consensus.cc:740] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:58.454393 27142 consensus_queue.cc:260] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.455809 27142 raft_consensus.cc:3060] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.460014 27217 raft_consensus.cc:2468] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:58.461723 27035 leader_election.cc:304] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:58.462714 27301 raft_consensus.cc:2804] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.463292 27142 raft_consensus.cc:2468] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:58.463569 27301 raft_consensus.cc:697] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:58.464794 27301 consensus_queue.cc:237] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.467398 27355 raft_consensus.cc:993] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: : Instructing follower c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.468086 27355 raft_consensus.cc:1081] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Signalling peer c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.470357 27141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40568
I20260709 13:13:58.470989 27141 raft_consensus.cc:493] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.471387 27141 raft_consensus.cc:3060] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.483953 27141 raft_consensus.cc:515] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.486920 27435 raft_consensus.cc:993] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: : Instructing follower c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.487120 27141 leader_election.cc:290] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:58.487982 27436 raft_consensus.cc:1081] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Signalling peer c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.488837 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:58.489437 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7dbcf045194958991d755ef18a1647" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:58.489615 27217 raft_consensus.cc:3060] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.490442 27068 raft_consensus.cc:3055] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.490836 27068 raft_consensus.cc:740] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:58.491735 27068 consensus_queue.cc:260] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.492692 27141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40558
I20260709 13:13:58.493448 27141 raft_consensus.cc:493] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.493558 27068 raft_consensus.cc:3060] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.493974 27141 raft_consensus.cc:3060] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.498852 27217 raft_consensus.cc:2468] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:58.498034 26964 catalog_manager.cc:5697] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 1 to 2, leader changed from c73779539f1349b2a36d720d7c0edfab (127.13.196.66) to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 2 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.500404 27110 leader_election.cc:304] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:58.501470 27445 raft_consensus.cc:2804] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.502002 27445 raft_consensus.cc:697] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:58.503153 27445 consensus_queue.cc:237] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.504695 27068 raft_consensus.cc:2468] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:58.508558 27141 raft_consensus.cc:515] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.511536 27141 leader_election.cc:290] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:58.513895 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:58.514911 27068 raft_consensus.cc:3060] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.515285 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30580a1ff03b40af8476e12d12e8f23d" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:58.515995 27217 raft_consensus.cc:3055] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.516299 27217 raft_consensus.cc:740] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:58.517181 27217 consensus_queue.cc:260] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.518373 27217 raft_consensus.cc:3060] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.517900 26964 catalog_manager.cc:5697] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 1 to 2, leader changed from 7d00d1065237495b95262e0bba919c8a (127.13.196.65) to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 2 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.525854 27068 raft_consensus.cc:2468] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:58.527590 27110 leader_election.cc:304] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, c73779539f1349b2a36d720d7c0edfab; no voters: 
I20260709 13:13:58.527638 27217 raft_consensus.cc:2468] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:58.528782 27445 raft_consensus.cc:2804] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.529631 27445 raft_consensus.cc:697] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:58.530643 27445 consensus_queue.cc:237] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.534795 27141 raft_consensus.cc:1275] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Refusing update from remote peer f03431098129496c8e4d64f56b3128b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:58.536836 27319 consensus_queue.cc:1048] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.540884 26964 catalog_manager.cc:5697] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 1 to 2, leader changed from f03431098129496c8e4d64f56b3128b1 (127.13.196.67) to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 2 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.545475 27435 raft_consensus.cc:993] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: : Instructing follower c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.546542 27319 raft_consensus.cc:1081] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 LEADER]: Signalling peer c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.548595 27142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80019b759bcd4769bbe37daefe516690"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40558
I20260709 13:13:58.555982 27142 raft_consensus.cc:493] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.556649 27142 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.561138 27067 raft_consensus.cc:1275] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer f03431098129496c8e4d64f56b3128b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:58.563505 27436 consensus_queue.cc:1048] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:58.566236 27436 raft_consensus.cc:993] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: : Instructing follower 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:58.566839 27435 raft_consensus.cc:1081] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Signalling peer 7d00d1065237495b95262e0bba919c8a to start an election
I20260709 13:13:58.566131 27142 raft_consensus.cc:515] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.569203 27068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
 from {username='slave'} at 127.0.0.1:45160
I20260709 13:13:58.569983 27068 raft_consensus.cc:493] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.570432 27068 raft_consensus.cc:3060] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.571792 27142 leader_election.cc:290] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 3 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:58.573179 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:58.573851 27217 raft_consensus.cc:3055] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:58.574131 27217 raft_consensus.cc:740] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:58.574923 27217 consensus_queue.cc:260] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.576234 27217 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.579073 27069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80019b759bcd4769bbe37daefe516690" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:58.580047 27068 raft_consensus.cc:515] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.582587 27068 leader_election.cc:290] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Requested vote from peers c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:58.584592 27216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:58.585305 27216 raft_consensus.cc:3055] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.585651 27216 raft_consensus.cc:740] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:13:58.586529 27216 consensus_queue.cc:260] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.587934 27216 raft_consensus.cc:3060] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.592900 27142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09bcb2e2737a460f9a62312f5456adbf" candidate_uuid: "7d00d1065237495b95262e0bba919c8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:13:58.593804 27142 raft_consensus.cc:3060] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.597031 27216 raft_consensus.cc:2468] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:58.599483 27035 leader_election.cc:304] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:58.600666 27301 raft_consensus.cc:2804] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.601254 27301 raft_consensus.cc:697] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Becoming Leader. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:58.602322 27301 consensus_queue.cc:237] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.602339 27217 raft_consensus.cc:2468] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 3.
I20260709 13:13:58.604252 27142 raft_consensus.cc:2468] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d00d1065237495b95262e0bba919c8a in term 2.
I20260709 13:13:58.605717 27110 leader_election.cc:304] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 7d00d1065237495b95262e0bba919c8a
I20260709 13:13:58.607264 27445 raft_consensus.cc:2804] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:58.607856 27445 raft_consensus.cc:697] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 3 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:58.608815 27445 consensus_queue.cc:237] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.620221 26964 catalog_manager.cc:5697] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 2 to 3, leader changed from f03431098129496c8e4d64f56b3128b1 (127.13.196.67) to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 3 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.631319 26967 catalog_manager.cc:5697] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a reported cstate change: term changed from 1 to 2, leader changed from f03431098129496c8e4d64f56b3128b1 (127.13.196.67) to 7d00d1065237495b95262e0bba919c8a (127.13.196.65). New cstate: current_term: 2 leader_uuid: "7d00d1065237495b95262e0bba919c8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.726982 27355 raft_consensus.cc:993] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: : Instructing follower c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.727558 27301 raft_consensus.cc:1081] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Signalling peer c73779539f1349b2a36d720d7c0edfab to start an election
I20260709 13:13:58.729518 27142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
 from {username='slave'} at 127.0.0.1:40568
I20260709 13:13:58.730108 27142 raft_consensus.cc:493] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.730492 27142 raft_consensus.cc:3060] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.737862 27142 raft_consensus.cc:515] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.739889 27142 leader_election.cc:290] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), f03431098129496c8e4d64f56b3128b1 (127.13.196.67:38645)
I20260709 13:13:58.741031 27067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:13:58.741199 27217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1149eb3177da4c79b644fd0577eb0cbc" candidate_uuid: "c73779539f1349b2a36d720d7c0edfab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03431098129496c8e4d64f56b3128b1"
I20260709 13:13:58.741860 27067 raft_consensus.cc:3055] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.741925 27217 raft_consensus.cc:3060] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.742268 27067 raft_consensus.cc:740] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:13:58.743577 27067 consensus_queue.cc:260] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.744881 27067 raft_consensus.cc:3060] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.748643 27217 raft_consensus.cc:2468] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:58.750180 27110 leader_election.cc:304] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:13:58.751068 27445 raft_consensus.cc:2804] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.751546 27445 raft_consensus.cc:697] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Becoming Leader. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:13:58.751945 27067 raft_consensus.cc:2468] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c73779539f1349b2a36d720d7c0edfab in term 2.
I20260709 13:13:58.752406 27445 consensus_queue.cc:237] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:13:58.762022 26967 catalog_manager.cc:5697] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab reported cstate change: term changed from 1 to 2, leader changed from 7d00d1065237495b95262e0bba919c8a (127.13.196.65) to c73779539f1349b2a36d720d7c0edfab (127.13.196.66). New cstate: current_term: 2 leader_uuid: "c73779539f1349b2a36d720d7c0edfab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.824143 27142 raft_consensus.cc:1275] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.825873 27301 consensus_queue.cc:1048] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.839825 27217 raft_consensus.cc:1275] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.841799 27446 consensus_queue.cc:1048] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:58.853242 27142 raft_consensus.cc:1275] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.855048 27446 consensus_queue.cc:1048] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.871585 27217 raft_consensus.cc:1275] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.874553 27355 consensus_queue.cc:1048] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:58.914801 27067 raft_consensus.cc:1275] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.916456 27379 consensus_queue.cc:1048] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:58.928750 27217 raft_consensus.cc:1275] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.931545 27462 consensus_queue.cc:1048] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:58.944233 27216 raft_consensus.cc:1275] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.945808 27445 consensus_queue.cc:1048] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.957944 27067 raft_consensus.cc:1275] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.960631 27462 consensus_queue.cc:1048] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.997798 27216 raft_consensus.cc:1275] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.999864 27355 consensus_queue.cc:1048] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:59.011253 27141 raft_consensus.cc:1275] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Refusing update from remote peer 7d00d1065237495b95262e0bba919c8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:59.013062 27367 consensus_queue.cc:1048] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:59.018899 27067 raft_consensus.cc:3060] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:59.029911 27067 raft_consensus.cc:1275] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 3 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:59.031981 27462 consensus_queue.cc:1048] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:59.042140 27216 raft_consensus.cc:1275] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 3 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:59.045351 27445 consensus_queue.cc:1048] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:59.268853 27217 raft_consensus.cc:1275] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:59.270877 27462 consensus_queue.cc:1048] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:59.272595 27067 raft_consensus.cc:1275] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer c73779539f1349b2a36d720d7c0edfab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:59.274206 27462 consensus_queue.cc:1048] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.295761 26963 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46852:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:01.323246 26963 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46852:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:01.360080 14097 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:01.555783 27496 log.cc:927] Time spent T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:14:01.658003 27515 tablet.cc:1724] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:01.658078 27491 log.cc:927] Time spent T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 13:14:01.694482 27512 log.cc:927] Time spent T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:14:01.810103 27539 tablet.cc:1724] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.782610 27529 tablet.cc:1724] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.801236 27144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3fc7af05891478d95c06041bd893937"
dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
mode: GRACEFUL
new_leader_uuid: "f03431098129496c8e4d64f56b3128b1"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:14:01.818276 27144 raft_consensus.cc:606] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Received request to transfer leadership to TS f03431098129496c8e4d64f56b3128b1
I20260709 13:14:01.817777 27538 tablet.cc:1724] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.835626 27535 tablet.cc:1724] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.842168 27537 tablet.cc:1724] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.848166 27542 tablet.cc:1724] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.825798 27540 tablet.cc:1724] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:01.857092 27035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.196.66:35673, user_credentials={real_user=slave}} blocked reactor thread for 228593us
I20260709 13:14:01.855760 27543 tablet.cc:1724] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.880545 27541 tablet.cc:1724] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.916610 27544 tablet.cc:1724] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.956988 27546 tablet.cc:1724] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.969007 27515 tablet.cc:1724] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.975538 27540 tablet.cc:1724] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.986117 27543 tablet.cc:1724] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.989102 27541 tablet.cc:1724] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.989490 27538 tablet.cc:1724] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.000427 27539 tablet.cc:1724] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:01.951829 27529 tablet.cc:1724] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.029903 27535 tablet.cc:1724] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.037566 27515 tablet.cc:1724] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.040766 27538 tablet.cc:1724] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.042491 27544 tablet.cc:1724] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.068909 27537 tablet.cc:1724] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.079989 27529 tablet.cc:1724] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.084262 27539 tablet.cc:1724] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.101686 27068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e"
dest_uuid: "7d00d1065237495b95262e0bba919c8a"
mode: GRACEFUL
new_leader_uuid: "f03431098129496c8e4d64f56b3128b1"
 from {username='slave'} at 127.0.0.1:57746
I20260709 13:14:02.102548 27068 raft_consensus.cc:606] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Received request to transfer leadership to TS f03431098129496c8e4d64f56b3128b1
I20260709 13:14:02.104848 14097 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:02.105712 14097 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:02.107776 27535 tablet.cc:1724] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:02.130769 27462 raft_consensus.cc:993] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab: : Instructing follower f03431098129496c8e4d64f56b3128b1 to start an election
I20260709 13:14:02.131440 27462 raft_consensus.cc:1081] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Signalling peer f03431098129496c8e4d64f56b3128b1 to start an election
I20260709 13:14:02.133754 27216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3fc7af05891478d95c06041bd893937"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
 from {username='slave'} at 127.0.0.1:40290
I20260709 13:14:02.134642 27216 raft_consensus.cc:493] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:02.135105 27216 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.143525 27216 raft_consensus.cc:515] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:14:02.147996 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:14:02.149065 27068 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.155277 26964 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51: soft_deleted_table [id=6dea1dea03454228a3433227fce6c759] alter complete (version 1)
I20260709 13:14:02.169170 27216 leader_election.cc:290] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 3 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:14:02.172976 27068 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 3.
I20260709 13:14:02.176879 27184 leader_election.cc:304] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d00d1065237495b95262e0bba919c8a, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:14:02.178000 27521 raft_consensus.cc:2804] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:02.178596 27521 raft_consensus.cc:697] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 3 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:14:02.178797 27141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3fc7af05891478d95c06041bd893937" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:14:02.179705 27521 consensus_queue.cc:237] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:14:02.180145 27141 raft_consensus.cc:3055] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:02.181803 27141 raft_consensus.cc:740] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c73779539f1349b2a36d720d7c0edfab, State: Running, Role: LEADER
I20260709 13:14:02.183080 27141 consensus_queue.cc:260] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:14:02.185235 27141 raft_consensus.cc:3060] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.198918 27141 raft_consensus.cc:2468] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 3.
I20260709 13:14:02.206806 26967 catalog_manager.cc:5697] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 2 to 3, leader changed from c73779539f1349b2a36d720d7c0edfab (127.13.196.66) to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 3 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:02.503535 27514 raft_consensus.cc:993] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a: : Instructing follower f03431098129496c8e4d64f56b3128b1 to start an election
I20260709 13:14:02.504439 27471 raft_consensus.cc:1081] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Signalling peer f03431098129496c8e4d64f56b3128b1 to start an election
I20260709 13:14:02.506832 27216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e"
dest_uuid: "f03431098129496c8e4d64f56b3128b1"
 from {username='slave'} at 127.0.0.1:40302
I20260709 13:14:02.507586 27216 raft_consensus.cc:493] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:02.508037 27216 raft_consensus.cc:3060] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.514832 27216 raft_consensus.cc:515] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:14:02.517187 27216 leader_election.cc:290] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665), c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673)
I20260709 13:14:02.518039 27068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d00d1065237495b95262e0bba919c8a"
I20260709 13:14:02.518361 27144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe691b26661c42a59f4e6e46a96b989e" candidate_uuid: "f03431098129496c8e4d64f56b3128b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c73779539f1349b2a36d720d7c0edfab"
I20260709 13:14:02.518901 27068 raft_consensus.cc:3055] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:02.519075 27144 raft_consensus.cc:3060] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.519274 27068 raft_consensus.cc:740] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d00d1065237495b95262e0bba919c8a, State: Running, Role: LEADER
I20260709 13:14:02.520197 27068 consensus_queue.cc:260] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:14:02.521287 27068 raft_consensus.cc:3060] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.526464 27144 raft_consensus.cc:2468] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 2.
I20260709 13:14:02.527137 27068 raft_consensus.cc:2468] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03431098129496c8e4d64f56b3128b1 in term 2.
I20260709 13:14:02.528558 27184 leader_election.cc:304] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c73779539f1349b2a36d720d7c0edfab, f03431098129496c8e4d64f56b3128b1; no voters: 
I20260709 13:14:02.529577 27521 raft_consensus.cc:2804] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:02.530285 27521 raft_consensus.cc:697] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 2 LEADER]: Becoming Leader. State: Replica: f03431098129496c8e4d64f56b3128b1, State: Running, Role: LEADER
I20260709 13:14:02.531180 27521 consensus_queue.cc:237] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } }
I20260709 13:14:02.541042 26967 catalog_manager.cc:5697] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 reported cstate change: term changed from 1 to 2, leader changed from 7d00d1065237495b95262e0bba919c8a (127.13.196.65) to f03431098129496c8e4d64f56b3128b1 (127.13.196.67). New cstate: current_term: 2 leader_uuid: "f03431098129496c8e4d64f56b3128b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03431098129496c8e4d64f56b3128b1" member_type: VOTER last_known_addr { host: "127.13.196.67" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:02.630606 27068 raft_consensus.cc:1275] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 3 FOLLOWER]: Refusing update from remote peer f03431098129496c8e4d64f56b3128b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:02.632251 27521 consensus_queue.cc:1048] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:02.647059 27144 raft_consensus.cc:1275] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 3 FOLLOWER]: Refusing update from remote peer f03431098129496c8e4d64f56b3128b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:02.650261 27521 consensus_queue.cc:1048] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:03.043807 27144 raft_consensus.cc:1275] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Refusing update from remote peer f03431098129496c8e4d64f56b3128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.045620 27521 consensus_queue.cc:1048] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c73779539f1349b2a36d720d7c0edfab" member_type: VOTER last_known_addr { host: "127.13.196.66" port: 35673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.059258 27068 raft_consensus.cc:1275] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Refusing update from remote peer f03431098129496c8e4d64f56b3128b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.061123 27521 consensus_queue.cc:1048] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d00d1065237495b95262e0bba919c8a" member_type: VOTER last_known_addr { host: "127.13.196.65" port: 36665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:03.191169 14097 tablet_server.cc:179] TabletServer@127.13.196.65:0 shutting down...
W20260709 13:14:03.209682 27110 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 13:14:03.227836 27110 consensus_peers.cc:597] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:03.234874 27110 consensus_peers.cc:597] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.251268 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:03.252398 14097 tablet_replica.cc:333] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.253626 14097 raft_consensus.cc:2243] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.254247 14097 raft_consensus.cc:2272] T 0d7dbcf045194958991d755ef18a1647 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.256858 14097 tablet_replica.cc:333] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.258013 14097 raft_consensus.cc:2243] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.259119 14097 raft_consensus.cc:2272] T 1f0ba611b825459292203dfcc62d2420 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.261900 14097 tablet_replica.cc:333] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.262658 14097 raft_consensus.cc:2243] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.263689 14097 raft_consensus.cc:2272] T f7f14c2cde0f48cea7fc7de5b228de23 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.266649 14097 tablet_replica.cc:333] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.267598 14097 raft_consensus.cc:2243] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.268265 14097 raft_consensus.cc:2272] T 30580a1ff03b40af8476e12d12e8f23d P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.270715 14097 tablet_replica.cc:333] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.271564 14097 raft_consensus.cc:2243] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.272760 14097 raft_consensus.cc:2272] T 808608154e3440369d46e51c2a4f5591 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.277105 14097 tablet_replica.cc:333] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.277972 14097 raft_consensus.cc:2243] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.279237 14097 raft_consensus.cc:2272] T 9132f7f30d694826b9da1b1bc2227c87 P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.281683 14097 tablet_replica.cc:333] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.282430 14097 raft_consensus.cc:2243] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.282985 14097 raft_consensus.cc:2272] T 95a12ece97fd4bfe8854ad306d9ba252 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.285892 14097 tablet_replica.cc:333] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.286578 14097 raft_consensus.cc:2243] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.287137 14097 raft_consensus.cc:2272] T 80019b759bcd4769bbe37daefe516690 P 7d00d1065237495b95262e0bba919c8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.289515 14097 tablet_replica.cc:333] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.290241 14097 raft_consensus.cc:2243] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.290983 14097 raft_consensus.cc:2272] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.294190 14097 tablet_replica.cc:333] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.294891 14097 raft_consensus.cc:2243] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.295888 14097 raft_consensus.cc:2272] T 09bcb2e2737a460f9a62312f5456adbf P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.298271 14097 tablet_replica.cc:333] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.298990 14097 raft_consensus.cc:2243] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.299782 14097 raft_consensus.cc:2272] T 619839991657438d8cb20965ae24980f P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.303445 14097 tablet_replica.cc:333] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.304198 14097 raft_consensus.cc:2243] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.304827 14097 raft_consensus.cc:2272] T 1149eb3177da4c79b644fd0577eb0cbc P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.307772 14097 tablet_replica.cc:333] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.308534 14097 raft_consensus.cc:2243] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.309252 14097 raft_consensus.cc:2272] T b3fc7af05891478d95c06041bd893937 P 7d00d1065237495b95262e0bba919c8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.314455 14097 tablet_replica.cc:333] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.315651 14097 raft_consensus.cc:2243] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.316411 14097 raft_consensus.cc:2272] T fe691b26661c42a59f4e6e46a96b989e P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:03.317803 27184 consensus_peers.cc:597] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.320490 14097 tablet_replica.cc:333] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.321365 14097 raft_consensus.cc:2243] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.321964 14097 raft_consensus.cc:2272] T cf2c46bf2783453b87f53f89e4928d7e P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.324425 14097 tablet_replica.cc:333] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.325090 14097 raft_consensus.cc:2243] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.326066 14097 raft_consensus.cc:2272] T f00f09104d28472193f45353a187e05a P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.329022 14097 tablet_replica.cc:333] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.329599 14097 raft_consensus.cc:2243] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.330427 14097 raft_consensus.cc:2272] T 3a443d470e0b4771beccc3ce51aa29d6 P 7d00d1065237495b95262e0bba919c8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.332765 14097 tablet_replica.cc:333] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a: stopping tablet replica
I20260709 13:14:03.333244 14097 raft_consensus.cc:2243] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.334128 14097 raft_consensus.cc:2272] T 35b44a3612a948d6a7a782bf4732a0ac P 7d00d1065237495b95262e0bba919c8a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:03.367636 27110 consensus_peers.cc:597] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.376993 14097 tablet_server.cc:196] TabletServer@127.13.196.65:0 shutdown complete.
I20260709 13:14:03.419068 14097 tablet_server.cc:179] TabletServer@127.13.196.66:0 shutting down...
W20260709 13:14:03.441203 27110 consensus_peers.cc:597] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:36665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.470165 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:03.471163 14097 tablet_replica.cc:333] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.472280 14097 raft_consensus.cc:2243] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.473644 14097 raft_consensus.cc:2272] T 0d7dbcf045194958991d755ef18a1647 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.476092 14097 tablet_replica.cc:333] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.476850 14097 raft_consensus.cc:2243] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.478091 14097 raft_consensus.cc:2272] T 1149eb3177da4c79b644fd0577eb0cbc P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.480836 14097 tablet_replica.cc:333] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.481627 14097 raft_consensus.cc:2243] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.482622 14097 raft_consensus.cc:2272] T 30580a1ff03b40af8476e12d12e8f23d P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.485136 14097 tablet_replica.cc:333] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.485929 14097 raft_consensus.cc:2243] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.486555 14097 raft_consensus.cc:2272] T f7f14c2cde0f48cea7fc7de5b228de23 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.489720 14097 tablet_replica.cc:333] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.490792 14097 raft_consensus.cc:2243] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:03.490872 27110 consensus_peers.cc:597] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:36665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.491371 14097 raft_consensus.cc:2272] T 1f0ba611b825459292203dfcc62d2420 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.494514 14097 tablet_replica.cc:333] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.495309 14097 raft_consensus.cc:2243] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.495916 14097 raft_consensus.cc:2272] T 95a12ece97fd4bfe8854ad306d9ba252 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.498382 14097 tablet_replica.cc:333] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.499107 14097 raft_consensus.cc:2243] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.500097 14097 raft_consensus.cc:2272] T 80019b759bcd4769bbe37daefe516690 P c73779539f1349b2a36d720d7c0edfab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.502627 14097 tablet_replica.cc:333] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.503343 14097 raft_consensus.cc:2243] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.504437 14097 raft_consensus.cc:2272] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.507112 14097 tablet_replica.cc:333] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.507761 14097 raft_consensus.cc:2243] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.508280 14097 raft_consensus.cc:2272] T b3fc7af05891478d95c06041bd893937 P c73779539f1349b2a36d720d7c0edfab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.511436 14097 tablet_replica.cc:333] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.512171 14097 raft_consensus.cc:2243] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.512777 14097 raft_consensus.cc:2272] T fe691b26661c42a59f4e6e46a96b989e P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.515985 14097 tablet_replica.cc:333] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.517010 14097 raft_consensus.cc:2243] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.518296 14097 raft_consensus.cc:2272] T 619839991657438d8cb20965ae24980f P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.521020 14097 tablet_replica.cc:333] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.521713 14097 raft_consensus.cc:2243] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.522306 14097 raft_consensus.cc:2272] T 09bcb2e2737a460f9a62312f5456adbf P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.525199 14097 tablet_replica.cc:333] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.525878 14097 raft_consensus.cc:2243] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.526434 14097 raft_consensus.cc:2272] T 3a443d470e0b4771beccc3ce51aa29d6 P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.528980 14097 tablet_replica.cc:333] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.529785 14097 raft_consensus.cc:2243] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.530400 14097 raft_consensus.cc:2272] T cf2c46bf2783453b87f53f89e4928d7e P c73779539f1349b2a36d720d7c0edfab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.533195 14097 tablet_replica.cc:333] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.534021 14097 raft_consensus.cc:2243] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.534693 14097 raft_consensus.cc:2272] T f00f09104d28472193f45353a187e05a P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.537771 14097 tablet_replica.cc:333] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.538363 14097 raft_consensus.cc:2243] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.538882 14097 raft_consensus.cc:2272] T 9132f7f30d694826b9da1b1bc2227c87 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.540848 14097 tablet_replica.cc:333] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.541314 14097 raft_consensus.cc:2243] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.542519 14097 raft_consensus.cc:2272] T 808608154e3440369d46e51c2a4f5591 P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.545220 14097 tablet_replica.cc:333] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab: stopping tablet replica
I20260709 13:14:03.545799 14097 raft_consensus.cc:2243] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.546293 14097 raft_consensus.cc:2272] T 35b44a3612a948d6a7a782bf4732a0ac P c73779539f1349b2a36d720d7c0edfab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.593878 14097 tablet_server.cc:196] TabletServer@127.13.196.66:0 shutdown complete.
W20260709 13:14:03.614533 27184 consensus_peers.cc:597] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:36665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.638666 14097 tablet_server.cc:179] TabletServer@127.13.196.67:0 shutting down...
W20260709 13:14:03.658298 27184 consensus_peers.cc:597] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 -> Peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Couldn't send request to peer c73779539f1349b2a36d720d7c0edfab. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:35673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:03.659677 27184 consensus_peers.cc:597] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:36665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:03.663439 27184 consensus_peers.cc:597] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 -> Peer 7d00d1065237495b95262e0bba919c8a (127.13.196.65:36665): Couldn't send request to peer 7d00d1065237495b95262e0bba919c8a. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.65:36665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.683678 14097 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:03.684741 14097 tablet_replica.cc:333] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.685833 14097 raft_consensus.cc:2243] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.686685 14097 raft_consensus.cc:2272] T 30580a1ff03b40af8476e12d12e8f23d P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.689178 14097 tablet_replica.cc:333] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.689864 14097 raft_consensus.cc:2243] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.690335 14097 raft_consensus.cc:2272] T 0d7dbcf045194958991d755ef18a1647 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.692988 14097 tablet_replica.cc:333] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.693871 14097 raft_consensus.cc:2243] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.694355 14097 raft_consensus.cc:2272] T f7f14c2cde0f48cea7fc7de5b228de23 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.696735 14097 tablet_replica.cc:333] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.697470 14097 raft_consensus.cc:2243] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.698107 14097 raft_consensus.cc:2272] T 1149eb3177da4c79b644fd0577eb0cbc P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.700284 14097 tablet_replica.cc:333] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.700994 14097 raft_consensus.cc:2243] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.701473 14097 raft_consensus.cc:2272] T 1f0ba611b825459292203dfcc62d2420 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.705027 14097 tablet_replica.cc:333] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.705955 14097 raft_consensus.cc:2243] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.707201 14097 raft_consensus.cc:2272] T 95a12ece97fd4bfe8854ad306d9ba252 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:03.708163 27184 consensus_peers.cc:597] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 -> Peer c73779539f1349b2a36d720d7c0edfab (127.13.196.66:35673): Couldn't send request to peer c73779539f1349b2a36d720d7c0edfab. Status: Network error: Client connection negotiation failed: client connection to 127.13.196.66:35673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.710160 14097 tablet_replica.cc:333] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.711035 14097 raft_consensus.cc:2243] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.711684 14097 raft_consensus.cc:2272] T f00f09104d28472193f45353a187e05a P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.714366 14097 tablet_replica.cc:333] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.715112 14097 raft_consensus.cc:2243] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.716149 14097 raft_consensus.cc:2272] T cf2c46bf2783453b87f53f89e4928d7e P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.718557 14097 tablet_replica.cc:333] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.719260 14097 raft_consensus.cc:2243] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.719805 14097 raft_consensus.cc:2272] T 80019b759bcd4769bbe37daefe516690 P f03431098129496c8e4d64f56b3128b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.722023 14097 tablet_replica.cc:333] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.722668 14097 raft_consensus.cc:2243] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.723219 14097 raft_consensus.cc:2272] T 2a6bfdbfbfb54f948b54fbfe78a1dc8c P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.725782 14097 tablet_replica.cc:333] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.726462 14097 raft_consensus.cc:2243] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.727393 14097 raft_consensus.cc:2272] T b3fc7af05891478d95c06041bd893937 P f03431098129496c8e4d64f56b3128b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.729839 14097 tablet_replica.cc:333] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.730520 14097 raft_consensus.cc:2243] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.731513 14097 raft_consensus.cc:2272] T fe691b26661c42a59f4e6e46a96b989e P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.735142 14097 tablet_replica.cc:333] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.736213 14097 raft_consensus.cc:2243] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.737046 14097 raft_consensus.cc:2272] T 09bcb2e2737a460f9a62312f5456adbf P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.739962 14097 tablet_replica.cc:333] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.740718 14097 raft_consensus.cc:2243] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.741274 14097 raft_consensus.cc:2272] T 619839991657438d8cb20965ae24980f P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.743706 14097 tablet_replica.cc:333] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.744494 14097 raft_consensus.cc:2243] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.745018 14097 raft_consensus.cc:2272] T 9132f7f30d694826b9da1b1bc2227c87 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.747598 14097 tablet_replica.cc:333] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.748522 14097 raft_consensus.cc:2243] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.749119 14097 raft_consensus.cc:2272] T 808608154e3440369d46e51c2a4f5591 P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.751550 14097 tablet_replica.cc:333] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.752229 14097 raft_consensus.cc:2243] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.752851 14097 raft_consensus.cc:2272] T 35b44a3612a948d6a7a782bf4732a0ac P f03431098129496c8e4d64f56b3128b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.755414 14097 tablet_replica.cc:333] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1: stopping tablet replica
I20260709 13:14:03.755976 14097 raft_consensus.cc:2243] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:03.756526 14097 raft_consensus.cc:2272] T 3a443d470e0b4771beccc3ce51aa29d6 P f03431098129496c8e4d64f56b3128b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.806007 14097 tablet_server.cc:196] TabletServer@127.13.196.67:0 shutdown complete.
I20260709 13:14:03.846372 14097 master.cc:562] Master@127.13.196.126:46099 shutting down...
I20260709 13:14:03.879263 14097 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:03.880312 14097 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:03.880841 14097 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4de7883820ff4707aa00522cc665dc51: stopping tablet replica
I20260709 13:14:03.904935 14097 master.cc:584] Master@127.13.196.126:46099 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (14047 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (27853 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (412452 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:14:03.970175 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 441 messages since previous log ~17 seconds ago
I20260709 13:14:03.970428 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 441 messages since previous log ~17 seconds ago
I20260709 13:14:03.970571 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 439 messages since previous log ~17 seconds ago
I20260709 13:14:03.970742 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:14:03.970903 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:14:03.971071 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~87 seconds ago
I20260709 13:14:03.971251 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~174 seconds ago
I20260709 13:14:03.971478 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:14:03.971752 14097 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~12 seconds ago
